Senior Data Engineer

Posted 3 Hours Ago
Hiring Remotely in USA
Remote
Senior level
Database
The Role
Designs and leads production-grade batch, incremental, streaming, and real-time data pipelines across Microsoft Fabric and Azure. Builds Delta Lake medallion architectures, dimensional and Data Vault models, CDC and incremental-loading solutions, CI/CD automation, governance, security, observability, and data-quality controls. Supports migrations to Fabric, prepares governed data for AI and RAG workloads, and leads client-facing engineering workstreams, estimates, risk management, mentoring, and operational handover.
Summary Generated by Built In
  • 8+ years in data engineering/data warehousing; 3+ years delivering Azure solutions and production
  • Microsoft Fabric experience
  • Advanced T-SQL, Spark SQL, Python/PySpark; working knowledge of KQL and DAX
  • Deep experience with Delta Lake, Spark tuning, medallion/lakehouse patterns, CDC and incremental loading
  • Strong dimensional modeling and working knowledge of Data Vault 2.0
  • Practical CI/CD, Git, automated testing, infrastructure as code, DataOps, governance and security experience
  • Professional-services/client-facing delivery experience
  • Authorization to work in the US and ability to travel up to 15%
  • Preferred: DP-700, DP-600, DP-203; streaming/event-driven, RAG/GenAI, Fabric IQ/data agents, and industry experience
  • Design, build and maintain production-grade batch, incremental, real-time and near-real-time data pipelines across Microsoft Fabric and Azure
  • Implement CDC, watermarking, merge/upsert, late-arriving-data and idempotent reprocessing patterns
  • Develop PySpark, Spark SQL and T-SQL transformations across bronze, silver and gold Delta Lake layers
  • Build Fabric solutions using OneLake, Lakehouse, Warehouse, Data Factory, Dataflows Gen2, Spark notebooks, Real-Time Intelligence and Power BI
  • Implement dimensional and Data Vault models, data-quality testing, reconciliation, observability, logging, alerting and SLA monitoring
  • Establish Git-based CI/CD and automated deployment using Azure DevOps or GitHub, Fabric deployment pipelines, REST APIs, Bicep and Terraform
  • Apply Purview catalog/lineage, least-privilege access, sensitivity controls, encryption and secure connectivity
  • Support migrations from SQL Server, SSIS, SSAS, legacy warehouses and Synapse to Fabric/Azure, including conversion, reconciliation and cutover
  • Prepare governed data for AI/ML and RAG workloads, including ingestion, chunking, embeddings, indexing and telemetry
  • Lead engineering workstreams, estimates, risk management, client communication, mentoring, reusable accelerators and operational handover
About UsDatavail is a leading provider of data management, application development, analytics, and cloud services, with more than 1,000 professionals helping clients build and manage applications and data via a world-class tech-enabled delivery platform and software solutions across all leading technologies. For more than 17 years, Datavail has worked with thousands of companies spanning different industries and sizes, and is an AWS Advanced Tier Consulting Partner, a Microsoft Solutions Partner for Data & AI and Digital & App Innovation (Azure), an Oracle Partner, and a MySQL Partner.

Skills Required

  • 8+ years of experience in data engineering or data warehousing
  • 3+ years delivering Azure solutions in production
  • Microsoft Fabric experience
  • Advanced T-SQL, Spark SQL, and Python/PySpark skills
  • Working knowledge of KQL and DAX
  • Experience with Delta Lake, Spark tuning, medallion/lakehouse patterns, CDC, and incremental loading
  • Experience with dimensional modeling and working knowledge of Data Vault 2.0
  • Experience with CI/CD, Git, automated testing, infrastructure as code, DataOps, governance, and security
  • Professional-services and client-facing delivery experience
  • Authorization to work in the United States
  • Ability to travel up to 15%
  • DP-700, DP-600, or DP-203 certification
  • Streaming or event-driven data experience
  • RAG or GenAI experience
  • Fabric IQ or data-agent experience
  • Relevant industry experience

Datavail Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Datavail and has not been reviewed or approved by Datavail.

  • Fair & Transparent Compensation — Pay is considered competitive for many roles at the time of hire, with some noting significant initial increases and timely pay. Feedback suggests compensation can be strong in particular regions or positions even as overall satisfaction varies.
  • Wellbeing & Lifestyle Benefits — Remote-friendly roles and flexible or unlimited time off policies are highlighted as part of the employment experience. Feedback suggests these arrangements support work flexibility, though experiences differ by team and location.

Datavail Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Broomfield, CO
263 Employees
Year Founded: 2007

What We Do

A premiere data services company serving clients in North America, Datavail has 1,000 data professionals, data engineers, developers, project managers, consultants, and business experts, supported by industry-leading automation and intellectual property. For more than 17 years, Datavail has worked with thousands of companies spanning different industries and sizes. At Datavail, we look for more than smarts, experience and proficiency. On top of those requirements, we seek people who mesh with our corporate values. We seek brilliance without bravado and know-how without a know-it-all attitude. We hold low ego in high regard, embrace problem-solving as a passion and welcome every day as a new opportunity to learn. We’re flexible and hard working. We’re committed to our clients and colleagues. We help our people grow so they can help our clients grow. That makes us grow so we can help even more customers leverage organizational data for business value. Our Core Values: 1. We desire to serve. 2. We embody flexibility for availability 3. We exemplify low ego. 4. We work hard. 5. We strive for continuous improvement. 6. We are growth-oriented.

Similar Jobs

Clear Street Logo Clear Street

Senior Data Engineer

Fintech • Software • Financial Services
Easy Apply
Remote or Hybrid
USA
581 Employees
150K-250K Annually

Block Logo Block

Senior Data Engineer

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office or Remote
8 Locations
12000 Employees
168K-297K Annually

Cash App Logo Cash App

Senior Data Engineer

Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Remote or Hybrid
8 Locations
3500 Employees
168K-297K Annually

Atlassian Logo Atlassian

Senior Data Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
20 Locations
11000 Employees
139K-219K Annually

Similar Companies Hiring

NinjaHoldings Thumbnail
Cloud • Fintech • Machine Learning • Database • Analytics • Financial Services • Automation
Chicago, IL
200 Employees
Apollo.io Thumbnail
Software • Sales • Productivity • Information Technology • Enterprise Web • Database • Artificial Intelligence
US
850 Employees
Jellyfish Thumbnail
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Boston, MA
225 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account