Senior Data Engineer

Posted Yesterday
San Diego, CA, USA
In-Office
Senior level
Big Data • Information Technology • Analytics • Business Intelligence
The Role
Lead architecture and engineering of a Microsoft Fabric lake-house, build scalable data pipelines from 50+ sources, provide technical leadership, oversee vendors, implement governance/security, establish SLAs/monitoring, and develop semantic layers and Power BI datasets.
Summary Generated by Built In

We are seeking a hands-on Technical Lead to lead the development and operation of its Microsoft Fabric-based Platform. This role combines data platform architecture, hands-on engineering, technical leadership, and business partnership.

Key Responsibilities
  • Lead the architecture and engineering of the Microsoft Fabric data lake-house, including OneLake, medallion architecture, Spark/SQL, and CI/CD.
  • Provide hands-on technical leadership, mentoring, code reviews, and architectural guidance to data and analytics engineers.
  • Design and build scalable data pipelines integrating 50+ enterprise source systems.
  • Partner with business stakeholders across R&D, Commercial, Manufacturing, Supply Chain, and Corporate functions to translate business needs into data solutions.
  • Manage and technically oversee external implementation partners, ensuring engineering quality and adherence to standards.
  • Establish platform support models, SLAs, monitoring, data quality, incident management, and operational processes.
  • Define and track platform KPIs such as pipeline reliability, data freshness, query performance, onboarding velocity, and incident resolution.
  • Develop the semantic layer, including Power BI datasets, gold-layer views, and self-service analytics.
  • Implement data governance, security, classification, RBAC, sensitivity labeling, and audit requirements.
  • Establish engineering standards for development, testing, branching, documentation, and deployment.
Required Qualifications
  • Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or related field.
  • 7–10 years of experience in data engineering, data platforms, or analytics infrastructure.
  • 2+ years of technical leadership experience with data/analytics engineers.
  • Strong hands-on experience with Microsoft Fabric; Databricks or Azure Synapse experience may be considered.
  • Strong proficiency in PySpark, Python, T-SQL, ETL/ELT, and modern data engineering practices.
  • Experience with medallion/layered data architecture at enterprise scale.
  • Experience with DevOps, CI/CD, Azure DevOps/GitHub, and infrastructure-as-code.
  • Knowledge of data governance and quality frameworks such as Microsoft Purview.
  • Experience managing technical delivery from external vendors.
Preferred
  • Biopharma, life sciences, or other regulated-industry experience, including GxP and validation requirements.
  • Experience with Veeva, LIMS, ELN/Benchling, CTMS, EDC, MasterControl, or HRIS integrations.
  • Experience with AI/ML workloads on a lake-house.
  • Microsoft Fabric Data Engineering certification.


Skills Required

  • Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related field
  • 7-10 years of experience in data engineering, data platforms, or analytics infrastructure
  • 2+ years of technical leadership experience with data/analytics engineers
  • Hands-on experience with Microsoft Fabric (Databricks or Azure Synapse experience considered)
  • Proficiency in PySpark, Python, T-SQL, and modern ETL/ELT data engineering practices
  • Experience with medallion/layered data architecture at enterprise scale
  • Experience with DevOps, CI/CD, Azure DevOps/GitHub, and infrastructure-as-code
  • Knowledge of data governance and data quality frameworks such as Microsoft Purview
  • Experience managing technical delivery from external vendors
  • Biopharma, life sciences, or regulated-industry experience including GxP and validation requirements
  • Experience with Veeva, LIMS, ELN/Benchling, CTMS, EDC, MasterControl, or HRIS integrations
  • Experience with AI/ML workloads on a lake-house
  • Microsoft Fabric Data Engineering certification
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Torrance, CA
168 Employees
Year Founded: 2008

What We Do

Numentica is a consulting firm specializing in software product development, business intelligence, data management, data analytics, AI, and cloud services, focusing on digital transformation.

Similar Jobs

Gusto Logo Gusto

Senior Data Engineer

Fintech • HR Tech
Easy Apply
Hybrid
3 Locations
4405 Employees
155K-220K Annually

Runpod Logo Runpod

Senior Data Engineer

Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
In-Office or Remote
San Francisco, CA, USA
80 Employees
175K-220K Annually

Crexi Logo Crexi

Senior Data Engineer

Real Estate • Sales • Software • PropTech
Easy Apply
Hybrid
Los Angeles, CA, USA
400 Employees
158K-214K Annually

Zeta Global Logo Zeta Global

Senior Data Engineer

AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Easy Apply
Remote or Hybrid
United States
2429 Employees
140K-160K Annually

Similar Companies Hiring

Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account