Senior Data Engineer

Posted Yesterday
Be an Early Applicant
Washington, DC, USA
In-Office
Senior level
Information Technology • Database • Consulting
The Role
Lead design, build, optimization, and operation of scalable Databricks-based batch and streaming data pipelines for healthcare programs. Ensure DataOps, data quality, lineage, observability, CI/CD, and compliance with CMS and federal healthcare regulations. Collaborate with architects, data scientists, and stakeholders, troubleshoot production issues, and mentor junior engineers.
Summary Generated by Built In

Analytica is seeking a Senior Data Engineer to support large-scale Health care data modernization and analytics initiatives. This role is responsible for designing, building, optimizing, and operating enterprise-grade data platforms and pipelines that support mission-critical healthcare programs. The ideal candidate possesses deep expertise in cloud-native data engineering, DataOps practices, and regulated healthcare environments. 

The Senior Data Engineer will lead the development and maintenance of scalable, secure, and auditable data pipelines while ensuring data quality, reliability, and compliance with federal healthcare regulations and CMS data governance requirements. This individual will serve as a technical leader, collaborating with data architects, data scientists, business analysts, and program stakeholders to deliver high-quality data products and operational capabilities. 

Analytica has been recognized by Inc. Magazine as one of the fastest-growing 250 businesses in the US for 3 years. We work with U.S. government clients in health, civilian, and national security missions to build better technology products that impact our day-to-day lives. The company offers competitive compensation with opportunities for bonuses, employer-paid health care, training and development funds, and 401k match.    

Key Responsibilities:

Data Engineering & Platform Development 

  • Design, develop, and maintain scalable batch and streaming data pipelines using Databricks and/or cloud-native services. 

  • Build and optimize ETL/ELT workflows that support operational reporting, analytics, machine learning, and data-sharing initiatives. 

  • Develop and maintain medallion architecture patterns (Bronze, Silver, Gold) within Databricks Lakehouse environments. 

  • Implement data integration solutions across multiple structured and unstructured healthcare data sources. 

  • Design reusable frameworks, templates, and accelerators that improve engineering productivity and consistency. 

Data Operations (DataOps) 

  • Establish and maintain DataOps processes that support reliable, automated, and observable data pipelines. 

  • Monitor pipeline health, performance, data quality, and operational SLAs. 

  • Implement automated testing, deployment, version control, and CI/CD practices for data products. 

  • Develop proactive monitoring, alerting, and incident response procedures. 

  • Troubleshoot and resolve production data issues while minimizing operational impact. 

Healthcare & Regulatory Compliance 

  • Ensure solutions comply with CMS, federal, and healthcare-specific security, privacy, and data governance requirements. 

  • Support environments containing protected health information (PHI), personally identifiable information (PII), and other sensitive healthcare datasets. 

  • Implement auditability, lineage, metadata management, and data quality controls. 

  • Partner with governance and security teams to ensure compliance with applicable standards and policies. 

Architecture & Technical Leadership 

  • Collaborate with solution architects and customer stakeholders to define data platform strategy and implementation roadmaps. 

  • Lead technical design reviews and contribute to enterprise data architecture decisions. 

  • Optimize data storage, processing performance, and cost management within cloud environments. 

  • Mentor junior engineers and promote engineering best practices across teams. 

Required Qualifications:

Experience 

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related technical discipline. 

  • 8+ years of data engineering experience, including large-scale enterprise data environments. 

  • 3+ years supporting CMS or other federal healthcare programs. 

  • Experience operating and supporting production-grade data platforms in regulated environments. 

  • Demonstrated experience with DataOps and modern data engineering practices. 

Technical Skills 

  • Expert-level experience with Databricks Lakehouse Platform. 

  • Strong proficiency with Apache Spark, PySpark, SQL, and Python. 

  • Experience designing and maintaining operational data pipelines at enterprise scale. 

  • Hands-on experience with cloud data platforms in AWS or Azure cloud environments.  

  • Experience implementing CI/CD pipelines using Git-based development workflows. 

  • Expertise in data quality, observability, lineage, metadata management, and monitoring frameworks. 

  • Experience with orchestration and workflow management tools. 

  • Strong knowledge of lakehouse, warehouse, and modern data architecture patterns. 

Regulatory & Healthcare Knowledge 

  • Experience supporting CMS, Medicare, Medicaid, or other federal healthcare data programs. 

  • Understanding of healthcare data governance, security, privacy, and compliance requirements. 

  • Experience working with healthcare data standards and regulated datasets. 

  • Familiarity with Federal Information Security requirements and operational controls. 

Preferred Qualifications 

  • Databricks Certified Data Engineer Professional 

  • Additional Databricks certifications. 

  • Experience supporting cloud-native analytics platforms for CMS. 

  • Experience implementing Delta Lake, Unity Catalog, and advanced Databricks governance capabilities. 

  • Familiarity with machine learning operations (MLOps) and AI/ML data pipelines. 

  • Experience with Collibra, Informatica, Unity Catalog or comparable data governance platforms. 

  • Experience supporting FedRAMP or FISMA-compliant environments. 

  • Prior experience leading technical teams or serving as a technical lead. 

Desired Competencies:

  • Deep technical expertise in modern data engineering and DataOps practices. 

  • Strong problem-solving and troubleshooting abilities. 

  • Exceptional written and verbal communication skills. 

  • Ability to translate business requirements into scalable technical solutions. 

  • Proven ability to operate effectively in highly regulated healthcare environments. 

  • Commitment to data quality, operational excellence, and continuous improvement. 

About Analytica: Analytica is a leading consulting and information technology solutions provider to public sector organizations supporting health, civilian, and national security missions. The company is an award-winning SBA certified small businessthat has been recognized by Inc. Magazine each of the past three years as one of the 250 fastest-growing companies in the U.S. Analytica specializes in providing software and systems engineering, information management, analytics & visualization, agile project management, and management consulting services. The company is appraised by the Software Engineering Institute (SEI) at CMMI® Maturity Level 3 and is an ISO 9001:2008 certified provider. 

Skills Required

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related technical discipline
  • 8+ years of data engineering experience, including large-scale enterprise data environments
  • 3+ years supporting CMS or other federal healthcare programs
  • Experience operating and supporting production-grade data platforms in regulated environments
  • Demonstrated experience with DataOps and modern data engineering practices
  • Expert-level experience with Databricks Lakehouse Platform
  • Strong proficiency with Apache Spark, PySpark, SQL, and Python
  • Hands-on experience with cloud data platforms in AWS or Azure
  • Experience implementing CI/CD pipelines using Git-based development workflows
  • Expertise in data quality, observability, lineage, metadata management, and monitoring frameworks
  • Experience with orchestration and workflow management tools
  • Experience supporting CMS, Medicare, Medicaid, or other federal healthcare data programs
  • Understanding of healthcare data governance, security, privacy, and compliance requirements
  • Familiarity with Federal Information Security requirements and operational controls
  • Databricks Certified Data Engineer Professional
  • Experience implementing Delta Lake, Unity Catalog, and advanced Databricks governance capabilities
  • Familiarity with machine learning operations (MLOps) and AI/ML data pipelines
  • Experience with Collibra, Informatica, Unity Catalog or comparable data governance platforms
  • Experience supporting FedRAMP or FISMA-compliant environments
  • Prior experience leading technical teams or serving as a technical lead
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Washington, DC
110 Employees
Year Founded: 2009

What We Do

Analytica is an award-winning consulting and technology services provider that supports public-sector health, civilian, and national security. We specialize in data-driven solutions, which have been recognized by organizations such as NYU’s Governance Lab for driving public sector modernization and innovation. Analytica is an SBA Certified 8(a), HUBZone that has been honored as one of the 250 fastest-growing businesses in the U.S. for three consecutive years by Inc. ​For information on the company visit: www.analytica.net For exciting career opportunities visit: careers.analytica.net

Similar Jobs

Samsara Logo Samsara

Senior Data Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
United States
4000 Employees
134K-203K Annually

Applied Systems Logo Applied Systems

Data Engineer

Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Remote or Hybrid
United States
3079 Employees
70K-160K Annually

Fusion Risk Management Logo Fusion Risk Management

Senior Data Engineer

Professional Services • Software
Remote or Hybrid
US
258 Employees
135K-155K Annually

Babylist Logo Babylist

Senior Data Engineer

eCommerce • Healthtech • Kids + Family • Retail • Social Media
Easy Apply
Remote or Hybrid
United States
300 Employees
186K-222K Annually

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account