Senior Data Platform Engineer

Posted 8 Hours Ago
Be an Early Applicant
San Francisco, CA, USA
Hybrid
150K-170K Annually
Senior level
Healthtech
The Role
Lead design, build, and operate a secure, scalable data platform to support analytics, MLOps, and BI. Architect data warehousing (Databricks, dbt, Spark), build ETL pipelines, optimize cloud storage and processing in GCP/AWS, implement LLM infrastructure and serving, create observability and BI dashboards, and ensure data governance and regulatory compliance (HIPAA/SOC-2). Collaborate with Data Science, ML, App, and DevOps teams.
Summary Generated by Built In

Ellipsis Health is creating cutting-edge AI/ML products that solve healthcare staffing challenges and administrative burdens using conversational AI and our patented voice biomarker technology - helping deliver better healthcare for everyone.

We are currently looking for an experienced Senior Data Platform Engineer, with significant experience in building, scaling, and optimizing modern data platforms across public cloud environments.

We are located in the San Francisco Bay Area, but we are open to remote candidates for this role anywhere in the US.

Responsibilities:
  • Lead the design, development, and operation of a scalable and secure data platform to support analytics, ML Ops, and business intelligence

  • Collaborate closely with Data Science, Machine Learning, Application and DevOps teams to implement end-to-end ML Ops pipelines

  • Architect and manage data warehousing solutions using Databricks, Dbt, and Spark

  • Develop and maintain ETL/data pipelines that handle structured and unstructured data across diverse sources

  • Optimize data storage, access, and processing for cost-efficiency and performance in GCP and AWS Cloud environments

  • Build and maintain dashboards and analytics solutions using tools such as Sigma, Metabase, and other BI platforms

  • Ensure compliance with data governance, security, and privacy best practices, including HIPAA, SOC-2, and other regulatory requirements

  • Evaluate and integrate third-party anonymization and security solutions to protect sensitive data

  • Provide strategic guidance on the evolution of the data platform to meet the company's growth and technical needs

  • Design and implement scalable infrastructure for Large Language Model (LLM) operations, including training, fine-tuning, and inference workflows

  • Collaborate with AI/ML teams to build and optimize LLM serving platforms for real-time and batch processing

  • Develop monitoring and observability solutions for LLMs, ensuring model performance, cost-efficiency, and compliance with ethical AI guidelines

  • Evaluate and integrate state-of-the-art LLM technologies into existing data platforms to enhance analytics and decision-making

Qualifications:
  • Bachelor's or Master's Degree in Computer Science or equivalent experience

  • 5+ years of industry experience in designing and building large-scale data platforms

  • Strong expertise in SQL, Data Modeling, and Data Warehousing (Databricks, Snowflake, Redshift, BigQuery, etc.)

  • Proficiency in writing Advanced SQLs and performance tuning

  • Strong proficiency in Python for building, optimizing, automating and maintaining data pipelines and services

  • Deep experience with Apache Spark and distributed data processing frameworks

  • Hands-on experience with modern ETL/Orchestration frameworks such as Airflow, dbt, and others

  • Knowledge of business intelligence tools such as Sigma, Metabase, Tableau, and Looker

  • Strong familiarity with cloud-based infrastructure and managed data services in GCP and AWS Cloud

  • Experience with CI/CD pipelines to automate testing, deployment and release of data engineering and analytics workflows using GitLab, GitHub etc

  • Experience with tools like Kubernetes, Terraform, Pubsub, Debezium

  • Exposure building data quality frameworks and automation

  • Understanding of data governance, privacy, and regulatory frameworks (HIPAA, SOC-2, HITRUST)

Nice to Have:
  • Experience working with ML Ops platforms and supporting Data Science teams

  • Experience with ML Ops tools such as MLflow, Streamlit, and vector databases

  • Familiarity with healthcare data standards (FHIR, HL7)

  • Experience in real-time data processing and event-driven architectures

  • Expertise in implementing data access controls and anonymization techniques

Salary and Benefits:

We offer competitive salary and benefits, including 401(k) matching, health, vision, and dental insurance, and very flexible paid time off.

The typical salary range for this role is $150,000 to $170,000 USD, depending on skills, qualifications, and relevant experience.

Background Checks:

As a health technology company, we reserve the right to run background checks on candidates to whom we extend offers, in compliance with applicable laws. We evaluate candidates holistically and comply with all “ban the box” regulations.

 
Assistance:

If you have a disability or require accommodations during the application or recruitment process, please contact [email protected].

Skills Required

  • Bachelor's or Master's degree in Computer Science or equivalent experience
  • 5+ years industry experience designing and building large-scale data platforms
  • Strong expertise in SQL, data modeling, and data warehousing (Databricks, Snowflake, Redshift, BigQuery)
  • Advanced SQL writing and performance tuning
  • Proficiency in Python for building, optimizing, automating, and maintaining data pipelines
  • Deep experience with Apache Spark and distributed data processing frameworks
  • Hands-on experience with ETL/orchestration frameworks such as Airflow and dbt
  • Familiarity with BI tools such as Sigma, Metabase, Tableau, or Looker
  • Strong familiarity with cloud-based infrastructure and managed data services in GCP and AWS
  • Experience with CI/CD pipelines for data engineering and analytics workflows (GitLab, GitHub)
  • Experience with Kubernetes, Terraform, Pub/Sub, and Debezium
  • Exposure building data quality frameworks and automation
  • Understanding of data governance, privacy, and regulatory frameworks (HIPAA, SOC-2, HITRUST)
  • Experience designing and operating infrastructure for LLM training, fine-tuning, and inference
  • Ability to build monitoring and observability solutions for ML/LLM performance and cost
  • Experience integrating third-party anonymization and security solutions
  • Experience working with Data Science and ML teams to implement end-to-end MLOps pipelines
  • Familiarity with ML Ops tools such as MLflow, Streamlit, and vector databases
  • Familiarity with healthcare data standards (FHIR, HL7)
  • Experience in real-time data processing and event-driven architectures
  • Expertise in implementing data access controls and anonymization techniques
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
45 Employees
Year Founded: 2019

What We Do

Ellipsis Health was founded with the belief that a person’s mental health should have the same priority as one’s physical health. The company saw an opportunity to connect the dots between the two - giving voice to a new standard of mental health care. By harnessing the unique power of the human voice as a biomarker for mental wellbeing, along with machine learning and AI, Ellipsis Health has established the first vital sign for mental health. Its technology identifies, measures, and monitors the severity of stress, anxiety, and depression at scale by analyzing a short sample of natural speech to create an objective and scalable clinical decision support tool. Through partnerships with providers, payers, employers and digital health companies, Ellipsis Health is working to positively impact the quality of care, shorten the time to diagnosis, drive workflow efficiencies, reduce costs and improve patient outcomes.

Similar Jobs

In-Office
San Diego, CA, USA
67 Employees
160K-220K Annually
Hybrid
Santa Clara, CA, USA
471 Employees
135K-200K Annually

Plenful Logo Plenful

Senior Software Engineer

Artificial Intelligence • Healthtech
Hybrid
San Francisco, CA, USA
120 Employees

Zipline Logo Zipline

Senior Data Engineer

Aerospace • Hardware • Logistics • Robotics • Software • Transportation
In-Office
South San Francisco, CA, USA
375 Employees

Similar Companies Hiring

Sailor Health Thumbnail
Healthtech • Social Impact • Telehealth
New York City, NY
20 Employees
Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
OneImaging Thumbnail
Healthtech
Miami, FL
62 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account