Top Senior Data Engineer Jobs in Rochester, NY

Design, build, and maintain end-to-end batch and streaming data pipelines on GCP. Migrate legacy warehouses to BigQuery/Bigtable/ClickHouse, orchestrate workflows in Airflow, ensure data quality and observability, and partner with ML engineers on feature pipelines, drift monitoring, and retraining.

Design, build, and automate scalable batch and streaming data pipelines, implement data models and ETL, automate deployments, support ML/experimentation, maintain server architecture, and partner with stakeholders to deliver analytics and data-driven tools.

Own and architect the semantic layer and metrics/metadata for the data platform (Databricks/GCP). Build AI-ready models, enforce modeling and documentation standards, implement observability/testing for pipelines, enable self-serve analytics, and collaborate across product, clinical, and business teams to translate questions into reliable data solutions.

Design, operate, and scale end-to-end data infrastructure and pipelines. Build reusable data models and a semantic layer, ensure data quality and privacy, implement observability and SLAs, support marketing and growth feeds, partner with cross-functional stakeholders, and enable ML/AI consumption and reverse ETL workflows.

Design, build, and maintain scalable, secure data architectures, models, and ETL pipelines. Integrate diverse data sources, optimize performance and data quality, implement governance, monitor production SLAs, and collaborate with data scientists, analysts, and product teams. Provide technical leadership, documentation, and training to improve engineering practices across the organization.

Lead a team of 5-6 data engineers to design and implement scalable data pipelines (Airflow), manage Snowflake data architecture, build real-time streaming solutions with Kafka/Spark Streaming, develop and integrate APIs, enforce code quality, and drive technical decisions and best practices.

Design, build, and maintain scalable ETL/ELT pipelines and product-level data architectures. Improve pipeline performance and data freshness, lead code/design reviews, mentor engineers, and collaborate with Data Science, Product, and Engineering to make data reliable and accessible.

Build, maintain, and optimize cloud data pipelines and dbt models; design Airflow DAGs; implement dimensional models and BI dashboards; integrate healthcare data with HIPAA-compliant practices; contribute to RAG pipelines and MLOps workflows; review contractor code, monitor data quality, and document designs following governance standards.

The Senior Data Engineer will design and build data pipelines and infrastructure to support data science and business intelligence solutions, utilizing AWS services and streaming technologies.

The Senior Data Engineer will design and implement lakehouse architectures, optimize ClickHouse deployments, develop ETL/ELT pipelines, and create data models to support analytical and operational functions.

Own and evolve end-to-end data pipeline architecture across ingestion, transformation, modeling, and serving. Lead platform improvements (cost, compute efficiency, access control), CI/CD, monitoring, and incident response. Drive cross-team technical initiatives, mentor engineers, and integrate AI tooling to improve workflows while remaining hands-on building and debugging production pipelines.

Own end-to-end data pipelines (ingest, dbt transformations, BigQuery warehousing) and consolidate the analytics stack into a single source of truth. Build and maintain dbt models with tests and documentation, establish data quality and observability, own product analytics and instrumentation, partner with GTM and marketing on reporting, and prepare for high-volume/streaming ingestion.

Lead design, build, test, and maintain scalable cloud data platforms and pipelines (ETL/ELT, batch and streaming). Ensure data quality, governance, security, CI/CD deployment, performance tuning, migration/archival, and mentor data engineering teams to support analytics and AI/ML use cases for a federal modernization program.

Design, build, test, and maintain scalable cloud-based data platforms and ETL/ELT pipelines (batch and near-real-time). Implement data models, data marts, governance, metadata, CI/CD and IaC, optimize pipeline performance, support migrations/DR, produce documentation, and collaborate with architects, DBAs, and stakeholders to meet federal security and audit requirements.

Design, build, and maintain production-scale data systems and web-scale datasets (Spark/Flink) to support personalization ML. Drive dataset/schema design, collaborate with algorithm teams, and improve distributed big-data processing for member experience.

Design, build, test, deploy, and support enterprise data solutions for financial reporting, reserving, and claims. Develop and maintain pipelines, transformations, data models, and controls using SQL, Python, PySpark, and Microsoft Fabric. Automate reconciliations and data quality checks, partner with business stakeholders, perform testing, review code, mentor peers, and resolve production issues to improve reporting accuracy and operational efficiency.

Technical leader for Data Engineering responsible for designing, operating, and optimizing Snowflake-based data platforms, self-hosted orchestration (Prefect), dbt practices, AWS infrastructure, and data pipelines. Drive architecture, mentor engineers, partner cross-functionally, ensure observability and production-grade practices, and enable model-ready datasets and AI/LLM workflows.

Design, build, operate, and optimize large-scale production data pipelines and foundational Healthcare Map data products using Python, SQL, Airflow, Spark, and AWS. Ensure data quality, observability, and performance; debug complex workflows; contribute to architecture, CI/CD, testing, documentation, and cross-functional delivery to enable analytics and AI/ML use cases.

Design, build, and scale reliable batch and real-time data pipelines and warehouses. Partner with engineering, data science, and business teams to define data models, improve observability, optimize storage and querying, and evangelize data engineering best practices across the company.

Design, build, and maintain scalable Databricks-based data pipelines and ELT workflows; develop and document dbt models; define data modeling methodology; ensure data quality, reliability, and scalability; collaborate with clients and cross-functional teams; provide technical guidance and deliver improvements to clients' data infrastructure and analytics capabilities.

Design, build, and optimize scalable batch and streaming data pipelines. Model and process structured and unstructured data, ensure production reliability and observability, apply ML techniques for insight extraction, and drive data strategy while adopting modern tooling and IaC practices.

Lead delivery of enterprise data governance, MDM, and modern data-platform components including Snowflake, CDC pipelines, schema-first contracts (JSON Schema/Avro/Protobuf), data catalog and PII classification, CI/CD schema management, AWS data services, and day-to-day leadership of an offshore delivery team.

Build and own data platform infrastructure and scalable pipelines (ingestion, orchestration, transformation, delivery). Define governance, observability, and AI-first architecture. Optimize performance, ensure data quality, mentor engineers, and integrate AI-assisted tooling.

Own and evolve the data platform: architect, build, and maintain data models, pipelines, and access layers. Ensure data quality, governance, and reliability; monitor and optimize infrastructure; provide technical leadership, code reviews, and collaborate with cross-functional teams to deliver scalable data solutions for operations and analytics.

Lead technical design and hands-on development of Pantheon’s data platform, extending ingestion, curation, retention services and ML/LLM infrastructure. Mentor engineers, drive architecture and engineering standards, operate in a DevOps model, partner cross-functionally, and participate in on-call support to ensure reliable, compliant data access and analytics.