Top Senior Data Engineer Jobs in Rochester, NY

Designs, analyzes, documents, integrates, and migrates complex environmental datasets for AirHub business lines. Responsibilities include analyzing legacy databases, creating logical and physical data models, documenting mappings and business rules, developing migration specifications and API integrations, supporting data governance and testing, and producing technical documentation. The role also requires close collaboration with business stakeholders in an Agile delivery environment.

Lead financial data engineering initiatives involving commissions, incentive programs, and backend financial systems. Build scalable, accurate, and reliable data pipelines, platform tooling, partner integrations, analytics infrastructure, and data science infrastructure. Shape technical strategy and roadmaps, collaborate with Finance, Product, Data Science, and Engineering, mentor engineers, contribute code, lead incident response, and establish engineering standards.

Develops scalable data models, Databricks pipelines, backend applications, ETL processes, and data ingestion systems. Partners with engineering, product, and business stakeholders on technical roadmaps; monitors and optimizes data systems for performance, reliability, and scalability. Provides technical leadership, mentors junior engineers, conducts code reviews, and builds secure solutions for sensitive healthcare data.

Build and operate scalable cloud data pipelines, warehouses, transformation layers, and ML production systems. Lead data infrastructure architecture, warehouse performance optimization, DataOps monitoring, CI/CD improvements, data quality testing, and large-scale data product delivery. Collaborate across teams, promote data stewardship, and support batch and streaming pipelines while deploying, serving, and monitoring machine learning models.

Own the architecture and technical direction of Northbeam’s data ingestion and integration platform. Design scalable API-based ETL, event-driven and batch processing systems; establish standards for observability, freshness, and failure handling; and guide build-versus-buy decisions. Collaborate across engineering, infrastructure, product, and business teams while mentoring engineers, leading design reviews, and driving complex platform initiatives to completion.

As the founding engineer of the Data Intelligence team, you will design semantic layers, develop AI tooling, and automate data processes to drive business insights.

Own and evolve the data infrastructure powering identity and fraud products. Build and operate scalable ETL/ELT pipelines, ensure data quality and observability, optimize storage and access, support product squads, respond to production incidents, mentor engineers, and drive data platform innovation.

Designs and maintains healthcare data pipelines, ETL workflows, databases, data models, and analytical frameworks. Analyzes claims and payer data to identify trends and insights, while ensuring data quality and integrity. Creates reports, dashboards, and visualizations for nontechnical stakeholders and collaborates with healthcare policy experts, analysts, and other stakeholders to translate requirements into data solutions. The role also improves data infrastructure and analytics capabilities.

Architect and operate BILL’s enterprise data platform across ingestion, lake storage, batch and streaming processing, query, feature store, knowledge graph, and search layers. Drive platform-wide technical decisions, migrations, standards, reliability, cost efficiency, and self-service capabilities. Partner with ML, Risk, Payments, and Analytics teams to deliver scalable solutions, lead complex initiatives from inception through production, and mentor senior and staff engineers.

Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.

Build and maintain modern data-centric applications, pipelines, transformations, enrichment processes, provisioning layers, and user interfaces supporting clinical and operational healthcare processes. Analyze clinical data and report trends using cloud, big data, data science, and modern software development practices. Collaborate with Product, Platform, and Architecture teams, mentor Data Engineers, document solutions, manage source control, and research emerging technologies.

Architect, build, and operate low-latency market data systems, including feed handlers, normalization, distribution, and exchange connectivity. Design high-throughput infrastructure for real-time trading data, improve reliability and performance, participate in observability, on-call, and incident response, and deliver well-tested features end to end. Partner with engineering, product, and cross-functional stakeholders while leading a lean, high-impact team.

Design and deliver modern data platforms, scalable and secure ingestion and transformation pipelines, durable data models, streaming systems, and reporting layers. Partner directly with clients and business stakeholders to translate requirements into architecture, explain tradeoffs, and own delivery outcomes. The role includes production implementation across cloud data platforms, orchestration, governance, real-time technologies, and analytics or AI data consumption.

Build Sailor Health’s foundational data platform from scratch. Responsibilities include developing Snowflake and dbt pipelines integrating EHR, CRM, and communications data; creating data-powered web applications; automating clinical and billing workflows with Python; analyzing therapy transcripts and patient data using AI and machine learning; tracking clinical outcomes; and designing scalable data architectures in collaboration with clinicians, engineers, founders, and other teams.

Own and evolve Worldly’s production data lake, Postgres warehouse, CDC and streaming pipelines, dbt transformations, orchestration, BI access controls, and graph integrations. Maintain reliable, governed analytics infrastructure using Iceberg, Trino, Dagster, Terraform, and AWS. Support production generative AI workflows involving embeddings, similarity search, extraction, and classification. Responsibilities include data quality, monitoring, security, incident response, disaster recovery, schema governance, and collaboration with data science and analytics stakeholders.

Designs, administers, and optimizes data systems supporting FSA IAM applications. Develops migration plans from legacy AIMS and PAS systems, creates data models, mappings, layouts, dictionaries, and integration processes, and supports analytics and fraud detection. Manages database configuration, performance tuning, monitoring, backups, capacity, secure data handling, encryption, network data flows, token management, and documentation while collaborating with development, security, and operations teams.

Manage, design, and optimize data activities for federal IAM systems. Develop data models, file layouts, source-to-target mappings, data dictionaries, integrations, ETL processes, and analytics support for identity analysis and fraud detection. Administer and tune databases, including configuration, backups, monitoring, capacity planning, and performance optimization. Support secure handling of identity and PII data, network-related data flows, documentation, token management processes, and collaboration across development, security, and operations teams.

Architect and maintain NetBrain’s first cloud data warehouse, ELT pipelines, transformation layer, semantic models, and BI foundation. Own data quality, governance, lineage, access controls, and curated models supporting product usage, customer adoption, account health, and go-to-market reporting. Partner with stakeholders to establish reliable metrics and a standardized source of truth, while supporting AI-assisted analytics and natural-language reporting use cases.

Design, build, and own scalable data pipelines and warehousing architecture from ingestion through analytics and incentive payouts. Lead data platform architecture, dbt modeling, data quality, lineage, observability, performance, and cost management. Partner with engineers and analysts on telematics accuracy and driver incentive reporting. Use AI coding tools daily to develop and review pipelines, SQL, and data models.

Designs, builds, and operates scalable enterprise data platforms supporting ingestion, processing, storage, governance, analytics, and AI/ML. Responsibilities include developing batch and real-time pipelines, lakehouse and warehouse architectures, orchestration, infrastructure automation, CI/CD, monitoring, security, cost optimization, and observability. The role partners with data, ML, DevOps, security, and application teams, troubleshoots complex platform issues, establishes reusable engineering standards, contributes to architecture strategy, and mentors engineers.

Own end-to-end data platform architecture across ingestion, transformation, modeling, and serving. Improve warehouse efficiency, access control, reliability, observability, orchestration, CI/CD, and developer experience. Lead cross-functional technical initiatives, build monitoring and alerting, mentor engineers, guide architectural decisions, and develop AI-powered data tooling. The role requires strong SQL and Python skills, production experience with Airflow, BigQuery, and containerized infrastructure, plus architectural ownership and stakeholder communication.

Design, build, maintain, and optimize Spark and Scala ETL/ELT pipelines on AWS for terabyte- and petabyte-scale datasets. Work across S3, Snowflake, Kafka, and monitoring systems, resolve production data-quality and performance issues, write automated tests, participate in architecture and code reviews, and support on-call operations. Use generative AI to improve pipeline development, monitoring, and engineering productivity.

Lead architecture and hands-on engineering to design, scale, and govern a cloud-native lakehouse using Databricks and Microsoft Fabric. Build batch/streaming pipelines, ensure HIPAA-compliant PHI handling, produce analytics-ready datasets, mentor engineers, and drive platform strategy, governance, and reliability.

Design and implement end-to-end data solutions on Microsoft Fabric and Azure for insurance datasets. Build ingestion pipelines (batch, streaming, API), Lakehouse architectures, and data models. Enforce governance, security, compliance, and cost/performance optimizations while guiding engineers and stakeholders on architectural best practices.

Develop and maintain large-scale, cloud-native data services and distributed pipelines for multi-tenant healthcare systems. Responsibilities include data modeling, database component development, SQL programming, performance tuning, testing, deployment, code reviews, proof-of-concepts, and full software development lifecycle ownership. Collaborate with global engineering teams, evaluate technologies, apply security and operational requirements, and use AI tools to accelerate development.