Top Data Engineer Jobs in Buffalo, NY

Design, build, and maintain scalable ETL/ELT pipelines and Lakehouse solutions; ingest and transform diverse data formats; optimize Databricks and SQL Server environments; implement data quality, lineage, and governance; support batch and streaming ingestion; collaborate with analysts and stakeholders to enable analytics (fraud/anomaly detection, financial oversight); troubleshoot and improve pipelines. Candidates must be willing to undergo a U.S. government background investigation.

Implement and manage data ingestion, enrichment, and integration for go-to-market teams. Clean and combine structured and unstructured sources, build automations and lightweight tools, integrate Clay outputs with the data warehouse, and partner with vertical stakeholders to create unified, actionable contact and lead views.

The Principal Data Platform Engineer leads the architecture and development of the enterprise data platform, focusing on analytics, data science, and AI/ML capabilities. They establish standards for data quality and observability, design data ingestion and processing patterns, and mentor team members to enhance technical capabilities.

Design, build, and operate scalable batch and streaming data pipelines and a lakehouse on AWS. Implement ETL/ELT, CDC, metadata/catalog and governance, automated AWS provisioning (IaC), CI/CD for data pipelines, data quality and lineage, observability, and documentation while collaborating across teams.

Own and operate the Snowflake warehouse and Sigma semantic layer; manage ingestion (Fivetran), dbt model scoping and review, reverse-ETL, data quality SLAs, dashboards, month-end financial analytics, vendor management, and automation to support AdOps, Sales, Finance, and executive reporting.

Own day-to-day Snowflake administration and the Sigma semantic layer; manage ingestion (Fivetran), dbt modeling scope, reverse-ETL to Salesforce/HubSpot/NetSuite, data quality SLAs, reporting and dashboards, partner with managed data vendors, design automation and reproducible month-end financial analytics, and drive analysis and experiments for AdOps, Sales, and Finance.

Own and scale Provable's data platform on GCP: build and optimize ingestion pipelines from blockchain indexers, design privacy-aware data models, manage Postgres and BigQuery, develop high-performance data-serving APIs, ensure data quality and observability, and use IaC (Terraform, Helm) and Kubernetes to deploy and cost-optimize environments.

The Sr. Data Engineer designs ETL solutions and data architecture, collaborates on technical solutions, and addresses data management functions.

Design, build, and maintain scalable ETL/ELT data pipelines and data platform architecture. Build programmatic pipelines (primarily Python), optimize analytical data models (SQL), integrate sources into Snowflake, use orchestration/transformation tools (dbt, Airflow, Dagster), improve data quality/observability, and partner with product, engineering, and analytics to deliver reliable data for decision-making.

Build and maintain scalable data pipelines for healthcare claims; implement de-identification and PII-reduction; ensure data quality and observability; integrate data stores and APIs; draft technical designs and documentation; gather product feedback and iterate quickly.

Lead performance investigations across the data product stack to diagnose and fix slow queries and UX issues. Design data architecture changes, build benchmarks, measure latency/throughput/cost (ClickHouse Cloud), prototype solutions, instrument monitoring, and partner with product and engineering to balance responsiveness, scalability, and cost.

The DMS Data Engineer is responsible for analyzing raw data, building data systems and pipelines, conducting complex data analyses, and collaborating on projects to enhance data quality and reliability.

Extract, transform, and load data from clients' legacy databases into CentralSquare systems. Write and tune SQL/ETL processes, present and validate converted data with clients, assist testing and go-live conversions, document processes, estimate project scope, and seek guidance from leadership when needed.

Lead design and development of web UI and REST middleware within an Agile team. Define requirements and acceptance criteria, implement Java/Spring and Angular solutions, build CI/CD pipelines, work with Product Owner and testers, and produce/update design documentation.

Build and optimize the Data Foundry: ingest and index structured and unstructured data, implement enterprise search pipelines, tune Airflow DAGs and BigQuery transformations, maintain secure API integrations, enforce RLS/CLS and governance (Dataplex/IAM), and prepare curated datasets and vector/feature pipelines for AI applications.

Designs and implements big-data data management solutions (Cloudera/Hortonworks/Databricks). Builds and automates reporting and analytics using SQL and Databricks, optimizes queries, manages ETL, integrates multiple data sources, enforces data governance, and supports payment integrity reporting requirements.

Design, build, and migrate large-scale batch data pipelines into Databricks. Develop and optimize production-grade Python/Spark/SQL solutions, support parallel legacy and cloud systems during migration, lead technical design discussions, use AI tools to improve workflows, ensure pipeline reliability through testing/monitoring/tuning, and participate in a rotating on-call schedule.

The Data Engineer will develop and maintain data pipelines, build data models, ensure data quality, and support cross-functional teams while improving internal data platform infrastructure and documentation.

Design, build, and maintain end-to-end batch and streaming data pipelines; develop ETL/ELT workflows and modular Python code; write and optimize SQL; implement analytics data models; monitor data quality, troubleshoot failures, and document pipelines; collaborate with stakeholders and mentor teammates. Remote role for candidates based in Latin America.

As a Data Engineer, you will develop and manage data pipelines, ensuring reliable data ingestion and delivery while optimizing for simplicity and performance.

Design, build, and maintain scalable ETL/ELT data pipelines on Databricks and AWS S3; manage large geospatial and temporal datasets; productionize ML models; implement data validation, testing, and monitoring; optimize storage and processing; document workflows; collaborate cross-functionally.

Own design and implementation of a greenfield analytical data platform: ingesting PostgreSQL and Kafka streams, establishing governance, data lineage, quality, monitoring, and compliance-ready pipelines. Evaluate AWS-native tooling, Snowflake, and Databricks; produce RFCs and documentation; mentor junior engineers and ensure analytical systems remain downstream of transactional sources.

The Senior Data Engineer will design and maintain scalable cloud-native data pipelines, develop APIs, implement advanced analytics, manage AI workflows, and enhance data operations collaboratively.

We are seeking a Data Engineer to design, build and optimize scalable data pipelines. Strong experience in Databricks, PySpark, and data warehouse concepts is required.

Lead design and scaling of backend data infrastructure for Beacon's Datastore: build event-driven pipelines, data models, and APIs; draft RFCs; integrate services; improve operational robustness, documentation, and tooling to support clinical and scientific workflows.