Top Data Engineer Jobs in Buffalo, NY

Design, implement, and manage advanced data ecosystems and scalable ETL/ELT pipelines. Analyze complex problems, deliver data warehousing and governance solutions, mentor junior staff, and build client relationships while maintaining high standards and business-context awareness.

Lead design and implementation of enterprise data architecture and cloud-based data solutions. Manage large data engineering projects, develop data models and pipelines, ensure governance and security compliance, advise clients strategically, and build high-performing inclusive teams.

Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.

Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.

Configure and maintain Adobe Experience Platform and Real-Time CDP data pipelines, XDM schemas, datasets, identity resolution, Profile enablement, segmentation readiness, and destination activation. Validate data quality, troubleshoot ingestion and identity issues, manage sandboxes, and implement privacy, consent, governance, and access controls. Partner with architects, data engineers, consultants, analysts, data scientists, and marketing teams to support reporting, personalization, and machine learning readiness.

Build, model, and maintain scalable BigQuery-based data solutions on GCP. Implement performant data models, storage partitioning/clustering, ETL improvements, data validation, and documentation. Collaborate with architects, data scientists, and engineers to deliver governed, high-quality data for reporting and AI initiatives.

Build scalable, secure data pipelines, models, platforms, and governance systems that enable AI applications to access trusted enterprise data. Partner with analytics, marketing, and product teams to translate requirements into technical solutions, independently deliver projects through production, and support sensitive-data security and access controls. Preferred experience includes LLM architectures, cloud data platforms, infrastructure as code, regulated environments, and technical leadership.

Designs and operates batch, streaming, and real-time data platforms and pipelines using Spark, Kafka, Iceberg, Airflow, and cloud infrastructure. Owns data lake evolution, data quality, observability, reliability, governance, event instrumentation, schema management, and privacy controls for PII, retention, deletion, and residency. Leads complex initiatives end-to-end, troubleshoots production issues, mentors engineers, and develops AI agent harnesses that enforce data engineering standards and quality gates.

As the first in-house Data Engineer, you will own the data infrastructure, build and maintain data pipelines, and collaborate with teams to ensure quality data access and insights.

Build and maintain large-scale data processing pipelines using Apache Spark (PySpark/Scala) and Python. Design ETL workflows, implement distributed data processing, use version control (Git), and work with cloud platforms (GCP/AWS/Azure).

Build, maintain, and support production data pipelines and platform capabilities using Snowflake, dbt, Airflow or Cloud Composer, APIs, files, and cloud services. Responsibilities include ETL/ELT development, data modeling, testing, deployment, monitoring, troubleshooting, optimization, documentation, and data quality. The role partners with analytics, data science, finance, risk, marketing, product, and engineering teams, while supporting reliable, scalable, and cost-effective data systems and emerging AI data workflows.

Build and optimize Alteryx workflows and data ingestion processes; extract, transform, normalize, and integrate enterprise data from multiple sources. Automate repetitive processing, ensure data quality, troubleshoot integrations, document workflows, and deliver datasets and analytical insights for internal business stakeholders. The role may also develop Tableau visualizations and use Python, PowerShell, or Bash scripting.

Designs and maintains scalable cloud data architectures, pipelines, ETL processes, data warehouses, databases, and data models. Ensures data quality, accuracy, security, availability, and consistency across sources. Develops SQL queries for analytics and reporting, and documents pipelines, schemas, architectures, and models. The role requires expertise with Python, Java, Scala, R, SQL, relational and NoSQL databases, cloud platforms, and Snowflake.

Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.

Designs and manages scalable data pipelines, contracts, transformation layers, and analytics models. The role focuses on data governance, observability, lineage, configuration validation, and collaboration with product engineering teams. It requires processing large datasets, integrating cloud and on-premises industrial technologies, and implementing streaming and message-queuing solutions, ideally in cybersecurity or industrial environments.

Build and operate cloud data capabilities, including ingestion pipelines, transformations, data models, curated data products, and data-quality controls. Use Snowflake, dbt, SQL, and Python to deliver governed data for analytics, applications, automation, and AI workflows. Implement testing, CI/CD, documentation, lineage, access controls, monitoring, incident resolution, and performance optimization. Collaborate with engineering, analytics, governance, security, and business teams in an Agile, product-oriented environment with active AI-assisted development.

Design and operate scalable, cloud-native data pipelines and orchestration systems for imaging, biomarker, and healthcare data. Build Databricks and distributed processing workflows, integrate DICOM data into data lakes, and implement validation, observability, monitoring, and fault tolerance. Collaborate with data science, AI, R&D, product, and data management teams to deliver secure, compliant, reliable data for analytics and machine learning.

Own and maintain the companys data infrastructure and pipelines. Design, build, and monitor ETL/ELT workflows and data architecture; integrate SaaS sources; enforce data quality, standards, and governance; partner with stakeholders to deliver analytics-ready data and meet data availability SLAs.

Designs and operates an AWS-native lakehouse supporting analytics, reporting, visualization, and AI/ML. Builds batch and streaming ingestion pipelines using Python and PySpark, Apache Iceberg data structures, governance and metadata services, quality controls, security, observability, and CI/CD automation. Optimizes performance, scalability, reliability, and cost while collaborating with cross-functional technical teams and documenting architecture, operations, and secure configurations.

Designs and maintains data warehouses, semantic models, metrics layers, pipelines, dashboards, and certified datasets. Establishes KPI governance, data security, row-level access controls, quality standards, and observability. Builds Sigma, Power BI, and Databricks dashboards, supports self-service analytics, resolves BI issues, and enables AI/ML use cases. Collaborates with architecture, engineering, analysts, and business stakeholders to define requirements, document solutions, train users, and drive BI adoption.

Design and manage financial systems for accurate cashback calculations, build and maintain reconciliation processes, ensure data integrity for yield-bearing instruments, collaborate with compliance, and partner with cross-functional teams to improve financial system efficiency.

Design, build, and maintain scalable data pipelines, data lakes, and databases; ingest and map customer financial datasets; monitor pipeline reliability; translate business requirements into data flows and analytical insights to ensure high-quality, usable data.

Build, deploy, and operate production-grade data pipelines and data products for healthcare audiences. Design transformations, data models, and governed views using Python, SQL, Airflow, S3, Snowflake, and EMR. Implement data-quality, monitoring, and privacy-by-design controls for PHI/PII. Partner with product, analytics, and platform teams to onboard sources, support audience discovery, segmentation, activation, measurement, and troubleshoot production issues.

As the founding engineer of the Data Intelligence team, you will design semantic layers, develop AI tooling, and automate data processes to drive business insights.

Lead design and scaling of the data platform and analytics pipelines. Build and maintain ETL/ELT workflows, integrations, serverless data services, and reliable data models. Mentor teammates, improve automation, observability, and data governance to support analytics and operational insights.