Top Senior Data Engineer Jobs in Buffalo, NY

Design, build, and maintain scalable ETL and data pipelines on AWS using Python/PySpark. Develop Glue/Lambda/Step Function workflows, event-driven integrations, and data lake/warehouse solutions. Tune SQL, implement monitoring/validation, support API/JSON integrations, troubleshoot operations, document and automate deployments, and mentor junior engineers.

Design and implement scalable data pipelines and orchestration on GCP to support AI/ML-driven mail intelligence. Build stream and batch processing, ensure data governance and quality, optimize workflows, create visualizations, and collaborate with US cross-functional teams to align technical strategy and recover from failures.

Design, develop, maintain, and optimize ADABAS database structures and data solutions. Support mainframe data processing (Natural, COBOL, JCL), perform migrations to modern platforms, tune performance, ensure data integrity/security, troubleshoot issues, and collaborate with developers, architects, and analysts on modernization, API/cloud integration, and data warehousing initiatives.

Build instrumentation and batch/streaming ETL/ELT pipelines and REST API integrations to generate audience and trigger data for CRM/marketing automation. Ensure data quality, monitoring, and reliability at scale while collaborating with CRM, campaign, and operations teams.

Own end-to-end data engineering for a business domain, including API and other-source ingestion, dbt models, orchestration, data-quality testing, monitoring, documentation, and performance. Build reliable, AI-ready single sources of truth and ensure data freshness, accuracy, traceability, and scalability. Collaborate with stakeholders and the Director of Data, establish engineering patterns, review work, and mentor other engineers.

Analyze large and diverse datasets to uncover insights, develop/train/deploy machine learning models, design data preprocessing pipelines, and create visualizations and reports. Collaborate with cross-functional teams to build predictive models, recommendation systems, and optimization algorithms to drive business improvements.

Build and operate trusted data products, governed datasets, scalable pipelines, and platform workflows supporting analytics, AI, and business operations. Responsibilities include data quality, validation, observability, recoverability, semantic consistency, governance controls, permissions, privacy-aware access, automation, and production monitoring. The role partners with stakeholders to resolve ambiguous data needs, drives platform improvements, provides technical direction, and adopts agentic development workflows.

Build and maintain Snowflake and dbt data platforms, including ELT pipelines, tested models, orchestration, monitoring, documentation, access controls, and governance. Optimize performance and costs while ensuring reliable, discoverable data for internal dashboards, client products, and AI/ML use cases. Translate ambiguous stakeholder needs into durable solutions and apply strong software engineering practices, including Git, CI/CD, code review, Python, testing, and alerting.

Owns the design, development, deployment, and support of B2B data pipelines using BigQuery, dbt, Python, and orchestration frameworks. Translates client requirements into scalable data models, integrates CRM and marketing data, builds measurement and activation pipelines, and ensures quality through testing, validation, monitoring, and observability. The role also standardizes reusable B2B data capabilities, troubleshoots production issues, and supports account-level marketing-to-revenue measurement across multiple clients.

Design, build, and operate production data pipelines using Python, Spark SQL, and Airflow. Canonicalize healthcare and customer data into trusted internal models, optimize distributed processing, enforce schemas, and implement quality checks and observability. Support customer onboarding, streaming pipelines, troubleshooting, on-call operations, and platform best practices while collaborating with product, analytics, engineering, data science, and customer teams.

Design, build, and own business-critical data infrastructure, including AWS Glue and Spark pipelines, cloud warehouse or lakehouse systems, orchestration, and Tableau BI platforms. Define event-driven contracts, data models, schemas, observability, and batch or streaming architectures across multi-tenant, multi-region environments. Collaborate across producer and consumer teams while owning production data infrastructure and outcomes end to end.

Design and support ETL, data migration, transformation, import, export, and validation workflows for moving legacy EHR data into athenahealth systems. Build Python and SQL utilities, define source-to-target mappings, support HL7 and FHIR interoperability, validate EHI exports, investigate data quality issues, document processes, and collaborate with product, implementation, operations, sales, and engineering teams in a remote environment.

Design, build, and operate scalable PostgreSQL databases and cloud-native data infrastructure. Build and maintain ETL/ELT pipelines, optimize query and server performance, ensure high availability and disaster recovery, improve observability, troubleshoot production issues, guide schema and application design, evaluate database technologies, and mentor junior engineers to support reliable, secure data-driven applications.

Own the go-to-market data infrastructure, integrating HubSpot, Dreamdata, advertising platforms, PostHog, and website data into BigQuery. Diagnose tracking and attribution discrepancies, configure multi-touch revenue attribution, and build executive dashboards covering channel performance and revenue. Develop ABM workflows using Clay, enrichment, behavioral signals, and AI personalization. Partner with sales and marketing to improve funnel visibility, campaign decisions, and outbound effectiveness.

Design, build, and maintain ingestion and transformation pipelines for a knowledge-graph analytics platform. Profile and prepare structured and semi-structured source data, ensure data lineage and traceability, implement transformation logic for graph loading, collaborate with data scientists on graph modeling and entity resolution, improve pipeline reliability, and document ingestion patterns using version control and issue tracking.

Own data ingestion, validation, reconciliation, and quality pipelines using Python, advanced SQL, and PostgreSQL. Design schemas, indexes, migrations, automated tests, and CI/CD workflows while handling unreliable third-party feeds. Develop test plans, track defects, establish quality metrics, conduct performance and security testing, and support compliance documentation. Preferred experience includes AWS event-driven architectures, healthcare or payer data, orchestration tools, infrastructure as code, FedRAMP environments, data quality frameworks, and anomaly detection.

Designs, develops, and maintains Databricks-based ETL pipelines, data lake architectures, datasets, and data quality processes supporting reporting, analytics, and AI/ML workloads. Maintains and migrates legacy SSIS and SQL Server systems, optimizes pipeline performance, and supports complex SSRS reporting. Collaborates with business users, analysts, and IT teams to define data requirements, troubleshoot issues, document solutions, and advance AI-assisted engineering practices.

Designs, develops, and maintains GCP-based security data pipelines and data products. Builds data quality and auditing frameworks, integrates security tools through APIs, optimizes BigQuery schemas and costs, and deploys automated ETL/ELT workflows using Python, SQL, and GCP services. Partners with security teams to deliver reporting views and dashboards. Cribl Stream experience is preferred for processing, enriching, routing, and reducing security telemetry and logs.

Designs, develops, and maintains Databricks ETL pipelines, data lake architectures, datasets, and data integrations supporting reporting, analytics, and AI/ML workloads. Troubleshoots and optimizes Databricks and SSIS processes, maintains legacy systems, implements data quality controls, and supports data warehousing. Maintains SSRS reports and collaborates with business users, analysts, and IT teams to deliver reporting solutions. Documents work, communicates technical information, and contributes to AI-assisted development practices.

Build scalable data pipelines, ELT processes, infrastructure, and dimensional data models supporting internal analytics and customer-facing data products. Implement data quality monitoring, auditing, alerting, warehouse optimization, and governed semantic layers for AI and LLM-enabled analytics. Partner with technical and business stakeholders, improve data processes using AI, and deliver reliable metrics from diverse data sources.

Design, build, and optimize enterprise ETL/ELT pipelines, cloud data lakes, lakehouse solutions, data models, and semantic layers across AWS and Azure. Ensure data quality, security, performance, reliability, and governance while supporting analytics, reporting, and AI initiatives. Collaborate with product, engineering, IT, and business stakeholders to translate requirements into scalable data solutions, monitor pipeline health, troubleshoot issues, and improve data architecture and practices.

Lead data engineering and machine learning initiatives by designing, architecting, developing, and supporting GCP data pipelines. Create information architecture documentation, estimate and plan technical work, collaborate with project teams and business analysts, and translate requirements into technical designs. Develop Python-based ELT pipelines, optimize BigQuery SQL, support CI/CD, and provide technical leadership to projects and teams.

Design, build, deploy, and operationalize scalable data engineering solutions for customers. Responsibilities include developing pipelines, transforming and cleansing data, analyzing sources, implementing governance, security, and quality practices, testing data movement and transformation code, resolving defects and incidents, and advising customers on technical decisions. The role also supports AI, machine learning, business intelligence, and data product adoption while collaborating across teams and educating end users.

Designs and develops enterprise cloud data solutions, including batch, near-real-time, and API-based pipelines. Builds data models, warehouses, lakes, and lakehouses while implementing governance, quality, lineage, and curation practices. Supports CI/CD, testing, monitoring, observability, security, and compliance. Collaborates with architects, product owners, analysts, and leadership on platform strategy and modernization. Mentors engineers, leads reviews, presents technical topics, and explores AI-enabled data capabilities.

Lead Salesforce data migration and quality activities for a Department of Veterans Affairs modernization program. Analyze SQL Server data, create source-to-target mappings, execute ETL and Salesforce loading, validate and reconcile records, implement data quality controls, and develop migration and application test plans. Track defects, support automated monitoring and testing, collaborate with architects, developers, stakeholders, and provide migration status, risk, and quality updates.