Top Data Engineer Jobs in Buffalo, NY

Builds and maintains scalable data pipelines and cloud infrastructure supporting an AI biomedical research platform. Responsibilities include ingesting, harmonizing, validating, and documenting multimodal neurodegeneration datasets; managing cloud storage, compute, permissions, and costs; implementing de-identification and data governance workflows; supporting research data repositories and AI/ML teams; and maintaining data lineage, catalogs, and technical documentation. The role requires strong Python and SQL skills, software engineering discipline, cloud experience, and neurodegeneration research data expertise.

Lead architecture and hands-on engineering to design, scale, and govern a cloud-native lakehouse using Databricks and Microsoft Fabric. Build batch/streaming pipelines, ensure HIPAA-compliant PHI handling, produce analytics-ready datasets, mentor engineers, and drive platform strategy, governance, and reliability.

Design, build, and maintain ETL pipelines, databases, and data models to process healthcare claims and related data. Ensure data quality, analyze claims data for trends, and produce reports and visualizations for nontechnical stakeholders. Collaborate with policy and analytics teams to translate requirements into data solutions and improve data infrastructure and analytics capabilities.

Design and implement end-to-end data solutions on Microsoft Fabric and Azure for insurance datasets. Build ingestion pipelines (batch, streaming, API), Lakehouse architectures, and data models. Enforce governance, security, compliance, and cost/performance optimizations while guiding engineers and stakeholders on architectural best practices.

Collects, consolidates, cleans, analyzes, and visualizes experimental data from analytical equipment, test rigs, and pilot plants. Performs statistical analysis, anomaly detection, experimental design support, equipment validation, and QA/QC activities. Presents findings to technical leadership, identifies process improvements, and helps extract actionable insights from structured and spectral data.

Build and operate production-grade data pipelines and models connecting marketing, event, operational, and SaaS data into Databricks. Own data quality, testing, monitoring, lineage, orchestration, attribution, identity resolution, and governed semantic-layer contributions. Partner cross-functionally on privacy-aware data flows, event taxonomies, and reliable Growth data products while improving engineering standards and maintainability.

Develop and maintain large-scale, cloud-native data services and distributed pipelines for multi-tenant healthcare systems. Responsibilities include data modeling, database component development, SQL programming, performance tuning, testing, deployment, code reviews, proof-of-concepts, and full software development lifecycle ownership. Collaborate with global engineering teams, evaluate technologies, apply security and operational requirements, and use AI tools to accelerate development.

Build and scale an enterprise metrics store, dbt models, semantic-layer definitions, and analytical workflows. Develop governed business metrics, root-cause analysis, metric relationships, and reusable logic for BI tools. Partner with product, engineering, sales, underwriting, claims, and experience teams to translate business questions into actionable insights. Improve data quality, define data contracts, debug upstream and analytical issues, and help prepare metric infrastructure for API-based serving.

Lead pre-sales technical engagements to design and optimize scalable cloud lakehouse data platforms (Snowflake/Databricks). Provide architecture reviews, ETL/ELT pipeline design, governance and AI-ready data foundations, support services sales, and translate technical tradeoffs into actionable recommendations for engineering and executive stakeholders.

Participate in an internship focused on database modeling and optimization, data analysis and consolidation, data quality, and data support. Work alongside experienced professionals on real-world projects while developing technical and professional skills. The program requires prior knowledge of data concepts, spreadsheets, databases, programming logic, and analytical problem-solving.

Leads the design, automation, optimization, and maintenance of scalable data pipelines using Airflow, dbt, Python, SQL, and Google Cloud technologies. Manages dbt models, develops reusable architecture patterns, monitors pipeline performance, supports CI/CD and testing, and ensures data security and governance. The role also provides technical leadership, mentors engineers, collaborates cross-functionally, documents implementations, and drives continuous improvement across data engineering practices.

Build and maintain scalable batch and real-time data pipelines, model data to power analytics and ML, and operate distributed data systems. Collaborate with business, engineering, and data science teams to ensure data quality, documentation, and debugging while adopting new technologies and working in an ambiguous, fast-changing environment.

Build and maintain low-latency, highly available distributed data systems and services to deliver high-quality data for product, analytics, and ML. Partner with data scientists and product teams to design scalable, observable, multi-tenant data products using batch and real-time processing frameworks. Ensure 24x7 reliability, monitoring, and operational excellence while owning end-to-end delivery.

Design, build, and own large-scale batch and streaming data pipelines and core Ads data products. Collaborate with analytics, data science, and engineering teams to model, transform, govern, and deliver high-quality ad datasets for analysis, ML, and reporting while ensuring privacy compliance.

Build scalable, privacy-focused data frameworks and ETL pipelines using big-data technologies (Spark, Presto, Flink, Kafka, Hive). Ensure appropriate handling of personal data, support privacy and legal needs, partner cross-functionally, and lead system design while mentoring teammates.

Designs and leads scalable data platforms, event-driven services, orchestration pipelines, and DataOps practices using Python, Airflow, Snowflake, Kafka, and related technologies. The role establishes engineering standards, governance, security, observability, cost efficiency, and AI-assisted development practices. It also mentors engineers, drives cross-functional initiatives, modernizes data ingestion, and ensures reliable, compliant, and well-governed systems.

Owns the end-to-end design and development of a greenfield data and AI platform for federal background investigations. Responsibilities include lakehouse architecture, ingestion and transformation pipelines, Terraform infrastructure, CI/CD, governance, cataloging, lineage, access control, compliance with FedRAMP and NIST requirements, artifact promotion, platform reliability, cost management, and enabling data science and machine learning teams.

Lead database engineering for a federal species-data integration program in a hybrid AWS cloud environment. Responsibilities include harmonizing schemas, documenting source-to-target mappings and lineage, enforcing metadata and data-quality standards, implementing encryption and NIST-aligned security controls, building authoritative source registries, optimizing performance, and leading production migration, validation, monitoring, and operational documentation. The role requires Databricks or equivalent lakehouse expertise, ETL programming, federal governance knowledge, and database migration leadership.

Designs secure Azure data pipelines and analytics foundations using Databricks and ADLS Gen2. Responsibilities include modernizing Oracle workloads, developing medallion data models, implementing data quality and monitoring practices, integrating curated datasets with Power BI, and establishing secure Azure Government identity, network, storage, and access patterns. The role also requires documentation, operational support, stakeholder collaboration, and performance optimization.

Leads data engineering strategy and mentors an analytics engineering team. Designs scalable ELT pipelines, warehouse integrations, data models, API ingestion workflows, and data quality frameworks using cloud and database technologies. Conducts exploratory analysis, supports dashboards and analytical solutions, monitors warehouse performance and costs, and ensures data governance, security, and compliance. Collaborates with data scientists, analysts, engineers, and business stakeholders to deliver healthcare analytics solutions.

Own SQL and dbt-based data modeling and data quality for clinical and claims datasets. Author and refactor dbt models/tests, triage DQ alerts, design monitors, optimize SQL performance, and collaborate with Data Engineering and stakeholders to ensure trusted production datasets.

The job involves building responsive web dashboards, advanced data visualizations, and analytics tools for unmanned aircraft systems, requiring a deep understanding of UI/UX design and data presentation.

Lead the data engineering strategy and architecture for distributed pharmaceutical data systems. Design and scale pipelines, APIs, and data platforms while ensuring reliability, governance, quality, and PII/PHI protection. Drive technical decisions, improve developer efficiency, deliver business impact, influence cross-functional roadmaps, mentor engineers, communicate with executives, and promote organizational adoption of new technologies and processes.

Leads the architecture, development, and operation of scalable enterprise data platforms, pipelines, ETL/ELT workflows, and transactional lakehouses. Uses AWS Glue, Apache Spark, Apache Hudi, and Amazon Athena to deliver production-grade data solutions. Provides data architecture leadership, code reviews, technical standards, query optimization, CI/CD integration, troubleshooting, and mentoring while collaborating with clients, product managers, and cross-functional teams.

Design and operate Alpaca’s scalable data platform on GCP, including lakehouse infrastructure, Kubernetes-based deployments, streaming and CDC pipelines, batch ingestion, BI access, cataloging, monitoring, and governance. Build infrastructure as code with Terraform and Ansible, operate distributed query engines and Apache Iceberg, maintain reliability practices, and collaborate with DevOps and analytics teams to support rapidly evolving data requirements.