Top Senior Data Engineer Jobs in Portland, ME

Lead data engineering for a healthcare scheduling platform rebuild: map legacy multi-TB schema, design target schema, build translation layer (views/materialized views and write mappers), ensure data consistency during parallel systems, plan per-tenant cutover with verification and rollback, tune DB performance, instrument data quality/lineage/audit, and mentor engineers.

Design, build, and scale reliable batch and real-time data pipelines and warehouses. Partner with engineering, data science, and business teams to define data models, improve observability, optimize storage and querying, and evangelize data engineering best practices across the company.

Owner of data platform modernization: design and migrate legacy systems to Kimball-style dimensional models and star schemas; build reliable production data pipelines; enforce data hygiene and validation; champion dbt best practices; mentor junior engineers; collaborate with analysts and stakeholders to ensure scalable, well-documented data models and platform observability.

Design, build, and maintain scalable Databricks-based data pipelines and ELT workflows; develop and document dbt models; define data modeling methodology; ensure data quality, reliability, and scalability; collaborate with clients and cross-functional teams; provide technical guidance and deliver improvements to clients' data infrastructure and analytics capabilities.

As a Senior Data Engineer, you will manage data pipelines, ensure data quality, partner with teams for data-driven decisions, and improve the data platform while maintaining data integrity.

The Senior Data Engineer will create and manage data pipelines, ensuring data quality, collaborating with teams for data-driven decisions, and evolving the data platform.

Design, build, and optimize scalable batch and streaming data pipelines. Model and process structured and unstructured data, ensure production reliability and observability, apply ML techniques for insight extraction, and drive data strategy while adopting modern tooling and IaC practices.

Build and own data platform infrastructure and scalable pipelines (ingestion, orchestration, transformation, delivery). Define governance, observability, and AI-first architecture. Optimize performance, ensure data quality, mentor engineers, and integrate AI-assisted tooling.

The Senior Data Engineer will maintain and improve data infrastructure, design ETL processes, and create high-performance pipelines for analytics and AI initiatives using SQL and Python in cloud environments.

Build and own data quality and observability for the data platform: profile data, define quality rules, set metrics/SLAs, monitor and alert, investigate and resolve data issues at source, and partner with data engineering and business stakeholders on standards and reporting.

Lead technical design and hands-on development of Pantheon’s data platform, extending ingestion, curation, retention services and ML/LLM infrastructure. Mentor engineers, drive architecture and engineering standards, operate in a DevOps model, partner cross-functionally, and participate in on-call support to ensure reliable, compliant data access and analytics.

Design, build, and maintain scalable cloud-based data pipelines and lakehouse platforms. Integrate diverse business systems, ensure data quality, support analytics and AI, implement governance, and mentor junior engineers while optimizing performance and enabling enterprise reporting and ML use cases.

Own and evolve the data platform: architect, build, and maintain data models, pipelines, and access layers. Ensure data quality, governance, and reliability; monitor and optimize infrastructure; provide technical leadership, code reviews, and collaborate with cross-functional teams to deliver scalable data solutions for operations and analytics.

The Senior Data Engineer will design and build scalable data platforms, handle automation for data operations, and ensure reliability and performance of data pipelines while collaborating with various teams.

Lead a team to design, build, and maintain cloud data engineering solutions using Microsoft Fabric and Azure Synapse. Responsibilities include architecture, data pipelines, lakehouse and warehousing implementation, governance, performance optimization, mentoring engineers, cross-functional collaboration, support/on-call, documentation, and ensuring reliability and compliance.

Build, operate, and modernize scalable data pipelines and warehouse environments for lottery reporting, analytics, and AI readiness. Improve ingestion, transformations, data models, contracts, observability, lineage, and onboarding patterns. Automate operations, troubleshoot production issues, mentor engineers, and support migration from legacy to cloud architectures while ensuring data quality, reliability, and regulatory continuity.

The Staff Data Engineer will lead financial data operations, ensuring accuracy and reliability of data pipelines, while collaborating with Finance, Product, and Engineering teams to enhance systems and decision-making processes.

Lead the vision and execution for scalable data governance and quality across Airbnb. Architect future-proof data ecosystems, define best practices and tooling, drive cross-functional policy implementation (privacy, legal, infosec), mentor senior engineers, and influence executive strategy to embed stewardship into the data product lifecycle.

Administer, stabilize, and scale Oura's global Databricks environment. Manage workspace governance, cluster policies, access control, cost monitoring, job scheduling, and incident SLAs. Onboard teams, resolve performance and reliability issues, and partner with IT and Data Architecture. Over time contribute to pipeline development, Spark optimization, CI/CD, and infrastructure-as-code to support domain-oriented data mesh initiatives.

Lead architecture and scaling of the Databricks data warehouse and self-service data platform. Build reusable batch and streaming frameworks, enforce governance, SLOs, lineage, observability, CI/CD, and multi-tenancy. Mentor engineers, run design reviews, and ship documented patterns to enable analytics, data science, and app teams to move quickly without blocking on platform tickets.

Build end-to-end data and analytics features: ingest and model data, build transformations and pipelines, create client-facing dashboards and interfaces, and develop LLM-powered workflows to accelerate analysis and app development. Partner with stakeholders, perform exploratory analyses, and ensure data quality, observability, and maintainability while influencing data engineering strategy.

Lead design, build, and maintain scalable batch and streaming data pipelines and data warehouse models. Ensure data quality, observability, performance, and security. Own workstreams, support production incidents, and enable analysts and downstream applications.

Lead architecture, implementation, and optimization of scalable data platforms, ETL/ELT pipelines, and data governance. Ensure security and compliance, mentor junior engineers, drive CI/CD and IaC for data workflows, and collaborate with stakeholders to deliver actionable analytics and reporting.

Design, build, and operate large-scale AWS-based ETL pipelines using Glue/PySpark to ingest, transform, and curate multi-format data into Apache Iceberg tables. Ensure data quality, metadata management, semantic layer creation (Trino/Athena), CloudFormation deployments, documentation, and compliance within a FedRAMP federal agile environment.

Lead design and delivery of a cloud-based data platform: implement CDC/streaming ingestion, modeling, transformations, cross-region DB replication, observability, governance (PII, lineage, access), and enable downstream marts while mentoring engineers and driving IaC/automation-first practices.