Top Senior Data Engineer Jobs in Portland, ME

Design and build a durable data storage platform that preserves source disagreements, provenance, uncertainty, historical versions, and evidence. Develop result and evidence stores, lineage tracking, versioned rules and configurations, reproducible decision records, and point-in-time entity views. Collaborate with entity-resolution and machine-learning teams to support probabilistic outputs. The role requires production data engineering experience, strong Python and SQL, PostgreSQL expertise, U.S. citizenship, and an active Secret clearance.

Designs and implements scalable software solutions, develops maintainable features, resolves bugs, optimizes performance, and writes automated tests. Participates in architecture discussions, code reviews, Agile planning, CI/CD, observability, and adoption of AI-assisted engineering tools. Collaborates with QA, Product Management, and DevOps to deliver software across web, desktop, cloud, and IoT environments. The role is remote for candidates in the Seattle or Los Angeles metropolitan areas, with quarterly travel to Los Angeles.

Own and evolve end-to-end data pipeline architecture across ingestion, transformation, modeling, and serving. Lead platform improvements for cost efficiency, reliability, access control, observability, orchestration, CI/CD, and developer experience. Drive complex cross-team initiatives, resolve production issues, influence architectural decisions, mentor engineers, and build automation incorporating AI into data engineering workflows.

Leads architecture and hands-on development of scalable data pipelines, governed data models, semantic layers, analytics products, and AI workflows. Writes production SQL and Python, establishes engineering standards, mentors engineers, and drives design reviews. Builds agentic and LLM solutions using retrieval and managed AI services while ensuring data quality, observability, reliability, privacy, and regulatory compliance for PHI and genomic data. Partners with stakeholders, platform teams, and governance forums to deliver trustworthy business solutions.

Designs and develops complex cloud-native data solutions, scalable batch and real-time pipelines, APIs, data models, and enterprise data platforms. Implements data governance, quality, lineage, security, observability, CI/CD, automated testing, and operational reporting capabilities. Collaborates with architects, product owners, analysts, governance, security, and platform teams on technology strategy and cloud modernization. Mentors engineers, leads technical design discussions, presents recommendations, and supports AI-ready data products and emerging development tools.

Designs and maintains scalable data pipelines, warehouse models, and analytics solutions. Builds natural-language data interfaces using GenAI and LLM techniques, optimizes SQL, improves data quality and observability, and supports distributed data platforms on AWS or GCP. Partners with engineering, analytics, business, and product teams, contributes to shared codebases, establishes development standards, and participates in production on-call and incident response.

Build and maintain data lakes, data warehouses, and modern data pipelines for a multi-tenant SaaS platform. Design end-to-end data processes, write pipeline and infrastructure code, conduct design reviews, optimize performance, monitor systems, support data governance, and troubleshoot scalability and security issues. Collaborate with technical and business stakeholders, mentor junior engineers, evaluate technologies, document platform architecture, automate testing, and participate in on-call rotation.

Own the architecture, roadmap, and operation of Clarium’s AWS-based data platform. Build reliable batch and near-real-time pipelines, model healthcare supply chain data, optimize Postgres and Snowflake performance, and establish standards for testing, deployment, quality, and governance. Partner cross-functionally to create durable data models, lead multi-quarter initiatives, manage sensitive data controls, and mentor engineers.

Leads and mentors the Data Engineering team while remaining hands-on in designing, building, and maintaining scalable data pipelines, warehouses, integrations, and infrastructure. Establishes architecture, reliability, quality, and performance standards; guides technical delivery; and resolves complex issues. Partners with Finance and business stakeholders to translate data needs into practical solutions, sets technical direction, evaluates technologies, and communicates strategy, risks, and recommendations to leadership.

Build and operate core data infrastructure for edge and hybrid environments, including ingestion, OT/IoT integrations, real-time streaming, data contracts, schemas, validation, lineage, observability, telemetry, and scalable query access. The role requires production ownership, reliability practices, customer integration, and collaboration across engineering and customer-facing teams. Candidates should have 6+ years of experience with production data, streaming, or integration systems and proficiency in Python and/or Go.

Design and build PerfectServe’s unified cloud data platform, including ingestion pipelines, integrations, data models, metrics, and consumer-facing data layers. Establish architecture, engineering, quality, and testing standards; enable safe extraction from production systems; partner with data users; and mentor data engineers. The role requires substantial cloud data platform experience, deep SQL, warehouse expertise, ELT, change-data-capture, AWS, modeling, orchestration, and data quality skills.

Build and manage scalable ETL/ELT pipelines using Microsoft Fabric and Azure Databricks, implement medallion architecture, support data migrations and legacy SSRS decommissioning, develop Power BI data models, and maintain governance, security, and CI/CD practices. The role also supports migration events and modernizes data infrastructure for advanced analytics and reporting.

Designs and maintains scalable cloud data architectures, pipelines, ETL processes, data warehouses, databases, and data models. Ensures data quality, accuracy, security, availability, and consistency across sources. Develops SQL queries for analytics and reporting, and documents pipelines, schemas, architectures, and models. The role requires expertise with Python, Java, Scala, R, SQL, relational and NoSQL databases, cloud platforms, and Snowflake.

Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.

Designs and manages scalable data pipelines, contracts, transformation layers, and analytics models. The role focuses on data governance, observability, lineage, configuration validation, and collaboration with product engineering teams. It requires processing large datasets, integrating cloud and on-premises industrial technologies, and implementing streaming and message-queuing solutions, ideally in cybersecurity or industrial environments.

Designs and maintains scalable data architecture, warehouses, ETL/ELT pipelines, and data platforms. Responsibilities include ensuring data quality, integrity, governance, accessibility, reliability, and performance; supporting customer onboarding and analytics tools; contributing to architecture and engineering best practices; troubleshooting complex data issues; and participating in on-call rotations. The role collaborates with engineering, product, solutions, business intelligence, and other cross-functional teams in healthcare and social care data environments.

Designs, analyzes, documents, integrates, and migrates complex environmental datasets for AirHub business lines. Responsibilities include analyzing legacy databases, creating logical and physical data models, documenting mappings and business rules, developing migration specifications and API integrations, supporting data governance and testing, and producing technical documentation. The role also requires close collaboration with business stakeholders in an Agile delivery environment.

Develops scalable data models, Databricks pipelines, backend applications, ETL processes, and data ingestion systems. Partners with engineering, product, and business stakeholders on technical roadmaps; monitors and optimizes data systems for performance, reliability, and scalability. Provides technical leadership, mentors junior engineers, conducts code reviews, and builds secure solutions for sensitive healthcare data.

Build and operate scalable cloud data pipelines, warehouses, transformation layers, and ML production systems. Lead data infrastructure architecture, warehouse performance optimization, DataOps monitoring, CI/CD improvements, data quality testing, and large-scale data product delivery. Collaborate across teams, promote data stewardship, and support batch and streaming pipelines while deploying, serving, and monitoring machine learning models.

Own the architecture and technical direction of Northbeam’s data ingestion and integration platform. Design scalable API-based ETL, event-driven and batch processing systems; establish standards for observability, freshness, and failure handling; and guide build-versus-buy decisions. Collaborate across engineering, infrastructure, product, and business teams while mentoring engineers, leading design reviews, and driving complex platform initiatives to completion.

As the founding engineer of the Data Intelligence team, you will design semantic layers, develop AI tooling, and automate data processes to drive business insights.

Own and evolve the data infrastructure powering identity and fraud products. Build and operate scalable ETL/ELT pipelines, ensure data quality and observability, optimize storage and access, support product squads, respond to production incidents, mentor engineers, and drive data platform innovation.

Designs and maintains healthcare data pipelines, ETL workflows, databases, data models, and analytical frameworks. Analyzes claims and payer data to identify trends and insights, while ensuring data quality and integrity. Creates reports, dashboards, and visualizations for nontechnical stakeholders and collaborates with healthcare policy experts, analysts, and other stakeholders to translate requirements into data solutions. The role also improves data infrastructure and analytics capabilities.

Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.

Build and maintain modern data-centric applications, pipelines, transformations, enrichment processes, provisioning layers, and user interfaces supporting clinical and operational healthcare processes. Analyze clinical data and report trends using cloud, big data, data science, and modern software development practices. Collaborate with Product, Platform, and Architecture teams, mentor Data Engineers, document solutions, manage source control, and research emerging technologies.