Top Senior Data Engineer Jobs in Portland, ME

Build and operate scalable batch, streaming, and event-driven data pipelines, cloud data platforms, trusted data products, and analytical models. Improve data quality, observability, reliability, performance, and cost efficiency while supporting risk, finance, product, analytics, and AI initiatives. Partner cross-functionally, influence architecture, lead complex technical initiatives, mentor engineers, and establish strong engineering practices including testing, CI/CD, governance, and infrastructure automation.

Lead data engineering strategy and develop enterprise data lake solutions on AWS. Build data pipelines using AWS data integration, engineering, and analytics resources, develop API services with FastAPI or Flask, optimize engineering practices, create long-term data plans, and represent the team in executive meetings.

Build and maintain dbt and semantic data models in Snowflake, develop ingestion and transformation pipelines, define trusted product metrics, and improve data collection. Partner with Product and Engineering to support experimentation and feature analysis. Establish data quality testing, documentation, HIPAA-aware access controls, and compliance practices. Use and validate AI-generated code and Snowflake Cortex outputs while raising technical standards across the team.

Develop and optimize enterprise Oracle SQL and PL/SQL solutions, including data models, database designs, APIs, ETL processes, batch jobs, and performance tuning. Collaborate with cross-functional teams to translate requirements into scalable implementations, support testing and CI/CD, troubleshoot production issues, and document solutions. Provide technical leadership, mentor engineers, participate in architecture and code reviews, and drive engineering best practices across data modernization initiatives.

Design, build, and operate scalable ETL/ELT pipelines and backend data services using Go. Integrate relational, NoSQL, blockchain, API, web, and social data sources; develop NLP pipelines for text extraction and classification; and support production APIs, dashboards, alerts, and intelligence systems. Collaborate with engineering, data science, and investigations teams on architecture, data quality, lineage, validation, monitoring, and client-facing products.

Design, build, and maintain scalable batch and streaming data pipelines using Python, SQL, Kafka, and GCP. Develop REST and GraphQL data services, CI/CD automation, observability, and data-quality frameworks. Integrate ML and NLP models into production workflows, including continuous retraining and real-time inference. Support structured and unstructured healthcare datasets, distributed systems, microservices, and reliable data infrastructure while collaborating with data science and MLOps teams.

Architect, build, and operate scalable data platforms processing billions of daily events through real-time and batch pipelines. Own production reliability, data quality, security, observability, and performance while partnering with engineering, analytics, data science, growth, and business teams. Develop frameworks and datasets, make architectural decisions, evaluate technologies, mentor engineers, and help define the platform roadmap.

Design and lead scalable, secure, highly available database infrastructure for multi-terabyte SQL Server environments. Set technical direction for data architecture, performance, real-time pipelines, security, and growth. Troubleshoot complex production issues, optimize queries and indexes, guide cross-functional projects, mentor engineers, review changes, reduce technical debt, and evaluate emerging technologies. Monitor database health using Splunk, Datadog, and Grafana while influencing engineering and Site Reliability strategy.

Build and operate a large-scale enterprise data platform spanning batch and streaming processing, lakehouse storage, Kafka infrastructure, APIs, observability, and agentic MCP interfaces. Develop reusable ingestion and data-quality frameworks, improve scalability and resilience, establish engineering practices, support production operations, and mentor engineers. The role requires deep ownership of distributed data infrastructure and practical use of AI coding agents.

Design and operate production-grade data pipelines, backend services, APIs, and agentic AI workflows. Build scalable systems that ingest, transform, and operationalize data for customer-facing and internal applications. Translate ambiguous operational workflows into reliable architectures, improve service observability and performance, and own technical decisions across data modeling, system design, security, and compliance.

Build scalable, secure data pipelines, models, platforms, and governance systems that enable AI applications to access trusted enterprise data. Partner with analytics, marketing, and product teams to translate requirements into technical solutions, independently deliver projects through production, and support sensitive-data security and access controls. Preferred experience includes LLM architectures, cloud data platforms, infrastructure as code, regulated environments, and technical leadership.

Provides hands-on technical leadership for foundational data engineering and analytics engineering. Owns multi-year data architecture, production pipelines, dimensional models, and trusted metrics spanning cloud costs, traffic, infrastructure, and AI usage. Designs new datasets integrating cost, utilization, performance, and reliability signals; establishes standards, coaches engineers, aligns stakeholders, and drives adoption across Infrastructure, Finance, Data Science, and Product Engineering.

Own and evolve production data systems supporting healthcare, claims, billing, analytics, and reporting. Design resilient ingestion patterns, data contracts, models, schemas, and pipelines that handle incomplete, duplicated, delayed, and changing data. Improve performance, observability, failure handling, retries, backfills, and replay safety. Collaborate with engineering, product, operations, and analytics teams while making architecture decisions and documenting technical changes.

Lead data engineering and machine learning initiatives by designing, architecting, developing, and supporting GCP data pipelines. Create information architecture documentation, estimate and plan technical work, collaborate with project teams and business analysts, and translate requirements into technical designs. Develop Python-based ELT pipelines, optimize BigQuery SQL, support CI/CD, and provide technical leadership to projects and teams.

Leads the architecture, development, and support of enterprise data warehouses, lakehouses, dimensional models, ETL/ELT pipelines, and governed data products using Microsoft Fabric and related tools. Ensures data quality, security, scalability, performance, and reliability for analytics and reporting. Partners with technical and business stakeholders, documents data solutions, guides architecture decisions, mentors team members, and drives continuous improvement of data engineering standards and practices.

Designs and maintains scalable ETL pipelines, data models, integrations, cloud databases, and healthcare data infrastructure. Ensures security, HIPAA/HITRUST compliance, reliability, monitoring, and documentation while collaborating with product, engineering, and clinical teams. Requires strong SQL and Python expertise, modern data warehousing and orchestration experience, cloud platform knowledge, and familiarity with healthcare interoperability and claims data.

Lead Data Engineer responsible for designing, maintaining, and improving data pipelines and platform infrastructure across ingestion, streaming, transformation, and delivery. The role uses Airflow, Spark, Iceberg, Kafka, Flink, dbt, Terraform, and GCP. Responsibilities also include defining data contracts, documenting systems, optimizing performance, reviewing code, supporting access controls and compliance, and collaborating with stakeholders and teammates.

Leads data engineering teams in designing, developing, and supporting scalable batch and streaming data solutions. Responsibilities include data pipeline development, architecture, governance, security, platform optimization, production support, technical mentorship, stakeholder collaboration, and delivery leadership. The role requires hands-on engineering with Python or similar languages, modern data technologies, cloud platforms, DevOps practices, and people-management responsibilities.

Designs and maintains ELT pipelines, warehouse integrations, data models, and data quality processes. Collaborates with data scientists, analysts, engineers, and stakeholders to deliver scalable analytical solutions. Responsibilities include data integration, governance, security, performance optimization, exploratory analysis, visualization, and cloud-based API ingestion. Requires strong SQL, DBT, Snowflake, Azure Data Factory, cloud, and scripting experience, plus leadership and communication skills.

Develops scalable data and software systems using Python and Apache Spark. Designs APIs, data models, ETL workflows, orchestration, and data interactions while optimizing performance, scalability, integrity, and security. Builds user interfaces, contributes to automated testing, applies Agile practices, and supports CI/CD delivery. The role requires strong software engineering, distributed computing, analytical, and communication skills, with AWS, R, Databricks, and SAS experience preferred.

Lead production of federal species range maps for marine and anadromous taxa. Aggregate, normalize, transform, and validate spatial data; analyze habitat intersects; coordinate iterative reviews with FWS and NOAA SMEs; prepare QA documentation; and secure government sign-off for map deliverables.

Build and operate reliable ETL and ELT pipelines across lakehouse and transactional systems. Develop data models, enforce governance, integrate diverse data sources, and support analytics, APIs, and predictive tools. Monitor performance, data quality, lineage, cost, and uptime while collaborating with data science, AI, product, and innovation teams.

Build and maintain automated ETL/ELT data pipelines, improve data quality and monitoring, optimize Postgres and BigQuery schemas and queries, develop internal tooling, support data governance (HIPAA), participate in on-call rotation, and collaborate across engineering teams to scale data systems.

Designs, builds, and maintains enterprise data pipelines, ETL processes, integrations, cloud data infrastructure, and complex data models. Supports analytics partners, develops data warehouse solutions, tunes SQL and database performance, troubleshoots production issues, and delivers end-to-end data engineering projects. The role collaborates with architects, analysts, developers, and business stakeholders, applies big data technologies, supports agile delivery, and mentors team members.

Design and build a durable data storage platform that preserves source disagreements, provenance, uncertainty, historical versions, and evidence. Develop result and evidence stores, lineage tracking, versioned rules and configurations, reproducible decision records, and point-in-time entity views. Collaborate with entity-resolution and machine-learning teams to support probabilistic outputs. The role requires production data engineering experience, strong Python and SQL, PostgreSQL expertise, U.S. citizenship, and an active Secret clearance.