Top Senior Data Engineer Jobs in Portland, ME

Own SQL and dbt-based data modeling and data quality for clinical and claims datasets. Author and refactor dbt models/tests, triage DQ alerts, design monitors, optimize SQL performance, and collaborate with Data Engineering and stakeholders to ensure trusted production datasets.

Design, build, and operate scalable cloud data pipelines and platforms (Azure preferred). Implement DevSecOps, CI/CD, automated testing, monitoring, performance tuning, and production readiness. Mentor engineers, drive operational excellence, and translate requirements into robust technical designs. Apply healthcare domain knowledge and collaborate in agile teams to deliver secure, reliable data products.

The job involves building responsive web dashboards, advanced data visualizations, and analytics tools for unmanned aircraft systems, requiring a deep understanding of UI/UX design and data presentation.

Build, deploy, and operate production-grade data pipelines and data products for healthcare audiences. Design transformations, data models, and governed views using Python, SQL, Airflow, S3, Snowflake, and EMR. Implement data-quality, monitoring, and privacy-by-design controls for PHI/PII. Partner with product, analytics, and platform teams to onboard sources, support audience discovery, segmentation, activation, measurement, and troubleshoot production issues.

As a Data Engineer, you will design and maintain data pipelines, support DoD systems, and ensure data quality and compliance.

Lead architecture and delivery of a cloud-native, petabyte-scale data platform: define technical roadmap, mentor engineers, build ETL/ELT pipelines, enable real-time streaming, implement Iceberg table format, optimize Snowflake/Redshift/Athena compute, and integrate observability with Splunk.

Design, build, and optimize scalable AWS-based data pipelines, data lakes, and warehouses. Migrate legacy systems, enforce data quality/security/governance, implement ETL/ELT and big-data solutions, adopt CI/CD and IaC, collaborate with stakeholders, and provide technical leadership and troubleshooting.

Design, build, and maintain scalable data pipelines, lakes, and infrastructure using Databricks, Spark, Python, and AWS. Collaborate with ML engineers, data scientists, and analysts to deliver data products, ensure data quality and governance, implement DevOps/SDLC practices, mentor junior engineers, and evaluate new data technologies.

Design, build, modernize, and maintain operational and analytical data capabilities for Wealthscape Reporting, Analytics and Insights. Perform solution design, data analysis, ETL development, and production rollouts using Snowflake, AWS, cloud databases, and CI/CD pipelines. Collaborate across teams in a fast-paced financial services environment.

Design, build, and maintain scalable data pipelines on AWS using EMR, Spark, and PySpark. Optimize EMR clusters and Spark jobs, implement ETL/ELT processes, ensure data quality, automate ingestion, and collaborate with data scientists and analysts. Document infrastructure, participate in code reviews, and monitor performance and costs.

Design, build, and maintain ETL/ELT data pipelines and orchestration using Airflow, Python, and PySpark. Develop custom connectors, implement DataOps and CI/CD for data workflows, monitor and troubleshoot pipelines, validate data quality, and document processes while collaborating with cross-functional teams and supporting large-scale distributed data systems.

As the founding engineer of the Data Intelligence team, you will design semantic layers, develop AI tooling, and automate data processes to drive business insights.

Build and maintain production-grade data processing systems and foundational infrastructure for enterprise AI. Collaborate with researchers and engineers, deliver end-to-end implementations, transform unstructured data into performant datasets, and use distributed processing frameworks and modern analytics tooling to inform products and strategy.

Lead design, build, and operate real-time, Flink-based streaming data platforms. Develop low-latency, stateful pipelines, enforce event schemas/contracts, ensure fault tolerance and observability, mentor engineers, and partner with architecture and compliance teams to deliver resilient streaming solutions for banking use cases.

Lead architecture, systems, and roadmap for Coinbase's Compliance Reporting Data Platform. Design and build production-grade data models, pipelines, quality frameworks, validations, and certification processes. Establish data contracts, monitoring, reconciliation, and audit-ready processes. Partner with engineering and compliance stakeholders, respond to regulatory exams, and mentor engineers while shaping standards and documentation.

The Data Engineer is responsible for designing data workflows and pipelines, implementing systems engineering principles, and deploying data streaming technologies while ensuring compliance with industry regulations and best practices.

Forward-deployed senior data engineer who deploys, hardens, integrates, and operates a data platform (lakehouse, streaming, governance) in DoD environments. Build pipelines across classification boundaries, produce accreditation evidence (STIG/cATO/FIPS), run day-2 operations, train mission teams, and mentor junior FDEs while feeding field feedback into product improvements.

Design, build, and maintain scalable ETL and data pipelines on AWS using Python/PySpark. Develop Glue/Lambda/Step Function workflows, event-driven integrations, and data lake/warehouse solutions. Tune SQL, implement monitoring/validation, support API/JSON integrations, troubleshoot operations, document and automate deployments, and mentor junior engineers.

Design and implement scalable data pipelines and orchestration on GCP to support AI/ML-driven mail intelligence. Build stream and batch processing, ensure data governance and quality, optimize workflows, create visualizations, and collaborate with US cross-functional teams to align technical strategy and recover from failures.

Design, develop, maintain, and optimize ADABAS database structures and data solutions. Support mainframe data processing (Natural, COBOL, JCL), perform migrations to modern platforms, tune performance, ensure data integrity/security, troubleshoot issues, and collaborate with developers, architects, and analysts on modernization, API/cloud integration, and data warehousing initiatives.

Owner of data platform modernization: design and migrate legacy systems to Kimball-style dimensional models and star schemas; build reliable production data pipelines; enforce data hygiene and validation; champion dbt best practices; mentor junior engineers; collaborate with analysts and stakeholders to ensure scalable, well-documented data models and platform observability.

Analyze large and diverse datasets to uncover insights, develop/train/deploy machine learning models, design data preprocessing pipelines, and create visualizations and reports. Collaborate with cross-functional teams to build predictive models, recommendation systems, and optimization algorithms to drive business improvements.

Design, build, and operate scalable PostgreSQL databases and cloud-native data infrastructure. Build and maintain ETL/ELT pipelines, optimize query and server performance, ensure high availability and disaster recovery, improve observability, troubleshoot production issues, guide schema and application design, evaluate database technologies, and mentor junior engineers to support reliable, secure data-driven applications.

Lead design and scaling of the data platform and analytics pipelines. Build and maintain ETL/ELT workflows, integrations, serverless data services, and reliable data models. Mentor teammates, improve automation, observability, and data governance to support analytics and operational insights.

Design, build, and maintain ingestion and transformation pipelines for a knowledge-graph analytics platform. Profile and prepare structured and semi-structured source data, ensure data lineage and traceability, implement transformation logic for graph loading, collaborate with data scientists on graph modeling and entity resolution, improve pipeline reliability, and document ingestion patterns using version control and issue tracking.