Top Senior Data Engineer Jobs in Portland, ME

Lead design and ownership of a modern data platform: ingestion, Snowflake governance, pipeline reliability, migrations, data contracts, observability, and AI-enabled tooling. Partner with Analytics, Engineering, and vendors to deliver trustworthy data products and operate production pipelines.

Own and operate Databricks production pipelines for Sugar Predict: monitor, alert, incident response, SLA reporting, performance and cost optimizations, migrate legacy ETL, onboard tenants, enforce Delta Lake architecture and multi-tenant isolation, apply security and governance, enable observability, maintain runbooks, and support CI/CD and on-call rotations.

Own day-to-day Snowflake administration and the Sigma semantic layer; manage ingestion (Fivetran), dbt modeling scope, reverse-ETL to Salesforce/HubSpot/NetSuite, data quality SLAs, reporting and dashboards, partner with managed data vendors, design automation and reproducible month-end financial analytics, and drive analysis and experiments for AdOps, Sales, and Finance.

Own and operate the Snowflake warehouse and Sigma semantic layer; manage ingestion (Fivetran), dbt model scoping and review, reverse-ETL, data quality SLAs, dashboards, month-end financial analytics, vendor management, and automation to support AdOps, Sales, Finance, and executive reporting.

Design, build, and maintain scalable ETL/ELT data pipelines and data platform architecture. Build programmatic pipelines (primarily Python), optimize analytical data models (SQL), integrate sources into Snowflake, use orchestration/transformation tools (dbt, Airflow, Dagster), improve data quality/observability, and partner with product, engineering, and analytics to deliver reliable data for decision-making.

Own and scale Provable's data platform on GCP: build and optimize ingestion pipelines from blockchain indexers, design privacy-aware data models, manage Postgres and BigQuery, develop high-performance data-serving APIs, ensure data quality and observability, and use IaC (Terraform, Helm) and Kubernetes to deploy and cost-optimize environments.

The Senior Data Engineer will design and implement data processing pipelines using Java and Spark, optimize performance, and mentor junior engineers while ensuring compliance with data governance standards.

Founding data engineer to design and build Payabli's data platform: architect lakehouse/warehouse, build batch and streaming pipelines, model canonical datasets, ensure data quality/observability, enforce access/masking/lineage for regulated financial data, and enable analytics/ML feature pipelines while establishing team standards and CI/CD.

The role involves building and optimizing data pipelines, modeling datasets, applying machine learning techniques, and supporting data strategies. Candidates should have experience with Python, data lakes, warehousing, and related technologies.

Design, build, and maintain scalable data pipelines, data models, ETL/ELT, and BI solutions. Collaborate with data scientists and stakeholders to improve data quality, accessibility, and PHI security. Develop and document workflows, optimize processing/storage, support data warehouse and visualization, and adopt AI tools to drive data-informed outcomes.

Design, build, and maintain dbt data models and scalable ELT pipelines; optimize performance-aware SQL on Snowflake; ensure observability, testing, and CI/CD; partner with product and engineering teams to meet analytic needs, mentor engineers, document business logic, and troubleshoot ingestion, transformation, and warehouse issues.

The Senior Data Engineer will construct and optimize data pipelines, work with cross-functional teams, ensure data quality and governance, and mentor junior engineers while leading advanced analytics initiatives.

Design, build, operate, and optimize large-scale data pipelines and foundational data products for Komodo's Healthcare Map. Improve pipeline reliability, observability, and performance; transform claims and EHR datasets; implement data quality, lineage, and monitoring; debug production workflows; collaborate with product and engineering teams; and enable downstream analytics and AI/ML use cases.

Technical lead on the Distribution Center data team building and scaling ETLs and data integrations using PySpark and DBT. Design robust pipelines to process large customer datasets, improve onboarding tooling, mentor engineers, manage contractors, and collaborate cross-functionally to support ML-driven grocery solutions.

Design and build cloud-based data applications and pipelines to analyze clinical data, enrich and provision datasets, and support clinical/operational processes. Mentor junior engineers, drive R&D for repeatable templates, collaborate with Product/Platform/Architecture, and prioritize source control, documentation, and simple solutions using modern data, ETL, and LLM tooling.

Design, build, and operate large-scale data pipelines and ETL processes to normalize varied partner datasets. Lead technical decisions, mentor engineers, implement testing and monitoring, manage data warehouses/lakes, and collaborate cross-functionally to deliver robust data infrastructure that supports ML and product teams.

Design, build, and operate scalable data transformation pipelines and dimensional models using dbt, SQL, and AWS. Implement infrastructure-as-code (AWS CDK), CI/CD, and query performance optimizations while ensuring data quality, governance, and collaboration with cross-functional and offshore teams.

Lead Data Engineer builds and maintains scalable data pipelines and lakehouse/warehouse platforms (Databricks) to support analytics, BI, reporting, and AI. Responsibilities include data modeling, ETL/ELT, medallion architecture, orchestration and monitoring (Airflow/Cron), performance tuning, CDC/incremental loads, data quality, and leading/mentoring a team while collaborating with stakeholders and maintaining documentation.

Design, build, and optimize scalable cloud data pipelines and infrastructure. Maintain and refactor SQL and ETL processes, automate data workflows, ensure data quality/security, and troubleshoot complex issues. Provide technical leadership and mentor junior engineers while collaborating with stakeholders to translate requirements.

Design, implement, and maintain PySpark applications to automate large-scale financial data reconciliations. Build transformation and matching algorithms, integrate with rules engines, analyze data gaps, and collaborate with analysts and architects to ensure data quality and system resilience.

Design, implement, and maintain PySpark-based data reconciliation solutions for financial systems. Build matching algorithms, integrate with rules engines, process large distributed datasets, identify and resolve discrepancies, and collaborate with analysts and architects to improve data quality and governance.

Design, build, and optimize PySpark applications and ETL pipelines to process large-scale datasets from SQL/NoSQL sources, data lakes, and streaming platforms. Ensure data quality, error handling, performance tuning, and collaborate with analysts, scientists, and architects to deliver scalable data solutions.

Design, build, and maintain scalable ETL/ELT pipelines into Snowflake, enforce data quality, optimize data models and query performance for Power BI reporting, produce documentation, and troubleshoot data issues while collaborating with stakeholders.

Design, develop, and maintain PySpark applications and ETL pipelines to process, transform, and integrate large-scale datasets from SQL, NoSQL, data lakes, and streaming sources. Optimize Spark job performance, implement robust error handling, and collaborate with data analysts, scientists, and architects using orchestration tools like Airflow or Luigi.

Design, develop, test, and deploy high-performance Spark/Scala data processing applications and ETL pipelines using the Cloudera Hadoop ecosystem. Optimize Spark and platform performance, ensure data integrity and security, collaborate with data scientists and analysts, troubleshoot issues, and implement version control and CI/CD for Spark applications.