Top Data Engineer Jobs in Portland, ME

Build, model, and maintain scalable BigQuery-based data solutions on GCP. Implement performant data models, storage partitioning/clustering, ETL improvements, data validation, and documentation. Collaborate with architects, data scientists, and engineers to deliver governed, high-quality data for reporting and AI initiatives.

Build and maintain governed Silver/Gold data models and semantic assets on Databricks. Translate stakeholder KPIs into testable, reusable transformations, apply enterprise modeling standards, enable domain self-service, ensure data sensitivity and governance, and review domain-contributed models for production readiness.

Lead design and implementation of scalable data pipelines and models for CX analytics. Integrate structured and unstructured sources (DB2, SQL Server, Teradata, Web APIs), enable AI/LLM workflows, define data engineering standards, mentor engineers, and partner with data scientists and BI to deliver reliable analytics and automation.

Build, deploy, and operate production-grade data pipelines and data products for healthcare audiences. Design transformations, data models, and governed views using Python, SQL, Airflow, S3, Snowflake, and EMR. Implement data-quality, monitoring, and privacy-by-design controls for PHI/PII. Partner with product, analytics, and platform teams to onboard sources, support audience discovery, segmentation, activation, measurement, and troubleshoot production issues.

As the founding engineer of the Data Intelligence team, you will design semantic layers, develop AI tooling, and automate data processes to drive business insights.

Build and maintain scalable, governed data pipelines from ingestion through transformation and integration. Implement schema validation, data quality checks, job monitoring, and production-grade APIs. Work with Python, SQL, Airflow, dbt, AWS (EMR, Athena, S3), Iceberg/Parquet, and contribute to CI/CD, observability, and on-call support while collaborating with analytics and product teams.

Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.

Lead architecture, systems, and roadmap for Coinbase's Compliance Reporting Data Platform. Design and build production-grade data models, pipelines, quality frameworks, validations, and certification processes. Establish data contracts, monitoring, reconciliation, and audit-ready processes. Partner with engineering and compliance stakeholders, respond to regulatory exams, and mentor engineers while shaping standards and documentation.

The Data Engineer will design and maintain data pipelines, enhance the data warehouse, support machine learning applications, and collaborate with various teams to leverage data effectively.

As a Data Engineer, you will build and maintain data pipelines, convert data into metrics, and operate the platform on AWS. Responsibilities include writing production code, processing data from APIs, and enhancing the orchestration layer using Dagster, while ensuring compliance in a HIPAA-regulated environment.

As a Data Engineer, you will build and maintain data pipelines, ensure data quality, support ML workflows, and optimize query performance using various technologies.

Build and maintain scalable data pipelines and integrations using Databricks and Azure. Transform and model large structured and unstructured datasets to support reporting, analytics, and operational needs. Implement data quality, monitoring, and governance; troubleshoot pipeline performance; collaborate with stakeholders and mentor junior engineers.

The Data Engineer is responsible for designing data workflows and pipelines, implementing systems engineering principles, and deploying data streaming technologies while ensuring compliance with industry regulations and best practices.

Forward-deployed senior data engineer who deploys, hardens, integrates, and operates a data platform (lakehouse, streaming, governance) in DoD environments. Build pipelines across classification boundaries, produce accreditation evidence (STIG/cATO/FIPS), run day-2 operations, train mission teams, and mentor junior FDEs while feeding field feedback into product improvements.

The Forward Deployed Data Engineer will manage AI-automated data platform migration projects, ensuring timely delivery and communication with clients while utilizing proprietary tools.

The Data Engineer I at Storable supports the design and maintenance of data pipelines, works with ETL processes, optimizes workflows, and collaborates with various teams to enhance data accessibility and reliability.

Design, build, and maintain scalable batch and near-real-time data pipelines and data products using Databricks and Spark. Integrate internal/external sources, implement data models, ensure data quality, support BI (Sisense), CI/CD, and collaborate with analysts, scientists, and stakeholders to enable analytics and decision-making.

Own product telemetry, maintain dbt models in Snowflake, support self-service reporting and NLP queries, drive product insights from user and retention data, and monitor Airbyte syncs to ensure data quality.

Design, develop, and implement ETL/BI and metadata/cataloging solutions. Lead data governance and data quality programs, build metadata catalogs, profile and remediate data issues, collaborate with stakeholders to define business rules and metrics, and support data stewardship and governance activities.

Design, build, and operate large-scale data platforms and Spark/PySpark pipelines. Enable data integration, modeling, quality, and observability. Build MCP servers and AI-augmented tooling, mentor engineers, and lead cross-functional projects to deliver reliable data products.

Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.

Build and maintain cloud cost monitoring, alerting, and optimization tooling. Develop automation, cost allocation/tagging, data pipelines, dashboards, and integrations with billing APIs. Support FinOps processes, implement cost guardrails, troubleshoot cost systems, participate in on-call rotation, and collaborate with senior engineers and product teams to drive cost-efficient infrastructure and reporting.

Design, build, and maintain scalable ETL and data pipelines on AWS using Python/PySpark. Develop Glue/Lambda/Step Function workflows, event-driven integrations, and data lake/warehouse solutions. Tune SQL, implement monitoring/validation, support API/JSON integrations, troubleshoot operations, document and automate deployments, and mentor junior engineers.

Support building and maintaining ETL pipelines using Python and PySpark. Work with AWS services (Glue, Lambda, Step Functions, S3, Redshift, RDS, EMR) to ingest, transform, and validate data. Write complex SQL, implement basic monitoring/logging, process API/JSON payloads, and collaborate with engineers, analysts, and stakeholders on deployment and documentation.

Design and implement scalable data pipelines and orchestration on GCP to support AI/ML-driven mail intelligence. Build stream and batch processing, ensure data governance and quality, optimize workflows, create visualizations, and collaborate with US cross-functional teams to align technical strategy and recover from failures.