Top Data Engineer Jobs in Portland, ME

Build and operate large-scale audio data pipelines for AI model training. Responsibilities include discovering data sources, developing reliable data acquisition and processing systems, optimizing quality, throughput, and cost, and collaborating with AI scientists. The role requires ownership of engineering projects from discovery through continuous improvement, with emphasis on backend development, production systems, and scalable data processing.

Build and operate large-scale audio data pipelines for AI model training. Responsibilities include discovering data sources, processing petabyte-scale datasets, optimizing quality, throughput, and cost, collaborating with AI scientists, and owning engineering projects from discovery through continuous improvement.

Build and operate large-scale data pipelines that collect, process, and optimize audio datasets for AI model training. The role involves discovering data sources, improving data quality, throughput, and cost efficiency, collaborating with AI scientists, and owning engineering projects from discovery through continuous improvement.

Designs and maintains secure, reliable data platforms, including relational data models, migrations, pipelines, monitoring, data quality processes, and self-service reporting access. The role protects PHI and PII through access controls, encryption, audit logging, and governance in a HIPAA environment. It also involves backend API development, code reviews, security reviews, stakeholder collaboration, and mentoring teams on data practices.

Own Moxie’s end-to-end data infrastructure, including pipelines, Snowflake warehousing, dbt and Omni modeling, orchestration, observability, and documentation. Partner with Engineering and Finance on schema changes, accounting logic, metrics, and business-critical reporting. Deliver financial or historical EMR data models, establish SOPs and reliability KPIs, optimize performance and cost, and help advance Practice Intelligence toward predictive and prescriptive products with appropriate AI safeguards.

Leads the architecture and evolution of scalable data platforms, pipelines, and data products across multiple teams. Designs Snowflake and cloud-based solutions for batch, streaming, CDC, ingestion, transformation, orchestration, and data delivery. Establishes engineering standards, governance, observability, testing, CI/CD, and reliability practices; mentors engineers; guides architecture and roadmap decisions; resolves complex incidents; and evaluates AI, automation, and MCP-enabled data capabilities.

Design and build cloud-agnostic Databricks Lakehouse architectures, scalable ETL/ELT pipelines, and production AI data workflows. Optimize Apache Spark performance, integrate MLflow for model deployment, and implement CI/CD and Infrastructure-as-Code using Terraform or Databricks CLI. Enforce governance, security, and compliance standards through Unity Catalog and cloud platforms. Collaborate with architects, scientists, product managers, and client engineering teams to deliver documented, production-ready solutions.

Build and own Snout’s data foundation, including PostgreSQL and dbt warehouses, ingestion pipelines, dimensional models, data quality, documentation, and reliable rebuilds. Reconcile data from veterinary practice-management systems, support LLM/AI tooling, translate stakeholder needs into technical plans, and establish the foundation for a future data team and analyst.

Design, develop, and operate large-scale data ingestion, transformation, enrichment, and processing pipelines across cloud, hybrid, and on-premises environments. Build distributed services using Java, Python, and Kafka; optimize data models and platform performance; deploy applications on Kubernetes; support infrastructure automation and CI/CD; troubleshoot production systems; and collaborate with customers and solution architects on implementations.

Designs, builds, and operates scalable batch and streaming data pipelines on Databricks for federal missions. Responsibilities include developing Spark and Delta Lake solutions, managing clusters and workflows, implementing Unity Catalog governance and security, optimizing ETL/ELT processes, integrating CI/CD, supporting machine learning and advanced analytics, monitoring data quality, and collaborating with technical teams and stakeholders.

Build and maintain production data ingestion pipelines, transformation models, warehouses, and schemas for PerfectServe’s data platform. Deploy reliable, tested pipelines using idempotency and data-quality checks, apply dimensional and medallion modeling, participate in design reviews, and document owned pipelines and runbooks. The role requires SQL, programming experience, dbt or similar transformation tools, cloud data warehouse experience, ELT orchestration, AWS knowledge, and a strong data-testing mindset.

Leads and develops a data engineering team implementing Navigate360 integrations for partner campuses. Oversees integration design, data mapping, validation, reconciliation, quality controls, delivery planning, and scalable implementation processes. Partners with Product, Launch, and Partner Success teams to resolve technical and partner challenges, improve adoption, manage project health, and ensure reliable outcomes. Provides technical mentorship, code and design review, stakeholder communication, and continuous process improvement.

Design, build, and own business-critical data pipelines and infrastructure across warehouses, orchestration, BI, and multiple regions. Develop AWS Glue and Spark jobs, data models, event contracts, observability, and batch or streaming architectures. Collaborate across producer and consumer teams, support Federal workloads, and operate production data platforms in government cloud environments.

Design, build, and scale data pipelines, ETL workflows, analytics infrastructure, and machine-learning data systems. Ensure data quality, security, monitoring, and reliability while optimizing storage and processing performance. Collaborate with engineering, product, and analytics teams on data requirements, modeling, schemas, and scalable infrastructure. The role also establishes data engineering best practices and supports a data-driven culture.

Lead the design and development of Azure-based big data solutions, including batch and real-time ETL/ELT pipelines, data architecture, ingestion, curation, warehousing, and storage. Build solutions using Azure Data Factory, Databricks, Synapse, Spark, Python, SQL, and related Azure services. Support Salesforce migration and integration while applying strong RDBMS, data management, and big data design expertise.

Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.

Lead the architecture and development of Vercel’s next-generation data platform, supporting batch and real-time integrations, analytics, data warehousing, and AI/ML workloads. Design scalable systems using Kafka, ClickHouse, Tinybird, and Snowflake; establish data governance and security standards; guide architectural decisions and roadmaps; collaborate with engineering, product, security, compliance, and leadership teams; write production code; and mentor engineers.

Build and maintain scalable ETL/ELT pipelines, integrate travel and customer data from internal and external systems, develop cloud data warehouse models, implement data quality monitoring, support real-time streaming, and ensure data privacy and regulatory compliance. Collaborate with analysts, data scientists, and product teams to deliver reliable datasets for personalization, forecasting, pricing, route optimization, and customer experience initiatives.

Build and maintain Google Cloud data pipelines and ETL/ELT processes supporting GenAI and RAG solutions. Classify and govern sensitive data using Dataplex and Cloud DLP, enforce access controls, assess AI readiness, and design reusable schemas and data models. Collaborate with engineering, delivery, and client teams to integrate legacy systems, monitor pipeline reliability, conduct data quality testing, document data flows, and proactively identify compliance and delivery risks.

Designs, builds, and maintains scalable ETL and data processing pipelines supporting analytics, forecasting, risk, and customer insights. Leads complex SQL development, data modeling, governance, quality, lineage, security, and compliance. Partners with engineering, finance, sales, compliance, product, analysts, and data scientists to translate requirements into reliable workflows. Evaluates emerging technologies, leads proof-of-concepts, and develops automated solutions using Python, Spark, Databricks, cloud platforms, orchestration tools, and modern data warehouses.

Leads the design, development, optimization, and migration of modern data platforms in Snowflake. Builds pipelines with dbt, Python, and cloud services; gathers client requirements; creates solution designs and project plans; advises on Snowflake performance, cost, security, and workload management; integrates BI, governance, and AI/ML tools; contributes to accelerators and mentors junior engineers. The role is remote, client-facing, consultative, and focused primarily on technical delivery rather than sales.

Build and operate batch and streaming data pipelines, ETL/ELT workflows, data warehouses, dimensional models, and reusable data services. Improve reliability, performance, quality, and cost efficiency through monitoring, testing, automation, and incident response. Partner with analytics, data science, product, business, platform, and infrastructure teams to deliver production data solutions and roadmap initiatives. Apply AI-assisted tools responsibly to development, testing, documentation, and troubleshooting.

Own and operate the Snowflake warehouse and Sigma semantic layer; manage ingestion (Fivetran), dbt model scoping and review, reverse-ETL, data quality SLAs, dashboards, month-end financial analytics, vendor management, and automation to support AdOps, Sales, Finance, and executive reporting.

Build and operate scalable batch, streaming, and event-driven data pipelines, cloud data platforms, trusted data products, and analytical models. Improve data quality, observability, reliability, performance, and cost efficiency while supporting risk, finance, product, analytics, and AI initiatives. Partner cross-functionally, influence architecture, lead complex technical initiatives, mentor engineers, and establish strong engineering practices including testing, CI/CD, governance, and infrastructure automation.

Lead data engineering strategy and develop enterprise data lake solutions on AWS. Build data pipelines using AWS data integration, engineering, and analytics resources, develop API services with FastAPI or Flask, optimize engineering practices, create long-term data plans, and represent the team in executive meetings.