Top Senior Data Engineer Jobs in Portland, ME

Design, build, and operate scalable PostgreSQL databases and cloud-native data infrastructure. Build and maintain ETL/ELT pipelines, optimize query and server performance, ensure high availability and disaster recovery, improve observability, troubleshoot production issues, guide schema and application design, evaluate database technologies, and mentor junior engineers to support reliable, secure data-driven applications.

Own the go-to-market data infrastructure, integrating HubSpot, Dreamdata, advertising platforms, PostHog, and website data into BigQuery. Diagnose tracking and attribution discrepancies, configure multi-touch revenue attribution, and build executive dashboards covering channel performance and revenue. Develop ABM workflows using Clay, enrichment, behavioral signals, and AI personalization. Partner with sales and marketing to improve funnel visibility, campaign decisions, and outbound effectiveness.

Designs, develops, and maintains Databricks-based ETL pipelines, data lake architectures, datasets, and data quality processes supporting reporting, analytics, and AI/ML workloads. Maintains and migrates legacy SSIS and SQL Server systems, optimizes pipeline performance, and supports complex SSRS reporting. Collaborates with business users, analysts, and IT teams to define data requirements, troubleshoot issues, document solutions, and advance AI-assisted engineering practices.

Designs, develops, and maintains Databricks ETL pipelines, data lake architectures, datasets, and data integrations supporting reporting, analytics, and AI/ML workloads. Troubleshoots and optimizes Databricks and SSIS processes, maintains legacy systems, implements data quality controls, and supports data warehousing. Maintains SSRS reports and collaborates with business users, analysts, and IT teams to deliver reporting solutions. Documents work, communicates technical information, and contributes to AI-assisted development practices.

Build scalable data pipelines, ELT processes, infrastructure, and dimensional data models supporting internal analytics and customer-facing data products. Implement data quality monitoring, auditing, alerting, warehouse optimization, and governed semantic layers for AI and LLM-enabled analytics. Partner with technical and business stakeholders, improve data processes using AI, and deliver reliable metrics from diverse data sources.

Design, build, and optimize enterprise ETL/ELT pipelines, cloud data lakes, lakehouse solutions, data models, and semantic layers across AWS and Azure. Ensure data quality, security, performance, reliability, and governance while supporting analytics, reporting, and AI initiatives. Collaborate with product, engineering, IT, and business stakeholders to translate requirements into scalable data solutions, monitor pipeline health, troubleshoot issues, and improve data architecture and practices.

Lead data engineering and machine learning initiatives by designing, architecting, developing, and supporting GCP data pipelines. Create information architecture documentation, estimate and plan technical work, collaborate with project teams and business analysts, and translate requirements into technical designs. Develop Python-based ELT pipelines, optimize BigQuery SQL, support CI/CD, and provide technical leadership to projects and teams.

Design, build, deploy, and operationalize scalable data engineering solutions for customers. Responsibilities include developing pipelines, transforming and cleansing data, analyzing sources, implementing governance, security, and quality practices, testing data movement and transformation code, resolving defects and incidents, and advising customers on technical decisions. The role also supports AI, machine learning, business intelligence, and data product adoption while collaborating across teams and educating end users.

Designs and develops enterprise cloud data solutions, including batch, near-real-time, and API-based pipelines. Builds data models, warehouses, lakes, and lakehouses while implementing governance, quality, lineage, and curation practices. Supports CI/CD, testing, monitoring, observability, security, and compliance. Collaborates with architects, product owners, analysts, and leadership on platform strategy and modernization. Mentors engineers, leads reviews, presents technical topics, and explores AI-enabled data capabilities.

Build and own the data platform backbone: design ingestion patterns, Snowflake warehouses, governance, and freshness strategy. Implement reliable batch and streaming pipelines, data quality, observability, and onboarding processes. Lead legacy migrations, create data contracts and SLAs, and apply AI-native tooling to automate debugging, documentation, and operational workflows while partnering with Analytics, Engineering, and vendors.

Lead design and ownership of a modern data platform: ingestion, Snowflake governance, pipeline reliability, migrations, data contracts, observability, and AI-enabled tooling. Partner with Analytics, Engineering, and vendors to deliver trustworthy data products and operate production pipelines.

Design and build Snowflake transformation layer and migrate legacy SQL to versioned dbt models. Define conformed dimensions/facts using Kimball principles, set modeling and CI/CD standards, implement data quality/lineage, support BI migration and AI/ML readiness, and mentor future hires. Hands-on work in dbt, SQL, and Python with stakeholder collaboration and governance for financial and operational data.

Own and optimize data infrastructure and ETL/ELT pipelines using SSIS and Microsoft Fabric. Build and maintain SQL Server data warehouse staging, transformations, and lakehouse ingestion. Implement CI/CD, version control with GitHub, monitor pipeline health, troubleshoot data issues, document data flows, and translate stakeholder requirements into data engineering solutions that support BI reporting.

Design, build, and maintain scalable data pipelines and tenant-aware APIs to ingest and transform data from varied sources. Work with event-driven and batch architectures, implement authentication and integration patterns, ensure observability/monitoring, optimize data flows for cost and performance, and collaborate with product, infrastructure, and engineering teams to onboard and maintain data sources at scale.

Responsible for designing, developing, and maintaining scalable data pipelines and infrastructure, implementing data governance, and collaborating with teams to meet data needs.

Lead design and scaling of ELT pipelines and analytics schemas on Snowflake. Build Looker views, CI/CD automation, and orchestration workflows (Prefect/Airflow). Ensure production reliability with monitoring (Datadog, Monte Carlo), partner with cross-functional teams, and provide technical leadership including code reviews, testing, and end-to-end ownership of data integrity and platform trustworthiness.

Leads data engineering strategy, architecture, delivery, support, and lifecycle management for secure, scalable cloud and hosted data solutions. Collaborates with technical and business stakeholders to deliver complex datasets, establish enterprise data standards, manage data engineering teams, and oversee maintenance, change management, capacity planning, business continuity, disaster recovery, and regulatory security requirements. The role also evaluates third-party tools and supports Azure DevOps, SDLC, CI/CD, and technical innovation.

The Senior Data Engineer will develop data engineering solutions, manage ETL workflows, and establish a new data practice while collaborating with stakeholders.

The Lead Data Platform Engineer will design and build Virtuous's data platform, ensuring it is secure, scalable, and AI-ready. Responsibilities include architecting access controls, optimizing performance, and enabling self-service analytics while maintaining governance and compliance standards.

Design, build, and maintain scalable ETL/ELT data pipelines and analytical platforms on AWS and Databricks. Migrate legacy workflows to cloud-native services, implement data lake and catalog solutions, enable AI/RAG/vector search, ensure FedRAMP/NIST compliance, optimize performance, and mentor junior engineers while collaborating in Agile teams.

Lead Data Engineer responsible for defining architecture, engineering standards, and best practices for the enterprise data platform, collaborating with distributed teams for modernization and scalability.

Designs and delivers a global analytics platform supporting reporting, visualizations, self-service analytics, and embedded data products. Responsibilities include data collection and processing, semantic modeling, warehouse and pipeline development, query optimization, governance, analytics enablement, and stakeholder collaboration. The role provides actionable insights from complex travel data and builds integrated analytics applications using cloud platforms and business intelligence tools.

Designs and maintains Snowflake-based cloud data pipelines and lake architectures for asset-based finance and mortgage servicing analytics. Leads legacy-system migrations, ETL/ELT development, data validation, reconciliation, and financial integrity controls. Translates business requirements into Jira epics and user stories, supports project planning, testing, cutover, and go-live readiness, and coordinates with business, finance, operations, and technical stakeholders.

Design and scale Zip’s enterprise data and AI platform across batch, streaming, structured, and unstructured workloads. Build reliable pipelines, AI-ready data products, semantic models, vector and hybrid search, and RAG capabilities. Establish standards for modeling, testing, governance, security, observability, and automation. Partner with engineering, data science, product, and business teams while mentoring engineers and influencing platform architecture.

Design and build modern GCP lakehouse architectures, including Python and Spark pipelines, BigQuery ingestion, Kafka CDC, Delta Lake and Iceberg UniForm integrations, Delta Sharing endpoints, Snowflake and Databricks connectivity, data lineage, governed access controls, and semantic-layer alignment. Collaborate cross-functionally, troubleshoot full-stack issues, and deliver reusable data-sharing adapters and end-to-end data features.