Top Senior Data Engineer Jobs in Portland, OR

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.

Lead design and implementation of enterprise data architecture and cloud-based data solutions. Manage large data engineering projects, develop data models and pipelines, ensure governance and security compliance, advise clients strategically, and build high-performing inclusive teams.

Architects, deploys, and operates large-scale Kafka and Confluent streaming platforms. Responsibilities include cluster sizing, configuration, security, automation, observability, HA/DR, troubleshooting, developer enablement, and production reliability. Partners with application and cross-functional teams, translates requirements into scalable solutions, contributes to code and design reviews, and mentors junior engineers. Requires deep Kafka expertise, DevOps/SRE practices, infrastructure-as-code experience, and strong communication skills.

Build and maintain production-grade batch and streaming data pipelines in Databricks using PySpark and SQL. Develop ingestion frameworks, data models, APIs, data quality checks, monitoring, and Medallion Architecture across bronze, silver, and gold layers. Integrate diverse data sources, optimize Spark workloads, document data lineage and architecture, and collaborate with engineering and federal stakeholders. An active Secret clearance or higher is required.

Leads the design and implementation of scalable data architectures, ETL pipelines, data warehouses, migrations, and cloud data solutions. Provides technical leadership through system analysis, requirements gathering, design documentation, code and architecture reviews, SDLC management, production deployments, and mentoring junior engineers. Develops integrations using multiple programming languages, ETL platforms, cloud services, APIs, and CI/CD tools.

Build and own Snout’s data foundation, including PostgreSQL and dbt warehouses, ingestion pipelines, dimensional models, data quality, documentation, and reliable rebuilds. Reconcile data from veterinary practice-management systems, support LLM/AI tooling, translate stakeholder needs into technical plans, and establish the foundation for a future data team and analyst.

Design, develop, and operate large-scale data ingestion, transformation, enrichment, and processing pipelines across cloud, hybrid, and on-premises environments. Build distributed services using Java, Python, and Kafka; optimize data models and platform performance; deploy applications on Kubernetes; support infrastructure automation and CI/CD; troubleshoot production systems; and collaborate with customers and solution architects on implementations.

Designs, builds, and maintains enterprise data pipelines, ETL processes, integrations, data infrastructure, and complex data models. The role supports analytics partners, develops scalable data warehouse solutions, tunes SQL and databases, troubleshoots production issues, and collaborates with architects, analysts, developers, and stakeholders. Responsibilities include end-to-end project delivery, data modeling, big data engineering, production support, agile planning, and mentoring team members.

Build and operate event-driven data pipelines processing healthcare claims data for fraud, waste, and abuse detection. Operationalize validated fraud signals, maintain alert delivery and partner dashboards, monitor pipeline reliability, and collaborate with data architects, scientists, and investigative teams. The role requires production-scale pipeline engineering using AWS, Snowflake, Python, and SQL in a fully remote environment.

Own and evolve UJET’s data platform, including MySQL CDC replication to BigQuery, dbt transformations, Terraform infrastructure, pipelines, data quality, observability, and Looker models. Build reliable, analytics-ready datasets and trusted metrics for internal and customer-facing reporting. Partner with Analytics, Finance, Product, and Engineering to deliver scalable data solutions, improve platform reliability, optimize performance and costs, and establish development standards and guardrails.

Designs, builds, tests, deploys, and maintains secure ETL/ELT pipelines for public health data. Integrates Power Platform, Azure services, APIs, SQL Server, CDC/NIOSH systems, and approved file-transfer platforms. Develops batch, event-driven, and near-real-time data workflows supporting intake, validation, reporting, analytics, notifications, and results delivery while meeting FISMA Moderate, federal privacy, Agile, and DevSecOps requirements.

Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.

Lead the architecture and development of Vercel’s next-generation data platform, supporting batch and real-time integrations, analytics, data warehousing, and AI/ML workloads. Design scalable systems using Kafka, ClickHouse, Tinybird, and Snowflake; establish data governance and security standards; guide architectural decisions and roadmaps; collaborate with engineering, product, security, compliance, and leadership teams; write production code; and mentor engineers.

Build and maintain Databricks-based data platforms, including ingestion, transformation, storage, governance, data modeling, and serving pipelines. Establish medallion architecture standards, canonical data models, quality controls, lineage, schema evolution, and reliable batch or incremental processing. Improve pipeline observability, scalability, idempotency, and recoverability while moving curated data to systems such as ClickHouse. Collaborate across application and analytics teams to create durable, governed production datasets.

Develop and optimize enterprise Oracle SQL and PL/SQL solutions, including data models, database designs, APIs, ETL processes, batch jobs, and performance tuning. Collaborate with cross-functional teams to translate requirements into scalable implementations, support testing and CI/CD, troubleshoot production issues, and document solutions. Provide technical leadership, mentor engineers, participate in architecture and code reviews, and drive engineering best practices across data modernization initiatives.

Design, build, and operate scalable ETL/ELT pipelines and backend data services using Go. Integrate relational, NoSQL, blockchain, API, web, and social data sources; develop NLP pipelines for text extraction and classification; and support production APIs, dashboards, alerts, and intelligence systems. Collaborate with engineering, data science, and investigations teams on architecture, data quality, lineage, validation, monitoring, and client-facing products.

Leads data engineering and data science teams, setting strategy and delivering scalable pipelines, data architecture, models, analytics infrastructure, and data governance. Partners with product, analytics, and business stakeholders to prioritize initiatives, assess upstream changes, maintain data quality, and support Snowflake-based warehousing. This hands-on leadership role includes mentoring staff, contributing to technical codebases, and advancing data science and engineering solutions.

Design, build, and maintain scalable batch and streaming data pipelines using Python, SQL, Kafka, and GCP. Develop REST and GraphQL data services, CI/CD automation, observability, and data-quality frameworks. Integrate ML and NLP models into production workflows, including continuous retraining and real-time inference. Support structured and unstructured healthcare datasets, distributed systems, microservices, and reliable data infrastructure while collaborating with data science and MLOps teams.

Build and configure a government Databricks workspace, develop ingestion and integration pipelines from enterprise and legacy systems, and prepare data for reporting. Implement Unity Catalog governance, metadata management, auditing, and lineage; configure MLflow workflows; assess security controls for sensitive data; and create architecture documentation, data dictionaries, and SOPs to support long-term sustainment.

Lead the design and optimization of healthcare data pipelines integrating EHR, payer, HIE, and vendor data. Build AWS-based ETL/ELT infrastructure, reusable integration tooling, data quality monitoring, and ML enablement foundations. Ensure HIPAA-compliant handling of clinical data, including security controls, audit logging, encryption, and de-identification. Provide technical leadership, mentor engineers, influence platform architecture, and lead complex partner integrations involving FHIR, HL7v2, CCDA, and healthcare terminology standards.

Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.

Design and lead scalable, secure, highly available database infrastructure for multi-terabyte SQL Server environments. Set technical direction for data architecture, performance, real-time pipelines, security, and growth. Troubleshoot complex production issues, optimize queries and indexes, guide cross-functional projects, mentor engineers, review changes, reduce technical debt, and evaluate emerging technologies. Monitor database health using Splunk, Datadog, and Grafana while influencing engineering and Site Reliability strategy.

Designs dimensional models, analytical datasets, ETL/ELT workflows, data warehouse and lake integrations, and governed Power BI semantic models. Ensures data quality, lineage, security, observability, and performance through testing, documentation, CI/CD, monitoring, and optimization. Partners with stakeholders to define requirements, KPIs, and acceptance tests while enabling self-service analytics and data-informed decision-making.

Build scalable, secure data pipelines, models, platforms, and governance systems that enable AI applications to access trusted enterprise data. Partner with analytics, marketing, and product teams to translate requirements into technical solutions, independently deliver projects through production, and support sensitive-data security and access controls. Preferred experience includes LLM architectures, cloud data platforms, infrastructure as code, regulated environments, and technical leadership.

Design and scale lakehouse architecture, streaming and batch pipelines, and reliable data platforms using Kafka, Spark, Airflow, Iceberg, Databricks, and related technologies. Build Medallion-layer data systems, manage open table formats, optimize distributed queries, monitor platform reliability, resolve data quality issues, and collaborate with analysts, data scientists, and product teams.