Top Data Engineer Jobs in Scottsdale, AZ

Designs, builds, optimizes, and supports scalable AWS-based data infrastructure, pipelines, data models, and ETL/ELT processes using Python, SQL, PySpark, Databricks, and Spark. The role supports analytics, reporting, and business intelligence through production monitoring, troubleshooting, testing, CI/CD, documentation, and cross-functional collaboration with BI, Product, Engineering, Data, and client-facing teams.

Designs and develops data engineering, business intelligence, ETL, datamart, and dashboard solutions using Cloudera, Tableau, Spark, and related technologies. Analyzes data quality and business metrics, builds data infrastructure and analytics tools, supports Data Science platforms, improves cluster computing, and collaborates with business and engineering teams. Provides training, mentors interns, and promotes secure, reliable data practices.

Designs and optimizes enterprise data pipelines within Microsoft Fabric, including lakehouse and warehouse architectures, real-time ingestion, cloud migration, governance, CI/CD, and reporting layers. The role uses PySpark, Spark SQL, T-SQL, AI tooling, vector search, and RAG patterns while ensuring performance, reliability, and SLA compliance. Responsibilities also include mentoring junior engineers, leading technical standards, and collaborating with analysts, data scientists, and stakeholders.

Leads architecture and engineering standards for Curaleaf’s data and analytics ecosystem. Designs scalable Snowflake platforms, ingestion and transformation pipelines, data models, governance, testing, CI/CD, security, observability, and cost optimization. Partners with engineering, analytics, data science, governance, and business teams to deliver trusted data products. Provides technical direction, mentorship, incident leadership, and cross-functional alignment as a hands-on principal individual contributor.

Designs and maintains scalable batch and streaming data pipelines, data warehouses, cloud data platforms, validation frameworks, and governance processes. Supports analytics through data modeling and Tableau enablement, resolves complex data issues, delivers architecture prototypes, collaborates with business and audit stakeholders, owns projects end to end, and mentors engineers. Requires advanced SQL and Python, AWS, Snowflake or Databricks, orchestration, transformation tooling, regulatory compliance, and extensive data engineering experience.