The Role
Designs, develops, and leads enterprise-scale AWS and Azure data platforms, pipelines, lakes, warehouses, and lakehouses. Builds ETL/ELT workflows using SQL, Python, Spark, Databricks, Kafka, Airflow, and dbt; implements data quality, governance, security, monitoring, CI/CD, and automated testing. Optimizes performance, reliability, scalability, and cloud costs, troubleshoots production issues, collaborates with technical and business stakeholders, and mentors junior engineers.
Summary Generated by Built In
We are looking for a Senior AWS Data Engineer to design and lead scalable, secure, and high-performance cloud data platforms across AWS/Azure." in Mississauga, ON (Hybrid).
Senior AWS Data Engineer (Strong Databricks)
Location: Mississauga, ON (Hybrid)
Full Time/CTH
Experience: 8+ Years
Role Expectations
The Senior Data Engineer will be responsible for hands-on development, implementation, optimization, and maintenance of enterprise-scale data solutions. The role requires strong technical ownership of data pipelines, data processing frameworks, and cloud data platforms, focusing on performance, reliability, data quality, and cost efficiency.
Key Responsibilities
Location: Mississauga, ON (Hybrid)
Full Time/CTH
Experience: 8+ Years
Role Expectations
The Senior Data Engineer will be responsible for hands-on development, implementation, optimization, and maintenance of enterprise-scale data solutions. The role requires strong technical ownership of data pipelines, data processing frameworks, and cloud data platforms, focusing on performance, reliability, data quality, and cost efficiency.
Key Responsibilities
- Design, develop, and maintain scalable cloud-based data pipelines and data platforms using AWS and/or Azure.
- Build and optimize data lakes, data warehouses, and lakehouse solutions.
- Implement Medallion Architecture (Bronze, Silver, and Gold layers) for efficient data processing and data quality.
- Develop and maintain robust ETL/ELT pipelines for batch and real-time data processing.
- Build data integration workflows using SQL, Python, Spark, Databricks, Kafka, Airflow, dbt, or equivalent technologies.
- Develop and optimize complex SQL queries, data models, and transformation logic.
- Work with structured, semi-structured, and unstructured data from multiple sources.
- Implement data quality checks, validation frameworks, error handling, and monitoring mechanisms.
- Apply data governance, security, access control, and compliance best practices.
- Optimize data pipeline performance, scalability, reliability, and cloud infrastructure costs.
- Implement CI/CD pipelines, automated testing, and DevOps practices for data engineering solutions.
- Collaborate with Data Architects, Analytics Engineers, Data Scientists, and business stakeholders to deliver reliable data solutions.
- Contribute to technical design documents, data flow diagrams, and implementation plans.
- Troubleshoot production issues and ensure data pipeline availability, accuracy, and timely delivery.
- Mentor junior Data Engineers and promote engineering best practices.
- 8–10+ years of experience in Data Engineering, with strong hands-on experience building production-grade data pipelines.
- Strong hands-on experience with AWS and/or Azure data services.
- Expertise in ETL/ELT development, data transformation, and data pipeline orchestration.
- Strong knowledge of Data Lakes, Lakehouses, Data Warehousing, and Medallion Architecture.
- Advanced SQL skills and proficiency in Python or equivalent programming languages.
- Hands-on experience with Apache Spark and/or Databricks.
- Experience with Kafka, Airflow, dbt, or equivalent streaming and orchestration technologies.
- Experience processing structured, semi-structured, and unstructured data.
- Strong understanding of data modeling, data quality, and data validation techniques.
- Knowledge of data governance, security, access management, and compliance practices.
- Experience with Git, CI/CD, automated testing, and DevOps practices.
- Strong analytical, problem-solving, communication, and collaboration skills.
- AWS or Azure certifications.
- Databricks certification or hands-on experience with the Databricks platform.
- Experience with Snowflake or other modern cloud data warehouses.
- Experience with real-time data processing and streaming architectures.
- Familiarity with Infrastructure as Code (Terraform, CloudFormation, or Bicep).
- Knowledge of data observability, monitoring, and data lineage tools.
- Exposure to Data Mesh concepts and distributed data architectures
Skills Required
- 8–10+ years of experience in data engineering, building production-grade data pipelines
- Strong hands-on experience with AWS and/or Azure data services
- Expertise in ETL/ELT development, data transformation, and data pipeline orchestration
- Strong knowledge of data lakes, lakehouses, data warehousing, and Medallion Architecture
- Advanced SQL skills and proficiency in Python or equivalent programming languages
- Hands-on experience with Apache Spark and/or Databricks
- Experience with Kafka, Airflow, dbt, or equivalent streaming and orchestration technologies
- Experience processing structured, semi-structured, and unstructured data
- Strong understanding of data modeling, data quality, and data validation techniques
- Knowledge of data governance, security, access management, and compliance practices
- Experience with Git, CI/CD, automated testing, and DevOps practices
- Strong analytical, problem-solving, communication, and collaboration skills
- AWS or Azure certifications
- Databricks certification or hands-on experience with the Databricks platform
- Experience with Snowflake or other modern cloud data warehouses
- Experience with real-time data processing and streaming architectures
- Familiarity with Infrastructure as Code, including Terraform, CloudFormation, or Bicep
- Knowledge of data observability, monitoring, and data lineage tools
- Exposure to Data Mesh concepts and distributed data architectures
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Driving Innovation through Advanced Data and AI Services. We offer next-level data and AI services to help you transform your data into actionable insights for a competitive edge. To augment your teams, we offer full-time/contract resources & consulting, design and development services for turnkey projects in the following areas: 01 DATA MODERNIZATION Define Cloud strategy, architecture & roadmap Identify current landscape & catalog data sources Data warehouse design & setup Develop data governance & data quality framework Implement data management technologies Build data analytics capabilities Inculcate data driven culture A future-ready framework to serve all business use cases 02 DATA INTEGRATION & CLOUD MIGRATION Design & develop Optimized data models and data pipelines ETL/ELT workloads & monitoring Processes that scale up and down without performance problems Automate data migration between upstream/downstream (on-prem) systems and Cloud 03 DATA ANALYTICS & AI Data analytics consulting – use-case exploration and building analytics roadmap Data preparation and creating a single version of truth Dashboard & report development AI/ML model selection and development AI/ML model tuning and validation AI/ML model scaling, integration and deployment
