The Role
Designs and optimizes scalable ETL/ELT pipelines and data ingestion workflows using Python, PySpark, Databricks, AWS, Azure, and Snowflake. Implements CDC, SCD Type 1/2, and Medallion Architecture; performs data validation, transformation, and quality checks; develops data models and analytics-ready datasets; supports BI reporting through Power BI and QuickSight; and collaborates with stakeholders to deliver reliable, high-performance data solutions.
Summary Generated by Built In
Data Engineer
RequirementsKey Roles & Responsibilities
- Design and develop scalable ETL/ELT data pipelines using Python, PySpark, and Databricks.
- Work with AWS, Azure, Snowflake, and data warehousing solutions.
- Build reliable, analytics-ready datasets and ensure data quality and performance.
RequirementsKey Roles & Responsibilities
- Develop and optimize ETL pipelines and data ingestion workflows.
- Implement CDC, SCD Type 1/2, and Medallion Architecture.
- Perform data validation, transformation, and quality checks.
- Develop data models and support BI reporting using Power BI/QuickSight.
- Work with AWS Glue, S3, Azure Data Factory, Airflow, and Snowflake.
- Collaborate with stakeholders to understand requirements and deliver data solutions.
Primary Skills:
- Python, SQL, PySpark
- Databricks & Apache Spark
- ETL/ELT & Data Pipelines
- AWS (S3, Glue)
- Snowflake
Secondary Skills:
- Azure Data Factory
- Apache Airflow, dbt, Fivetran
- Data Modeling & Data Warehousing
- CDC & SCD Type 1/2
- Power BI & Amazon QuickSight
- Delta Lake, Terraform & CI/CD
Skills Required
- Experience developing and optimizing ETL/ELT pipelines and data ingestion workflows
- Proficiency with Python, SQL, and PySpark
- Experience with Databricks and Apache Spark
- Experience with AWS, including S3 and Glue
- Experience with Snowflake and data warehousing
- Knowledge of CDC, SCD Type 1/2, and Medallion Architecture
- Experience with data validation, transformation, and quality checks
- Experience developing data models and supporting BI reporting
- Experience with Azure Data Factory
- Experience with Apache Airflow, dbt, and Fivetran
- Experience with Power BI and Amazon QuickSight
- Knowledge of Delta Lake, Terraform, and CI/CD
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
QBrainX Inc. is a specialized provider of hyper-automation and enterprise process optimization solutions. Acting as a digital transformation ally, the company empowers businesses across various domains to achieve excellence through innovative digital engineering and platform modernization. It leverages expertise in ServiceNow, Salesforce, SAP, and AI-driven data solutions to automate business processes and deliver high-performance, future-ready systems for global enterprises.
