This is a remote position.
-
3–6 years of experience in Data Engineering.
-
Strong knowledge of SQL, Python, and PySpark.
-
Hands-on experience with Databricks and Apache Spark.
-
Understanding of Spark optimization, partitioning, and shuffling.
-
Experience with Delta Lake, Z-Ordering, and VACUUM.
-
Experience building ETL pipelines using Delta Live Tables (DLT).
-
Knowledge of Apache Airflow or Azure Data Factory.
-
Understanding of data governance and data quality.
-
Develop and maintain scalable data pipelines using Databricks, Python, and PySpark.
-
Build and automate ETL workflows using Delta Live Tables (DLT).
-
Optimize Spark jobs through partitioning, shuffling, and performance tuning.
-
Implement Delta Lake optimization techniques, including Z-Ordering and VACUUM.
-
Manage data orchestration using Airflow or Azure Data Factory.
-
Ensure data quality, governance, and pipeline performance.
-
Collaborate with cross-functional teams to deliver efficient data engineering solutions.
-
Skills Required
- 3-6 years of experience in data engineering
- Strong knowledge of SQL
- Strong knowledge of Python
- Strong knowledge of PySpark
- Hands-on experience with Databricks and Apache Spark
- Understanding of Spark optimization, partitioning, and shuffling
- Experience with Delta Lake, Z-Ordering, and VACUUM
- Experience building ETL pipelines using Delta Live Tables
- Knowledge of Apache Airflow or Azure Data Factory
- Understanding of data governance and data quality
What We Do
Arting Digital is an IT services and digital transformation company serving more than 500 clients worldwide. It provides customized technology solutions spanning software and product engineering, web and mobile application development, cloud computing, data and analytics, DevOps, QA testing, robotic process automation, digital marketing, consulting, and related digital services to help organizations improve operations and achieve growth.
.jpeg)







