Location: UAE-based (Travel required)
Duration: 6-month assignment
Summary (Data Engineer)
Timely, reliable data pipelines are what turn a platform design into business value. The Data Engineer builds and operates the pipelines that move data from source systems into the lakehouse and on to analytics and AI consumers, ensuring that the pipelines are automated, performant, secure and governed. The role works alongside the data architect, data quality engineer, business analysts and AI engineers, delivering production-grade pipelines on Azure / Microsoft Fabric, with metadata and lineage captured in Microsoft Purview.
Responsibilities
- Build batch, incremental, CDC and streaming ingestion pipelines from source systems into the Bronze layer, using Azure Data Factory and Fabric pipelines.
- Develop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks, including cleansing, conformance, enrichment and business-rule logic.
- Implement dimensional models, SCDs, surrogate keys and data marts according to the architect's designs.
- Integrate DQ checks, validation, quarantine and reconciliation into pipelines in partnership with the Senior Data Quality Engineer.
- Ensure that pipelines publish metadata and lineage to Microsoft Purview.
- Implement scheduling, dependency management, parameterization, error handling and alerting.
- Optimize pipelines, partitioning, file formats (Delta/Parquet) and compute usage for performance and cost efficiency.
- Apply access controls, masking, encryption and secure credential management in line with UAE PDPL, the Dubai Data Law and DESC ISR.
- Maintain code in source control and deploy through CI/CD pipelines, with automated tests and environment promotion.
- Support production operations, incident resolution and runbooks, and coach counterparts so that the pipelines can be sustained after handover.
Must Have
- 4+ years in data engineering, preferably within UAE government or regulated-sector environments.
- Advanced SQL, Python and PySpark/Spark skills.
- Hands-on experience with Azure Data Factory, Microsoft Fabric, Databricks or Synapse.
- Strong understanding of Lakehouse/Medallion architecture, Delta/Parquet formats and dimensional modelling, including SCDs and surrogate keys.
- Experience with CI/CD (Azure DevOps or GitHub), source control and DataOps practices.
- Familiarity with Microsoft Purview metadata and lineage, and with DQ tooling.
- Awareness of UAE data regulation, including UAE PDPL, the Dubai Data Law and DESC ISR.
- Excellent English communication and documentation skills.
Good to Have
- Arabic proficiency is an advantage.
Skills Required
- 4+ years of experience in data engineering, preferably in UAE government or regulated-sector environments
- Advanced SQL, Python, and PySpark or Spark skills
- Hands-on experience with Azure Data Factory, Microsoft Fabric, Databricks, or Synapse
- Strong understanding of Lakehouse or Medallion architecture, Delta or Parquet formats, and dimensional modeling including SCDs and surrogate keys
- Experience with CI/CD, Azure DevOps or GitHub, source control, and DataOps practices
- Familiarity with Microsoft Purview metadata and lineage and data quality tooling
- Awareness of UAE PDPL, the Dubai Data Law, and DESC ISR
- Excellent English communication and documentation skills
- Arabic proficiency
Datamatics Technologies Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Datamatics Technologies and has not been reviewed or approved by Datamatics Technologies.
-
Flexible Benefits — Feedback suggests flexible timings and work-from-home options are available in some roles. This flexibility is highlighted as part of the employment experience across certain postings and materials.
-
Wellbeing & Lifestyle Benefits — Feedback suggests flexibility around time off and remote work supports work-life balance. These elements can help offset leaner cash components for some individuals.
Datamatics Technologies Insights
What We Do
Datamatics Technologies (DMT) was established in Dubai. We specialize in providing onsite and offshore professional services, covering the full spectrum of Data Analytics and Data Science domains. Our experience of working with diverse industry sectors such as Telecoms, Finance, Government and Manufacturing, across multiple regions enables us to engage and deliver for our clients with confidence. We can offer our full portfolio of services through resource augmentation, managed services, both on T&M or fixed price financial arrangements. Through our end-to-end managed services offering we enable our clients to cut down costs, increase profitability and focus on value addition to their core business activities. Our project and delivery management team are certified in Agile, PMI and ITIL to ensure the planning and execution are carried out using industry best practices. We are working with our clients across Middle East and Africa Region.








