Data Engineer

Posted Yesterday
Be an Early Applicant
Delhi, Connaught Place, New Delhi, Delhi, IND
In-Office
Senior level
Artificial Intelligence • Information Technology • Software • Analytics
The Role
Build and optimize scalable data ingestion, transformation, and consumption pipelines on an on-premises lakehouse platform. Develop Spark ETL/ELT workloads, Apache Iceberg datasets, Informatica integrations, and governed data workflows using Denodo, Starburst, or Dremio. Support batch and near-real-time processing, data quality, metadata management, migration, testing, deployment, production rollout, troubleshooting, and performance optimization.
Summary Generated by Built In
Job Description – Data Engineer

Employment Type: Full-Time
Work Location: KSA
Experience Required: Hands-on experience with Spark development, Informatica integration solutions, and enterprise data platforms.
Years of Experience: 5 to 10

Role Overview

We are looking for a Data Engineer to build, configure, and optimize data ingestion, transformation, and consumption workloads on a modern on-premises lakehouse platform. The ideal candidate will have strong hands-on experience with Spark-based development, enterprise data lake/lakehouse implementations, and Informatica-based integration solutions.

Key Responsibilities
  • Design and develop scalable data ingestion and transformation pipelines.
  • Build, optimize, and maintain Spark-based ETL/ELT workloads.
  • Develop and manage data models and datasets using Apache Iceberg tables.
  • Implement and support data integration workflows using Informatica.
  • Enable analytics and data consumption through Denodo, Starburst, and/or Dremio.
  • Develop secure, governed, and scalable data pipelines aligned with enterprise standards.
  • Support batch and near real-time data processing requirements.
  • Implement data quality, metadata management, and validation controls.
  • Collaborate with Platform Engineers on deployment, integration, and operationalization activities.
  • Support migration, testing, and production rollout initiatives.
  • Troubleshoot and optimize data pipeline performance, reliability, and scalability.
Must-Have Skills
  • Apache Spark (PySpark and/or Scala Spark)
  • Apache Iceberg
  • Informatica Data Integration
  • MinIO Object Storage
  • Denodo
  • SQL and Data Modeling
  • Data Warehousing Concepts
  • ETL/ELT Development
  • Git Version Control
Good-to-Have Skills
  • Starburst and/or Dremio
  • Data Governance and Metadata Management
  • Data Quality Frameworks
  • CI/CD for Data Pipelines
  • Python
  • Kafka or Streaming Technologies
  • Lakehouse Architecture Patterns
  • Experience with enterprise data lake and lakehouse implementations
  • Performance tuning and optimization of large-scale data workloads

Skills Required

  • Hands-on experience with Spark development
  • Experience with Informatica integration solutions
  • Experience with enterprise data platforms
  • Apache Spark, including PySpark and/or Scala Spark
  • Apache Iceberg
  • Informatica Data Integration
  • MinIO Object Storage
  • Denodo
  • SQL and data modeling
  • Data warehousing concepts
  • ETL/ELT development
  • Git version control
  • Starburst and/or Dremio
  • Data governance and metadata management
  • Data quality frameworks
  • CI/CD for data pipelines
  • Python
  • Kafka or streaming technologies
  • Lakehouse architecture patterns
  • Enterprise data lake and lakehouse implementations
  • Performance tuning and optimization of large-scale data workloads

Datamatics Technologies Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Datamatics Technologies and has not been reviewed or approved by Datamatics Technologies.

  • Flexible Benefits — Feedback suggests flexible timings and work-from-home options are available in some roles. This flexibility is highlighted as part of the employment experience across certain postings and materials.
  • Wellbeing & Lifestyle Benefits — Feedback suggests flexibility around time off and remote work supports work-life balance. These elements can help offset leaner cash components for some individuals.

Datamatics Technologies Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Dubai
65 Employees
Year Founded: 2016

What We Do

Datamatics Technologies (DMT) was established in Dubai. We specialize in providing onsite and offshore professional services, covering the full spectrum of Data Analytics and Data Science domains. Our experience of working with diverse industry sectors such as Telecoms, Finance, Government and Manufacturing, across multiple regions enables us to engage and deliver for our clients with confidence. We can offer our full portfolio of services through resource augmentation, managed services, both on T&M or fixed price financial arrangements. Through our end-to-end managed services offering we enable our clients to cut down costs, increase profitability and focus on value addition to their core business activities. Our project and delivery management team are certified in Agile, PMI and ITIL to ensure the planning and execution are carried out using industry best practices. We are working with our clients across Middle East and Africa Region.

Similar Jobs

CrowdStrike Logo CrowdStrike

Data Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
India
11000 Employees
In-Office
New Delhi, Delhi, IND
In-Office or Remote
7 Locations
49 Employees
In-Office or Remote
2 Locations
5000 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account