Senior Data Engineer (PySpark-Python)

Reposted 3 Days Ago
Be an Early Applicant
Hiring Remotely in Dubai, ARE
Remote
Senior level
Fintech • Payments • Software • Financial Services • Automation
The Role
Design, build, and maintain scalable PySpark ETL/ELT pipelines on Cloudera CDP; ingest, transform, and validate large datasets; optimise Spark jobs and Cloudera components; automate and orchestrate workflows; monitor production pipelines and provide support.
Summary Generated by Built In

We are seeking a highly skilled Senior Data Engineer with strong expertise in PySpark and Python to join our team for a leading banking client in Dubai. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and data architectures to support advanced analytics and business intelligence initiatives.

Key Responsibilities:
  • Design, develop, and maintain scalable data pipelines using PySpark and Python
  • Work with large-scale distributed systems (Hadoop/Spark ecosystem)
  • Build and optimize ETL/ELT workflows for structured and unstructured data
  • Collaborate with data scientists, analysts, and stakeholders to deliver data solutions
  • Ensure data quality, integrity, and governance across platforms
  • Implement performance tuning and optimization for Spark jobs
  • Work with cloud-based data platforms (AWS / Azure / GCP) if applicable
  • Develop and maintain data models, schemas, and metadata management
  • Troubleshoot production issues and provide timely resolutions
Required Skills & Qualifications:
  • 7 years of experience in Data Engineering
  • Strong hands-on experience with PySpark and Python
  • Solid understanding of Apache Spark, Hadoop ecosystem
  • Experience in SQL, data warehousing, and data modeling
  • Familiarity with ETL tools and big data processing frameworks
  • Experience with cloud platforms (AWS / Azure / GCP) is a plus
  • Knowledge of data pipelines orchestration tools (Airflow, etc.)
  • Strong problem-solving and analytical skills
Preferred Qualifications:
  • Experience in the Banking / Financial Services domain
  • Exposure to real-time data processing (Kafka, Spark Streaming)
  • Understanding of data governance and security practices
Soft Skills:
  • Strong communication and stakeholder management skills
  • Ability to work in a fast-paced, collaborative environment
  • Proactive and solution-oriented mindset

Top Skills

Apache Airflow
Apache Oozie
APIs
Ci/Cd
Cloudera Data Platform (Cdp)
Data Lake
Data Warehouse
Hadoop
Hdfs
Hive
Impala
Kafka
Pyspark
Relational Databases
Spark
Spark Streaming
SQL
Yarn
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Dubai Internet City
160 Employees
Year Founded: 1997

What We Do

Global Software Solutions Group Veracious product line is a series of robust banking platforms that provide core banking, payment systems, custom process automation, and document management solutions for banks and financial institutions in Middle East & Africa. This cutting-edge product line features the Veracious Payments Hub, Digital Banking and the DMS, all built on the Torus Lowcode development platform software. Global Software Solutions Group is a software solutions provider that aims to solve mission-critical problems that financial institutions face today. Our software solutions bring together our Low Code platform, the payments product line and customized service offerings to solve mission-critical statements in core banking, payments, process automation, and document management. The Payments Hub is GSS's flagship product.

Similar Jobs

ServiceNow Logo ServiceNow

Sales Executive

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Dubai, ARE
28000 Employees

Cloudflare Logo Cloudflare

Solutions Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Remote or Hybrid
Dubai, ARE
4400 Employees

MongoDB Logo MongoDB

Senior Solutions Architect

Big Data • Cloud • Software • Database
Easy Apply
Remote or Hybrid
Dubai, ARE
5550 Employees

Mastercard Logo Mastercard

Analyst, Corporate Treasury

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Remote or Hybrid
Dubai, ARE
38800 Employees

Similar Companies Hiring

Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Hardware • Other • Robotics • Sales • Software • Hospitality
New York, NY
30 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account