Senior Data Engineer (PySpark, Python)

Posted 8 Hours Ago
Be an Early Applicant
Chennai, Tamil Nadu, IND
In-Office
Senior level
Fintech • Payments • Software • Financial Services • Automation
The Role
Seeking a Senior Data Engineer to design and maintain data pipelines for the Risk & Compliance domain using PySpark and Python, ensuring data integrity and security while collaborating with cross-functional teams.
Summary Generated by Built In

We are seeking a highly skilled Senior Data Engineer to design, build, and maintain scalable data pipelines for enterprise-grade data platforms within the Risk & Compliance domain. The ideal candidate will have strong expertise in PySpark, Python, and data engineering best practices, with a focus on data quality, governance, and security.

Key Responsibilities
  • Design, develop, and optimize scalable data pipelines using PySpark and Python
  • Build robust ETL/ELT workflows to process large volumes of structured and unstructured data
  • Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets
  • Ensure data integrity, accuracy, and reliability through validation frameworks and monitoring
  • Implement data security and access control mechanisms aligned with compliance standards
  • Work closely with Risk & Compliance teams to support regulatory and reporting requirements
  • Optimize performance of data processing jobs and queries
  • Maintain and enhance existing data architecture and pipelines
Required Skills & Experience
  • 6+ years of experience in Data Engineering
  • Strong hands-on experience with PySpark and Python
  • Solid experience with SQL and Oracle databases
  • Experience in building and maintaining large-scale data pipelines
  • Good understanding of data warehousing concepts and ETL frameworks
  • Experience with data validation, data quality, and governance frameworks
  • Familiarity with cloud platforms (AWS/Azure/GCP) is a plus
  • Exposure to banking, financial services, or risk & compliance domain is preferred
Key Competencies
  • Strong problem-solving and analytical skills
  • Ability to work in a fast-paced, collaborative environment
  • Excellent communication and stakeholder management skills
  • Attention to detail with a focus on data quality and security
Nice to Have
  • Experience with Big Data ecosystems (Hadoop, Spark)
  • Knowledge of data security and regulatory compliance frameworks
  • Prior experience working with enterprise data platforms

Top Skills

AWS
Azure
GCP
Hadoop
Oracle
Pyspark
Python
Spark
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Dubai Internet City
160 Employees
Year Founded: 1997

What We Do

Global Software Solutions Group Veracious product line is a series of robust banking platforms that provide core banking, payment systems, custom process automation, and document management solutions for banks and financial institutions in Middle East & Africa. This cutting-edge product line features the Veracious Payments Hub, Digital Banking and the DMS, all built on the Torus Lowcode development platform software. Global Software Solutions Group is a software solutions provider that aims to solve mission-critical problems that financial institutions face today. Our software solutions bring together our Low Code platform, the payments product line and customized service offerings to solve mission-critical statements in core banking, payments, process automation, and document management. The Payments Hub is GSS's flagship product.

Similar Jobs

ZS Logo ZS

Decision Analytics Associate

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
5 Locations
13000 Employees

TransUnion Logo TransUnion

Rep I - Business Operations

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
Chennai, Tamil Nadu, IND
13000 Employees

Pfizer Logo Pfizer

Senior Associate, Senior Central Testing Analyst, Central Services

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Hybrid
Chennai, Tamil Nadu, IND
121990 Employees

Ericsson Logo Ericsson

Technical Lead

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
In-Office
4 Locations
88000 Employees

Similar Companies Hiring

Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account