Role Summary
We are looking for experienced Data Engineers / Data Analysts to support a ledger migration and data clean-up initiative across the data lake, reporting and downstream feeds. The role will involve working on large-scale batch processing, data validation, regression testing and migration readiness activities within a financial services environment.
Key Responsibilities
-
Support ledger migration activities, including data extraction, transformation, reconciliation and validation.
-
Work on data lake clean-up, data quality checks, reporting pipelines and downstream feeds.
-
Develop, enhance and validate SQL queries, batch jobs and data processing logic.
-
Perform regression testing on batch processes to ensure data accuracy and completeness before and after migration.
-
Collaborate with engineering, product and business teams to understand migration requirements and resolve data issues.
-
Document data mapping, validation rules, test results and migration exceptions clearly.
-
Support production readiness, defect triage and post-migration validation activities.
Required Skills and Experience
-
Strong hands-on experience with SQL and data analysis across large datasets.
-
Experience with batch processing, batch regression testing and data reconciliation.
-
Working knowledge of Spark or similar distributed data processing technologies.
-
Experience working with data lakes, reporting platforms, feeds and data migration programmes.
-
Ability to identify data inconsistencies, investigate root causes and support remediation.
-
Strong understanding of data quality, controls, validation and auditability in enterprise environments.
-
Good communication skills with the ability to work across engineering, business and product stakeholders.
Preferred Experience
-
Prior experience in financial services, banking, ledger systems or regulatory data environments.
-
Experience supporting enterprise-scale migration, modernisation or platform transformation programmes.
-
Exposure to reporting, dashboards, data views and operational data feeds.
-
Ability to work in distributed teams across London, Bangalore and Singapore.
Skills Required
- Strong hands-on experience with SQL and data analysis across large datasets.
- Experience with batch processing, batch regression testing and data reconciliation.
- Working knowledge of Spark or similar distributed data processing technologies.
- Experience working with data lakes, reporting platforms, feeds and data migration programmes.
- Ability to identify data inconsistencies, investigate root causes and support remediation.
- Strong understanding of data quality, controls, validation and auditability in enterprise environments.
- Good communication skills with the ability to work across engineering, business and product stakeholders.
- Prior experience in financial services, banking, ledger systems or regulatory data environments.
- Experience supporting enterprise-scale migration, modernisation or platform transformation programmes.
- Exposure to reporting, dashboards, data views and operational data feeds.
- Ability to work in distributed teams across London, Bangalore and Singapore.
What We Do
Photon.com has emerged as one of the world’s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. Please visit www.photon.com to learn more about us, how we work, and our customer case studies. Digital Transformation Starts Here.
