The Role
Build and maintain large-scale PySpark/Spark data reconciliation pipelines on Hadoop/Big Data platforms; integrate with Kafka, APIs and microservices; support capital markets regulatory reporting and reconciliations; lead globally distributed teams, manage stakeholders, and deliver solutions with strong application design and optional UI integration.
Summary Generated by Built In
Job Title: PySpark Data Reconciliation Engineer
- 7+ years of relevant experience in technology and development.
- Technical skillset required:
- (1) Language: Java or Python
- (2) Experience with BigData/Hadoop/Spark/Kafka
- (3) Experience with APIs and microservices architecture
- (4) UI Development and integration experience would be a plus.
- Domain required:
- Experience in a capital market domain.
- Experience in Regulatory reporting or reconciliations (tech) would be a big plus.
- Proven track record of delivering large scale projects with globally distributed teams.
- Strong experience in applications development, design paradigms. Previous experience with data domain would be a plus.
- Experience in stakeholder management and managing global technology team is a must.
- Consistently demonstrates clear and concise written and verbal communication
Skills Required
- 7+ years of relevant experience in technology and development
- Experience with Java or Python
- Experience with Big Data / Hadoop / Spark / PySpark
- Experience with Kafka
- Experience with APIs and microservices architecture
- Experience in a capital markets domain
- Experience in regulatory reporting or reconciliations (technical)
- Proven track record delivering large-scale projects with globally distributed teams
- Experience in applications development and design paradigms
- Previous experience with data domain
- Experience in stakeholder management and managing global technology teams
- Clear and concise written and verbal communication
- UI development and integration experience
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Photon.com has emerged as one of the world’s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. Please visit www.photon.com to learn more about us, how we work, and our customer case studies. Digital Transformation Starts Here.
.jpeg)
