The Role
Design, develop, and maintain data engineering solutions across the SDLC using Python (primary) and Scala (secondary). Build distributed data pipelines on Hadoop/Spark ecosystems, extend data processing platforms (Spark SQL, Hive, Starburst), manage CI/CD, and deploy on Kubernetes/OpenShift. Collaborate with stakeholders in Agile teams and ensure maintainable, reusable code.
Summary Generated by Built In
Qualifications:
- Strong communication skills
- Experience of Agile development and scrums
- Banking and securities domain knowledge would be an added advantage
Skills Required:
- Strong experience working across the entire SDLC lifecycle
- Programming experience in one or more application or systems languages, Python - Primary, Scala - Secondary (basic knowledge)
- Strong experience working with Python concepts and libraries such as Jupyterhub, Airflow, Pandas, NumPy etc.
- Good experience with classes based OOP and design patterns
- Distributed Systems Design Experience - including understanding of distributed systems concepts and principles
- Knowledge and understanding of Kerberos and authentication
- Hadoop Ecosystem of Tools (Spark, Hive, Impala, etc).
- Experience extending and implementing core functionality and libraries in data processing platforms (Spark / Spark SQL, Hive, Starburst, etc)
- Strong experience working with the CI/CD pipeline and tools like Jenkins , Harness/Tekton, Udeploy/Ansible,Bitbucket, Jira
- Strong experience in cloud platforms like Kubernetes, OpenShift4
- Ability to deal with multiple stakeholders and follow through on open issues.
- A commitment to writing understandable, maintainable, and reusable software.
- Willingness to learn new languages and methodologies.
- Experience working with business partners and engineers to gather, understand, and bridge definitions and requirements.
- An innate desire to deliver and a strong sense of accountability for your work.
Education:
- Bachelor’s degree/University degree or equivalent experience
Skills Required
- Strong communication skills
- Experience of Agile development and scrums
- Banking and securities domain knowledge
- Strong experience working across the entire SDLC lifecycle
- Programming experience in Python (primary) and Scala (secondary)
- Experience with Python tools/libraries: Jupyterhub, Airflow, Pandas, NumPy
- Good experience with classes-based OOP and design patterns
- Distributed systems design experience
- Knowledge and understanding of Kerberos and authentication
- Experience with Hadoop ecosystem tools (Spark, Hive, Impala)
- Experience extending/implementing core functionality in data processing platforms (Spark / Spark SQL, Hive, Starburst)
- Strong experience with CI/CD pipelines and tools (Jenkins, Harness/Tekton, Udeploy, Ansible, Bitbucket, Jira)
- Experience with cloud/container platforms like Kubernetes and OpenShift4
- Ability to deal with multiple stakeholders and follow through on issues
- Commitment to writing understandable, maintainable, and reusable software
- Willingness to learn new languages and methodologies
- Experience working with business partners and engineers to gather and bridge requirements
- Bachelor's degree or equivalent experience
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Photon.com has emerged as one of the world’s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. Please visit www.photon.com to learn more about us, how we work, and our customer case studies. Digital Transformation Starts Here.
.png)
