The Role
Design, build, and optimize end-to-end data pipelines and near-real-time integrations. Implement validation, monitor and troubleshoot systems, manage containerized microservices and Kubernetes deployments, collaborate with stakeholders, document designs, mentor team members, and support product upgrades and migrations.
Summary Generated by Built In
Location: Pune
- Design, implement and optimize end-to-end data pipelines for ingesting, processing and transforming large volumes of structured and unstructured data.
- Develop data pipelines to extract and transform data in near real time using cloud native technologies.
- Implement data validation and quality checks to ensure accuracy and consistency.
- Monitor system performance, troubleshoot issues and implement optimizations to enhance reliability and efficiency.
- Collaborate with business users, analysts and other stakeholders to understand data requirements and deliver tailored solutions.
- Document technical designs, workflows and best practices to facilitate knowledge sharing and maintain system documentation.
- Provide technical guidance and support to team members and stakeholders as needed.
- Identify problems and recommend appropriate solutions for WSI in a wide variety of circumstances.
- Take an active role in developing effective, scalable and maintainable code in a timely fashion and participate in design and code reviews.
- Maintains a manner of leadership and flexibility that diffuses pressure and promotes a positive environment.
- We're a successful, fast-growing company with an entrepreneurial vibe
- A technologically and data-driven business
- Competitive salaries and comprehensive health benefits
- We're at the forefront of tech and retail, redefining technology for the next generation
- We're passionate about our internal and external clients and live/breathe the client experience
- We get to be creative on a daily basis
- A smart, experienced the leadership team that wants to do it right and is open to new ideas
- We believe in autonomy and reward taking the initiative •We have fun!
We're excited about you because you have...
- Experience in development of Web & Enterprise applications in Python language
- Experience in building containerized microservices using Python frameworks, Django, Flask etc.
- Experience in Bash/Shell scripting and Hands-On in Linux Environment
- Experience in integration technologies like Kafka (Distributed Messaging Systems), REST APIs and Webservices.
- Expertise in troubleshooting integration issues involving SSL, firewalls, proxies, load balancers and LDAP
- Experience in managing applications in Kubernetes, Docker and Helm
- Proficiency in working with Oracle/MySQL/graph databases.
- Good to have understanding of Elastic/Open Search applications. Should be comfortable in analysing data, scripting and the desire to learn the rest of our stack.
- Good to have understanding of CI/CD Pipeline functionality.
- Good to have exposure in Redis and monitoring tools such as AppDynamics, Nagios and Grafana.
- Familiarity with Unix/AIX environments and monitoring tools.
- Experience in planning and managing product upgrades and migrations.
- Strong problem-solving, analytical and team collaboration skills.
Desirable Competencies
- Bachelor’s degree or foreign equivalent in Computer Science, Engineering or related field
- 5+ years of progressively responsible experience in software engineering
- 3+ years of data engineering or equivalent experience.
Skills Required
- 5+ years of progressively responsible experience in software engineering
- 3+ years of data engineering or equivalent experience
- Experience in development of Web & Enterprise applications in Python
- Experience building containerized microservices using Python frameworks such as Django, Flask
- Bash/Shell scripting and hands-on experience in Linux environments
- Experience with integration technologies like Kafka, REST APIs and Webservices
- Expertise troubleshooting integration issues involving SSL, firewalls, proxies, load balancers and LDAP
- Experience managing applications in Kubernetes, Docker and Helm
- Proficiency working with Oracle, MySQL and graph databases
- Experience planning and managing product upgrades and migrations
- Strong problem-solving, analytical and team collaboration skills
- Understanding of Elastic/Open Search applications
- Understanding of CI/CD pipeline functionality
- Exposure to Redis and monitoring tools such as AppDynamics, Nagios and Grafana
- Familiarity with Unix/AIX environments and monitoring tools
- Bachelor's degree or foreign equivalent in Computer Science, Engineering or related field
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Photon.com has emerged as one of the world’s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. Please visit www.photon.com to learn more about us, how we work, and our customer case studies. Digital Transformation Starts Here.






