The Role
Lead design, development, and maintenance of scalable data pipelines and ETL processes. Implement data integration, validation, and schema improvements. Optimize for performance and reliability, ensure data security and compliance, run on-call operations, and collaborate with cross-functional teams to meet analytics and product requirements.
Summary Generated by Built In
About Us:
Paytm is India's leading mobile payments and financial services distribution company. Pioneer of the mobile QR payments revolution in India, Paytm builds technologies that help small businesses with payments and commerce. Paytm’s mission is to serve half a billion Indians and bring them to the mainstream economy with the help of technology.
Job Summary: Build systems for collection & transformation of complex data sets for use in production systems Collaborate with engineers on building & maintaining back-end services Implement data schema and data management improvements for scale and performance Provide insights into key performance indicators for the product and customer usage Serve as team's authority on data infrastructure, privacy controls and data security Collaborate with appropriate stakeholders to understand user requirements Support efforts for continuous improvement, metrics and test automation Maintain operations of live service as issues arise on a rotational, on-call basis Verify whether data architecture meets security and compliance requirements and expectations .Should be able to fast learn and quickly adapt at rapid pace. java/scala, SQL,
Minimum Qualifications:
Bachelor's degree in computer science, computer engineering or a related field, or equivalent
Experience 6+ years of progressive experience demonstrating strong architecture, programming and engineering skills.
Firm grasp of data structures, algorithms with fluency in programming languages like Java, Python, Scala. Strong SQL language and should be able to write complex queries.
Strong Airflow like orchestration tools. Demonstrated ability to lead, partner, and collaborate cross functionally across many engineering organizations
Experience with streaming technologies such as Apache Spark, Kafka, Flink. Backend experience including Apache Cassandra, MongoDB and relational databases such as Oracle, PostgreSQL AWS/GCP
Solid hands on with 4+ years of experience. Strong communication and soft skills. Knowledge and/or experience with containerized environments, Kubernetes, docker.
Experience in implementing and maintained highly scalable micro services in Rest, Spring Boot, GRPC. Appetite for trying new things and building rapid POCs"
Key Responsibilities :Design, develop, and maintain scalable data pipelines to support data ingestion, processing, and storage Implement data integration solutions to consolidate data from multiple sources into a centralized data warehouse or data lake Collaborate with data scientists and analysts to understand data requirements and translate them into technical specifications Ensure data quality and integrity by implementing robust data validation and cleansing processes Optimize data pipelines for performance, scalability, and reliability. Develop and maintain ETL (Extract, Transform, Load) processes using tools such as Apache Spark, Apache NiFi, or similar technologies .Monitor and troubleshoot data pipeline issues, ensuring timely resolution and minimal downtimeImplement best practices for data management, security, and complianceDocument data engineering processes, workflows, and technical specificationsStay up-to-date with industry trends and emerging technologies in data engineering and big data.
Compensation:
If you are the right fit, we believe in creating wealth for you with enviable 500 mn+ registered users, 25 mn+ merchants and depth of data in our ecosystem, we are in a unique position to democratize credit for deserving consumers & merchants – and we are committed to it.
India’s largest digital lending story is brewing here.
It’s your opportunity to be a part of the story!
Skills Required
- Bachelor's degree in computer science, computer engineering or related field (or equivalent)
- 6+ years progressive experience in architecture, programming and engineering
- Fluency in programming languages: Java, Python, Scala
- Strong SQL skills and ability to write complex queries
- Experience with orchestration tools like Airflow
- Experience with streaming technologies: Apache Spark, Kafka, Flink
- Backend experience with Apache Cassandra, MongoDB, Oracle, PostgreSQL
- Experience with cloud platforms (AWS or GCP)
- 4+ years hands-on experience (solid practical experience)
- Knowledge/experience with containerized environments: Kubernetes, Docker
- Experience building and maintaining scalable microservices (REST, Spring Boot, gRPC)
- Experience developing ETL processes and tools such as Apache NiFi
- Ability to lead and collaborate cross-functionally
- Strong communication and soft skills
- Knowledge of data security, privacy controls, and compliance verification
- On-call rotational support for live service operations
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Paytm started the Digital Revolution in India. And we went on to become India’s leading Payments App. Today, more than 20 Million merchants & businesses are powered by Paytm to Accept Payments digitally. This is because more than 300 million Indians use Paytm to Pay at their stores. And that’s not all, Paytm App is used to Pay bills, do Recharges, Send money to friends & family, Book movies & travel tickets. With innovations to Financial services & products in pipeline, this is but one of the milestones achieved towards our mission – to bring 500 million unserved and underserved Indians to the mainstream economy.
