The Role
Lead and grow a Data DevOps team to design, build, and operate large-scale, secure cloud data platforms. Drive architecture, infrastructure automation, CI/CD, observability, cost optimization, and cross-functional collaboration to deliver reliable big data solutions.
Summary Generated by Built In
Position: Principal Engineer–Data DevOps
Job Location: Noida
Job Overview:
We are seeking an experienced Principal Engineer (Data DevOps) to lead our Data DevOps team in building, managing, and optimizing high-scale, secure, and reliable big data platforms. The ideal candidate will combine strong technical expertise with proven leadership skills, driving best practices in cloud infrastructure, automation, CI/CD, and big data technologies. This role involves managing cross-functional priorities, mentoring engineers, and ensuring delivery of high-quality, scalable data solutions.
Key Responsibilities:
● Lead, mentor, and grow a high-performing Data DevOps team, fostering technical excellence and ownership.
● Drive architecture, design, and implementation of large-scale cloud and data infrastructure, ensuring scalability, performance, and security.
● Collaborate closely with Data Engineering, Data Science, Analytics, and Product teams to deliver efficient and reliable data platforms.
● Oversee operations and optimization of AWS-based infrastructure, including VPC, EC2, S3, EMR, EKS, SageMaker, Lambda, CloudFront, CloudWatch, and IAM.
● Manage and scale big data platforms leveraging Kafka, Hive HMS, Apache Ranger, Apache Airflow, EMR, Spark, Trino, Looker, and Jupyter Notebooks.
● Implement and maintain CI/CD pipelines and infrastructure automation using Terraform, Ansible, and CloudFormation.
● Ensure system observability, proactive incident management, and SLA adherence.
● Champion cloud security best practices, including API security, TLS/HTTPS, and access control policies.
● Partner with stakeholders to prioritize initiatives, manage budgets, and optimize cloud and operational costs.
Required Qualifications:
● Experience: 8+ years in DevOps/Data DevOps or related fields, including at least 4+ years in a leadership role.
● Proven track record in managing high-scale big data infrastructure and leading engineering teams.
● Strong hands-on experience with AWS services and infrastructure automation tools (Terraform, Ansible, CloudFormation).
● Deep knowledge and hands-on experience with Kafka, Hive HMS, Apache Ranger, Apache Airflow, EMR, Spark, Trino, Jupyter Notebooks, and Looker.
● Proficiency in Kubernetes/EKS, Docker, ECS, and CI/CD tools.
● Strong understanding of networking, cloud security, and compliance requirements.
● Excellent communication, stakeholder management, and decision-making skills.
● Exposure to SQL and data query optimization is an advantage.
Skills Required
- 8+ years in DevOps/Data DevOps or related fields with at least 4+ years in a leadership role
- Proven track record managing high-scale big data infrastructure and leading engineering teams
- Hands-on experience with AWS services and infrastructure automation tools (Terraform, Ansible, CloudFormation)
- Deep knowledge and hands-on experience with Kafka, Hive HMS, Apache Ranger, Apache Airflow, EMR, Spark, Trino, Jupyter Notebooks, and Looker
- Proficiency in Kubernetes/EKS, Docker, ECS, and CI/CD tools
- Strong understanding of networking, cloud security, and compliance requirements
- Excellent communication, stakeholder management, and decision-making skills
- Exposure to SQL and data query optimization
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Paytm started the Digital Revolution in India. And we went on to become India’s leading Payments App. Today, more than 20 Million merchants & businesses are powered by Paytm to Accept Payments digitally. This is because more than 300 million Indians use Paytm to Pay at their stores. And that’s not all, Paytm App is used to Pay bills, do Recharges, Send money to friends & family, Book movies & travel tickets. With innovations to Financial services & products in pipeline, this is but one of the milestones achieved towards our mission – to bring 500 million unserved and underserved Indians to the mainstream economy.
