EXL is seeking an experienced Platform Engineer to design, implement, automate and operate cloud infrastructure for large scale analytics and data engineering workloads. This role focuses on building and managing Databricks on AWS, Infrastructure-as-Code, CI/CD automation, platform reliability, and cloud governance. The ideal candidate will bring strong hands-on experience across AWS cloud services, Terraform, DevOps practices, and a solid understanding of data engineering platforms, pipelines, and workload orchestration.
Responsibilities• Design, build, and manage scalable AWS infrastructure including EC2, EKS, Lambda, API Gateway, VPCs, IAM, Security Groups, Load Balancers, and routing components
• Implement Infrastructure-as-Code (IaC) using Terraform/AWS CDK to automate provisioning, scaling, and environment management
• Set up and manage DevOps pipelines using GitHub, GitHub Actions, CodeBuild, CodeDeploy and ArgoCD to support automated build, test, and deployment workflows.
• Design, deploy, and manage Databricks workspaces, clusters, cluster policies, Unity Catalog, networking, and security integrations on AWS.
• Partner with data engineering teams to enable reliable execution of pipelines, data ingestion frameworks, batch processing, and workflow orchestration.
• Automate deployment and lifecycle management of data platform components, including Databricks jobs, workflows, libraries, secrets, service principals, and environment configurations.
• Collaborate with data engineering teams to support infrastructure components such as AWS Glue, Lambda, Databricks on AWS, DynamoDB, and Redshift.
• Monitor and optimize platform performance, reliability, and cloud costs for data engineering workloads and analytics platforms. Troubleshoot platform, connectivity, and workload issues
• Utilize AWS Well-Architected Framework principles to design secure, reliable, cost-efficient, and high-performing solutions
• Implement platform governance, access controls, security standards, and operational best practices across cloud and data platforms.
• Contribute to establishing DevOps best practices, reusable templates, and standard operating procedures across engagements
• Strong hands-on experience managing AWS infrastructure through Terraform, including networking, security, compute, storage, and IAM services.
• Practical experience working with Databricks on AWS, including workspace administration, compute management, job orchestration, and platform operations.
• Good understanding of data engineering concepts such as ETL/ELT pipelines, data lakes, workflow orchestration, batch processing, and data platform architecture.
• Working knowledge of data engineering ecosystems and tools (e.g., Databricks, AWS Glue, Redshift).
• Practical experience designing and maintaining CI/CD pipelines.
• Solid understanding of cloud architecture patterns, DevOps workflows, automation, and monitoring practices.
Nice to Have
• Experience implementing container orchestration using Kubernetes / EKS.
• Knowledge of cost optimization, FinOps practices, and cloud governance.
• Exposure to multi-account AWS setups using Control Tower, Organizations, or Landing Zone.
• Familiarity with logging and observability tools such as CloudWatch, Grafana, Prometheus, or ELK.
• Experience working with cross-functional agile teams in a consulting environment.
Skills Required
- Hands-on experience managing AWS infrastructure using Terraform (networking, security, compute, storage, IAM)
- Practical experience with Databricks on AWS (workspace administration, cluster management, job orchestration)
- Experience implementing Infrastructure-as-Code using Terraform or AWS CDK
- Experience designing and maintaining CI/CD pipelines (GitHub, GitHub Actions, CodeBuild, CodeDeploy, ArgoCD)
- Understanding of data engineering concepts (ETL/ELT, data lakes, workflow orchestration, batch processing)
- Working knowledge of data platform tools (AWS Glue, Redshift, DynamoDB)
- Solid understanding of cloud architecture patterns, DevOps workflows, automation, and monitoring practices
- Ability to design, deploy, and manage Databricks components including Unity Catalog, networking, and security integrations
- Experience troubleshooting platform, connectivity, and workload issues and optimizing cloud costs
- Experience with Kubernetes / EKS (container orchestration)
- Knowledge of cost optimization/FinOps and cloud governance
- Exposure to multi-account AWS setups (Control Tower, Organizations, Landing Zone)
- Familiarity with logging and observability tools (CloudWatch, Grafana, Prometheus, ELK)
- Experience working with cross-functional agile teams in a consulting environment
What We Do
Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Unrealistic overhauls and off-the-shelf products ignore what matters most — your unique needs, culture, goals, and your legacy data and technology environments. At EXL, our collaboration is built on ongoing listening and learning to adapt our methodologies. We’re your business evolution partner—tailoring solutions that make the most of data to make better business decisions and drive more intelligence into your increasingly digital operations. Whether your goals are scaling the use of AI and digital, redesign operating models, or driving better and faster decisions, we’re here to partner with you to help you gain—and maintain—competitive advantage with efficient, sustainable models at scale. Our expertise in transformation, data science, and change management helps make your business more efficient and effective, improve customer relationships and enhance revenue growth. Instead of focusing on multi-year, resource- and time-intensive platform designs or migrations, we look deeper at your entire value chain to integrate strategies with impact. We use our specialization in analytics, digital interventions, and operations management—alongside deep industry expertise — to deliver solutions that help you outperform the competition. At EXL, it’s all about outcomes—your outcomes—and delivering success on your terms. Share your goals with us and together, we’ll optimize how you leverage data to drive your business forward. For more information, visit www.exlservice.com.
.png){kind=logo}
