Role Summary
Design, develop, and maintain scalable data pipelines and data assets on Databricks and the Microsoft Azure Data Platform to support Business Intelligence and Advanced Analytics objectives.
- Lead the technical migration of legacy databases and on-premises data systems to a cloud-based lakehouse architecture using Delta Lake, including data modeling, transformation logic, and post-migration data validation.
Role and Responsibilities:
- Design, develop, and maintain scalable data pipelines and data assets on Databricks and the Microsoft Azure Data Platform to support Business Intelligence and Advanced Analytics objectives.
- Lead the technical migration of legacy databases and on-premises data systems to a cloud-based lakehouse architecture using Delta Lake, including data modeling, transformation logic, and post-migration data validation.
- Develop distributed data processing applications using PySpark, Scala Spark, Python, and SQL for batch, incremental(CDC),and real-time streaming workloads.
- Build and customize data integration tools, data warehouses, data marts, and data lakes using Azure Data Factory, ADLS Gen2, and Kafka.
- Analyze business and system requirements and translate them into technical designs, data models, and software specifications aligned with enterprise architecture.
- Implement data governance, security, and data quality controls, including access management, lineage tracking, and automated data validation frameworks.
- Develop CI/CD pipelines and infrastructure-as-code for automated testing and deployment of data solutions using Databricks Asset Bundles and Git-based version control.
- Optimize performance, reliability, and cost of Spark workloads and cloud infrastructure through job tuning, cluster configuration, and storage optimization.
- Create tools and automation that help client engineering teams derive value from their data.
- Perform hands-on development, lead code reviews and testing, and establish engineering best practices across the team.
- Review solution approaches and provide technical guidance to onshore and offshore engineers to ensure delivery quality.
- Collaborate with client stakeholders to understand data needs and support timely delivery of data platform initiatives
Requirement/Competencies:
Bachelor’s or Master’s (preferred) degree in in a quantitative or technical field such as Computer Science, Information Technology, Computer Engineering or equivalent
8+ years of experience comprising development for data systems at scale (building data warehouse, data marts, data lakes, ETL, analytic solutions, etc.)
Experience leading data migration / cloud transformation engagements
Experience with and understanding of Databricks, Azure Data Platform is a must.
Skills Required
- Bachelor's degree in Computer Science, Information Technology, Computer Engineering, or an equivalent quantitative or technical field
- Master's degree in a quantitative or technical field
- 8+ years of experience developing data systems at scale, including data warehouses, data marts, data lakes, ETL, and analytics solutions
- Experience leading data migration or cloud transformation engagements
- Experience with Databricks and Azure Data Platform
- 5+ years of leadership and people management experience in a technology environment
- Knowledge of cloud technology market trends
- Experience managing projects involving cloud data platforms, data warehouses, ETL or ELT pipelines, analytics solutions, and reporting ecosystems
- Leadership, problem-solving, and people management skills
- Excellent listening, written communication, and presentation skills
EXL Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about EXL and has not been reviewed or approved by EXL.
-
Healthcare Strength — Medical plan options include HSA, HRA, and PPO choices, with additional health-related programs such as disability coverage and an employee assistance program. Feedback suggests these options provide meaningful flexibility and coverage breadth for many roles.
-
Leave & Time Off Breadth — Up to 20 days of paid time off, plus federal holidays and paid sick and safe time, are highlighted. Feedback suggests this leave structure is a notable benefit alongside core compensation.
-
Retirement Support — A traditional and Roth 401(k) with up to a 3% company match and full vesting after one year is described. Feedback suggests this match and vesting timeline help bolster long-term savings.
EXL Insights
What We Do
Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Unrealistic overhauls and off-the-shelf products ignore what matters most — your unique needs, culture, goals, and your legacy data and technology environments. At EXL, our collaboration is built on ongoing listening and learning to adapt our methodologies. We’re your business evolution partner—tailoring solutions that make the most of data to make better business decisions and drive more intelligence into your increasingly digital operations. Whether your goals are scaling the use of AI and digital, redesign operating models, or driving better and faster decisions, we’re here to partner with you to help you gain—and maintain—competitive advantage with efficient, sustainable models at scale. Our expertise in transformation, data science, and change management helps make your business more efficient and effective, improve customer relationships and enhance revenue growth. Instead of focusing on multi-year, resource- and time-intensive platform designs or migrations, we look deeper at your entire value chain to integrate strategies with impact. We use our specialization in analytics, digital interventions, and operations management—alongside deep industry expertise — to deliver solutions that help you outperform the competition. At EXL, it’s all about outcomes—your outcomes—and delivering success on your terms. Share your goals with us and together, we’ll optimize how you leverage data to drive your business forward. For more information, visit www.exlservice.com.
.png)
