Manager

Reposted 2 Days Ago
Be an Early Applicant
Noida, Gautam Buddha Nagar, Uttar Pradesh, IND
Hybrid
Senior level
Information Technology • Database • Consulting
The Role
Design, build, and maintain scalable Azure-based data pipelines and lakehouse solutions. Optimize compute, storage, and costs; implement metadata and master data management; support batch and real-time Spark processing; enable AI/ML analytics and Power BI reporting while ensuring data governance and security.
Summary Generated by Built In
Job Description: Data Engineer (Manager Level – Individual Contributor)Experience: 5–8 yearsLocation: Noida, UPRole Type: Individual Contributor (IC)About the RoleWe are seeking a highly skilled Data Engineer with strong Python development expertise and proven experience in building and scaling cloud-based data management platforms. This role requires hands-on expertise in data pipelines, data lakehouse architectures, and Apache Spark, with a strong foundation in metadata and master data management. The ideal candidate will also bring experience in AI-driven analytics and demonstrate the ability to design, optimize, and manage data solutions with a focus on cost efficiency.Key ResponsibilitiesDesign, build, and maintain scalable data pipelines and ETL/ELT processes across Azure-based ecosystems.Develop and optimize data lakehouse solutions leveraging Azure Synapse Analytics, Microsoft Fabric, and Databricks.Estimate and manage cloud resource utilization and costs for data pipelines, ensuring efficiency and cost-effectiveness.Monitor and fine-tune pipelines to balance performance and cost optimization across compute, storage, and data movement.Collaborate with analytics teams to deliver business-ready datasets for reporting and AI-driven use cases.Implement best practices for metadata and master data management, ensuring data lineage, quality, and governance.Develop and support real-time and batch processing frameworks using Apache Spark.Integrate and support visualization solutions using Power BI for business stakeholders.Partner with data science and AI teams to enable AI/ML-powered analytics solutions.Ensure adherence to data security, compliance, and governance standards.Required Qualifications5–8 years of hands-on experience as a Data Engineer or similar role.Strong Python coding expertise for data processing and automation.Proven experience with Azure Synapse, Microsoft Fabric, and Databricks in enterprise environments.Hands-on expertise with Apache Spark, distributed data processing, and performance optimization.Experience in cost estimation, monitoring, and optimization of cloud-based pipelines.Proficiency in Power BI and data visualization best practices.Strong knowledge of metadata management, master data management, and data governance frameworks.Exposure to AI-driven analytics and integration with ML/GenAI workflows.Solid understanding of data modeling, data quality, and data integration principles.Preferred SkillsFamiliarity with CI/CD pipelines for data engineering (Azure DevOps, GitHub Actions, etc.).Experience with API-driven data ingestion and workflow orchestration tools.Knowledge of responsible AI practices and explainability frameworks.Strong problem-solving, communication, and stakeholder management skills. ; About the TeamEXL is the indispensable partner for leading businesses in data-led industries such as insurance, banking and financial services, healthcare, retail and logistics. We bring a unique combination of data, advanced analytics, digital technology and industry expertise to help our clients turn data into insights, streamline operations, improve customer experience, and transform their business. Our partnerships with clients are built on a foundation of collaboration – and we’ve been chosen as a partner by nine of the top ten leading US insurance companies, nine of the top 20 global banks, and six of the top ten US health care payers. We function as one team to make your goals our goals, whether that’s unlocking the value of generative AI or embedding analytics into workflows that reduce risk or power your growth. Clients choose EXL as their transformation partner for many reasons. Our geographic diversity make talent all over the world instantly accessible. Digital accelerators enable unmatched speed-to-value, letting you realize results fast. It’s our people that truly set us apart, though, including the 1,500 data scientists we have dedicated to our generative AI practice. And our more than twenty years of experience in delivering business services, garnering stellar client references, and maintaining a solid balance sheet are reassuring to our C-suite clients. Find out for yourself why clients, employees, and analysts think we’re some of the best in the business. Contact us to see how we can help you achieve your goals.

Skills Required

  • 5-8 years hands-on experience as a Data Engineer or similar role
  • Strong Python coding expertise for data processing and automation
  • Proven experience with Azure Synapse, Microsoft Fabric, and Databricks in enterprise environments
  • Hands-on expertise with Apache Spark, distributed data processing, and performance optimization
  • Experience in cost estimation, monitoring, and optimization of cloud-based pipelines
  • Proficiency in Power BI and data visualization best practices
  • Strong knowledge of metadata management, master data management, and data governance frameworks
  • Exposure to AI-driven analytics and integration with ML/GenAI workflows
  • Solid understanding of data modeling, data quality, and data integration principles
  • Familiarity with CI/CD pipelines for data engineering (Azure DevOps, GitHub Actions)
  • Experience with API-driven data ingestion and workflow orchestration tools
  • Knowledge of responsible AI practices and explainability frameworks
  • Strong problem-solving, communication, and stakeholder management skills
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
30,246 Employees
Year Founded: 1999

What We Do

Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Unrealistic overhauls and off-the-shelf products ignore what matters most — your unique needs, culture, goals, and your legacy data and technology environments. At EXL, our collaboration is built on ongoing listening and learning to adapt our methodologies. We’re your business evolution partner—tailoring solutions that make the most of data to make better business decisions and drive more intelligence into your increasingly digital operations. Whether your goals are scaling the use of AI and digital, redesign operating models, or driving better and faster decisions, we’re here to partner with you to help you gain—and maintain—competitive advantage with efficient, sustainable models at scale. Our expertise in transformation, data science, and change management helps make your business more efficient and effective, improve customer relationships and enhance revenue growth. Instead of focusing on multi-year, resource- and time-intensive platform designs or migrations, we look deeper at your entire value chain to integrate strategies with impact. We use our specialization in analytics, digital interventions, and operations management—alongside deep industry expertise — to deliver solutions that help you outperform the competition. At EXL, it’s all about outcomes—your outcomes—and delivering success on your terms. Share your goals with us and together, we’ll optimize how you leverage data to drive your business forward. For more information, visit www.exlservice.com.

Similar Jobs

Clearwater Analytics (CWAN) Logo Clearwater Analytics (CWAN)

Software Development Manager

Fintech • Software • Financial Services
Hybrid
Block Noida Authority Office, Sector 6, Gautam Buddha Nagar, Uttar Pradesh, IND
1100 Employees

Ericsson Logo Ericsson

Service Architecture Manager

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
In-Office
Noida, Gautam Buddha Nagar, Uttar Pradesh, IND
88000 Employees

Ericsson Logo Ericsson

Mobile Financial Services Solution Consulting Manager

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
In-Office
Noida, Gautam Buddha Nagar, Uttar Pradesh, IND
88000 Employees

MetLife Logo MetLife

Unit Manager

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Hybrid
Noida, Gautam Buddha Nagar, Uttar Pradesh, IND
43000 Employees

Similar Companies Hiring

Axle Health Thumbnail
Artificial Intelligence • Healthtech • Information Technology • Logistics
Santa Monica, CA
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account