BTL / ETL - Data Engineer - SQL / DBT In Azure Databricks

Posted Yesterday
Be an Early Applicant
Gurugram, Haryana, IND
Hybrid
Senior level
Information Technology • Database • Consulting
The Role
Design, build, and maintain Business Translation Layer (BTL) data pipelines using SQL and DBT on Azure Databricks. Implement CI/CD with GitHub and Azure DevOps/Harness, monitor and optimize pipeline performance, diagnose data processing issues, ensure data quality and secure coding practices, and collaborate with teams for system integration.
Summary Generated by Built In

Responsibilities

  1. Design, Develop and maintain Business Translation Layer (BTL) pipelines using SQL/DBT in Azure Databricks 
  2. Create build from Github and release pipeline and Databricks using Azure Devops / Harness
  3. Monitor Performance of BTL Jobs, resolve any issues and improve the performance metrics as needed.
  4. Diagnose system performance issue related to data processing and implement solution to address 
  5. Collaborate with other teams to ensure successful integration of data pipelines into larger system architecture requirement.
  6. Maintain integrity and quality across all pipelines and environments.
  7. Understand and follow secure coding practice to make sure code is not vulnerable 

Responsibilities

Responsibilities

  1. Design, Develop and maintain Business Translation Layer (BTL) pipelines using SQL/DBT in Azure Databricks 
  2. Create build from Github and release pipeline and Databricks using Azure Devops / Harness
  3. Monitor Performance of BTL Jobs, resolve any issues and improve the performance metrics as needed.
  4. Diagnose system performance issue related to data processing and implement solution to address 
  5. Collaborate with other teams to ensure successful integration of data pipelines into larger system architecture requirement.
  6. Maintain integrity and quality across all pipelines and environments.
  7. Understand and follow secure coding practice to make sure code is not vulnerable 

Qualifications

Skills

  • Should have Strong background in Software development with experience in ingest, transform and store data from large datasets using SQL with strong knowledge on distributed computing concepts.
  • Must have hands on experience in designing and developing Data Transformation Logic using SQL
  • Must have hands on Experience with Databricks.
  • Must have minimum 5 years of exposure and good proficiency in data warehousing concepts.
  • Extensive experience writing, optimizing, and data pipelines.
  • Proficient in SQL and database Design concepts.
  • Knowledge of Azure cloud computing platform with Azure Synapse, ADLS
  • Knowledge on GitHub and build management.
  • Passion for data and experience working within a data driven organization
  • Excellent presentation, communication (oral & written), and relationship building skills, across all levels of management

Skills Required

  • Strong background in software development with experience ingesting, transforming, and storing large datasets using SQL and distributed computing concepts.
  • Hands-on experience designing and developing data transformation logic using SQL.
  • Hands-on experience with Databricks (Azure Databricks).
  • Minimum 5 years of exposure and proficiency in data warehousing concepts.
  • Extensive experience writing, optimizing, and maintaining data pipelines.
  • Proficiency in SQL and database design concepts.
  • Knowledge of Azure cloud platform, including Azure Synapse and ADLS.
  • Experience with GitHub and build/release management (CI/CD) and Azure DevOps or Harness.
  • Understanding and following secure coding practices to reduce vulnerabilities.
  • Experience working in a data-driven organization and strong communication and presentation skills.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
30,246 Employees
Year Founded: 1999

What We Do

Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Unrealistic overhauls and off-the-shelf products ignore what matters most — your unique needs, culture, goals, and your legacy data and technology environments. At EXL, our collaboration is built on ongoing listening and learning to adapt our methodologies. We’re your business evolution partner—tailoring solutions that make the most of data to make better business decisions and drive more intelligence into your increasingly digital operations. Whether your goals are scaling the use of AI and digital, redesign operating models, or driving better and faster decisions, we’re here to partner with you to help you gain—and maintain—competitive advantage with efficient, sustainable models at scale. Our expertise in transformation, data science, and change management helps make your business more efficient and effective, improve customer relationships and enhance revenue growth. Instead of focusing on multi-year, resource- and time-intensive platform designs or migrations, we look deeper at your entire value chain to integrate strategies with impact. We use our specialization in analytics, digital interventions, and operations management—alongside deep industry expertise — to deliver solutions that help you outperform the competition. At EXL, it’s all about outcomes—your outcomes—and delivering success on your terms. Share your goals with us and together, we’ll optimize how you leverage data to drive your business forward. For more information, visit www.exlservice.com.

Similar Jobs

Expedia Group Logo Expedia Group

Data Scientist

AdTech • eCommerce • Information Technology • Travel • Generative AI
Hybrid
2 Locations
16000 Employees

Capco Logo Capco

Managing Principal - Data

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

Ericsson Logo Ericsson

Security Specialist Engineer

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
In-Office
3 Locations
88000 Employees

Capco Logo Capco

Python Automation Expert

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account