Req number:
R6875Employment type:
Full timeWorksite flexibility:
HybridWho we areCAI is a global services firm with over 9,000 associates worldwide and a yearly revenue of $1.3 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise.
Job Summary
We are looking for a motivated Azure Data Engineer ready to take us to the next level! If you understand Databricks, Python, Azure Data Services, Azure DevOps, and API integrations and are looking forward to your next career move, apply nowJob Description
We are looking for Azure Data Engineer. This position will be full-time and Hybrid Bangalore.
What You’ll Do
Design, build, and optimize data ingestion and ETL/ELT pipelines using Azure Databricks and Azure Data Factory.
Work extensively with Delta Lake, Structured Streaming, and Lakehouse architecture.
Develop scalable PySpark and Python transformation logic for batch and streaming workloads.
Design and maintain data models (Dimensional, SCD Types 1 & 2, Lakehouse schemas).
Manage data storage using Azure Data Lake Gen2, Delta tables, and Parquet formats.
Integrate with REST/Graph/Custom APIs for data access and ingestion, including OAuth or managed authentication flows.
Implement CI/CD pipelines for data solutions using Azure DevOps (Repos, Pipelines, Release automation).
Implement strong security practices RBAC, Key Vault, managed identities, network security.
Maintain documentation, knowledge sharing, and best practices across the team.
Knowledge of CI/CD for Databricks using Databricks Asset Bundles / DABs.
What You'll Need
Required:
7–8 years of total experience in Data Engineering.
Azure Databricks (Jobs, Workflows, SQL Warehouses, Unity Catalog).
Python / PySpark.
Azure Data Factory & Azure Data Lake Storage.
Azure DevOps (Git branching, CI/CD pipelines).
API integration (REST, Graph API, token-based auth).
Strong command of SQL performance tuning, CTEs, window functions.
Knowledge of distributed systems, partitioning, and big data processing.
Experience with Delta Lake principles (ACID, time travel, vacuum, Z-ordering).
Understanding of Data Governance concepts.
Preferred:
Experience with Event-driven architecture (Kafka/Event Hub).
Knowledge of python backend.
Physical Demands
Sedentary work that involves sitting or remaining stationery most of the time with occasional need to move around the office to attend meetings, etc.
Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard, and monitor.
Reasonable accommodation statement
If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to [email protected] or (888) 824 – 8111.
Skills Required
- 7-8 years of total experience in Data Engineering
- Azure Databricks and related services
- Python / PySpark
- Azure Data Factory & Azure Data Lake Storage
- API integration experience
- Strong SQL performance tuning skills
CAI (cai.io). Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about CAI (cai.io). and has not been reviewed or approved by CAI (cai.io)..
-
Retirement Support — Retirement contributions and an ownership component are highlighted as standout perks and positioned as a key strength of the package. This is framed as a notable differentiator within the overall offering.
-
Wellbeing & Lifestyle Benefits — A wellness program that can reduce medical premiums, an Employee Assistance Program, and active employee resource groups are emphasized. A work-from-anywhere philosophy and flexible scheduling are also presented as quality-of-life benefits when client needs allow.
-
Affordable Benefits — The primary medical setup is described as a high-deductible option with low premiums and an HSA contribution, which some view as cost-effective. Wellness participation is stated to further lower monthly premiums.
CAI (cai.io). Insights
What We Do
CAI is a global services firm with over 8,700 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what’s right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise
