We are looking for a Senior Databricks Data Engineer with strong expertise in Databricks, cloud data architecture, data engineering, and healthcare data. The ideal candidate will be responsible for designing scalable, secure, and high-performance data platforms supporting healthcare analytics and data integration.
The candidate should have strong knowledge of modern data architecture, Lakehouse architecture, SQL, Python, data governance, and healthcare domain workflows.
Responsibilities- Design and lead Databricks Lakehouse architecture for large-scale healthcare data platforms.
- Define scalable data architectures for batch and real-time healthcare data processing.
- Design data ingestion, transformation, storage, and consumption patterns using Databricks.
- Develop architecture using Delta Lake, Unity Catalog, Databricks Workflows, and Delta Live Tables/Lakeflow.
- Integrate data from multiple healthcare sources, including clinical, claims, eligibility, provider, and patient systems.
- Design robust ETL/ELT pipelines using PySpark, SQL, and Databricks.
- Establish data quality, validation, reconciliation, lineage, and governance frameworks.
- Design secure healthcare data solutions while considering HIPAA and PHI/PII protection requirements.
- Work with cloud platforms such as Azure, AWS, or GCP to build scalable data solutions.
- Collaborate with data engineers, data scientists, analysts, product owners, and business stakeholders.
- Define technical standards, architectural patterns, and best practices for Databricks development.
- Lead performance optimization and cost-management initiatives across the Databricks platform.
- Provide technical leadership and mentoring to data engineering teams.
- Participate in Agile ceremonies and contribute to technical planning and roadmap discussions.
- Strong hands-on experience with Databricks.
- Expertise in Lakehouse architecture and Delta Lake.
- Strong PySpark and SQL skills.
- Experience with Unity Catalog and data governance.
- Experience designing enterprise-scale data platforms.
- Strong knowledge of ETL/ELT and data modeling.
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Experience with data integration and orchestration tools.
- Knowledge of CI/CD, Git, and DevOps practices.
- Strong understanding of data security and access control.
- Experience with Agile/Scrum methodologies.
Skills Required
- Hands-on experience with Databricks
- Expertise in Lakehouse architecture and Delta Lake
- Strong PySpark and SQL skills
- Experience with Unity Catalog and data governance
- Experience designing enterprise-scale data platforms
- Strong knowledge of ETL/ELT and data modeling
- Experience with Azure, AWS, or GCP
- Experience with data integration and orchestration tools
- Knowledge of CI/CD, Git, and DevOps practices
- Strong understanding of data security and access control (HIPAA/PHI/PII protection)
- Experience with Agile/Scrum methodologies
What We Do
Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Unrealistic overhauls and off-the-shelf products ignore what matters most — your unique needs, culture, goals, and your legacy data and technology environments. At EXL, our collaboration is built on ongoing listening and learning to adapt our methodologies. We’re your business evolution partner—tailoring solutions that make the most of data to make better business decisions and drive more intelligence into your increasingly digital operations. Whether your goals are scaling the use of AI and digital, redesign operating models, or driving better and faster decisions, we’re here to partner with you to help you gain—and maintain—competitive advantage with efficient, sustainable models at scale. Our expertise in transformation, data science, and change management helps make your business more efficient and effective, improve customer relationships and enhance revenue growth. Instead of focusing on multi-year, resource- and time-intensive platform designs or migrations, we look deeper at your entire value chain to integrate strategies with impact. We use our specialization in analytics, digital interventions, and operations management—alongside deep industry expertise — to deliver solutions that help you outperform the competition. At EXL, it’s all about outcomes—your outcomes—and delivering success on your terms. Share your goals with us and together, we’ll optimize how you leverage data to drive your business forward. For more information, visit www.exlservice.com.
