Exavalu

Databricks Engineer

Posted 16 Days Ago

Hiring Remotely in Chennai, Tamilnadu, IND

In-Office or Remote

Entry level

Information Technology • Business Intelligence • Consulting

The Role

Design, build, optimize, and troubleshoot ETL/ELT pipelines using Azure Databricks, Spark, Python, PySpark, and SQL. Manage ADLS Gen2 and implement Delta Lake for reliable, versioned data operations. Integrate Databricks with Azure Data Factory, Synapse Analytics, and Key Vault. Optimize clusters and Spark jobs for cost and performance while implementing security, governance, encryption, RBAC, and data lineage.

Summary Generated by Built In

This is a remote position.

Overview :

Data Pipeline Development: Design, build, and optimize robust ETL/ELT pipelines using Azure Databricks, Spark, and SQL.
Data Processing & Transformation: Utilize Python, PySpark, and SQL to clean, transform, and aggregate complex data for analytics.
Azure Data Lake Management: Manage and optimize data storage and retrieval in Azure Data Lake Storage (ADLS) Gen2.
Delta Lake Implementation: Implement Delta Lake for ACID compliance, data versioning, and high-performance data lake operations.
Integration with Azure Services: Integrate Databricks with Azure Data Factory for orchestration, Azure Synapse Analytics for warehousing, and Azure Key Vault for security.
Performance Optimization: Monitor, troubleshoot, and optimize Databricks clusters and spark jobs to manage costs and performance.
Data Security & Governance: Implement Role-Based Access Control (RBAC), data encryption, and data lineage tracking.

Requirements

Strong data engineering skills on Azure, ADF, Synapse and Databricks Strong experience of Python/Pysprak, SQL

Benefits

Diversity Inclusion: Exavalu also promotes flexibility, adapting to the needs of employees, customers, and the business. It might be part-time work, working outside normal 9-5 business hours or working remotely. We also offer a welcome back program to help individuals return to the mainstream after a prolonged absence due to health or family reasons. At Exavalu, we are committed to building a diverse and inclusive workforce. We welcome applications for employment from all qualified candidates, regardless of race, colour, gender, national or ethnic origin, age, disability, religion, sexual orientation, gender identity or any other status protected by applicable law. We nurture a culture that embraces all individuals and promotes diverse perspectives, where you can make an impact and grow your career

Skills Required

Strong data engineering skills on Azure
Experience with Azure Data Factory
Experience with Azure Synapse Analytics
Experience with Azure Databricks
Strong experience with Python or PySpark
Strong experience with SQL

View all jobs at Exavalu

View Exavalu Profile

Report Job

Am I A Good Fit?

beta

Get Personalized Job Insights.

Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company

Chennai, Tamilnadu

295 Employees

Year Founded: 2018

What We Do

Exavalu leads the way in business and technology consulting and solution delivery, focusing on specialized digital transformation across the Insurance, Healthcare & Life Sciences, and Nonprofit industries. As an award-winning digital transformation advisor, we take pride in delivering leading-edge solutions to clients worldwide. Led by industry veterans and technology experts, we bring our deep understanding in customer experience, process automation, digital engineering, cloud, data and AI with a very strong industry core foundation. Drawing on our industry insights and technological acumen, we enable clients to drives growth, profitability, and cost optimization. We mitigate risks and elevate customer experience through our comprehensive suite of services, including strategic advisory, expert-led technology [build and maintenance], and best-in-class products and solutions. Our unwavering focus on understanding the industry's hard problems and finding the right solution has garnered recognition as the preferred ally for organizations seeking transformative growth.