The Role
Design and implement scalable ETL and real-time/batch pipelines using Azure Data Factory, Synapse, and Spark; build and optimize lakehouse and warehouse analytics, integrate Kusto/Delta Lake sources, tune SQL, develop Power BI reports with DAX, maintain secure Azure data architectures, and document technical processes.
Summary Generated by Built In
Lead Data Engineer
Primary Skills
- AKS, Event Hub, Azure DevOps, Azure sentinel, Cosmos DB, Azure Functions
Specialization
- Azure Data Engineering Advanced: Senior Lead Data Engineer
Job requirements
- Experience Range: with at least 4 to 6 years of hands-on experience in data engineering, including substantial expertise in Azure analytics and pipeline development Key Responsibilities: 1. Design and implement scalable ETL processes using Azure Data Factory, Synapse Analytics, and Spark, delivering robust real-time and batch data feeds 2. Develop and optimize data pipelines and models for large-scale lakehouse and warehouse analytics systems, achieving high performance and reliability targets 3. Integrate and manage data sources from Azure Data Explorer, Kusto, and Delta Lake formats to enable advanced analytics and reporting capabilities 4. Configure and maintain cloud-hosted data architectures, leveraging Azure services to ensure secure, efficient, and resilient data operations 5. Collaborate with cross-functional teams to capture data requirements and drive test-driven, data-driven development methodologies 6. Monitor, troubleshoot, and enhance SQL performance, ensuring efficient query execution and maintaining data quality across all systems 7. Develop and maintain Power BI reports, focusing on data modeling and DAX to deliver actionable insights to stakeholders 8. Document technical business processes and data architecture, supporting organizational knowledge sharing and compliance Required Skills: 1. Azure Synapse Analytics 2. Azure Data Factory 3. Azure Data Explorer (Kusto) 4. Pyspark 5. Delta Lake 6. SQL performance tuning 7. Power BI (Data Modeling and DAX) 8. Azure Data Lake Preferred Skills: 1. Azure DevOps for CI/CD 2. AKS (Azure Kubernetes Service) 3. Event Hub 4. Azure Sentinel 5. Experience with large-scale streaming analytics Desired Qualifications: 1. Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline 2. Microsoft Certified: Azure Data Engineer Associate 3. Microsoft Certified: Azure Solutions Architect Expert Additional Information: Location: Bangalore
Skills Required
- 4 to 6 years hands-on data engineering experience (Azure analytics and pipeline development)
- Azure Synapse Analytics
- Azure Data Factory
- Azure Data Explorer (Kusto)
- PySpark / Spark
- Delta Lake
- SQL performance tuning
- Power BI (data modeling and DAX)
- Azure Data Lake
- Azure DevOps (CI/CD)
- AKS (Azure Kubernetes Service)
- Event Hub
- Azure Sentinel
- Experience with large-scale streaming analytics
- Bachelor's degree in Computer Science or related discipline
- Microsoft Certified: Azure Data Engineer Associate / Azure Solutions Architect Expert
Brillio Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Brillio and has not been reviewed or approved by Brillio.
-
Healthcare Strength — Healthcare is considered comprehensive, including medical coverage for employees and dependents alongside life, disability, and accidental death protections. Feedback suggests these protections are a core strength of the package.
-
Leave & Time Off Breadth — Time-off options include paid leave and parental leave, with flexible or ‘flexible PTO’ approaches cited in some contexts. Feedback suggests this breadth helps support work-life balance when team norms permit usage.
-
Wellbeing & Lifestyle Benefits — Wellbeing offerings span counseling, financial-management sessions, fitness programs, and travel insurance, plus region-specific extras like discounted IT hardware and work-from-home essentials. Feedback suggests these add-ons enhance perceived value beyond core insurance.
Brillio Insights
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Brillio is the leader in global digital business transformation, applying technology with a human touch. We help businesses define internal and external transformation objectives, and translate those objectives into actionable market strategies using proprietary technologies. With 2600+ experts and 13 offices worldwide, Brillio is the ideal partner for enterprises that want to quickly increase their core business productivity, and achieve a competitive edge, with the latest digital solutions.
