The Role
Lead production support and continuous improvement for an Azure and Databricks data platform. Responsibilities include incident resolution, root-cause analysis, stakeholder communication, monitoring, performance and cost optimization, data quality and governance, change and release management, KPI reporting, documentation, training, and automation including self-healing capabilities.
Summary Generated by Built In
Role Overview:
We are seeking a strong Data Engineering Lead with support engagement experience to manage and enhance a Data Platform built on Azure and Databricks. This role requires a hands-on leader who can stabilize, optimize, and mature platform operations through structured processes and automation.
Key Responsibilities:
- Incident & Communication Management – Ensure quick resolution, RCA, and transparent stakeholder updates.
- Proactive Monitoring & Optimization – Improve performance, cost, and reliability.
- Data Quality & Governance – Enforce data integrity, lineage, and compliance.
- Change & Release Management – Streamline deployments and minimize disruptions.
- Reporting & Continuous Improvement – Track KPIs, resolve recurring issues, and drive efficiency.
- Knowledge Management – Maintain documentation, SOPs, and training for seamless operations.
- Automation & Monitoring – Implement self-healing mechanisms and reduce manual overhead.
Qualifications:
- 8+ years in data engineering & platform support, with expertise in Azure & Databricks.
- Strong knowledge of incident management, performance tuning, and data governance.
- Hands-on experience with SQL, Python, Spark, and CI/CD pipelines.
- Familiarity with monitoring tools (Azure Monitor etc.) and automation frameworks.
- Excellent communication and stakeholder management skills.
Skills Required
- 8+ years of experience in data engineering and platform support
- Expertise with Azure and Databricks
- Knowledge of incident management, performance tuning, and data governance
- Hands-on experience with SQL, Python, Spark, and CI/CD pipelines
- Familiarity with monitoring tools such as Azure Monitor
- Experience with automation frameworks
- Strong communication and stakeholder management skills
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Anblicks is a Cloud Data Analytics Company based out of Dallas, TX, with offices in USA, India, and Australia. Since 2004, Anblicks has been helping customers by bringing value to their data and implementing modern data architecture and advanced analytics solutions in the cloud.
