Senior Data Engineer - Azure Databricks Platform

Posted 9 Days Ago
Be an Early Applicant
Mumbai, Maharashtra, IND
In-Office
Senior level
Energy • Renewable Energy
The Role
Owns Azure Databricks platform workstreams across data modeling, medallion architecture, Delta tables, data quality, Azure infrastructure, CI/CD, DevOps, security, and DataOps. The role involves designing and operating scalable production data platforms, managing Terraform and Azure configurations, implementing governance and PII protection, troubleshooting complex issues, and engaging stakeholders globally.
Summary Generated by Built In

We are EnerMech, a specialist service company that delivers safe, integrated solutions for complex energy projects.

For over 50 years, we've been energizing our clients across the world with unrivalled expertise, equipment, and technology that supports the entire asset life-cycle - offshore and on land.

We enable progress through our three global business lines: Energy Solutions, Infrastructure & Industrial Solutions, and Lifting Solutions.

Within these areas, we offer a wide range of services, including cranes, lifting, fluid power, training, equipment rental, pipeline and subsea, process, and valves - all designed to help our clients optimize performance, enhance reliability, and improve efficiency.

With a focus on operational excellence, we deliver value through our customized integrated solutions. This approach reduces risk and enhances efficiencies making us a leading and trusted partner every step of the way.

The Role & Responsibilities

The role will be responsible for taking technical ownership of key workstreams on EnerMech's Azure Databricks data platform, operating across the full platform stack: data modelling and pipeline development in Databricks, the underlying Azure infrastructure, and the CI/CD, DevOps and DataOps practices that keep the platform reliable, secure and scalable.

Working for our Enterprise Business Systems (EBS) function in the Mumbai Shared Service Centre, the role holder operates with a high degree of autonomy, makes and documents architectural decisions, resolves complex platform issues, and is a technical point of contact for the global EBS Team, and business stakeholders.

Key reponsibilities will include:

    • Design, build, quality and reliable operation of assigned workstreams on the Azure Databricks data platform, from scoping through to production deployment. 
    • Integrity of the medallion data model (bronze/silver/gold) for assigned data domains, ensuring data is modelled, validated, documented and certified for downstream reporting and analytics. 
    • Build and optimise Delta tables and materialized views, with attention to performance at scale. 
    • Design and implement data quality frameworks (preferably DQX or equivalent), including quarantine/error handling and validation against data contracts. 
    • Define job-specific compute configurations appropriate to each workload, balancing performance and cost. 
    • Contribute to and troubleshoot Terraform-managed infrastructure (networking, storage, Key Vaults, Managed DevOps Pools, Dev Centers). 
    • Own and maintain Azure DevOps build and release pipelines, variable groups/libraries, and repository security, permissions and branch policies. 
    • Support environment-level Azure configuration, including subscription-level access, RBAC for user and pipeline (service principal) identities, and Terraform state backend management across multiple storage accounts and environments. 
    • Operate autonomously across a workstream, from scoping through to production deployment. 
    • Use AI-assisted tooling to support day-to-day development, validating outputs against authoritative sources (architecture decisions, technical leads, documentation) before acting on them. 
    • Communicate clearly with technical and non-technical stakeholders, including across time zones with colleagues in the UK, Americas, Middle East and Asia Pacific.

The Requirements

Essential 

  • Bachelor's degree in Computer Science, Engineering, Information Systems or a related discipline, or equivalent practical experience. 
  • Typically 6+ years in data engineering, including 3+ years hands-on with Azure Databricks in production. 
  • Demonstrated ownership of medallion architecture design and data modelling. 
  • Implemented data quality frameworks and data contracts in production. 
  • Implemented PII protection (masking, tokenisation or access tiering) across environments. 
  • Platform engineering experience: diagnosing infrastructure issues, not just consuming platform services. 
  • Track record of autonomous delivery, including direct stakeholder engagement. 
  • Databricks Certified Data Engineer Associate (minimum). 

Desirable 

  • Databricks Certified Data Engineer Professional. 
  • Microsoft AZ-400: Designing and Implementing Microsoft DevOps Solutions. 
  • Multi-environment Azure networking (VNet peering, DNS zone design, NAT Gateway). 
  • Migrating or standing up CI/CD pipelines, incl. introducing pipeline templates/standards. 
  • Governance and identity patterns (e.g. Entra ID, RBAC scoping). 
  • Applying regulatory frameworks (e.g. GDPR) to data platform design. 
  • Shared service centre or global delivery model experience, ideally in energy or industrial services.

Skills Required

  • Bachelor's degree in Computer Science, Engineering, Information Systems, a related discipline, or equivalent practical experience
  • Typically 6+ years of experience in data engineering
  • 3+ years of hands-on Azure Databricks production experience
  • Experience owning medallion architecture design and data modeling
  • Production experience implementing data quality frameworks and data contracts
  • Experience implementing PII protection through masking, tokenization, or access tiering
  • Platform engineering experience diagnosing infrastructure issues
  • Track record of autonomous delivery and direct stakeholder engagement
  • Databricks Certified Data Engineer Associate certification
  • Databricks Certified Data Engineer Professional certification
  • Microsoft AZ-400 certification
  • Experience with multi-environment Azure networking, including VNet peering, DNS zones, and NAT Gateway
  • Experience migrating or establishing CI/CD pipelines and introducing pipeline templates or standards
  • Experience with governance and identity patterns such as Entra ID and RBAC scoping
  • Experience applying regulatory frameworks such as GDPR to data platform design
  • Shared service center or global delivery model experience, preferably in energy or industrial services
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Aberdeen
2,865 Employees
Year Founded: 2008

What We Do

EnerMech delivers integrated specialist services that support critical assets across the energy and infrastructure sectors worldwide. With a heritage rooted in the North Sea and more than five decades of experience, our business has evolved into a dynamic, forward-looking organisation operating in over 50 countries. Through three global business lines—Energy, Infrastructure & Industrial, and Lifting Solutions—we provide full asset lifecycle support, from pre-commissioning through to decommissioning. Our integrated model brings together mechanical, electrical, instrumentation, and lifting capabilities to streamline project delivery, improve safety outcomes, and boost operational efficiency. What sets us apart is the ability to blend global reach with local execution. By working closely with clients to understand their unique challenges, we deliver customised solutions that mitigate risk, enhance performance, and create long-term value. EnerMech is powered by a bold, capable team and a culture built on safety, integrity, and continuous improvement. We take pride in energizing the future of energy, growing our global footprint, and delivering outcomes that make a real difference.

Similar Jobs

Mastercard Logo Mastercard

Software Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Maharashtra, IND
38800 Employees

Mastercard Logo Mastercard

Associate Analyst, Analytics & Metrics

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Navi Mumbai, Thane, Maharashtra, IND
38800 Employees

Mastercard Logo Mastercard

Engineering Manager

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Maharashtra, IND
38800 Employees

Mastercard Logo Mastercard

Lead Software Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Maharashtra, IND
38800 Employees

Similar Companies Hiring

Energy CX Thumbnail
Greentech • Professional Services • Business Intelligence • Consulting • Energy • Financial Services • Utilities
Chicago, IL
150 Employees
Rangeview Thumbnail
Aerospace • Robotics • Energy • Defense • Manufacturing • Weapons Systems
El Segundo, California
38 Employees
Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
Glendale, Kentucky
55 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account