Databricks Platform Engineer (Terraform / AWS / GitLab CI/CD)

Posted Yesterday
Be an Early Applicant
Hiring Remotely in Chennai, Tamilnadu, IND
In-Office or Remote
Expert/Leader
Information Technology • Business Intelligence • Consulting
The Role
Deploys and manages Databricks infrastructure on AWS using Terraform, including workspaces, clusters, jobs, permissions, and Unity Catalog. Builds GitLab CI/CD pipelines for infrastructure and Databricks assets, configures secure integrations among GitLab, Databricks, and AWS, and partners with platform engineering on infrastructure standards and integrations.
Summary Generated by Built In

This is a remote position.

JD: Databricks Platform Engineer (Terraform / AWS / GitLab CI/CD)

Experience: 10+ years

Role summary

This is a hands-on engineer role covering Databricks infrastructure-as-code, deployment on AWS, and CI/CD integration with GitLab. You’ll work closely with platform engineering. It does not involve data science.

Key responsibilities

  • Deploy and manage Databricks on AWS using Terraform
  • Build and maintain Terraform code for Databricks resources: workspaces, clusters, jobs, permissions and Unity Catalog
  • Set up GitLab CI/CD pipelines that deploy infrastructure and Databricks assets
  • Configure secure connections between GitLab, Databricks and AWS
  • Work with platform engineers on infrastructure standards and integrations

Must-have skills

  • Terraform with the Databricks provider
  • Databricks deployment on AWS
  • GitLab CI/CD integration with Databricks
  • Core AWS services: IAM, VPC, S3

Good to have

  • Databricks and data engineering experience
  • OpenTelemetry (OTel) for observability


Requirements

Key responsibilities

  • Deploy and manage Databricks on AWS using Terraform
  • Build and maintain Terraform code for Databricks resources: workspaces, clusters, jobs, permissions and Unity Catalog
  • Set up GitLab CI/CD pipelines that deploy infrastructure and Databricks assets
  • Configure secure connections between GitLab, Databricks and AWS
  • Work with platform engineers on infrastructure standards and integrations

Must-have skills

  • Terraform with the Databricks provider
  • Databricks deployment on AWS
  • GitLab CI/CD integration with Databricks
  • Core AWS services: IAM, VPC, S3

Good to have

  • Databricks and data engineering experience
  • OpenTelemetry (OTel) for observability

Benefits

At Exavalu, we are committed to building a diverse and inclusive workforce. We welcome applications for employment from all qualified candidates, regardless of race, color, gender, national or ethnic origin, age, disability, religion, sexual orientation, gender identity or any other status protected by applicable law. We nurture a culture that embraces all individuals and promotes diverse perspectives, where you can make an impact and grow your career.

Exavalu also promotes flexibility  depending on the needs of employees, customers and the business. It might be part-time work, working outside normal 9-5 business hours or working remotely. We also have a welcome back program to help people get back to the mainstream after a long break due to health or family reasons.



Skills Required

  • 10+ years of experience
  • Terraform with the Databricks provider
  • Databricks deployment on AWS
  • GitLab CI/CD integration with Databricks
  • AWS IAM, VPC, and S3
  • Databricks and data engineering experience
  • OpenTelemetry for observability
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Chennai, Tamilnadu
295 Employees
Year Founded: 2018

What We Do

Exavalu leads the way in business and technology consulting and solution delivery, focusing on specialized digital transformation across the Insurance, Healthcare & Life Sciences, and Nonprofit industries. As an award-winning digital transformation advisor, we take pride in delivering leading-edge solutions to clients worldwide. Led by industry veterans and technology experts, we bring our deep understanding in customer experience, process automation, digital engineering, cloud, data and AI with a very strong industry core foundation. Drawing on our industry insights and technological acumen, we enable clients to drives growth, profitability, and cost optimization. We mitigate risks and elevate customer experience through our comprehensive suite of services, including strategic advisory, expert-led technology [build and maintenance], and best-in-class products and solutions. Our unwavering focus on understanding the industry's hard problems and finding the right solution has garnered recognition as the preferred ally for organizations seeking transformative growth.

Similar Jobs

Capco Logo Capco

Project Manager

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

Capco Logo Capco

Business Analyst

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

Capco Logo Capco

Product Manager

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

Mondelēz International Logo Mondelēz International

Sales Officer Trainee - North Branch

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
India
90000 Employees

Similar Companies Hiring

Quanta Thumbnail
Artificial Intelligence • Fintech • Software • Business Intelligence • Big Data Analytics
San Francisco, California
23 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account