Databricks Technical Lead

Posted 4 Days Ago
Be an Early Applicant
2 Locations
In-Office
Senior level
Insurance • Professional Services • Consulting • Financial Services
The Role
Lead design and delivery of Databricks-based banking data platforms on AWS. Build and optimise large-scale Spark/PySpark pipelines with Delta Lake, own data governance (Unity Catalog), manage Terraform IaC, drive CI/CD, mentor engineers, maintain documentation, and ensure scalable, secure, cost-effective architectures in a regulated financial environment.
Summary Generated by Built In

G MASS are seeking an experienced Databricks Technical Lead to support the development and ownership of strategic data platforms and cloud-based applications within a financial services environment.

The role will focus on defining technical direction and architecture across Databricks and the wider AWS estate, ensuring scalable and secure development practices, and overseeing delivery through the full software development lifecycle. The successful candidate will work closely with Development, Business Analysis, QA, Application Support, IT Security, and Enterprise Architecture teams to deliver robust and high-performing solutions across complex banking and financial systems.

Responsibilities:

  • Lead the development and enhancement of strategic banking data platforms and applications across Databricks and AWS cloud environments
  • Design, build, and optimise large-scale data pipelines using Spark / PySpark, Delta Lake, and Databricks Workflows
  • Own data governance and access control within the Databricks environment, including Unity Catalog design and implementation
  • Manage cloud infrastructure deployments using Terraform and Infrastructure as Code best practices
  • Maintain technical documentation and internal knowledge resources
  • Provide technical leadership through mentoring, code reviews, and best practice guidance
  • Support architectural design with a focus on scalability, performance, cost efficiency, and reliability
  • Drive CI/CD improvements across cloud and on-premise environments
  • Promote clean coding standards, automated testing, and effective use of AI-assisted development tools

Requirements
  • Enterprise SDLC experience
  • Financial services experience, including banking exposure
  • Strong hands-on Databricks experience, including Spark / PySpark, Delta Lake, Databricks SQL, and Workflows, with proficiency in Python and / or Scala
  • Experience of Unity Catalog and data governance within a regulated environment
  • Strong AWS experience (EC2, Lambda, ECS, RDS, S3, IAM)
  • Hands-on Terraform / Infrastructure as Code experience
  • CI/CD experience using Jenkins
  • Degree in Computer Science or related discipline (or equivalent experience)
  • IBM MQ or similar messaging systems

Benefits

Length: Permanent

Location: Cork, Dublin, or Amsterdam

Skills Required

  • Enterprise SDLC experience
  • Financial services experience, including banking exposure
  • Hands-on Databricks including Spark / PySpark, Delta Lake, Databricks SQL, and Workflows
  • Proficiency in Python and/or Scala
  • Experience of Unity Catalog and data governance in a regulated environment
  • Strong AWS experience (EC2, Lambda, ECS, RDS, S3, IAM)
  • Hands-on Terraform / Infrastructure as Code experience
  • CI/CD experience using Jenkins
  • Degree in Computer Science or related discipline (or equivalent experience)
  • Experience with IBM MQ or similar messaging systems
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company

What We Do

G MASS is a specialist resource augmentation consultancy focused on Financial Services & Insurance, partnering with clients to augment their teams with the exact skills needed for success.

Similar Jobs

Mastercard Logo Mastercard

Manager, Product Development Disputes

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Remote or Hybrid
Dublin, IRL
38800 Employees

Mastercard Logo Mastercard

Manager, Product Development Disputes

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Howth, Dublin, IRL
38800 Employees

Mastercard Logo Mastercard

Manager, Product Development Disputes

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Clondalkin, Lucan, Dublin, IRL
38800 Employees

Mastercard Logo Mastercard

Manager, Product Development Disputes

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Malahide, Dublin, IRL
38800 Employees

Similar Companies Hiring

Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account