Databricks Tech Lead

Posted 4 Hours Ago
Be an Early Applicant
Dublin, Leinster, IRL
Hybrid
Expert/Leader
Information Technology • Database • Consulting
The Role
Lead the architecture and delivery of enterprise Databricks Lakehouse and financial crime solutions for banking clients. Design cloud data platforms supporting AML, KYC, fraud detection, sanctions screening, transaction monitoring, and regulatory reporting. Define governance, security, streaming, ingestion, and data modeling frameworks; oversee Spark and PySpark engineering teams; develop migration roadmaps; conduct stakeholder workshops; and provide client-facing consulting, architectural leadership, and mentoring.
Summary Generated by Built In

EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world’s leading corporations in industries including insurance, healthcare, banking and financial services, media and retail, among others. EXL was founded in 1999 with the core values of innovation, collaboration, excellence, integrity and respect. 


We are headquartered in New York and have more than 60,000 employees spanning six continents. For more information, visit www.exlservice.com.


Role Title: Databricks Tech Lead

BU/Segment: Data Management / Banking & Financial Services

Location:   Dublin, Republic of Ireland (Flexible hybrid working) 

Employment Type: Contract


Summary of the role:

We are seeking a highly experienced Databricks Solution Architect to lead the design and delivery of large-scale Data, Analytics and Financial Crime solutions for Banking and Financial Services clients.

The successful candidate will be responsible for defining end-to-end Databricks Lakehouse architectures, and delivering Financial Crime platforms covering Anti-Money Laundering (AML), Know Your Customer (KYC), Customer Risk Assessment (CRA), Sanctions Screening, Transaction Monitoring, Fraud Detection, and Regulatory Reporting.

This is a client-facing consulting role requiring strong architecture leadership, domain expertise, solutioning capabilities, and the ability to translate business requirements into scalable cloud-native solutions.

As part of your duties, you will be responsible for:

Solution Architecture & Consulting

  • Lead end-to-end architecture design for Databricks-based Financial Crime and Banking platforms.
  • Define enterprise data architectures leveraging Lakehouse, Delta Lake and Unity Catalog.
  • Conduct discovery workshops with business, compliance, and technology stakeholders.
  • Translate regulatory and operational requirements into scalable technical solutions.
  • Develop target-state architectures, migration roadmaps, and implementation strategies.

Financial Crime & Risk Management

  • Architect solutions supporting: 
    • AML Transaction Monitoring
    • Customer Risk Assessment (CRA)
    • KYC and Customer Due Diligence
    • Ongoing Due Diligence (ODD)
    • Sanctions and PEP Screening
    • Fraud Detection
    • Financial Crime Investigations
    • Regulatory Reporting
  • Design Customer 360 and Financial Crime Lakehouse solutions.
  • Enable real-time monitoring and risk analytics using streaming architectures.

Databricks Platform Architecture

  • Design enterprise Databricks environments across Azure, AWS, or GCP.
  • Architect: 
    • Delta Lake
    • Unity Catalog
    • Lakehouse Architecture
    • Lakeflow / DLT
    • MLflow
    • Databricks SQL
    • Auto Loader
    • Vector Search and AI capabilities
  • Define security, governance, lineage, and access-control frameworks.
  • Ensure scalability, platform resilience, and cost optimization.

Data Engineering Leadership

  • Define ingestion frameworks using: 
  • CDC
  • Event Streaming
  • Kafka
  • Azure Event Hub
  • Batch Processing
  • Design Bronze/Silver/Gold data models.
  • Oversee development teams implementing Spark and PySpark pipelines.
  • Establish reusable accelerators and architectural standards.

Qualifications and experience we consider to be essential for the role:

  • Bachelor's or Master's degree in Computer Science, Engineering, Analytics, Mathematics, or related discipline.
  • 12+ years of Data and Analytics experience.
  • 5+ years of hands-on Databricks architecture experience.
  • 5+ years within Banking, Financial Services, AML, Fraud, or Financial Crime programs.
  • Proven experience designing enterprise-scale cloud data platforms.

Skills we would like to have:

Databricks

Delta Lake, Databricks SQL, Unity Catalog, Lakeflow / DLT, MLflow, Auto Loader, Photon Engine, Vector Search

Data Engineering

PySpark, Python, Scala, Data Modeling, CDC Architecture, Batch and Streaming Pipelines


Cloud Platforms

Azure (preferred)


DevOps & Automation

Azure DevOps, GitHub, CI/CD, Terraform, Infrastructure as Code


Preferred Certifications

  • Databricks Certified Data Engineer Professional
  • Databricks Certified Solution Architect
  • Databricks Certified Machine Learning Professional


Responsibilities

Lead data warehousing strategy. Drive organizational change. Represent in external forums. Mentor senior leaders.

Qualifications

Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field. 12-14 years of experience in data warehousing or data management.

Skills Required

  • Bachelor's or Master's degree in Computer Science, Engineering, Analytics, Mathematics, Data Science, Information Technology, or a related discipline
  • 12+ years of Data and Analytics experience
  • 12-14 years of experience in data warehousing or data management
  • 5+ years of hands-on Databricks architecture experience
  • 5+ years of experience in Banking, Financial Services, AML, Fraud, or Financial Crime programs
  • Proven experience designing enterprise-scale cloud data platforms
  • Databricks Certified Data Engineer Professional certification
  • Databricks Certified Solution Architect certification
  • Databricks Certified Machine Learning Professional certification
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
30,246 Employees
Year Founded: 1999

What We Do

Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Unrealistic overhauls and off-the-shelf products ignore what matters most — your unique needs, culture, goals, and your legacy data and technology environments. At EXL, our collaboration is built on ongoing listening and learning to adapt our methodologies. We’re your business evolution partner—tailoring solutions that make the most of data to make better business decisions and drive more intelligence into your increasingly digital operations. Whether your goals are scaling the use of AI and digital, redesign operating models, or driving better and faster decisions, we’re here to partner with you to help you gain—and maintain—competitive advantage with efficient, sustainable models at scale. Our expertise in transformation, data science, and change management helps make your business more efficient and effective, improve customer relationships and enhance revenue growth. Instead of focusing on multi-year, resource- and time-intensive platform designs or migrations, we look deeper at your entire value chain to integrate strategies with impact. We use our specialization in analytics, digital interventions, and operations management—alongside deep industry expertise — to deliver solutions that help you outperform the competition. At EXL, it’s all about outcomes—your outcomes—and delivering success on your terms. Share your goals with us and together, we’ll optimize how you leverage data to drive your business forward. For more information, visit www.exlservice.com.

Similar Jobs

Hybrid
2 Locations
289097 Employees

CrowdStrike Logo CrowdStrike

Data Analyst

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
4 Locations
11000 Employees

Pfizer Logo Pfizer

Digital Operations Agentic Lead - Senior Manager

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
29 Locations
121990 Employees
Hybrid
2 Locations
289097 Employees

Similar Companies Hiring

Axle Health Thumbnail
Artificial Intelligence • Healthtech • Information Technology • Logistics
Santa Monica, CA
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account