Senior Solutions Architect (Databricks Specialist)

Reposted One Month Ago
Be an Early Applicant
Hiring Remotely in ZAF
Remote
Senior level
Information Technology • Pet • Professional Services
The Role
Lead Databricks-focused data modernization: define target-state architecture, governance, migration strategy, platform optimization, cost efficiency, and alignment to AI/ML and business goals while mentoring teams and advising executives.
Summary Generated by Built In

This is a remote position.

We are seeking an experienced Senior Solutions Architect specializing in Databricks to provide strategic leadership and architectural oversight for a large-scale data modernization program within a leading Financial Services organization.

The client is currently transitioning from a traditional SQL Server and Microsoft-centric data ecosystem to a modern Databricks-based platform to support its long-term data, analytics, and AI strategy. While the client has an established and capable Data Engineering team, they require a senior-level architect to provide strategic direction, implementation frameworks, architectural governance, and best-practice guidance to ensure a successful and cost-effective transformation.

  • This role will focus on defining the target-state architecture, establishing standards and governance, optimizing platform design, and ensuring alignment between technology investments and business objectives.
Key Responsibilities
  • Provide strategic architectural leadership for the organisation's Databricks implementation and data modernization initiatives.
  • Design and define enterprise-scale data and analytics architectures aligned to business and AI objectives.
  • Develop and implement architectural frameworks, standards, patterns, and best practices for Databricks adoption.
  • Guide the Data Engineering team on solution design, scalability, performance optimization, security, and governance.
  • Assess current SQL Server and Microsoft-based environments and define migration strategies to Databricks.
  • Ensure architecture decisions support future AI, machine learning, advanced analytics, and reporting requirements.
  • Evaluate and optimize platform utilization to drive cost efficiency and maximize return on investment.
  • Establish governance, architecture review processes, and implementation roadmaps.
  • Provide executive-level insights and recommendations on technology direction, risks, opportunities, and investments.
  • Collaborate with business stakeholders, technology leadership, engineering teams, and vendors to drive successful outcomes.
  • Oversee solution quality and ensure alignment with enterprise architecture principles and regulatory requirements.
  • Identify technical risks, dependencies, and potential challenges, implementing mitigation strategies where required.
  • Mentor engineering teams and promote architectural excellence across the program


Requirements
Required Technical Skills
Essential
  • Deep expertise in Databricks architecture, implementation, and optimization
  • Strong understanding of enterprise data platforms and modern data architectures
  • Data Lakehouse architecture design and implementation
  • Data governance, security, compliance, and data management frameworks
  • Data migration strategy and execution
  • Enterprise integration patterns and cloud-based architectures
  • Analytics, Business Intelligence, and AI/ML platform enablement
Preferred
  • Experience with Microsoft Azure Data Services
  • Azure Data Factory
  • Azure Synapse Analytics
  • SQL Server
  • Delta Lake
  • Unity Catalog
  • DataOps and DevOps practices
  • AI and Machine Learning platform architecture
Essential Experience & Qualifications
  • 10+ years of experience in Solution Architecture, Enterprise Architecture, or Data Architecture roles.
  • Demonstrated experience delivering large-scale data transformation and modernization initiatives.
  • Extensive experience designing and implementing Databricks solutions in enterprise environments.
  • Proven track record supporting cloud migration and modern data platform programs.
  • Experience within Financial Services, Banking, Insurance, or highly regulated environments.
  • Strong understanding of data governance, security, compliance, and risk management frameworks.
  • Experience developing enterprise architecture standards, frameworks, and governance models.
  • Relevant certifications in Databricks, Cloud Platforms (Azure preferred), TOGAF, or related disciplines are highly advantageous.
Key Competencies
Strategic Leadership
  • Ability to align technology architecture with long-term business strategy.
  • Strong commercial acumen and focus on value delivery.
  • Ability to influence technology direction at executive level.
Stakeholder Engagement
  • Comfortable engaging with C-suite executives and senior business leaders.
  • Strong communication, presentation, and facilitation skills.
  • Ability to simplify complex technical concepts for non-technical audiences.
Architecture & Governance
  • Excellent architectural design and decision-making capabilities.
  • Strong focus on governance, standards, and best practices.
  • Ability to drive consistency across multiple teams and initiatives.
Delivery & Outcomes
  • Results-driven with a focus on business impact and measurable outcomes.
  • Strong problem-solving and analytical thinking skills.
  • Ability to work independently while guiding large technical teams.
Ideal Candidate Profile

The ideal candidate is a highly experienced Senior Solutions Architect with deep Databricks expertise, capable of providing strategic oversight to an established engineering team. They will bring extensive experience in enterprise data transformation, architecture governance, and cloud-based analytics platforms. The successful individual will be comfortable operating at executive level, influencing business and technology strategy, while ensuring Databricks is implemented in a scalable, cost-effective, and future-ready manner that supports the organisation's AI and data ambitions.



Skills Required

  • Deep expertise in Databricks architecture, implementation, and optimization
  • Strong understanding of enterprise data platforms and modern data architectures
  • Data Lakehouse architecture design and implementation
  • Data governance, security, compliance, and data management frameworks
  • Data migration strategy and execution
  • Enterprise integration patterns and cloud-based architectures
  • Analytics, Business Intelligence, and AI/ML platform enablement
  • 10+ years in Solution Architecture, Enterprise Architecture, or Data Architecture
  • Demonstrated delivery of large-scale data transformation and modernization initiatives
  • Extensive experience designing and implementing Databricks solutions in enterprise environments
  • Proven track record supporting cloud migration and modern data platform programs
  • Experience within Financial Services, Banking, Insurance, or highly regulated environments
  • Experience developing enterprise architecture standards, frameworks, and governance models
  • Relevant certifications in Databricks, Cloud Platforms (Azure preferred), TOGAF, or related disciplines
  • Experience with Microsoft Azure Data Services
  • Azure Data Factory
  • Azure Synapse Analytics
  • SQL Server
  • Delta Lake
  • Unity Catalog
  • DataOps and DevOps practices
  • AI and Machine Learning platform architecture
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
22 Employees
Year Founded: 2013

What We Do

Blue Pearl is a market-leading CLOUD Solutions developer with extensive knowledge and insight into the latest technologies, standardised processes, advanced technical capabilities and consulting processes available, ensuring wholistic success for our clientele. We offer professional consulting to compliment your business strategy and overall management and make it our priority to add value to any business by listening, analysing and creating a conducive solution that will empower our client. We implement a Data Analysis Process that includes inspecting, cleansing, transforming, and modelling data with the end-goal of discovering useful information, informing conclusions, and relevant information to support your decision-making. Your business cannot afford not to engage with us, allowing our data analysis to play a role in making your business decisions more scientific and helping your business achieve effective operation. Blue Pearl’s team of experts include BI strategists, BI analysts, Data Warehouse Architects, Data Scientists, Implementation and Development experts. With the use of BI, Analytics and Big Data, we effectively partner with our customers on their mission to achieve a competitive business advantage and real ROI from the structured information we collect.

Similar Jobs

Morningstar Logo Morningstar

Infrastructure Engineer

Artificial Intelligence • Big Data • Enterprise Web • Fintech • Software • Financial Services
Remote or Hybrid
South Africa
11500 Employees
Remote
25 Locations
393 Employees
179K-179K Annually

DuckDuckGo Logo DuckDuckGo

Director, Data Science

Information Technology
Remote
17 Locations
393 Employees
244K-244K Annually

Falcon Funded Logo Falcon Funded

UGC Creator - South Africa

Fintech • Financial Services
Remote
ZA
125 Employees

Similar Companies Hiring

Axle Health Thumbnail
Artificial Intelligence • Healthtech • Information Technology • Logistics
Santa Monica, CA
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account