The Role
Design and implement scalable Databricks-based data lakes and lakehouses, lead cloud migrations, optimize integrations and performance, advise on security and cost, and upskill customer teams through workshops and mentorship.
Summary Generated by Built In
Job Description
Compensation
Our client is looking for a Databricks Solution Architect to join our elite team of data alchemists. You’ll work with cutting-edge cloud and AI solutions, helping customers architect scalable, high-performance data platforms using Databricks on AWS or Azure,.
This role blends deep technical expertise, strategic consulting, and hands-on implementation. You’ll design data solutions, mentor teams, and ensure customers extract maximum value from their Databricks investments.
Responsibilities- Shape the future of AI-driven data platforms – Architect next-gen data lakes, lakehouses, and real-time analytics solutions.
- Lead transformative projects – Guide organisations through cloud migrations, Databricks deployments, and AI-powered decision-making.
- Enable seamless integrations – Optimise how Databricks connects with third-party tools, data pipelines, and governance frameworks.
- Be the go-to expert – Advise customers on best practices, security, cost optimisation, and performance tuning.
- Upskill teams – Conduct workshops, training sessions, and hands-on mentorship to elevate data engineering capabilities.
- Collaborate with the best – Work alongside Datasmiths’ architects, engineers, and Databricks field teams to drive impactful outcomes.
- 5+ years of experience in Big Data, Cloud, or AI-driven architectures.
- Hands-on expertise with Databricks, Apache Spark™, Delta Lake, and MLflow
- Proficiency in Python, Scala, or SQL, with a deep understanding of data engineering and ELT/ETL pipelines.
- Strong cloud experience with AWS orAzure, particularly in data lake architectures and security frameworks.
- Strategic mindset, with experience in technical consulting, solution architecture, or professional services.
- Exceptional problem-solving and customer engagement skills.
- A passion for AI, automation, and making complex data problems disappear.
- Databricks Certification (e.g., Databricks Certified Data Engineer, ML Associate, Solutions Architect).
- Experience in high-scale real-time streaming architectures (e.g., Kafka, Kinesis).
- Prior experience in regulatory-heavy industries (Financial Services, Government).
- Knowledge of AI/ML pipelines and MLOps best practices.
- Be part of an AI-native company – We live and breathe cutting-edge AI and data solutions.
- Work on high-impact projects – We partner with industry leaders to solve some of the toughest data challenges.
- Shape the future of Databricks in ANZ – We are deeply embedded in the Databricks ecosystem, running meetups, training talent, and leading AI-driven transformation.
- Competitive compensation – We offer a generous salary and performance-based bonuses.
- Flexible work culture – Hybrid and remote work options to fit your lifestyle.
- Grow with us – Access top-tier learning resources, Databricks partnerships, and leadership development programs.
The base pay range for this role is A$150,000 – A$200,000 per year.
Skills Required
- 5+ years of experience in Big Data, Cloud, or AI-driven architectures
- Hands-on expertise with Databricks, Apache Spark, Delta Lake, and MLflow
- Proficiency in Python, Scala, or SQL
- Strong cloud experience with AWS or Azure, particularly in data lake architectures and security frameworks
- Experience in technical consulting, solution architecture, or professional services
- Exceptional problem-solving and customer engagement skills
- A passion for AI, automation, and solving complex data problems
- Databricks Certification (e.g., Databricks Certified Data Engineer, ML Associate, Solutions Architect)
- Experience in high-scale real-time streaming architectures (e.g., Kafka, Kinesis)
- Prior experience in regulatory-heavy industries (Financial Services, Government)
- Knowledge of AI/ML pipelines and MLOps best practices
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
MatchDB is a specialized talent marketplace that connects Databricks consultants with organizations utilizing the Databricks Lakehouse Platform. It facilitates the hiring process for both permanent and contract roles, serving as a dedicated network for Databricks expertise. The platform provides tools for companies to post jobs and for consultants to find opportunities, streamlining the recruitment process within this specific technical ecosystem.
