Databricks Data Engineering Manager

Posted 2 Days Ago
Be an Early Applicant
2 Locations
In-Office
Expert/Leader
Information Technology
The Role
Leads and mentors cross-functional data engineering teams delivering Databricks solutions. Designs scalable, secure cloud data platforms; manages project delivery, stakeholders, and issue resolution; enforces governance, observability, and CI/CD practices; and drives innovation across batch, streaming, GenAI, and Lakehouse engineering programs. Advises clients and senior stakeholders while delivering complex data and AI transformation initiatives.
Summary Generated by Built In

About Accenture

Accenture is a global professional services company with leading capabilities in digital, cloud and security. Find out more about us at www.accenture.com.

Job Description: 

Join Accenture’s Data & AI practice and help build the next generation of AI‑ready data platforms on Databricks. We’re investing heavily to lead in GenAI, Data & AI, and we bring that momentum to real client outcomes across ANZ.

As Accenture, we are Databricks’ largest partner and have earned Global GSI Partner of the Year recognition 7 years in a row (2019–2025) and APJ Industry Leader Partner of the Year 2025

You’ll work alongside one of the largest certified Databricks teams in ANZ, supported by a strong local bench and global delivery scale -designing, modernizing, and accelerating data journeys with proven assets and accelerators that move clients faster from strategy to implementation.

Key Responsibilities 

  • Lead and mentor cross-functional data engineering teams to deliver end-to-end Databricks solutions. 

  • Collaborate with clients and SMEs to architect scalable, secure, and efficient data platforms. 

  • Own project delivery, stakeholder communication, and issue resolution across cloud data engagements. 

  • Enforce best practices around data governance, observability, and CI/CD pipelines. 

  • Drive innovation by evaluating emerging data technologies and promoting continuous learning. 

Key Skills

Databricks & Lakehouse Expertise

Expertise across Databricks Lakehouse Platform:

  • Delta Lake & Delta Live Tables (DLT)

  • Unity Catalog (governance, lineage, data sharing)

  • Workflows & orchestration

  • SQL Warehouses & AI/BI Genie capabilities

  • AgentBricks for agentic AI orchestration

Data + AI Platform Engineering

  • Experience with GenAI on Databricks: Model Serving, Vector Search, and LLM integration patterns.

  • Strong understanding of data product architectures, semantic layers, and domain-oriented data design.

Engineering Excellence

  • Advanced proficiency in Python, PySpark, and SQL for large-scale data processing.

  • Strong experience in streaming (Structured Streaming), batch pipelines, and performance optimisation.

  • Hands-on with CI/CD, DevOps, and Lakehouse-native deployment frameworks (e.g. Spark Declarative Pipelines and Declarative Automation Bundles).

Cloud & Ecosystem

  • Deep experience across cloud platforms (AWS, Azure, or GCP) and integration with enterprise data ecosystems.

  • Familiarity with event-driven architectures, APIs, and Microservices integration.

Leadership & Consulting

  • Proven ability to lead large, distributed teams and deliver complex, multi-workstream programs.

  • Strong stakeholder management with C-level engagement and strategic advisory capability.

  • Experience in driving business outcomes through data and AI transformation programs.

Benefits of working at Accenture:

 

·       18 weeks paid parental leave

·       Long & short-term career break opportunities

·       Structured career development program

·       Local and international career opportunities.

·       Certified as a Family Inclusive Workplace™

·       Flexible Work Arrangements - centered around Accenture’s Truly Human ethos and our commitment to supporting the health and wellbeing of our people.

·       We are proud to be in the top 3 of last year’s Diversity & Inclusion Index!

 

We are a WORK180 Endorsed Employer, to see our benefits and policies click here

All our consulting professionals receive comprehensive training covering business acumen, technical and professional skills development. You’ll also have opportunities to hone your functional skills and expertise in an area of specialization. We offer a variety of formal and informal training programs at every level to help you acquire and build specialized skills faster. Learning takes place both on the job and through formal training conducted online, in the classroom, or in collaboration with teammates. The sheer variety of work we do, and the experience it offers, provide an unbeatable platform from which to build a career.

Accenture is a an EEO and Affirmative Action Employee of Females/Minorities/Veterans/Individuals with Disabilities.

 

Equal Employment Opportunity Statement for Australia:

At Accenture, we recognise that our people are multi-dimensional, and we create a work environment where all people feel like they can bring their authentic selves to work, every day.   

Our unwavering commitment to inclusion and diversity unleashes innovation and creates a culture where everyone feels they have equal opportunity. Our range of progressive policies support flexibility in ‘where’, ‘when’ and ‘how’ our people work to ensure that Accenture is an organisation where you can strive for more, achieve great things and maintain the balance and wellbeing you need.

We encourage applications from all people, and we are committed to removing barriers to the recruitment process and employee lifecycle. All employment decisions shall be made without regard to age, disability status, ethnicity, gender, gender identity or expression, religion or sexual orientation and we do not tolerate discrimination. If you require adjustments to the recruitment process or have a preferred communication method, please email [email protected] and cite the relevant Job Number, or contact us on +61 2 9005 5000.   

To ensure our workplace is inclusive and diverse we are setting bold goals and taking comprehensive action. To achieve these goals, we collect information that allows us to track the effectiveness of our Inclusion and Diversity programs. Learn how Accenture protects your personal data and know your rights in relation to your personal data. Read more about our Privacy Statement.

.

About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.

Visit us at www.accenture.com 

Equal Employment Opportunity Statement for New Zealand:

At Accenture, our intention is to foster a culture and a workplace in which all of our people feel a sense of belonging and are respected and empowered to do their best work.


As part of our talent strategy, we hire and develop people who have different backgrounds, different perspectives and different lived experiences. These differences ensure that we have and attract the cognitive diversity to deliver a variety of perspectives, observations and insights which are essential to drive the innovation needed to reinvent, and we hold our leaders accountable for ensuring we have the most innovative and talented people in our industry.


We encourage applications from all people, and we are committed to removing barriers to the recruitment process and employee lifecycle. All employment decisions shall be made without regard to age, disability status, ethnicity, gender, gender identity or expression, religion or sexual orientation and we do not tolerate discrimination. If you require adjustments to the recruitment process or have a preferred communication method, please email [email protected] and cite the relevant Job Number, or contact us on +61 2 9005 5000.


Learn how Accenture protects your personal data and know your rights in relation to your personal data. Read more about our Privacy Statement.

Skills Required

  • Expertise with the Databricks Lakehouse Platform, including Delta Lake, Delta Live Tables, Unity Catalog, Workflows, SQL Warehouses, AI/BI Genie, and AgentBricks
  • Experience with Generative AI on Databricks, including Model Serving, Vector Search, and LLM integration patterns
  • Strong understanding of data product architectures, semantic layers, and domain-oriented data design
  • Advanced proficiency in Python, PySpark, and SQL for large-scale data processing
  • Strong experience with Structured Streaming, batch pipelines, and performance optimization
  • Hands-on experience with CI/CD, DevOps, Spark Declarative Pipelines, and Declarative Automation Bundles
  • Deep experience with at least one cloud platform: AWS, Azure, or GCP
  • Experience integrating event-driven architectures, APIs, and microservices
  • Proven ability to lead large, distributed teams and deliver complex, multi-workstream programs
  • Strong stakeholder management, including C-level engagement and strategic advisory capability
  • Experience driving business outcomes through data and AI transformation programs

Accenture Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Accenture and has not been reviewed or approved by Accenture.

  • Healthcare Strength Pay is considered competitive when paired with robust insurance options and other perks that compare well with large consulting and IT services peers. Multiple national medical plan options plus dental and vision are positioned as a core strength of the overall package.
  • Retirement Support Retirement support is positioned as a standout feature through a 401(k) dollar-for-dollar match up to a set percentage after eligibility. The package is reinforced by additional financial programs such as savings tools and related resources.
  • Parental & Family Support Parental and caregiving supports are presented as a meaningful benefit differentiator through substantial paid parental leave and multiple caregiver-oriented programs. Backup care and fertility/adoption/surrogacy navigation and reimbursements add breadth to family support beyond leave alone.

Accenture Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Dublin
456,553 Employees
Year Founded: 1989

What We Do

Accenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and Consulting, Interactive, Technology and Operations services—all powered by the world’s largest network of Advanced Technology and Intelligent Operations centers. Our 500,000+ people deliver on the promise of technology and human ingenuity every day, serving clients in more than 120 countries. We embrace the power of change to create value and shared success for our clients, people, shareholders, partners and communities. Visit us at www.accenture.com.

Similar Jobs

Xero Logo Xero

Integration Engineer

Cloud • Fintech • Information Technology • Machine Learning • Software
Hybrid
4 Locations
4500 Employees

Halter Logo Halter

Analytics Engineer

Greentech • Hardware • Internet of Things • Machine Learning • Software • Business Intelligence • Agriculture
In-Office
Auckland, NZL
350 Employees

SailPoint Logo SailPoint

Engagement Manager

Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Remote or Hybrid
New Zealand
2461 Employees

SailPoint Logo SailPoint

Architect

Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Remote or Hybrid
New Zealand
2461 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account