Senior Data Engineer - Enterprise Data Team

Posted Yesterday
Be an Early Applicant
Hyderabad, Telangana, IND
In-Office
Senior level
Information Technology • Consulting
The Role
Designs and maintains large-scale data pipelines on Azure, including ingestion, transformation, storage, and data access. Writes tested production code, reviews designs, monitors data quality and pipeline reliability, troubleshoots production issues, and supports ETL operations. Collaborates with stakeholders on technical planning and agile delivery, contributes to deployments and CI/CD, and mentors junior engineers.
Summary Generated by Built In
Who is Quantium?

Quantium is a world leader in data science and artificial intelligence. Established in Australia in 2002, Quantium is a global team of more than 1,200 people across 14 locations with a unique blend of capabilities across product and consulting services to help businesses unlock value from data and analytics. Quantium partners with the world's largest corporations to forge a better, more intelligent world.


How will you make an impact?Delivery & Engineering
  • Write production-quality code aligned to team standards, including appropriate unit and integration tests
  • Design and implement data pipelines that ingest, transform, and serve large-scale structured and unstructured datasets
  • Review code and test cases produced by others, ensuring changes satisfy business requirements, follow best practices, and integrate cleanly with the existing codebase
  • Provide constructive feedback to other team members on code quality, design patterns, and testing approaches
  • Collaborate with other Lead and Senior Engineers to produce high-level designs and technical architectures for larger pieces of work
  • Validate technical designs and estimates produced by other team members
  • Merge reviewed code into release branches, resolve conflicts, and manage deployments to production and non-production environments

Operations & Reliability

  • Troubleshoot production issues and raise / prioritise bug tickets to drive resolution
  • Proactively monitor pipeline health, data quality, and system performance — acting to report and resolve issues before they impact downstream consumers
  • Provide support for periodic ETL processes that run outside standard Australia business hours (aligned to Indian time zones), ensuring SLAs are met

Planning & Collaboration

  • Work with business stakeholders and technical leads to define, scope, and estimate new epics
  • Contribute to backlog refinement sessions, breaking down epics into well-defined user stories that deliver incremental business value
  • Work closely with Product Owners to ensure the backlog is prioritised to maximise business value while managing technical debt
  • Contribute to sprint planning, daily stand-ups, sprint reviews, and retrospectives to maintain a culture of continuous improvement within the squad

Mentoring & Development

  • Coach and mentor more junior engineers to support their technical growth and professional development
  • Support the Lead Data Engineer in identifying development opportunities and aligning work assignments to team members' longer-term career objectives

The superpowers you'll be bringing to the team:Core Experience
  • 4+ years of experience designing, developing, and implementing end-to-end data solutions (storage, integration, processing, access) on Azure Platform or a comparable cloud platform
  • Strong proficiency in SQL and Python for data engineering workloads
  • Strong understanding of Infrastructure and Security around the data platform. Experience in Terraform or a comparable tooling.
  • Demonstrated experience building ETL/ELT pipelines that transform and process large volumes of structured and unstructured data
  • Solid understanding of data warehousing concepts and data modelling techniques (e.g. dimensional modelling, slowly changing dimensions)
  • Hands-on experience with ADF, SQL Server (or equivalent tools on other cloud platforms)
  • Familiarity with version control (Git) and CI/CD practices
  • Understanding of GNU/Linux systems and shell scripting (Bash)
  • Bachelor's degree in Computer Science, Information Technology, or a related discipline
  • Comfortable working in a fast-paced agile development environment
  • Strong problem-solving and analytical skills
  • Good written and verbal communication skills in English

Desirable

  • Familiarity with containerisation technologies (e.g. Docker, Kubernetes)
  • Exposure to data quality frameworks, data observability tooling, or data governance practices
  • Proficiency with AI-assisted development tooling (e.g. GitHub Copilot, Claude Code, Cursor) and a demonstrated ability to incorporate these tools thoughtfully into day-to-day engineering workflows to improve productivity and code quality
  • Experience working with cross-functional stakeholders across multiple time zones
  • Prior experience mentoring junior engineers in a squad or team setting
  • Commercial awareness, with the ability to connect technical work to business outcomes

What could your Quantium Experience look like?

Working at Quantium will allow you to challenge your imagination. You will get to solve complex problems using rigor, precision and by asking great questions – but it also means you can think big, outside the box and push your problem-solving skills to the max.

By joining the Quantium team, you’ll get to:

  • Forge your path: So many of our team have moved around different teams or offices. You’ll be in the driver’s seat, and we empower you to make your career your own.
  • Find your kind: Embrace diversity and connect with your tribe (think foodies, dog lovers, readers, or runners).
  • Make an impact: Leave your mark. Your contributions resonate, regardless of your role or rank.
But wait, there’s more!

We’ve got some pretty sweet perks:  (refer to benefits doc. for full list and select the benefits most applicable to this role, max 3 bullets)

  • Flexible work arrangements: Achieve work life balance at your own pace with hybrid and flexible work arrangements.
  • Continuous learning: Our vision is empowering analytics talent to thrive. The Analytics Community fosters the development of individuals, thought leadership and technical excellence at Quantium through building strong connections, fostering collaboration, and co-creation of best practice.
  • Remote working: Embrace the opportunity to work outside of your assigned home location for up to 2 months every year.
Apply now and let's forge a better, more intelligent world together!

Quantium’s recruitment process involves the collection and use of personal information, see our Candidate Data Collection Notice for more information. This provides information on how we collect, use & store your personal information, including potential disclosure to our majority shareholder, Woolworths Group Limited.


Skills Required

  • 4+ years designing, developing, and implementing end-to-end data solutions on Azure or a comparable cloud platform
  • Strong proficiency in SQL and Python for data engineering workloads
  • Understanding of infrastructure and security for data platforms
  • Experience with Terraform or comparable infrastructure tooling
  • Experience building ETL/ELT pipelines processing large volumes of structured and unstructured data
  • Understanding of data warehousing and data modeling, including dimensional modeling and slowly changing dimensions
  • Hands-on experience with Azure Data Factory and SQL Server or equivalent tools
  • Familiarity with Git and CI/CD practices
  • Understanding of GNU/Linux systems and Bash shell scripting
  • Bachelor’s degree in Computer Science, Information Technology, or a related discipline
  • Ability to work in a fast-paced agile development environment
  • Strong problem-solving and analytical skills
  • Good written and verbal communication skills in English
  • Familiarity with Docker or Kubernetes
  • Exposure to data quality frameworks, data observability tooling, or data governance practices
  • Proficiency with AI-assisted development tools such as GitHub Copilot, Claude Code, or Cursor
  • Experience working with cross-functional stakeholders across multiple time zones
  • Prior experience mentoring junior engineers
  • Commercial awareness and ability to connect technical work to business outcomes
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Sydney
1,280 Employees
Year Founded: 2002

What We Do

When expertly harnessed and strategically applied, data can be transformational. Quantium offers an unmatched track record of innovation in analytics and data science since 2002. We combine the best of human and artificial intelligence to power possibilities for individuals, organisations and society. Founded in Australia in 2002, Quantium works with iconic brands in over 20 countries, partnering on their greatest challenges and unlocking breakthrough opportunities.

Similar Jobs

Easy Apply
In-Office
Hyderabad, Telangana, IND
900 Employees

Zeta Global Logo Zeta Global

General Ledger & Commissions Analyst

AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Easy Apply
Hybrid
Hyderabad, Telangana, IND
2429 Employees

Zeta Global Logo Zeta Global

Billing Analyst

AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Easy Apply
Hybrid
Hyderabad, Telangana, IND
2429 Employees

Optum Logo Optum

Senior Software Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account