Senior Data Engineer

Posted 12 Hours Ago
Be an Early Applicant
Hyderabad, Telangana, IND
In-Office
Senior level
Information Technology • Consulting
The Role
Designs and maintains large-scale data pipelines and cloud data solutions using Python, SQL, and GCP technologies. Responsibilities include ETL/ELT development, data quality monitoring, production support, architecture, code review, Agile planning, stakeholder collaboration, mentoring, and deployment management. The role also leads AI-enabled engineering solutions, technical roadmaps, client delivery, engineering standards, and responsible AI adoption.
Summary Generated by Built In
Who is Quantium?

Quantium is a world leader in data science and artificial intelligence. Established in Australia in 2002, Quantium is a global team of more than 1,200 people across 14 locations with a unique blend of capabilities across product and consulting services to help businesses unlock value from data and analytics. Quantium partners with the world's largest corporations to forge a better, more intelligent world.


How will you make an impact?
  • Write production-quality code aligned to team standards, including appropriate unit and integration tests
  • Design and implement data pipelines that ingest, transform, and serve large-scale structured and unstructured datasets
  • Review code and test cases produced by others, ensuring changes satisfy business requirements, follow best practices, and integrate cleanly with the existing codebase
  • Provide constructive feedback to other team members on code quality, design patterns, and testing approaches
  • Collaborate with other Lead and Senior Engineers to produce high-level designs and technical architectures for larger pieces of work
  • Validate technical designs and estimates produced by other team members
  • Merge reviewed code into release branches, resolve conflicts, and manage deployments to production and non-production environments

Operations & Reliability

  • Troubleshoot production issues and raise / prioritise bug tickets to drive resolution
  • Proactively monitor pipeline health, data quality, and system performance — acting to report and resolve issues before they impact downstream consumers
  • Provide support for periodic ETL processes that run outside standard Hyderabad business hours (aligned to Australian time zones), ensuring SLAs are met

Planning & Collaboration

  • Work with business stakeholders and technical leads to define, scope, and estimate new epics
  • Contribute to backlog refinement sessions, breaking down epics into well-defined user stories that deliver incremental business value
  • Work closely with Product Owners to ensure the backlog is prioritised to maximise business value while managing technical debt
  • Contribute to sprint planning, daily stand-ups, sprint reviews, and retrospectives to maintain a culture of continuous improvement within the squad

Mentoring & Development

  • Coach and mentor more junior engineers to support their technical growth and professional development
  • Support the Lead Data Engineer in identifying development opportunities and aligning work assignments to team members' longer-term career objectives

  • Lead the technical design and architecture of AI-enabled applications, ensuring scalability, performance and security across both frontend and backend systems.
  • Drive end-to-end delivery of enterprise-grade software solutions for major clients, taking accountability for quality, timeliness and alignment with client expectations.
  • Act as a technical consulting partner to client stakeholders, representing Quantium's engineering capability in senior conversations and translating strategic AI ambitions into executable delivery roadmaps.
  • Establish and embed repeatable methodologies, engineering standards and AI delivery playbooks that can scale across multiple client engagements.
  • Lead and develop a team of engineers, fostering capability growth, engineering excellence and a strong delivery culture aligned to Quantium's capability framework.
  • Collaborate with product managers, delivery managers and data science teams to translate business requirements into well-architected technical solutions.
  • Own and drive the engineering roadmap for assigned products and client platforms, balancing technical debt reduction with feature and AI capability development.
  • Champion the adoption of AI-first engineering practices, modern cloud-native architectures and responsible AI principles across client and internal teams.
  • Lead technical discovery sessions, architecture reviews and design forums for major features, system components and AI integration patterns.
  • Contribute to Quantium's broader engineering community through knowledge sharing, thought leadership and participation in cross-team technical initiatives.
The superpowers you'll be bringing to the team:Core Experience
  • 5+ years of experience designing, developing, and implementing end-to-end data solutions (storage, integration, processing, access) on Google Cloud Platform or a comparable cloud platform
  • Strong proficiency in SQL and Python for data engineering workloads
  • Demonstrated experience building ETL/ELT pipelines that transform and process large volumes of structured and unstructured data
  • Solid understanding of data warehousing concepts and data modelling techniques (e.g. dimensional modelling, slowly changing dimensions)
  • Hands-on experience with BigQuery, Airflow or Argo Workflows, Dataflow, and Pub/Sub (or equivalent tools on other cloud platforms)
  • Familiarity with version control (Git) and CI/CD practices
  • Understanding of GNU/Linux systems and shell scripting (Bash)
  • Bachelor's degree in Computer Science, Information Technology, or a related discipline
  • Comfortable working in a fast-paced agile development environment
  • Strong problem-solving and analytical skills
  • Good written and verbal communication skills in English

Desirable

  • Experience with infrastructure-as-code tools (e.g. Terraform)
  • Familiarity with containerisation technologies (e.g. Docker, Kubernetes)
  • Exposure to data quality frameworks, data observability tooling, or data governance practices
  • Proficiency with AI-assisted development tooling (e.g. GitHub Copilot, Claude Code, Cursor) and a demonstrated ability to incorporate these tools thoughtfully into day-to-day engineering workflows to improve productivity and code quality
  • Experience working with cross-functional stakeholders across multiple time zones
  • Prior experience mentoring junior engineers in a squad or team setting
  • Commercial awareness, with the ability to connect technical work to business outcomes

What could your Quantium Experience look like?

Working at Quantium will allow you to challenge your imagination. You will get to solve complex problems using rigor, precision, and by asking great questions – but it also means you can think big, outside the box, and push your problem-solving skills to the max.

By joining the Quantium team, you'll get to:

  • Forge your path: Shape your career journey with opportunities to move across different teams or offices
  • Find your kind: Embrace diversity and connect with like-minded professionals
  • Make an impact: Drive transformational outcomes for leading FMCG clients through data-driven solutions

Benefits and Perks:

  • Flexible Work Arrangements: Achieve work-life balance with hybrid and flexible work arrangements
  • Continuous Learning: Access to the Analytics Community, fostering development, thought leadership, and technical excellence through collaboration and best practice sharing
  • Group and Health Insurance: Comprehensive coverage for you and your loved ones
  • Supportive Environment: Modern, flexible, and supportive workplace dedicated to powering possibilities for our team members, clients, and partners

Quantium’s recruitment process involves the collection and use of personal information. Please click on the link “Privacy” for Quantium’s Collection Notice. This provides information on how we collect, use & store your personal information, including potential disclosure to our majority shareholder, Woolworths Group Limited.



Quantium’s recruitment process involves the collection and use of personal information, see our Candidate Data Collection Notice for more information. This provides information on how we collect, use & store your personal information, including potential disclosure to our majority shareholder, Woolworths Group Limited.


Skills Required

  • 5+ years of experience designing, developing, and implementing end-to-end data solutions on Google Cloud Platform or a comparable cloud platform
  • Strong proficiency in SQL and Python for data engineering workloads
  • Experience building ETL/ELT pipelines processing large volumes of structured and unstructured data
  • Understanding of data warehousing and data modeling techniques, including dimensional modeling and slowly changing dimensions
  • Hands-on experience with BigQuery, Airflow or Argo Workflows, Dataflow, and Pub/Sub, or equivalent tools
  • Familiarity with Git and CI/CD practices
  • Understanding of GNU/Linux systems and Bash shell scripting
  • Bachelor’s degree in Computer Science, Information Technology, or a related discipline
  • Ability to work in a fast-paced Agile development environment
  • Strong problem-solving and analytical skills
  • Good written and verbal communication skills in English
  • Experience with Terraform or other infrastructure-as-code tools
  • Familiarity with Docker or Kubernetes
  • Exposure to data quality frameworks, data observability tooling, or data governance practices
  • Experience using AI-assisted development tools such as GitHub Copilot, Claude Code, or Cursor
  • Experience working with cross-functional stakeholders across multiple time zones
  • Prior experience mentoring junior engineers
  • Commercial awareness and ability to connect technical work to business outcomes
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Sydney
1,280 Employees
Year Founded: 2002

What We Do

When expertly harnessed and strategically applied, data can be transformational. Quantium offers an unmatched track record of innovation in analytics and data science since 2002. We combine the best of human and artificial intelligence to power possibilities for individuals, organisations and society. Founded in Australia in 2002, Quantium works with iconic brands in over 20 countries, partnering on their greatest challenges and unlocking breakthrough opportunities.

Similar Jobs

Optum Logo Optum

Senior Data Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Optum Logo Optum

Senior Data Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Optum Logo Optum

Senior Data Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Cohere Health Logo Cohere Health

Senior Data Engineer

Healthtech • Software
Easy Apply
In-Office
Hyderabad, Telangana, IND
900 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account