Company Description
Are you passionate about AWS and Snowflake, with hands-on experience helping customers overcome data engineering challenges and building modern data platforms? If so, this could be the perfect role for you!
We are a customer-obsessed, “one stop shop” for all things data-related. We are deliberately narrow in our focus areas, but we go deep in each of them. We provide solutions, services and training in the data strategy, data governance, data security, data management, data classification, data wrangling, data lake, data analytics, data visualisation, artificial intelligence, machine learning and IoT areas. Our solutions and services help transform customer organisations by teaching them how to turn their data into insight!
We build on AWS and Snowflake, using the latest AWS services, best practices and reference architectures. We deliberately focus on helping customers that are data-heavy but insight-light – federal & state government departments, universities, and high-performance sports organisations.
Job Description
Your impact
As an AWS Data Engineer, you will play a key role in working with customers to establish cloud infrastructure, build data pipelines and manage their data effectively. You will have considerable experience working on data-related solutions using AWS and Snowflake, working alongside technical resources such as data analysts, data engineers, and data scientists to enable organisations to derive insights from their data.
You will relish the opportunity to innovate, evolve and test existing assumptions and design bold solutions. Your experience with large-scale data challenges and ability to create reliable, scalable cloud-based solutions, will see you thriving in this role!
Candidates must be currently have full, unrestricted work rights in Australia.
Expectations
- Enjoy honing your technical skills and developing new ones, so you can make strong contributions to deep architecture discussions.
- Have a demonstrated ability to think strategically about solutions to business, product, and technical challenges.
- Possess an innate awareness of technology trends and how they impact the way businesses consume IT.
- Basic understanding of IT security and governance, including security standards, access policies, and data classification schemas.
- Passion for what you do and an instinct for making work enjoyable.
- A dynamic and creative mindset, willing to take on challenges that make a big impact.
- Enthusiasm for working in a small, agile, and friendly startup environment.
- A Technical degree required. (Examples include Computer Science, Data Science, Information Technology and similar)
Qualifications
Technical Requirements:
- 3+ years of hands-on AWS & Snowflake experience, including designing, optimising, and managing data solutions.
- One or more AWS certifications required (Solution Architect, Developer, SysOps, Data Analytics, or Machine Learning Specialty).
- Strong background in data engineering, including real-time & batch pipelines.
- Proficiency in writing SQL and working with DBT for data transformation.
- Proficiency in at least one of the following programming languages Python, Java, TypeScript, SCALA or Spark. (Python preferred)
- Familiarity with data formats like JSON, AVRO, Parquet, and ORC.
- Solid understanding of databases, data security, governance, and transformation.
- Experience with DevOps tools (Bitbucket, Bamboo, Jenkins, Ansible) and CI/CD automation.
- Strong grasp of Infrastructure as Code (IaC), especially AWS CDK or Terraform.
- Snowflake performance tuning and security expertise (Highly Desirable).
- Knowledge of containers and networking fundamentals (Desirable).
Additional Information
Join our team
- We’re passionate about the technical community we are a part of, and believe in contributing to open source and AWS initiatives
- We care about climate change and are always looking at ways to reduce our carbon footprint
- We support and contribute to a different cause each quarter
- We’re committed to developing your career with customised individual growth and development plans
- We’re committed to ensuring all our staff feel welcome, included and respected every day they work for The Data Foundry
Can’t pass up this awesome opportunity? Apply now!
Similar Jobs
What We Do
We are a niche, AWS data and analytics partner that specialises in helping public sector customers to unlock their vast data repositories and use the insights gained to drive better service delivery and improved programme outcomes.
We use our data, analytics, AI/ML and IoT powers for good i.e. we don’t take on work where it’s clear that the outputs of what we’re building are to be used for purposes that we believe to be unethical
We use the Australian Government’s AI Ethics Principles as the guardrails for our AI work
We provide new graduates with amazing opportunities – to apply their newfound skills, to turn their theory into practice and to learn from some of the best in the industry
We also provide experienced industry professionals with an opportunity to pivot their careers and transition from the enterprise world to the “smartup” world, where they can transfer their valuable skills to our team and our customers, as well as learn new ones
We are building a company where employees can grow and thrive, both personally and professionally
We hire for diversity of thought
We are unashamedly customer-obsessed, always putting ourselves in our customers’ shoes, considering things from their perspective, then determining the best course of action for all concerned
We want to develop a sustainable company that plays its part in being environmentally-responsible
We believe in supporting career, community and cause
