Data Engineer

Posted 5 Days Ago
Be an Early Applicant
Wellington, New South Wales
110K Annually
Mid level
Consumer Web • eCommerce
The Role
As a Data Engineer, you will develop and support data ingestion and transformation within the Unified Data Platform, integrate new data sources, maintain data pipelines, ensure data flow integrity, and collaborate with project teams. You will also design and deploy data transformations and optimize data solutions for analytics.
Summary Generated by Built In

As a Data Engineer you will be enabling the business by providing data, reporting and analytics solutions, through developing and supporting Data Ingestion and transformation in our Unified Data Platform (UDP) based on Microsoft Azure Synapse Analytics.

The salary for this role is $110k + super and this position is full time permanent.


What will you be doing?

  • Identifying, researching, and integrating new data sources into the Unified Data Platform.
  • Developing and maintaining data ingestion pipelines using Azure Synapse Analytics.
  • Monitoring and sustaining data flows, ensuring seamless integration with various data sources.
  • Documenting all processes and data objects involved in the data ingestion and transformation processes.
  • Collaborating with project teams and analysts to understand and meet their data needs.
  • Designing, testing, and deploying data transformations into production environments.
  • Providing expert guidance on data provisioning for analytics and advanced analytics.
  • Building and maintaining robust data models as specified by analysts.
  • Ensuring data solutions remain effective and update them as necessary.
  • Offering expertise on the capabilities of Azure Synapse Analytics.
  • Creating optimal solutions for pushing data from the Unified Data Platform to other systems.
  • Gathering and documenting user requirements for data integration and data warehouse solutions.
  • Providing ad-hoc support to users of the Unified Data Platform.

What are we looking for in you?

  • Tertiary qualification, Bachelors and ideally Masters in a quantitative field such as Computer Science, Information Management, Mathematics, Engineering, Economics, Finance, Statistics, or in a Business/Commerce/Marketing discipline is mandatory. 
  • Commercial experience in the field of Data Engineering, preferably in Azure.
  • Demonstrated experience in the development of data transformation processes using ETL (Extract, Transform & Load) tools.
  • Understanding of business, particularly Motoring, Sales, Marketing and Finance.
  • Cloud Experience understanding of cloud principles and modern data warehousing in the Azure cloud. Experience of building solutions in Microsoft Fabric (Lakehouse, Synapse Data Engineering, Synapse Datawarehouse and Realtime Intelligence)
  • Azure Synapse Analytics (Azure Synapse Pipelines, Azure Synapse Notebooks Azure Data Lake, Azure Blob, Azure SQL Database and Azure SQL Data Warehouse). 
  • Experience of working with Delta Lake and Data warehouse 
  • Experience of working on Meta Data Driver Framework 
  • Experience with OCI
  • Proficient in SQL, Pyspark, PySQL 
  • Proficient in Microsoft Power BI or other Business Intelligence tool
  • Knowledge of data modelling techniques and tools like ER diagrams, dimensional modelling, and tools like ERwin or Lucidchart.
  • Desired knowledge/experience in real time data processing and integration with Azure applications (such as MS Dynamics) 
  • Understanding of relational database concepts and Data Warehousing concepts.
  • Experience in working with both structured and unstructured data. 
  • Advanced problem-solving skills and a meticulous attention to detail.
  • An understanding of Business Intelligence and reporting concepts and an awareness of Business Intelligence toolsets. 
  • A broad understanding of Information Management, Data Quality, Master Data Management, Data Governance and Data Stewardship is not required, but would be beneficial. 
  • Proficient in the use of Microsoft Word, Microsoft Excel, Microsoft PowerPoint and Microsoft Outlook.

What can we offer you?

  • Working in an environment that is embracing a continuous improvement culture using experimentation to support learning.
  • Time dedicated to your personal development time with access to training, development, and certification programs to ensure you can upskill.
  • Being part of empowered, cross-functional agile delivery teams that works with the business to build systems that solve problems.
  • Complete flexibility to choose between working from the home or office with flexible hours for a better work life balance.
  • Building digital systems that will shape the future for the RAC and a better WA.
  • Gain RAC Staff Benefits including free Roadside Assistance and 25% discount on your Insurances, Social Club and access Fitness Passport for cheaper gym memberships.

About RAC

As an Equal Opportunity Employer, RAC values inclusivity and promotes a workplace that actively seeks to welcome contributions from all people. We encourage people of all abilities, Aboriginal and Torres Strait Islanders, diverse cultures and backgrounds, LGBTIQ+ identities, and all age groups to apply.

RAC is committed to flexibility. If you need assistance or adjustments to fully participate in the application process, please contact [email protected].

Top Skills

Pyspark
Pysql
SQL
The Company
Joondalup, Western Australia
1,367 Employees
On-site Workplace
Year Founded: 1905

What We Do

At RAC we offer career opportunities that will allow you to give back and make a difference to our members and the WA community. We pride ourselves on employing the highest calibre of people to meet our member’s needs. RAC promotes healthy living and aims to protect health and safety of employees, members and visitors.

RAC has been a part of the West Australian community since 1905. We are unique organisation, built by members for members. From our origins as a motoring club, we have grown to a diverse organisation of over 1,400 employees serving more than 1 million members with a range of products and services. RAC’s difference is that we are a membership organisation, which means we don't have shareholders and we reinvest our profits for the better of our members and the WA community.

House rules:
We really enjoy receiving your feedback, comments and experiences and enjoy getting the most out of our LinkedIn community. With this in mind, we ask that you stick to the following guidelines:

• Please be polite to other RAC LinkedIn users and treat each other as you would like to be treated.

• Please don’t give out any personal information.

• We cannot allow any inappropriate or offensive language.

• Advertising, spam, selling and links to external shopping sites are not allowed here and will be removed.

• If you want to post a link to another site to illustrate your point, please do not link to sites that require registration in order to view, or any site that prompts an automatic download as these comments will be removed.

• Page admins and the RAC LinkedIn community must be able to easily understand your message. For this reason we can't allow messages which are written in code or a language which isn’t English.

• We reserve the right to de-tag RAC from any posts or photos that we deem inappropriate.

• Please note that repeat offenders may be reported and will be blocked from the LinkedIn page

Similar Jobs

Atlassian Logo Atlassian

Data Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Remote
Sydney, New South Wales, AUS
11000 Employees

Rokt Logo Rokt

Senior Software Engineer - Data Engineering

Artificial Intelligence • Digital Media • eCommerce • Marketing Tech • Software
Sydney, New South Wales, AUS
500 Employees
175K-235K Annually

DXC Technology Logo DXC Technology

Data Engineer

Information Technology
Sydney, New South Wales, AUS
86261 Employees
Sydney, New South Wales, AUS
556 Employees

Similar Companies Hiring

Munchkin, Inc. Thumbnail
Kids + Family • Enterprise Web • eCommerce • Consumer Web • 3D Printing
Milton, Ontario
325 Employees
News 12 Thumbnail
News + Entertainment • Digital Media • Consumer Web
Bethpage, NY
400 Employees
Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
San Francisco, CA
14 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account