About Billigence:
Billigence is a boutique data consultancy with global outreach & clientele, transforming the way organizations work with data. We leverage proven, cutting-edge technologies to design, tailor, and implement advanced Business Intelligence solutions with high added value across a wide range of applications from process digitization through to Cloud Data Warehousing, Visualisation, Data Science, and Engineering or Data Governance. Headquartered in Sydney, Australia with offices around the world, we help clients navigate difficult business conditions, remove inefficiencies, and enable scalable adoption of analytics culture.
About the role:
We are seeking an experienced Senior Data Engineer with strong hands-on expertise in Microsoft Azure–based data platforms. The role focuses on development of scalable, high-performance data pipelines and streaming solutions. The ideal candidate will have deep experience with big data technologies, cloud-native services, and modern data engineering practices.
What you'll do:
- Design, develop, and maintain scalable data pipelines on Microsoft Azure
- Build and manage real-time and batch data processing solutions using Kafka, Spark, and Python
- Develop and optimize ETL/ELT workflows using Azure Data Factory (ADF)
- Work extensively with Databricks for large-scale data processing and analytics
- Design, develop, and optimize Snowflake data models and queries
- Write efficient and optimized SQL for data transformation and analysis
- Process and manage structured and semi-structured data, including XML and JSON formats
- Collaborate with cross-functional teams to support data-driven solutions
- Ensure data quality, reliability, performance, and scalability of data systems
- Follow best practices for cloud infrastructure, security, and performance optimization
What you'll need:
- Apache Kafka (Queue-based messaging / streaming) – Strong hands-on experience
- Python – Advanced development skills
- Apache Spark – Strong experience in distributed data processing
- Databricks – Hands-on experience in development and data engineering workflows
- Azure Data Factory (ADF) – ETL/ELT pipeline development
- Snowflake – Data warehousing and SQL optimization
- SQL – Advanced querying and performance tuning
- XML & JSON – Strong understanding of data structures and transformations
- Scala – Basic working knowledge
Benefits:
- Hybrid/remote working environment, allowing you a flexible work-life balance to thrive both in the office and from the comfort of your home.
- Competitive compensations package + performance bonus.
- Referral bonus scheme.
- Coaching, mentoring, and buddy scheme (for faster integration during the probationary period)
- Certification opportunities throughout your time with us.
- Career growth support, internal moves, and career advancement opportunities.
- Team building and networking events.
Top Skills
What We Do
We are headquartered in Sydney, Australia, with offices in Europe (London, Prague, Frankfurt, Stockholm, Warsaw), Bangalore, Singapore, New Zealand & United States. Billigence is a BI Consultancy and contingent labour service company with a growing customer base of large corporations across different industries as well as young and agile internet-based businesses. We help organisations big and small build scalable AI solutions that drive value by enhancing their data governance, aligning strategy and empowering their people. As a company we source and hire innovative data enthusiasts and believe data is the most powerful asset of today's businesses. That is why at Billigence, we are helping our clients to drive the business value of their data. We do this through our data proposition comprising of data consolidation and enrichment, data visualisation and analytics and data governance components. We deliver market leading recruitment services for temporary and contract labour hires to supplement our clients workforces. Our vision is to become leaders in helping companies to transform into digital age and reach their full potential by leveraging the power of their data. Billigence also leverages partnerships with some of the world’s most innovative data companies such as Snowflake, Collibra, Alteryx, Salesforce, Tableau, dbt Labs, H2O.ai, Matillion, Google Cloud Platform, Microsoft, Keboola & others
.jpeg)
