Who are we?
Billigence is a boutique data consultancy with global reach, helping organisations transform the way they work with data. We specialise in delivering high-impact data solutions across Business Intelligence, Data Engineering, Data Governance, Cloud Data Platforms, and Advanced Analytics. Headquartered in Sydney with offices across the UK, Europe, and APAC, Billigence partners with organisations to design and implement modern data platforms that drive better decision-making and business outcomes.
Our teams work on complex, enterprise-scale data programmes across a variety of industries including retail, financial services, and technology.
About the role:
Billigence is currently supporting a global Financial Services client on a major data platform modernisation initiative centred around Azure Databricks.
We are looking for an experienced Senior Data Engineer based in India to support the delivery of scalable enterprise data pipelines as part of a distributed global engineering team.
The role will focus on building pipelines that ingest accounting and operational data from the client’s back-office provider and exposing curated datasets through Databricks SQL and APIs.
The client currently operates ingestion pipelines through Azure Synapse notebooks but is transitioning to Azure Databricks, creating an opportunity to modernise and improve pipeline design, performance, and scalability.
You will help establish best-practice patterns for data ingestion, transformation, and storage within the Databricks Delta Lake environment, supporting both historical data ingestion and ongoing operational data flows.
This role will begin as a 6-month contract, with a strong likelihood of extension based on performance and project requirements.
What you’ll do:
- Build and optimise data pipelines within Azure Databricks
- Support migration of existing Azure Synapse notebook pipelines
- Design scalable data models and storage patterns within Delta Lake
- Integrate historical data from on-premise data warehouses
- Build new ingestion pipelines from SQL Server stored procedures
- Implement scalable ingestion frameworks and reusable pipeline patterns
- Collaborate with global data engineering teams across the UK and India
- Contribute to best practices and platform standards for future pipeline development
What you’ll need:
- Strong experience working as a Data Engineer or Senior Data Engineer
- Hands-on experience with Azure Databricks
- Strong understanding of Delta Lake architecture
- Experience with Azure Synapse, Spark, and modern cloud data platforms
- Strong SQL and experience working with enterprise data systems
- Experience building data pipelines and ETL/ELT frameworks
- Ability to work effectively in distributed global teams
- Experience within Financial Services or regulated industries is beneficial
Top Skills
What We Do
We are headquartered in Sydney, Australia, with offices in Europe (London, Prague, Frankfurt, Stockholm, Warsaw), Bangalore, Singapore, New Zealand & United States.
Billigence is a BI Consultancy and contingent labour service company with a growing customer base of large corporations across different industries as well as young and agile internet-based businesses.
We help organisations big and small build scalable AI solutions that drive value by enhancing their data governance, aligning strategy and empowering their people.
As a company we source and hire innovative data enthusiasts and believe data is the most powerful asset of today's businesses. That is why at Billigence, we are helping our clients to drive the business value of their data. We do this through our data proposition comprising of data consolidation and enrichment, data visualisation and analytics and data governance components.
We deliver market leading recruitment services for temporary and contract labour hires to supplement our clients workforces. Our vision is to become leaders in helping companies to transform into digital age and reach their full potential by leveraging the power of their data.
Billigence also leverages partnerships with some of the world’s most innovative data companies such as Snowflake, Collibra, Alteryx, Salesforce, Tableau, dbt Labs, H2O.ai, Matillion, Google Cloud Platform, Microsoft, Keboola & others
.jpeg)
