At Aligned Automation, we live by our "Better Together" philosophy to build a better world. As a strategic service provider to Fortune 500 companies, we help digitize enterprise operations and drive impactful business strategies. Our purpose goes beyond projects—we strive to deliver meaningful, sustainable change that shapes a more optimistic and equitable future.
Our culture is deeply rooted in our 4Cs—Care, Courage, Curiosity, and Collaboration—ensuring that each employee is empowered to grow, innovate, and thrive in an inclusive workplace.
We are looking for an experienced Senior Azure Databricks & Microsoft Fabric Data Engineer to design, develop, and implement scalable cloud-based data platforms using Microsoft Azure technologies. The ideal candidate should have strong hands-on experience with Azure Databricks, Microsoft Fabric, and modern data engineering practices, along with the ability to deliver enterprise-scale data platform solutions from design through production deployment.
- Design, develop, and maintain scalable data pipelines using Azure Databricks.
- Develop ETL/ELT workflows using PySpark, Spark SQL, Delta Lake, and Databricks Notebooks.
- Build and optimize Lakehouse and Data Warehouse architectures.
- Develop and manage Microsoft Fabric Lakehouses, Dataflows Gen2, Data Pipelines, and OneLake solutions.
- Perform data ingestion, transformation, validation, and performance tuning.
- Collaborate with business stakeholders, solution architects, BI developers, and cross-functional teams to translate business requirements into technical solutions.
- Participate in solution design, code reviews, testing, deployment, and production support.
- Follow best practices for data security, governance, documentation, and CI/CD.
- Strong hands-on experience with Azure Databricks.
- Expertise in PySpark, Spark SQL, Delta Lake, and Databricks Notebooks.
- Solid working knowledge of Microsoft Fabric, including Lakehouses, Dataflows Gen2, Data Pipelines, and OneLake.
- Strong understanding of Data Warehouse and Lakehouse architecture.
- Experience delivering large-scale enterprise data platform projects from design to production.
- Strong SQL skills and data modelling experience.
- Excellent communication and stakeholder management skills.
- Power BI (Data Modelling, DAX, Power Query, Report Development).
- Azure Data Factory, Azure Data Lake Storage Gen2, Azure DevOps, Git, CI/CD.
- Azure Synapse Analytics, Unity Catalog, Microsoft Purview.
- Experience in Agile/Scrum environments.
- Microsoft Azure or Microsoft Fabric certifications.
- 8–15 years of overall IT experience with at least 4+ years in Azure Data Engineering.
- Proven experience building enterprise-scale cloud data platforms.
- Experience working with structured and semi-structured data.
- Strong problem-solving and analytical skills with the ability to work independently.
Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related discipline.
Experience in Manufacturing, Pharmaceuticals, Healthcare, Life Sciences, or Supply Chain domains will be an advantage. Exposure to regulated environments (GxP/FDA) is desirable.
Keywords: Azure Databricks, PySpark, Delta Lake, Microsoft Fabric, Lakehouse, OneLake, Dataflows Gen2, Data Pipelines, SQL, Data Warehouse, Azure Data Engineering, Power BI, DAX, Azure DevOps, ETL, Cloud Data Platform.
Skills Required
- Strong hands-on experience with Azure Databricks
- Expertise in PySpark, Spark SQL, Delta Lake, and Databricks Notebooks
- Solid working knowledge of Microsoft Fabric including Lakehouses, Dataflows Gen2, Data Pipelines, and OneLake
- Strong understanding of Data Warehouse and Lakehouse architecture
- Experience delivering large-scale enterprise data platform projects from design to production
- Strong SQL skills and data modelling experience
- Excellent communication and stakeholder management skills
- 8-15 years of overall IT experience with at least 4+ years in Azure Data Engineering
- Experience working with structured and semi-structured data
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related discipline
- Power BI (Data Modelling, DAX, Power Query, Report Development)
- Azure Data Factory, Azure Data Lake Storage Gen2, Azure DevOps, Git, CI/CD
- Azure Synapse Analytics, Unity Catalog, Microsoft Purview
- Experience in Agile/Scrum environments
- Microsoft Azure or Microsoft Fabric certifications
- Domain experience in Manufacturing, Pharmaceuticals, Healthcare, Life Sciences, or Supply Chain; exposure to regulated environments (GxP/FDA)
What We Do
Technology, society, economy, policy – all moving at breakneck speed in our 21st century world. You’re feeling the pressure to quickly implement new business models, find new value, make split-second informed decisions and keep one step ahead of customers. How? The answer lies in the ability to make quick, accurate and sustainable business decisions. We believe digital offers a way of doing things better – but the journey to transformation doesn’t have to be painful. At Aligned Automation, we work hard to digitally enable your business strategy – connecting processes, technologies and people to unlock value and drive critical business outcomes.
