As a Data Engineer, you will design, build, and optimize modern data platforms using Microsoft Azure, Microsoft Fabric, Power BI, and Databricks. You combine deep technical expertise with strong consulting skills to engage clients, understand their business needs, and translate requirements into scalable solutions. You contribute to solution architecture and deliver high-quality data solutions that drive measurable business value. You are comfortable discussing technical details with engineers, facilitating design sessions with clients, and presenting recommendations to leadership.
Responsibilities
- Work directly with clients to understand business goals, data challenges, and technical requirements.
- Lead or support discovery sessions, requirements workshops, architecture discussions, and solution reviews.
- Develop and optimize batch and streaming data ingestion pipelines from enterprise applications, databases, APIs, and file-based sources.
- Implement medallion/Lakehouse architectures, dimensional models, and data transformation workflows to support analytics and reporting use cases.
- Engineer solutions using technologies such as PySpark, Spark SQL, SQL, Python, Delta Lake, and orchestration tools within Azure and Databricks.
- Recommend best practices for data modeling, governance, lineage, monitoring, DevOps, and security.
Minimum Requirements
- Bachelor’s degree in computer science or related field
- 4 years of experience in data engineering, data platform development, or cloud data solutions
- 2 years of hands-on experience with Azure Databricks, Apache Spark, or similar distributed data processing technologies
- Expertise with Microsoft Azure infrastructure and data resources, including Fabric, Azure Data Factory, Synapse Data Analytics ,Power BI, Azure SQL, Azure Cosmos DB
- Expertise with Databricks, specifically the ability to design enterprise-level strategy and architecture including Unity Catalog, data warehousing, data sharing
- DevOps for data, GitHub, automated testing, and working with containers (AKS, Docker, registries, etc.)
- Excellent communication skills, ability to clearly explain concepts to teammates and customers, and quickly learn new concepts and technologies
Preferred Qualifications
- Experience working directly with clients, business stakeholders, or cross-functional teams in a consulting or professional services environment
- Experience with data management, including data governance, data security, master data management, and familiarity with different industry security requirements
- Broad experience with data/reporting tools, architectures, cloud vendors, and data/AI concepts other than Microsoft
Skills Required
- Bachelor's degree in computer science or related field
- 4 years of experience in data engineering or cloud data solutions
- 2 years of hands-on experience with Azure Databricks or Apache Spark
- Expertise with Microsoft Azure infrastructure and resources
- Expertise with Databricks architectural design and strategy
- Experience with GitHub, automated testing, and containers
What We Do
Reply [EXM, STAR: REY] specialises in the design and implementation of solutions based on new communication channels and digital media. As a network of highly specialised companies, Reply defines and develops business models enabled by the new models of AI, big data, cloud computing, digital media and the internet of things. Reply delivers consulting, system integration and digital services to organisations across the telecom and media; industry and services; banking and insurance; and public sectors.
.png){kind=logo}
