We are seeking an experienced Senior Data Engineer to design and build next-generation data platforms leveraging AI Copilot capabilities and Microsoft Fabric. This role focuses on enabling intelligent, scalable, and automated data workflows while supporting advanced analytics and AI-driven use cases. You will play a key role in modernizing data architecture and embedding AI-assisted development practices across the data lifecycle.
Key Responsibilities
- Design, build, and maintain scalable data pipelines and data platforms using Microsoft Fabric.
- Develop and optimize data ingestion, transformation, and orchestration workflows.
- Leverage AI Copilot tools to accelerate development, automate data engineering tasks, and improve productivity.
- Implement and manage Lakehouse architectures and unified data environments.
- Collaborate with data scientists and analysts to enable AI/ML and advanced analytics use cases.
- Ensure data quality, governance, security, and compliance across all pipelines.
- Optimize performance and cost efficiency of data workloads.
- Integrate data from multiple sources (structured, semi-structured, and streaming).
- Contribute to data modeling, metadata management, and lineage tracking.
- Support CI/CD pipelines, testing, and deployment of data solutions.
- Mentor junior engineers and promote best practices in data engineering and AI-assisted development.
Required Skills & Experience
- 6+ years of experience in data engineering or related roles.
- Strong hands-on experience with Microsoft Fabric (Data Factory, Lakehouse, Synapse, or equivalent components).
- Experience working with AI Copilot tools (e.g., GitHub Copilot, Azure AI Copilot) in development workflows.
- Proficiency in Python and/or Scala.
- Strong experience with SQL and large-scale data processing.
- Experience with Spark and distributed data systems.
- Solid understanding of data warehousing and lakehouse architectures.
- Familiarity with Azure ecosystem (Azure Data Factory, Azure Synapse, Azure Data Lake).
- Experience with data governance, security, and compliance frameworks.
- Knowledge of CI/CD pipelines, DevOps practices, and version control (Git).
- Experience enabling AI-driven data platforms or intelligent data workflows.
- Familiarity with real-time/streaming data processing.
- Knowledge of MLOps and integration with machine learning pipelines.
- Experience with Power BI or other data visualization tools.
- Exposure to enterprise data platform migrations or modernization programs.
Skills Required
- Deep hands-on experience with GitHub Copilot (plan mode and agent mode)
- Strong prompt engineering capability for code and documentation generation
- Experience designing AI-driven workflows or agent-based automation
- Strong understanding of LLM behaviour, context handling and output optimisation
- Experience improving developer productivity using AI tools
- Strong software engineering foundation (Python, SQL or equivalent)
- Experience working in Agile/Scrum environments
- Comfortable reviewing and challenging production-grade code
- Experience working with distributed global engineering teams
- Familiarity with Microsoft Fabric
- Familiarity with Azure ecosystem
- Exposure to Cosmos DB
- Understanding of data engineering pipelines
Brillio Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Brillio and has not been reviewed or approved by Brillio.
-
Healthcare Strength — Healthcare is considered comprehensive, including medical coverage for employees and dependents alongside life, disability, and accidental death protections. Feedback suggests these protections are a core strength of the package.
-
Leave & Time Off Breadth — Time-off options include paid leave and parental leave, with flexible or ‘flexible PTO’ approaches cited in some contexts. Feedback suggests this breadth helps support work-life balance when team norms permit usage.
-
Wellbeing & Lifestyle Benefits — Wellbeing offerings span counseling, financial-management sessions, fitness programs, and travel insurance, plus region-specific extras like discounted IT hardware and work-from-home essentials. Feedback suggests these add-ons enhance perceived value beyond core insurance.
Brillio Insights
What We Do
Brillio is the leader in global digital business transformation, applying technology with a human touch. We help businesses define internal and external transformation objectives, and translate those objectives into actionable market strategies using proprietary technologies. With 2600+ experts and 13 offices worldwide, Brillio is the ideal partner for enterprises that want to quickly increase their core business productivity, and achieve a competitive edge, with the latest digital solutions.








