Our data is like a city with no street signs. Everything is in there somewhere, but good luck finding it. We need a Senior Data Platform Engineer to draw the map, put up the signs and make sure our AI agents don’t get lost...
This is the client’s first dedicated data engineering role. This person owns the company’s data platform: a Microsoft Fabric lakehouse fed by its internal platforms, and the DOMO environment the business reports from. They also organize and document that data so AI agents built in Azure AI Foundry and on external platforms can use it safely, through MCP servers and similar connectors.
It is a senior, hands-on role. This person recommends the architecture and improvements, then builds and runs them, without day-to-day direction.
This company is at the forefront of learning technologies, providing e-learning programs for professionals in regulated industries such as healthcare and finance. They’re constantly evolving and growing, run efficient Agile-first teams, and have a broadly distributed staff. They value good-natured, inquisitive, and methodical IT professionals who come prepared to collaborate and share their knowledge.
Your responsibilities will include:
- Own the Microsoft Fabric platform end-to-end: lakehouses, mirrors, notebooks, and pipelines, plus reliability, monitoring, and capacity cost.
- Administer DOMO and move reporting onto curated Fabric tables, so each metric has one definition.
- Model, organize and document data for AI agents in Azure AI Foundry: curated datasets, field descriptions, data contracts, retrieval-ready data.
- Build and maintain connectors (mainly MCP servers and APIs) that agents and external platforms use to reach internal data, with tool schemas, permission scopes and logging.
- Assess the current setup and propose architecture and tooling changes, including costs and trade-offs, then move the approved ones to production.
- Secure and govern the data: least-privilege access, PII handling, data quality, lineage, privacy and accreditation compliance.
- Work with Git, code review and pull requests in Bitbucket and Azure DevOps.
What are the required skills?
- 6+ years of data engineering on a cloud data platform
- Hands-on Microsoft Fabric, or deep Synapse or Databricks experience and willingness to go deep on Fabric
- Has delivered data platform changes end to end: recommended, designed, built and ran them in production
- Strong SQL and Python (PySpark)
- Data modeling for lakehouse and reporting
- BI platform administration: DOMO preferred, Power BI acceptable
- Working knowledge of how AI agents consume data: RAG, embeddings, semantic metadata, APIs or MCP servers as tools
- Azure fundamentals and data security: Entra ID, Key Vault, RBAC, row-level security, PII handling
- Works with AI coding tools, documents as a habit, communicates clearly with non-technical colleagues
- Hands-on experience running a production data platform that other teams depend on
- BA/BS in Computer Science, Information Systems or related, or equivalent experience
- Azure AI Foundry or a similar agent platform
- MCP server development
- Learning or assessment data
- Microsoft DP-700 certification
If this looks interesting, please use the form below to apply! Remember, this is a fully remote, long-term opportunity :)
Skills Required
- 6+ years of data engineering experience on a cloud data platform
- Hands-on Microsoft Fabric experience, or deep Synapse or Databricks experience with willingness to learn Fabric
- Experience delivering data platform changes end to end, from recommendation and design through production operation
- Strong SQL and Python PySpark skills
- Data modeling experience for lakehouse and reporting environments
- BI platform administration experience; DOMO preferred and Power BI acceptable
- Working knowledge of AI agent data consumption, including RAG, embeddings, semantic metadata, APIs, or MCP servers
- Azure fundamentals and data security experience with Entra ID, Key Vault, RBAC, row-level security, and PII handling
- Experience using AI coding tools, documenting work, and communicating with nontechnical colleagues
- Hands-on experience running a production data platform relied upon by other teams
- BA or BS in Computer Science, Information Systems, or a related field, or equivalent experience
- Azure AI Foundry or similar agent platform experience
- MCP server development experience
- Learning or assessment data experience
- Microsoft DP-700 certification
What We Do
DistantJob is a remote recruitment agency that connects U.S. and Canadian companies with pre-vetted global tech professionals. They specialize in sourcing, screening, and facilitating remote hiring, handling aspects like international payroll and compliance to help companies hire top engineering talent.
