Fabric Principal Data Engineer / Solution Architect

Posted Yesterday
Be an Early Applicant
New York, NY, USA
In-Office
Senior level
Sharing Economy
The Role
Lead design, build, and support of scalable data pipelines and integrations using Microsoft Fabric, ADF, PySpark, SQL, ADLS Gen2, and Databricks Unity Catalog. Drive Azure-to-Fabric migration, stabilize pipelines, tune performance, manage data governance, troubleshoot issues, document designs, mentor team members, and collaborate with stakeholders in Life Sciences regulatory environments during US Eastern hours.
Summary Generated by Built In

About Fusemachines

Fusemachines is a 12+ year old AI company, dedicated to delivering state-of-the-art AI products and solutions to a diverse range of industries. Founded by Sameer Maskey, Ph.D., an Adjunct Associate Professor at Columbia University, our company is on a steadfast mission to democratize AI and harness the power of global AI talent from underserved communities. With a robust presence in four countries and a dedicated team of over 400 full-time employees, we are committed to fostering AI transformation journeys for businesses worldwide. At Fusemachines, we not only bridge the gap between AI advancement and its global impact but also strive to deliver the most advanced technology solutions to the world. 

About the role:

This is a full-time position for a Principal Data Engineer / Solution Architect specializing in Microsoft Fabric and Azure data architectures to support a fast-moving project for a key client in the Life Sciences / Biotech industry.

In this role, you will serve as a senior technical resource responsible for supporting, enhancing, and executing data engineering solutions across Microsoft Fabric, Fabric Data Factory, Microsoft SQL, ADLS Gen2, Databricks Unity Catalog, PySpark in Fabric, and related Azure ecosystem services. The project operates at high velocity, requiring someone who can ramp up quickly, navigate technical ambiguity, and keep active delivery moving seamlessly. You will help stabilize, troubleshoot, and advance an active migration from traditional Azure infrastructure to Microsoft Fabric.

Location & Logistics: Candidates must be based in Boston, MA or fully capable of traveling to Boston as required by project milestones, maintaining 100% working time overlap with US East Coast business hours.

Qualification / Skill Set Requirement:

  • Core Technical Expertise:
    • 8+ years of hands-on data engineering, data architecture, or complex data platform development experience.  
    • Strong, practical experience building, supporting, and troubleshooting data pipelines in Microsoft Fabric and Azure Data Factory (ADF).  
    • Advanced proficiency in Microsoft SQL (query development, stored procedures, schema design, indexing, performance tuning) and Python / PySpark in Fabric
    • Hands-on experience managing and supporting Databricks Unity Catalog (catalog/schema/table organization, access controls, permissions, and governance administration).  
    • Deep familiarity with Azure Data Lake Storage Gen2 (ADLS Gen2), including data organization, security, and cloud service integrations. 
  • Architecture & Migration Experience:
    • Proven experience supporting or leading platform migrations, modernizations, or transitions (specifically Azure-to-Microsoft Fabric).  
    • Familiarity with medallion architecture, lakehouse patterns, and modern data warehouse design.  
    • Experience with Azure administration activities supporting data platforms (access management, service configuration, and monitoring). 
  • Industry & Domain Experience:
    • Required: Prior hands-on experience working with Life Sciences, pharmaceutical, biotechnology, medical device, clinical, or regulatory data environments.  
    • Knowledge of appropriate data handling, quality, compliance awareness, and business context in regulated settings. 
  • Logistics & Operating Style:
    • Based in Boston, MA or willing/able to travel to Boston, MA for client engagements and alignment meetings.
    • Full working time overlap with US East Coast business hours (ET).
    • Demonstrated ability to operate effectively in a startup-speed environment with shifting priorities, tight timelines, and minimal ramp-up time.
  • Certifications Preferred:
    • Microsoft Certified: Azure Solutions Architect Expert  
    • Microsoft Certified: Fabric Data Engineer Associate  
    • Microsoft Certified: Azure Data Engineer Associate 
    • Microsoft Certified: Azure AI Engineer Associate: nice to have

Responsibilities

  • Fabric & Pipeline Engineering: Design, build, enhance, and support scalable data pipelines and integrations using Microsoft Fabric Data Factory, PySpark in Fabric, and Azure Data Factory.  
  • Migration Support & Stabilization: Drive active migration efforts to Microsoft Fabric, including pipeline transition, validation, performance tuning, and operational stabilization.  
  • Databricks Governance: Manage and organize Databricks Unity Catalog structures, permissions, and access control policies.  
  • Data Asset Management: Develop and optimize Microsoft SQL data assets, complex stored procedures, queries, and ADLS Gen2 storage layers.  
  • Troubleshooting & Quality Assurance: Quickly diagnose and resolve issues across data pipelines, SQL queries, Fabric PySpark notebooks, Unity Catalog, and cloud integration layers.  
  • Technical Leadership & Knowledge Transfer: Assist with knowledge transfer from outgoing project resources, document technical designs and operational workflows, and mentor delivery team members.  
  • Stakeholder Collaboration: Partner closely with technical, project, and business stakeholders to translate complex requirements into reliable, compliant data solutions during US Eastern business hours.
 

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status


 

Skills Required

  • 8+ years of hands-on data engineering, data architecture, or complex data platform development experience
  • Practical experience building, supporting, and troubleshooting data pipelines in Microsoft Fabric and Azure Data Factory (ADF)
  • Advanced proficiency in Microsoft SQL (queries, stored procedures, schema design, indexing, performance tuning)
  • Advanced proficiency in Python and PySpark (specifically PySpark in Fabric)
  • Hands-on experience managing Databricks Unity Catalog (catalog/schema/table organization, access controls, governance)
  • Deep familiarity with Azure Data Lake Storage Gen2 (data organization, security, cloud integrations)
  • Proven experience supporting or leading platform migrations/modernizations (specifically Azure-to-Microsoft Fabric)
  • Familiarity with medallion architecture, lakehouse patterns, and modern data warehouse design
  • Experience with Azure administration activities supporting data platforms (access management, service config, monitoring)
  • Prior hands-on experience working with Life Sciences, pharmaceutical, biotechnology, medical device, clinical, or regulatory data environments
  • Knowledge of data handling, quality, and compliance in regulated settings
  • Based in Boston, MA or able/willing to travel to Boston for client engagements
  • Full working time overlap with US East Coast business hours (ET)
  • Ability to operate effectively in a fast-paced, startup-speed environment with shifting priorities and tight timelines
  • Microsoft Certified: Azure Solutions Architect Expert
  • Microsoft Certified: Fabric Data Engineer Associate
  • Microsoft Certified: Azure Data Engineer Associate
  • Microsoft Certified: Azure AI Engineer Associate
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
428 Employees
Year Founded: 2013

What We Do

A 10+ year old AI company offering cutting-edge AI products and solutions across industries. With over a decade of experience, we help companies in their AI Transformation journey with our suite of AI Products and AI Solutions supported by our global AI Talent from underserved communities. On a mission to #DemocratizeAI, we aim to bridge the gap between AI advancement and global impact, bringing the most advanced technology solutions to the world.

Similar Jobs

Spectrum Logo Spectrum

Manager, Software Procurement

Information Technology • Internet of Things • Mobile • On-Demand • Software
In-Office
New York, NY, USA
100000 Employees
99K-175K Annually

Spectrum Logo Spectrum

Senior Manager, Procurement (Software)

Information Technology • Internet of Things • Mobile • On-Demand • Software
In-Office
New York, NY, USA
100000 Employees
99K-191K Annually

CoreWeave Logo CoreWeave

Talent Acquisition Coordinator (Contract)

Cloud • Information Technology • Machine Learning
In-Office
2 Locations
1450 Employees
40-40 Hourly

DraftKings Logo DraftKings

Senior Associate Delivery Manager

Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
Remote or Hybrid
United States
6400 Employees
82K-102K Annually

Similar Companies Hiring

Cargill Thumbnail
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Wayzata, MN
155000 Employees
Taskrabbit Thumbnail
eCommerce • Information Technology • Sharing Economy • Software
San Franscisco, CA
450 Employees
Federal Reserve Bank of Chicago Thumbnail
Agency • Fintech • Payments • Sharing Economy • Social Impact
Chicago, IL
1515 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account