Data Platform Architect (Databricks)

Position: Data Platform Architect (Databricks)

Role Overview

Work closely with enterprise IT teams to design analytics and data solutions aligned to business strategy. This role is responsible for defining and owning end-to-end architecture from definition through go-live—within Azure cloud environments, including Azure Databricks. You’ll ensure enterprise-grade data platforms that enable trusted data ingestion and reporting, while setting standards, optimizing performance, and mentoring engineering teams.

Key Responsibilities

Platform Architecture & Design

• Define architecture patterns for ingestion, transformation, and serving layers
  
• Establish best practices for Unity Catalog, Delta Lake, and orchestration
  
• Support scalable, multi-domain data product architecture
  

Data Engineering & Delivery Leadership

• Guide pod-based delivery teams
  
• Define development standards for pipelines, notebooks, and CI/CD
  
• Drive transition to Databricks-native pipelines
  

Performance Optimization & Cost Management

• Optimize pipelines for performance and cost
  
• Monitor cost anomalies and runtime variability
  

Platform Integration & Ecosystem Alignment

• Integrate Databricks with Azure ecosystem and Power BI
  
• Support Fabric alignment and code portability
  

Data Governance & Security

• Implement governance using Unity Catalog
  
• Ensure secure and scalable access patterns
  

Engineering Standards & Capability Build

• Define reusable frameworks and templates
  
• Mentor and guide Tech Leads and Engineers
  

Stakeholder Engagement

• Partner with architects, product managers, and domain modelers
  
• Provide input into roadmap and hiring decisions
  

Qualifications

Required Skills & Experience

• 3+ years of strong experience with Databricks (Spark, Delta Lake, notebooks, pipelines)
  
• Experience with Unity Catalog and governance models
  
• Experience with Azure Data Lake and data transformation frameworks
  
• Proven experience designing enterprise-scale data platforms
  
• Experience optimizing large-scale pipelines and distributed systems
  
• Leadership experience in global, matrixed environments
  
• Databricks certification
  

Nice to Have

• Experience with Microsoft Fabric ecosystem
  
• Power BI integration experience
  
• ADF or legacy ETL migration experience
  

About Symbiotic Digital.

Symbiotic Digital provides the IT Experts you need that solve problems and get things done. See what the top 2% in their field can do for you. (Symbiotic Digital is a division of Symbiotic Group Inc.)

We serve customers in two ways, we provide:

1. Digital Experts: IT Consulting expertise. Bright Minds That Produce Proven Results
   
2. Recruitment: Find The Right People You Need
   

Serving IT & Business leaders, Symbiotic Digital provides a business system that enable us to provide the Expert Technical staff needed to solve challenging business and IT problems. IT leaders in the most reputable organizations in Canada have relied on Symbiotic Digital to help them staff difficult assignments with proven Experts uniquely evaluated by our proven QMS- Quality Management System Staff Development Model. We are a 100% Indigenous owned company.

Learn more online at https://www.symbioticgroup.com/home-sd/.

Please submit your most recent resume to: [email protected]

View All Jobs online at: https://www.symbioticgroup.com/view-jobs/