Senior Databricks Platform Architect / Lead

Posted 7 Days Ago
Be an Early Applicant
Ottawa, ON, CAN
In-Office
Senior level
Information Technology • Consulting
The Role
Lead the architecture and implementation of secure, enterprise-scale Databricks platforms on Microsoft Azure. Define Lakehouse, workspace, Unity Catalog, networking, identity, governance, security, and data integration architectures. Provide technical direction to engineering, DevOps, security, networking, and governance teams; lead stakeholder workshops and design reviews; and produce standards, documentation, runbooks, and knowledge-transfer materials for Government of Canada initiatives.
Summary Generated by Built In

49 Solutions is proactively building a team of experienced, security-cleared professionals in preparation for anticipated Databricks initiatives within the Government of Canada. We are connecting with qualified candidates in advance so that we have a strong team ready to respond as relevant opportunities arise. 

Please note that these opportunities are currently prospective and are not associated with a guaranteed placement or awarded contract. Candidates who join our network will be considered for relevant opportunities as they become available. 

49 Solutions is seeking a Senior Databricks Platform Architect / Lead to provide technical leadership for the design and implementation of secure, enterprise-scale Databricks environments supporting Government of Canada data, analytics and AI initiatives. 

Responsibilities 

•       Lead the architecture and implementation of enterprise Databricks platforms within Microsoft Azure.

•       Define target-state Lakehouse, workspace and Unity Catalog architectures.

•       Design secure foundations supporting data engineering, Databricks SQL, BI, analytics, AI and machine learning workloads.

•       Establish architectural patterns for Delta Lake, Lakeflow, Databricks SQL and Unity Catalog.

•       Design integration with cloud, enterprise and on-premises data sources.

•       Work with Azure cloud and network specialists on VNet injection, Private Link, routing and secure connectivity.

•       Define identity and access patterns using Microsoft Entra ID, SCIM and role-based access controls.

•       Guide platform security approval, governance, classification, lineage, auditing and cost controls.

•       Provide technical direction to data engineering, DevOps, security, networking and governance resources.

•       Lead discovery sessions, architecture workshops and design reviews with federal stakeholders.

•       Develop reusable architectures, implementation standards, runbooks and knowledge-transfer materials.


Requirements

Mandatory Qualifications 

•       A minimum of 10 years of professional experience working in the IT industry or performing IT-related roles.

•       A valid and active Government of Canada Reliability, Secret or Top Secret security clearance.

•       Significant experience designing enterprise data, cloud or analytics platforms.

•       Demonstrated hands-on Databricks and Microsoft Azure experience.

•       Experience with Databricks workspaces, Delta Lake, Unity Catalog and enterprise ETL/ELT architecture.

•       Strong knowledge of cloud networking, identity, security and data governance.

•       Experience leading complex technical delivery and preparing architecture documentation.

•       Strong client-facing consulting and communication skills.


Technical Skills 

•       Databricks Lakehouse 

•       Unity Catalog 

•       Delta Lake 

•       Lakeflow 

•       Databricks SQL 

•       Apache Spark / PySpark 

•       Python and SQL 

•       Microsoft Azure 

•       Microsoft Entra ID 

•       Cloud networking and security 

•       Enterprise data architecture 

•       Data governance 

•       CI/CD and DevOps concepts 

Assets 

•       Government of Canada Databricks implementations

•       Protected B, ITSG-33, PBMM, SA&A or ATO

•       Microsoft Purview

•       Terraform and Databricks Asset Bundles

•       Migration from SAS, Synapse, DataStage, DB2, Oracle, Teradata or Netezza

•       Databricks AI/BI, Genie, MLflow or Mosaic AI

•       Bilingualism in English and French


Certifications 

Target Certification 

•       Databricks Certified Data Engineer Professional or another advanced Databricks certification directly relevant to solution architecture. 


Candidates who do not currently hold the target certification may still be considered based on their experience. Candidates are not expected to obtain the certification immediately while 49 Solutions is building its prospective team. If a specific certification becomes required for an opportunity, candidates must be willing to obtain it at their own expense before being submitted for that opportunity. 


Additional Asset Certifications 

•       Microsoft Certified: Azure Solutions Architect Expert 

•       Databricks Solutions Architect training or accreditation 

•       Databricks Platform Administrator accreditation 

•       Databricks Data & AI Governance with Unity Catalog training 

•       Databricks EDW/ETL migration training 

•       TOGAF or equivalent 


Security Requirement 

Candidates must hold a valid and active Government of Canada Reliability, Secret or Top Secret security clearance. 


Location 

Ottawa, Ontario, Canada. Engagements may be remote, hybrid, or performed at a Government of Canada location. Candidates located in Toronto or Montreal are also encouraged to apply, provided they are willing and able to travel to Ottawa for onsite meetings approximately once per month, as required. 


Work arrangements will depend on the client, project and security requirements. 


Use of Artificial Intelligence and Applicant Privacy 

Use of Artificial Intelligence (AI tools): 49 Solutions may use approved, secure, and private enterprise AI tools, including Microsoft 365 Copilot, to support recruitment and proposal activities. Information processed using our approved enterprise AI tools is not used to train public AI models or underlying foundation models. Personal contact information (address, email address and phone numbers) will be removed before uploading into the enterprise AI environment. Personal Information shall not be entered into public or consumer AI systems, and our use of enterprise AI is subject to applicable privacy requirements, including PIPEDA, as well as organizational security, retention, and deletion policies. 

By submitting an application or CV to 49 Solutions, you consent to the collection and use of your information for staffing, recruitment, proposal, contracting and placement purposes. AI use for these purposes is optional. If you prefer that your CV not be processed using AI, please let us know. You can opt out of AI use and still apply for opportunities, remain in our candidate database, work with 49 Solutions, and be considered for current and future opportunities. 

Consent may be withdrawn at any time, subject to applicable legal, contractual, operational, and record-keeping requirements. For more information, our full Privacy Policy is available upon request. 

Skills Required

  • Minimum 10 years of professional IT or IT-related experience
  • Valid and active Government of Canada Reliability, Secret, or Top Secret security clearance
  • Significant experience designing enterprise data, cloud, or analytics platforms
  • Hands-on experience with Databricks and Microsoft Azure
  • Experience with Databricks workspaces, Delta Lake, Unity Catalog, and enterprise ETL/ELT architecture
  • Strong knowledge of cloud networking, identity, security, and data governance
  • Experience leading complex technical delivery and preparing architecture documentation
  • Strong client-facing consulting and communication skills
  • Databricks Certified Data Engineer Professional or another advanced Databricks certification relevant to solution architecture
  • Experience with Government of Canada Databricks implementations
  • Experience with Protected B, ITSG-33, PBMM, SA&A, or ATO
  • Experience with Microsoft Purview, Terraform, or Databricks Asset Bundles
  • Experience migrating from SAS, Synapse, DataStage, DB2, Oracle, Teradata, or Netezza
  • Experience with Databricks AI/BI, Genie, MLflow, or Mosaic AI
  • Bilingualism in English and French
  • Microsoft Certified: Azure Solutions Architect Expert
  • Databricks Solutions Architect training or accreditation
  • Databricks Platform Administrator accreditation
  • Databricks Data and AI Governance with Unity Catalog training
  • Databricks EDW/ETL migration training
  • TOGAF or equivalent certification
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Ottawa, Ontario
23 Employees
Year Founded: 2008

What We Do

At 49 Solutions we consistently deliver top quality consulting services, supporting both business and technology. We work alongside our clients to assess their needs and ensure our approach, recommendations and move-forward plan will deliver the results they expect and the value they deserve. Our clients have mandates; our expert consultants help them develop comprehensive strategic plans to achieve their goals. We understand the machinery of government and how to articulate plans to meet the needs of central agencies, senior managers and program administrators. We can facilitate direction setting, research and analyze the issues, outline the options and define resource requirements. 49 Solutions will bring together project management, communications, human resource, IT and finance professionals to help you do what you set out to do. The core of our business foundation is trust. When you work with 49 Solutions, you can count on us to bring the right skills and capabilities to the table, at the right place and at the right time, in order to achieve a successful outcome. The majority of our clients are repeat customers who time and time again reach out to 49 Solutions as their first call when a new project, deliverable, or issue lands on their desk. We are well versed in both business and technology and often become the bridge between the two, creating cohesive projects that achieve desired outcomes.

Similar Jobs

Capco Logo Capco

Talent Acquisition Partner - Technical

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Hybrid
Toronto, ON, CAN
6000 Employees
89K-121K Annually

Mondelēz International Logo Mondelēz International

Project Engineer

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
East York, ON, CAN
90000 Employees
85K-106K Annually

Ericsson Logo Ericsson

Cloud Native Test FW SW Developer

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
In-Office
Ottawa, ON, CAN
88000 Employees
102K-133K Annually

Ericsson Logo Ericsson

AI System Developer

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
In-Office
Ottawa, ON, CAN
88000 Employees
85K-111K Annually

Similar Companies Hiring

NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity • Defense • Defense Technology
Austin, TX
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account