The Solutions Architect will lead the design and deployment of AI-powered applications directly on the Azure Databricks platform. This individual will architect solutions that run natively on the Databricks serverless environment—eliminating the need for separate hosting infrastructure—while integrating tightly with core platform services for data governance, querying, authentication, and model serving. The role blends hands-on technical architecture with cross-functional leadership across data, security, and application teams.
CampusWorks consultants engage with our clients in higher education to assist them in fully leveraging their people, processes, policies, and technologies. We work collaboratively with clients' functional and technical teams and our CampusWorks colleagues to evaluate current processes, design future-state optimal processes, and to architect, develop, test, train, and rollout process and technical solutions that delight our clients. As a 1099 project-based consultant, you will enjoy the flexibility of remote work while contributing to the success of leading intstitutions.
Responsibilities:
- Lead end-to-end deployment of AI applications on the Databricks Apps platform, from architecture design through production rollout and ongoing maintenance.
- Architect serverless-first solutions that leverage Databricks Apps to eliminate external hosting infrastructure, inheriting the platform’s built-in security, compliance, and resource management capabilities.
- Design and integrate AI agents (e.g., Retrieval-Augmented Generation / RAG patterns) using Databricks Agent tooling, and manage the full agent lifecycle—creation, deployment, testing, and monitoring.
- Establish data governance through Unity Catalog for centralized access control, lineage, and security across application data assets.
- Enable efficient data access by integrating applications with Databricks SQL for querying large datasets at scale.
- Implement secure authentication using OAuth and platform-native identity and authorization patterns.
- Configure and optimize Model Serving and Serving Endpoints for deploying and querying ML models and LLM agents at scale.
- Collaborate with data engineering, security, and business stakeholders to translate requirements into scalable, governed, production-ready solutions.
- Define architecture standards, reference patterns, and best practices for AI application development on Databricks.
Qualifications:
Databricks SQL
Designing and optimizing queries against large datasets.
OAuth / IAM
Implementing secure authentication and authorization flows.
Model Serving & Endpoints
Deploying and scaling ML models and LLM agents via serving endpoints.
AI Agent Frameworks
RAG architectures and frameworks such as LangChain and/or LlamaIndex.
MLflow
Logging, testing, debugging, and monitoring agents and models.
Application Frameworks
FastAPI, Flask, Streamlit, Dash, or Gradio; front-end experience with React or a comparable modern JavaScript framework.
Programming
Strong Python proficiency for application, agent, and pipeline development.
Data Pipelines / ETL
Experience with Databricks Jobs and workflow orchestration.
Cloud Architecture
Microsoft Azure networking, security, and compliance fundamentals.
Preferred:
- Prior experience delivering enterprise chatbot or conversational AI solutions.
- Familiarity with token streaming, request logging, and review-app patterns for production AI agents.
- Industry-specific solution experience (e.g., operations management, analytics-heavy domains).
- Relevant certifications (e.g., Databricks Certified Data Engineer / ML, Azure Solutions Architect)
Core Competencies:
- Strong architectural judgment balancing scalability, security, governance, and cost.
- Ability to lead technical delivery and mentor engineering teams.
- Clear communication with both technical and executive/business stakeholders.
- Bias toward practical, outcome-driven solutions.
Skills Required
- Designing and optimizing Databricks SQL queries against large datasets
- Implementing secure authentication and authorization flows using OAuth and IAM
- Deploying and scaling machine learning models and LLM agents using Model Serving and serving endpoints
- Experience with AI agent frameworks and RAG architectures, such as LangChain or LlamaIndex
- Using MLflow for logging, testing, debugging, and monitoring agents and models
- Experience with application frameworks such as FastAPI, Flask, Streamlit, Dash, or Gradio
- Front-end experience with React or a comparable modern JavaScript framework
- Strong Python proficiency for application, agent, and pipeline development
- Experience with Databricks Jobs and workflow orchestration for data pipelines and ETL
- Microsoft Azure networking, security, and compliance fundamentals
- Experience delivering enterprise chatbot or conversational AI solutions
- Familiarity with token streaming, request logging, and review-app patterns for production AI agents
- Industry-specific solution experience in operations management or analytics-heavy domains
- Databricks Certified Data Engineer or Machine Learning certification
- Azure Solutions Architect certification
What We Do
Since our inception in 1999, CampusWorks has become a trusted partner of countless colleges and universities across the United States and Canada. We serve higher education exclusively, so we have a deep understanding of and appreciation for your institution's mission, vision, and values as well as the business and technical challenges you’re facing. Since we are not associated with any hardware or software vendors, institutions know they can count on us to listen to their needs, provide unbiased insights into their organizational challenges, and develop tailored solutions with their best interests in mind. Our professional services team is comprised of senior-level technical and functional experts who have the experience and skill to take on your toughest challenges. Our services are rooted in systems thinking and reach across the institution—from Student Services to Human Resources to Finance to Academic Services—to remove obstacles standing in the way of success. We pride ourselves on the collaborative partnerships we form with our clients, and we value the opportunity to work alongside your team to implement change, achieve transformational results, and ensure lasting success. Dedicated exclusively to higher education, CampusWorks’ capabilities include: - Academic services - Accreditation and compliance - Assessments - Business process optimization - Cybersecurity - Enterprise resource planning (ERP) support - IT leadership - Network and infrastructure services - Project management - Shared services and collaborative services - Staff augmentation - Strategic planning Learn more at campusworksinc.com
.png){kind=logo}
