The Role
Designs and develops Databricks data pipelines, AI applications, RAG solutions, and full-stack interfaces using PySpark, FastAPI, React, and Claude APIs. Builds Databricks Apps, configures Unity Catalog permissions and service principals, implements AI safety controls and caching, and automates deployments through Azure DevOps CI/CD. Collaborates with cloud, security, project, and technical stakeholders on architecture, testing, documentation, and short sprint delivery.
Summary Generated by Built In
Solution Architecture/Data Architecture
- Change Source code to accommodate for various architectural considerations e.g.: Moving MSAL based authentication to JWT based authentication to Databricks X-forwarded headers while using Apps
- Sit through Technical reviews for configuring necessary Azure resources for deploying the application.
- Prepare Technical/Network Architecture Documentation and send it reviews and approvals for cloud and security teams before going live.
Databricks
- Design and build pipelines for ingesting data into Databricks from various sources like SAP, website scraping. Core technical skill will be PySpark and PySQL
- Write and do scenario-based testing, edge cases and discuss with the stake holders to finalize the necessary code changes and acceptance criteria.
- Understanding of the Databricks Unity Catalog permissions model and how to use OBO tokens and configure Service Principals for Databricks Agents,Genie Spaces, Machine Learning and Foundation Models.
- Knowledge of Databricks Apps. Ability to build and Deploy Databricks Apps using Visual Studio Code.
- Sending custom notifications from Databricks using APIs to custom Team Channel Webhooks
AI:
- Ability to use FastAPI /React front end and build minimal Single Page Applications(SPAs) using Chat UI interfaces and Claude Models/APIs
- Ability to use defined System Prompts, User Prompts etc..(i..e,) skills in prompt engineering.
- Basic Knowledge of Token Economics and ability use rule enforcement in prompts in addition to standard NLP language.
- Ability to reengineer code and see what it does and map it to the requirement specifications from users
- Ability to use Graphs to detect inter dependencies between rules and circular references.
- Ability to use both Claude Vision API in addition to standard text processing.
- Understand and develop Retrieval Augmented Generation specifically to Databricks like AI Search indexes, Hierarchical Chunking etc..
- Know how to implement basic guard rails related to AI safety
- Understand various caching mechanisms
Tools:
- Ability to work with Claude Code and Genie.
Full Stack Development:
- Ability to understand how a full stack works frontend, backend, middle ware data layers, routes etc.. and troubleshoot issues if any.
- Correct and rewrite code if any related to security findings in addition to standard development.
- Ability to Document code through various techniques like TDD,FDD,DFD and SD’s
DevOps:
- Create and Automate deployment pipelines(CI/CD) for Teams Bot Deployment ,Web Application Deployments, Databricks Bundle/notebook Deployments through ADO.
- Add various validation steps like SnykScans, Linting.
- Configuring various various environments based on CI/CD pipelines.
Communication Skills and Expectations:
- Ability to work with short descriptions of requirements and collaborating closely with Toxicoloigists, Project Managers from client team.
- Ability to deliver work as an Individual Contributor in short sprint cycles.
Requirements
Please share your resume to [email protected] for a quick response.
Along with sharing the profile, kindly share the below details:
Total Years:
Relevant Years:
Current CTC:
Expected CTC:
Notice Period: Only immediate Joiners
Skills Required
- Experience designing and building Databricks data ingestion pipelines using PySpark and PySQL
- Experience with Azure resource configuration and cloud and network architecture documentation
- Knowledge of Databricks Unity Catalog permissions, OBO tokens, and service principals
- Ability to build and deploy Databricks Apps using Visual Studio Code
- Experience with FastAPI, React, single-page applications, and chat interfaces
- Experience using Claude models, Claude APIs, and Claude Vision API
- Prompt engineering experience, including system prompts, user prompts, token economics, and rule enforcement
- Knowledge of retrieval augmented generation, AI Search indexes, and hierarchical chunking
- Knowledge of AI safety guardrails and caching mechanisms
- Full-stack troubleshooting across frontend, backend, middleware, data layers, and routes
- Ability to remediate security findings and rewrite code securely
- Experience creating CI/CD pipelines for Teams bots, web applications, and Databricks bundles or notebooks using Azure DevOps
- Experience implementing Snyk scans, linting, validation steps, and environment configuration
- Ability to work as an individual contributor in short sprint cycles
- Strong collaboration and communication skills with technical and client stakeholders
- Immediate availability to join
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Enable Data specializes in advanced data, application and cloud solutions working on cutting-edge projects driving innovation and transformation for our customers. We empower our customers to leverage modern solutions to deliver increased value across their business ecosystem. We help clients by providing consulting, managed project and staff augmentation services working with clients across various industries including healthcare, financial, media, insurance, and manufacturing.
.jpeg)
.jpg)
