Tech Lead, Databricks &
Modern Data Stack
About the role
Creole Studios is launching a dedicated Data & AI
practice focused on the modern data stack, with Databricks as the anchor. The
target market is US mid-market companies that need data platforms that actually
work in production.
We are hiring our first Tech Lead for this practice. You
will be one of the first engineers on the ground, lead a small pod of data
engineers, and own technical delivery on our early client engagements.
This is a hands-on lead role. Roughly 60% deep technical
work (architecture, code, reviews), 30% team leadership (mentoring, planning,
quality), 10% client and pre-sales support.
Requirements
What you will do
Technical delivery
- Architect
and build Databricks-based data platforms for US mid-market clients.
- Design
and implement medallion architectures, Delta Lake pipelines, Unity Catalog
governance, and Workflows-based orchestration.
- Write
production PySpark and SQL. Yes, you will still be in the code.
- Set
engineering standards: code quality, testing, CI/CD, IaC, monitoring.
- Own
technical decisions on your projects. Architecture, tooling, trade-offs.
Team leadership
- Lead
a pod of 3 to 5 data engineers across 1 to 2 client engagements.
- Run
code reviews, design reviews, and weekly technical syncs.
- Mentor
mid and junior engineers. Help them get certified.
- Interview
and help hire engineers into your pod.
Client work
- Be
the technical point of contact for client engineering teams.
- Run
technical workshops, requirement-gathering sessions, and architecture
reviews with client stakeholders.
- Translate
business requirements into technical solutions.
- Support
pre-sales: scoping calls, technical proposals, effort estimates. You will
not own pre-sales, but you will be in the room.
Practice building
- Contribute
to internal IP: reusable accelerators, reference architectures, demo
assets.
- Help
shape engineering standards and delivery playbooks for the practice.
- Co-author
technical blog posts and case studies.
What you bring
Must have
- 6
to 10 years in data engineering, with at least 3 years on Databricks
or Spark at production scale.
- Strong
PySpark and SQL. You can write, debug, and optimize Spark jobs without
help.
- Databricks
ecosystem fluency: Delta Lake, Unity Catalog, Workflows or DLT, MLflow
basics. Databricks Certified Data Engineer Associate or Professional (or
willing to get certified within 60 days of joining).
- One
cloud at strong level, ideally AWS or Azure. Comfortable with IAM,
networking basics, and Terraform or equivalent IaC.
- Modern
data stack exposure beyond Databricks: Airflow, dbt, Fivetran, or
similar.
- Prior
lead or senior engineer experience. You have led at least one team of
3+ engineers on a real project. You know how to run a code review, push
back on bad design, and unblock a junior.
- Solid
English, written and spoken. You will be on calls with US clients
regularly.
Strong bonus
- Databricks
Certified Data Engineer Professional or ML Associate.
- Experience
working with US clients in a services or consulting setting.
- GenAI
or LLM work on Databricks (Mosaic AI, vector search, RAG pipelines).
- DevOps
fluency: CI/CD pipelines, Docker, Kubernetes, observability tooling.
- Open
source contributions, technical writing, or conference talks.
What this role is not
- A
pure individual contributor seat. You will lead people.
- A
management-only role. You will still be in the codebase every week.
- A
9-to-5 with a fixed scope. Early-practice work is variable. Some weeks are
heavy delivery, some are pre-sales support, some are internal R&D.
Benefits
What you get
- A
leadership role in a brand new practice with room to grow into a Principal
or Practice Lead position over 2 to 3 years.
- Direct
working relationship with the founder. Decisions get made quickly.
- US
client exposure from day one. Real platforms, real production scale.
- Strong
compensation with a performance-linked component.
- Full
sponsorship for Databricks certifications, cloud certifications, and
relevant training.
- A
small, senior team to work with. No bureaucracy. No legacy projects.
How to apply
Send the following to [careers email]:
- A
resume or LinkedIn profile.
- A
short note (5 to 10 lines) on the most complex Databricks or Spark problem
you have solved and how you approached it.
- Optional:
links to GitHub, technical writing, or conference talks.
We will respond to every serious application within 5
working days.
Creole Studios is a 12 year old bootstrapped software
studio with offices in Ahmedabad and a US entity. We build custom software, AI
products, and data platforms for founders and operators globally.
Skills Required
- 6 to 10 years of experience in data engineering
- At least 3 years of production-scale Databricks or Spark experience
- Strong PySpark and SQL skills, including writing, debugging, and optimizing Spark jobs
- Fluency with Delta Lake, Unity Catalog, Workflows or Delta Live Tables, and MLflow basics
- Databricks Certified Data Engineer Associate or Professional certification, or willingness to obtain certification within 60 days
- Strong expertise in at least one cloud platform, ideally AWS or Azure
- Knowledge of IAM, networking fundamentals, and Terraform or equivalent infrastructure as code
- Exposure to modern data stack technologies such as Airflow, dbt, or Fivetran
- Prior lead or senior engineer experience leading at least three engineers on a real project
- Strong written and spoken English for regular communication with US clients
- Databricks Certified Data Engineer Professional or ML Associate certification
- Experience working with US clients in a services or consulting setting
- GenAI or LLM experience on Databricks, including Mosaic AI, vector search, or RAG pipelines
- DevOps experience with CI/CD pipelines, Docker, Kubernetes, or observability tooling
- Open source contributions, technical writing, or conference talks
What We Do
As a leading web development agency, we take utmost pride in keeping up with the newest industry trends and technologies. We craft user-centric designs that are both intuitive and engaging, transforming complex concepts into accessible solutions – where form meets function with a smile. Offering comprehensive web audit services to assess design, development, performance, security, and usability, followed by ongoing maintenance to ensure optimal operation and up-to-date features.
Why Work With Us
At Creole Studios, we blend innovation with creativity to deliver exceptional web and app solutions. Our diverse team thrives in a collaborative environment where every idea is valued. We push boundaries, prioritize growth, and strive for excellence, making us a unique place to work and grow.
Gallery
