Senior Databricks Engineer / Architect - GenAI & Genie

Reposted Yesterday
Be an Early Applicant
3 Locations
Remote
Senior level
Artificial Intelligence • Information Technology • Professional Services • Analytics
The Role
Design and scale Databricks Genie conversational data interfaces, including Genie Spaces, semantic layers, SQL guidance, testing, fine-tuning, and external integrations. Build optimized Python, SQL, and PySpark pipelines in Delta Lake, support LLM-based metadata enrichment and semantic optimization, and translate business requirements into reliable data models. Collaborate with stakeholders and maintain high standards for accuracy, performance, and governed enterprise data access.
Summary Generated by Built In

About Entrada AI

Entrada AI is a specialized consulting partner and a strategic portfolio company of Databricks Ventures. We were recently named the Genie Partner of the Year (2026) for our work deploying Databricks Genie at enterprise scale—bridging the gap between AI ambition and the trusted, governed data required for accurate responses. With over 150 Databricks projects delivered, we unlock self-service analytics for Fortune 500 leaders.

Databricks invested in us because of our technical excellence, placing us in the "inner circle" of the ecosystem. For our engineers, this means direct access to product roadmaps, private previews, and the teams building the platform. You will join a team of industry veterans who value clean architecture over quick fixes. We don't just maintain pipelines; we solve complex architectural challenges.

About the Role

As a Databricks Genie Architect, you will be the driving force behind building next-generation conversational data interfaces. Your primary focus will be designing, implementing, and scaling intelligent, natural-language data assistants using Genie.

You will bridge the gap between complex enterprise data warehouses and business users, enabling them to query databases using natural language. This role is a hybrid of cutting-edge Generative AI engineering and robust Data Engineering within the Databricks Lakehouse ecosystem.

Key Responsibilities1. Databricks Genie & Conversational AI Development (Core Focus)
  • Genie Space Architecture: Design, configure, and maintain high-performing Databricks Genie Spaces tailored to complex business domains.

  • Semantic Layer & Curation: Curate the semantic metadata, SQL queries, and golden instructions that guide Genie to ensure highly accurate, deterministic SQL generation.

  • Testing & Fine-Tuning: Proactively test, benchmark, and fine-tune Genie responses to handle complex business logic, edge cases, and multi-turn conversations.

  • Integration & Feedback: Connect Databricks Genie endpoints to custom web interfaces/external UIs and implement feedback loops to continuously improve accuracy.

2. GenAI & Data Engineering Support
  • Data Pipelines & Spark: Build and optimize data pipelines using Python, SQL, and PySpark to ensure data in Delta Lake is perfectly structured and optimized for Genie's consumption.

  • GenAI Orchestration: Utilize LLMs on Databricks for metadata enrichment, automated data labeling, and semantic optimization.

3. Collaboration & Implementation
  • Business Translation: Act as a translator between business users (understanding what questions they ask) and the data platform (structuring schemas so Genie can answer them easily).

Technical Requirements

MUST HAVE

  • Databricks Mastery: 5+ years hands-on experience with the Databricks ecosystem, with specific focus on Databricks Genie (or equivalent Text-to-SQL/semantic-layer work), Unity Catalog, and Databricks SQL/Workflows.

  • Excellent SQL & Data Modeling: Expert-level SQL skills (writing complex, performant queries) and experience structuring data (star schemas, gold tables, views) to be "Genie-ready."

  • Production Python: Strong experience in writing clean, production-grade Python code.

  • GenAI / LLM Concepts: Strong understanding of Text-to-SQL paradigms, prompt engineering, semantic routing, and RAG architectures.

  • Big Data: Proficiency in Apache Spark (PySpark) for data transformation and orchestration.

  • API Integration: Experience working with REST APIs to integrate GenAI endpoints into external applications.

NICE TO HAVE

  • MLflow & Model Serving: Manage model lifecycles and deploy endpoints utilizing the broader Databricks AI suite (MLflow, Databricks Model Serving).

Soft Skills
  • Analytical & Precise: Strong attention to detail, especially when auditing Genie's generated SQL for business accuracy.

  • Bridge Builder: Ability to communicate effectively with business stakeholders to understand their language and translate it into semantic data models.

  • Continuous Learner: Enthusiasm for keeping up with the rapid pace of Databricks and GenAI product updates.

The Offer

Cooperation Models:

Poland: Available via Employment Contract (UoP) or B2B.

Romania/ Greece: Available via B2B only.

  • 100% Remote: Full flexibility to work from anywhere in Poland/ Romania / Greece

  • Schedule & Travel: This is a remote position, but it requires daily overlap with US Time for team syncs and collaborative work. Additionally, you should be prepared to travel to US for client meetings.

  • High-End Tech: Apple MacBook Air M4 15" provided to all engineers.

  • Referral Bonus: Bonus for bringing other top-tier engineers to the team.

  • Professional Growth:

    • Certification Support: Coverage for all Databricks technical certifications.

    • Industry Leadership: Support in reaching the highest tiers of Databricks expertise (such as the Champion program) tailored to your specific career track.

    • Personal Branding: Opportunities to present at global industry conferences and contribute to technical thought leadership.

    • Expert Mentorship: Direct collaboration with Databricks MVPs and core product teams, giving you a front-row seat to the platform's evolution.

Recruitment Process

  • Introductory Call (20 min): Short conversation with our Recruiter to discuss your background and expectations.

  • Technical Interview (60 min): Deep dive into your technical skills with our engineering team.

  • Optional Client Interview: Required only in specific cases.

  • Decision & Offer: We aim to close the process and provide feedback efficiently.

Skills Required

  • 5+ years of hands-on experience with the Databricks ecosystem
  • Experience with Databricks Genie or equivalent Text-to-SQL and semantic-layer work
  • Experience with Unity Catalog, Databricks SQL, and Databricks Workflows
  • Expert-level SQL skills, including complex and performant queries
  • Experience with data modeling, including star schemas, gold tables, and views
  • Strong production-grade Python development experience
  • Understanding of Text-to-SQL, prompt engineering, semantic routing, and RAG architectures
  • Proficiency with Apache Spark and PySpark
  • Experience integrating GenAI endpoints with external applications through REST APIs
  • Experience with MLflow and Databricks Model Serving
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
60 Employees
Year Founded: 2023

What We Do

Entrada is a global Databricks-focused data and AI consulting and implementation partner. It helps organizations modernize data platforms and turn trusted data into business outcomes, offering data engineering, strategy and governance, migrations, AI/ML, analytics, concierge support, and training. Its teams work with clients from early data-platform migration through advanced use cases and production data products, tailoring solutions to industry needs and business results.

Similar Jobs

Pfizer Logo Pfizer

Digital Operations Agentic Lead - Senior Manager

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
29 Locations
121990 Employees

Zapier Logo Zapier

People Business Partner

Artificial Intelligence • Productivity • Software • Automation
Remote
27 Locations
800 Employees

Pfizer Logo Pfizer

Manager, ServiceNow ITOM Engineer

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
2 Locations
121990 Employees

Zapier Logo Zapier

Designer

Artificial Intelligence • Productivity • Software • Automation
Remote
27 Locations
800 Employees

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
43 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account