The Role
Design and build Databricks ETL pipelines and CDC connectors integrating Salesforce and Microsoft Dynamics 365. Develop PySpark and SQL transformations using Delta Lake, implement data-quality frameworks, optimize data workloads, create KPI dashboards, and establish monitoring, alerting, orchestration, architecture documentation, and data lineage. The role requires Azure experience, Databricks administration, and collaboration with international stakeholders, with occasional travel to Zurich.
Summary Generated by Built In
Senior Databricks Engineer - Long Term Mission - Full
Remote
Avanda is a Swiss IT
Consultancy. We are currently looking for a Senior Databricks
Engineer to join our international team at our global end client. This is a long-term
opportunity. You can work remotely with a few
business trips to Zurich, CH.
THE ROLE
You will join a B2B
Sales Data Aggregation programme built on Databricks.
The goal is to unify CRM data from Salesforce, Microsoft Dynamics 365, and
Excel/SharePoint into a single harmonised platform and deliver high-quality
data products and KPI dashboards for senior leadership.
YOUR RESPONSIBILITIES
- Design and build ETL
pipelines and CDC/incremental connectors for Salesforce & Dynamics 365
using Databricks-native patterns (Auto Loader / Structured Streaming /
Jobs)
- Implement Bronze → Silver
transformations using Delta Lake and reusable SQL/Notebook templates
- Develop PySpark notebooks and
apply Delta Lake optimisations (compaction, Z-order, caching)
- Build automated data-quality
checks and deliver KPI dashboards for C-level stakeholders
- Set up monitoring, alerting,
and job orchestration (Databricks Jobs / Observability)
- Document architecture and
data lineage (Unity Catalog / Delta time-travel)
Requirements
- 5+ years of data engineering
experience
- 3+ years with Databricks and
Delta Lake
- Strong PySpark / Python and
SQL skills
- Proven experience integrating
Salesforce & Dynamics 365 (APIs, CDC, Bulk API)
- Solid background in data
modelling, ETL design, and incremental/CDC approaches
- Experience with Azure cloud
services and Databricks workspace administration
- Experience building data
quality frameworks and monitoring
- English mandatory; German is
a plus
Skills Required
- 5+ years of data engineering experience
- 3+ years of Databricks and Delta Lake experience
- Strong PySpark, Python, and SQL skills
- Experience integrating Salesforce and Microsoft Dynamics 365 using APIs, CDC, or Bulk API
- Experience with data modelling, ETL design, and incremental or CDC approaches
- Experience with Azure cloud services and Databricks workspace administration
- Experience building data-quality frameworks and monitoring
- English proficiency
- German proficiency
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Avanda Solutions is a STEM professional services consultancy headquartered in Wollerau, Switzerland, serving enterprise clients across Switzerland and Europe. It helps organizations design, build, and scale complex technology initiatives across technology, life sciences, and engineering. Its offerings span strategic advisory, managed services, technology solutions—including cloud, data, custom software, and systems integration—and access to senior STEM professionals for large, mission-critical business transformations.
