DataBricks Architect [EGN]

🌴 Work format: long-term, full-time, 100% remote 👈
⏰ Start: ASAP 👈

Hi there! 👋

We’re looking for Databricks Architect for our US-based client. The work involves activities such as data migration, data collection, and optimization of Databricks-based solutions. The client has a steady demand for specialists. Most of the projects are short-term (with a high chance of extension), and thanks to the consistent demand, the client is able to offer new engagements after a project ends.
Currently, we’re looking for specialists for an AI/ML project in the healthcare domain. The project involves processing text data and analyzing images generated by medical devices (X-ray, MRI, etc.). The collected data will be migrated to a cloud-based Databricks platform. The platform is designed to handle the full data lifecycle, with built-in features ensuring compliance, auditability, cohort creation, and model reuse. The goal is to solve existing data management challenges (fragmented sources, manual processes, insufficient security).
We’re looking for individuals with strong Python skills. Cloud experience and knowledge of Databricks and Apache Spark are crucial. The projects are mainly US-based - in most cases, working hours require only a slight overlap (e.g., 10:00 to 18:00 CET), but we’re flexible and happy to accommodate preferences.

Key responsibilities:
📍 Ensuring secure data storage
📍 Processing and indexing DICOM data
📍 Data validation, building processing pipelines, creating and sharing cohorts
📍 Planning and executing database migrations
📍 Close collaboration with the team (including data engineers, data scientists, clinical informatics professionals, and support staff)

Requirements:
⚡️ Solid experience in a data engineering or related role (8+ years)
⚡️ Strong knowledge of the Databricks platform and Apache Spark
⚡️ Proficient in Python
⚡️ Experience with cloud data migrations
⚡️ Experience working in AWS environments (Amazon S3)
⚡️ Background in AI/ML project delivery
⚡️ Strong interpersonal and teamwork skills
⚡️ Initiative and the ability to work independently
⚡️ English fluency for effective communication within the team
Nice to have:
⚡️ Experience with other cloud platforms (e.g., Azure - Data Factory, Synapse, Logic Apps, Data Lake)
⚡️ Experience designing and optimizing data pipelines using DBT, SSIS, TimeXtender, or similar ETL/ELT solutions
⚡️ Exposure to big data or noSQL platforms (Redshift, Hadoop, EMR, Google Data, etc.)

How we work and what we offer:
🎯 We value open communication throughout the recruitment and employment process - we strive for clarity and transparency at every step
🎯 Our recruitment approach is human-centered - we simplify processes to be as smooth and candidate-friendly as possible
🎯 We operate on a "remote first" basis - remote work is the norm, and business travel is kept to a minimum
🎯 We offer private medical care (Medicover) and a Multisport card for contractors

How to apply? 👈

Send us your application via the form!