Databricks Engineer

Posted 7 Days Ago
Be an Early Applicant
Lisboa, PRT
In-Office
Senior level
Information Technology • Professional Services
Digital and Communication Solutions for EU Institutions and International Organisations.
The Role
Design, build, optimize, deploy, and operate production-grade data pipelines on Databricks. Responsibilities include PySpark and Spark SQL development, Delta Lake architecture, workflow orchestration, cluster and cost optimization, monitoring, data quality, governance through Unity Catalog, CI/CD, documentation, and collaboration in Agile teams.
Summary Generated by Built In

About Cronos Europa Portugal

Cronos Europa Portugal is the Lisbon delivery centre of Cronos Europa, part of the Cronos Group, a technology federation of 9,000+ professionals and 500+ competence centres across Europe. From our office at IDB Lisbon, we deliver application development, architecture, and IT operations for major European organisations, working as an integrated nearshore extension of our clients' teams.

Cronos Europa Portugal is recruiting two Senior Databricks Engineers for an international technology services group.

As a member of an established data engineering team, you will design, build, and operate data solutions on the Databricks Lakehouse Platform. This role requires hands-on expertise across the full data engineering lifecycle, from architecture and development to production deployment and operational support.

We are looking for autonomous senior engineers capable of transforming ambiguous business requirements into scalable, production-ready data solutions while taking full ownership of their technical decisions.

Responsibilities:
  • Design, build, and maintain scalable data pipelines on the Databricks Lakehouse Platform.
  • Develop high-quality solutions using PySpark, Spark SQL, and Python.
  • Design and optimize Delta Lake tables, including partitioning, schema evolution, and performance tuning.
  • Implement layered data architectures (Raw, Cleansed, Curated).
  • Build and manage workflows using Databricks Jobs, Workflows, and Delta Live Tables.
  • Optimize Spark workloads, including partitioning, caching, shuffling, join strategies, and file sizing.
  • Manage cluster configurations and monitor platform cost efficiency.
  • Implement logging, monitoring, alerting, and recovery mechanisms to ensure reliable operations.
  • Integrate data quality controls throughout the pipeline lifecycle.
  • Work within Unity Catalog to support data governance, lineage, and access control.
  • Participate in code reviews and contribute to CI/CD-driven delivery practices.
  • Collaborate in Agile ceremonies including planning, refinement, reviews, and retrospectives.
  • Produce and maintain technical documentation and design decisions.
Technical skills:
  • Minimum 6 years of professional experience in Data Engineering.
  • Significant hands-on experience with Databricks in production environments.
  • Strong expertise in Apache Spark, PySpark, and Spark SQL.
  • Proven practical experience with Delta Lake.
  • Advanced Python and SQL skills.
  • Experience designing, deploying, and supporting production-grade data pipelines.
  • Experience with Git and CI/CD practices.
  • Knowledge of Databricks Workflows, Jobs, and Delta Live Tables.
  • Experience with Unity Catalog, governance, and data lineage is an asset.
  • Cloud experience with Azure, AWS, and/or GCP is highly valued.
  • Knowledge of Terraform, Databricks Asset Bundles, dbt, or Airflow is considered a plus.
  • Databricks certifications (Data Engineer Associate or Professional) are an advantage.
  • Exposure to MLflow and Databricks ML workflows is a plus.
Profile :
  • Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
  • Strong analytical and problem-solving skills.
  • Ability to work independently and take ownership of technical decisions.
  • Excellent communication and collaboration skills within international teams.
  • Experience in product engineering environments is considered a strong asset.
  • Fluent English, written and spoken, is mandatory.
  • Ability to work effectively in a fully remote environment.
Why Cronos Group?We'll propose you:
  • An attractive salary package.
  • A good work-life balance environment.
  • The opportunity to work on large-scale international data platforms.
  • Exposure to modern cloud, data engineering, and analytics technologies.
  • The assurance of working with cutting-edge technologies in an entrepreneurial spirit.
  • Tailor-made training courses aligned with your professional goals.
  • A good job in a friendly and collaborative environment.

If you wish to integrate a dynamic structure on a human scale while working with the latest technologies, don't wait anymore and join Cronos!

Skills Required

  • At least 6 years of professional data engineering experience
  • Significant hands-on Databricks experience in production environments
  • Strong expertise in Apache Spark, PySpark, and Spark SQL
  • Proven practical experience with Delta Lake
  • Advanced Python and SQL skills
  • Experience designing, deploying, and supporting production-grade data pipelines
  • Experience with Git and CI/CD practices
  • Knowledge of Databricks Workflows, Jobs, and Delta Live Tables
  • Unity Catalog, governance, and data lineage experience
  • Cloud experience with Azure, AWS, and/or GCP
  • Knowledge of Terraform, Databricks Asset Bundles, dbt, or Airflow
  • Databricks Data Engineer Associate or Professional certification
  • Exposure to MLflow and Databricks ML workflows
  • Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field
  • Fluent written and spoken English
  • Ability to work effectively in a fully remote environment
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Brussels
427 Employees
Year Founded: 2005

What We Do

Cronos Europa is an IT and digital communications company uniquely dedicated to serving the European institutions, agencies and bodies. From the European Union to EUROCONTROL, we partner with a range of supranational and interinstitutional authorities. Our mission is to arm them with the tools they need to thrive in the digital age. Every aspect of our organisation is designed to complement their capabilities - from our people to our processes and our premises. Our brand combines the expertise of former companies Cronos International and C-Dev, with the creative skills of Inspiiro and the breadth of capabilities of the Cronos Group. Today, Cronos Europa employs over 1,000 people in offices across Belgium, Luxembourg and the Netherlands, serving institutions across diverse framework contracts. Cronos Europa is part of the Cronos Group, one of the largest IT service providers in the Benelux, employing over 8,000 people across 200 competence centres. By leveraging the Group’s resources, Cronos Europa can help clients extract value from new and emerging technologies, for everything from Artificial intelligence to Zg Quantum. For spontaneous applications: https://cronoseuropa.breezy.hr/p/7a64ee973c6701-spontaneous-application?state=published

Similar Jobs

IG&H Logo IG&H

Databricks Engineer

Information Technology • Analytics • Business Intelligence • Consulting
Hybrid
Lisboa, PRT
31K-39K Annually

Pfizer Logo Pfizer

Machine Learning Engineer

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
32 Locations
121990 Employees
163K-272K Annually

Pfizer Logo Pfizer

Senior Director, Innovation, Data & Analytics (IDA) Lead

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
32 Locations
121990 Employees
231K-385K Annually

Pfizer Logo Pfizer

InsightXplorer Platform Lead, Medical Insights

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
32 Locations
121990 Employees
124K-207K Annually

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account