The Role
Design, build, and optimize cloud-based Databricks data platforms and scalable ETL/streaming pipelines (Delta Lake, Spark). Collaborate with data scientists and stakeholders, troubleshoot performance, and support analytics and MLOps workflows on Azure.
Summary Generated by Built In
The Project
We are looking for a Data Engineer (Databricks) to join our partner's international team. The role focuses on building and optimizing modern data platforms, developing scalable data pipelines, and supporting cloud-based analytics solutions in a dynamic environment.
Requirements
Requirements
- Bachelor's degree in Computer Science, Information Technology, or a related field
- More than 4 years of experience in data engineering, big data, or cloud-based analytics, with a strong preference for experience in banking or fintech sector
- More than 2 years of hands-on experience with Databricks (Workflows, Jobs, Notebooks, and Clusters), including Delta Lake, Spark Structured Streaming
- Expertise in Apache Spark (PySpark/Scala) for large-scale data processing and real-time analytics
- Advanced experience in SQL and Python/Scala, with experience in data transformations and ETL pipelines
- Strong understanding of Delta Lake architecture for data versioning, ACID transactions, and schema evolution
- Experience with Cloud Platforms, particularly Databricks on Azure
- Knowledge of Lakehouse architecture and designing scalable, secure, and cost-efficient data pipelines is a plus
- Familiarity with streaming architectures (Kafka) is a plus
- Experience in MLOps and model deployment using MLflow in Databricks is a plus
- Ability to collaborate with data scientists, analysts, and business teams to understand data needs
- Strong problem-solving skills, with the ability to troubleshoot performance bottlenecks and optimize workloads
- Excellent communication skills to explain technical concepts to non-technical stakeholders
Benefits
Benefits
- Full-remote working
- International working environment
- Modern technologies and challenging projects
- Opportunity to work with experienced professionals
- Long-term career opportunities
Skills Required
- Bachelor's degree in Computer Science, Information Technology, or a related field
- More than 4 years of experience in data engineering, big data, or cloud-based analytics
- Experience in banking or fintech sector
- More than 2 years of hands-on experience with Databricks (Workflows, Jobs, Notebooks, Clusters), including Delta Lake and Spark Structured Streaming
- Expertise in Apache Spark (PySpark/Scala) for large-scale data processing
- Advanced experience in SQL and Python/Scala for data transformations and ETL
- Strong understanding of Delta Lake architecture (data versioning, ACID transactions, schema evolution)
- Experience with cloud platforms, particularly Databricks on Azure
- Knowledge of Lakehouse architecture and designing scalable, secure, cost-efficient data pipelines
- Familiarity with streaming architectures (Kafka)
- Experience in MLOps and model deployment using MLflow in Databricks
- Ability to collaborate with data scientists, analysts, and business teams
- Strong problem-solving skills; ability to troubleshoot performance bottlenecks and optimize workloads
- Excellent communication skills to explain technical concepts to non-technical stakeholders
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
IDBC Group is a digital recruitment company and an IT & HR services firm, acting as one of Hungary's leading external IT resource providers, specializing in executive search, IT contracting, RPO, and workforce leasing services.
