Senior Data Engineer

Posted 2 Months Ago
Be an Early Applicant
6 Locations
In-Office
Senior level
Transportation
The Role
Develop, operate, and optimize a multi-tenant Azure data platform using Data Factory, ADLS Gen2, Databricks, and Synapse Analytics. Build scalable PySpark and Spark ETL/ELT pipelines, maintain data infrastructure, implement CI/CD automation, optimize cost and performance, and support data governance, security, modeling, and reporting. Collaborate with BI and data teams across development, test, and production environments.
Summary Generated by Built In

What You Can Expect:

About the Role:

We are looking for an experienced and solution-oriented Azure Data Platform Engineer to develop, operate, and optimize our modern Azure-based data platform. In this role, you will focus on Azure, Databricks, data infrastructure, and CI/CD, supporting multi-tenant environments and enabling reliable, scalable data solutions.

Main responsibilities:

• Develop a Modern Azure Data Platform: Design, build, and operate end-to-end data solutions using Azure Data Factory, Azure Data Lake Storage Gen2, Databricks, and Azure Synapse Analytics.

• Create Data Pipelines: Develop and maintain scalable ETL/ELT pipelines using PySpark and Spark, with a strong focus on data quality, reliability, and performance.

• Multi-Tenant & Environment Support: Support and operate multi-tenant data platforms across multiple environments (development, test, production) with clear separation and governance.

• Infrastructure & Platform Operations: Provision, configure, and maintain Azure data infrastructure, ensuring stability, security, and scalability.

• CI/CD for Data Platforms: Build and maintain CI/CD pipelines for data pipelines and Databricks workloads, enabling automated deployments across environments.

• Cost-Efficient & Best-Practice Azure Usage: Apply Azure best practices to optimize performance and cost, including resource sizing, lifecycle management, and cost monitoring.

• Collaboration with BI & Data Teams: Work closely with BI and data teams to support efficient data models and reporting solutions.

• Data Governance & Security Basics: Support data governance requirements such as access control, secure data handling, and basic metadata management.

What You Bring:

• Azure Data Platform Experience: Several years of hands-on experience with Azure Data Factory, ADLS Gen2, Databricks, and Azure Synapse Analytics.

• PySpark & Spark: Strong experience building distributed data processing pipelines using PySpark and Spark.

• ETL / ELT Knowledge: Solid understanding of ETL/ELT concepts and data modeling practices.

• CI/CD & Automation: Experience with CI/CD pipelines for data workloads and basic automation of deployments.

• SQL Skills: Strong SQL skills and experience optimizing analytical queries.

• Data Formats: Practical experience with Parquet and/or Avro.

• Infrastructure Awareness: Good understanding of Azure resource structure, environments, and operational best practices.

• Analytical & Team-Oriented Mindset: Solution-focused approach with the ability to work independently and collaboratively.

• Language Skills: Fluency in English is required; knowledge of German is an advantage.

Note: This is a remote role in the European Union. Candidates need to be based in a country where Rhenus Overland Transport is already established.
Please provide a CV in English language.

Skills Required

  • Several years of hands-on experience with Azure Data Factory, Azure Data Lake Storage Gen2, Databricks, and Azure Synapse Analytics
  • Strong experience building distributed data processing pipelines using PySpark and Spark
  • Solid understanding of ETL/ELT concepts and data modeling practices
  • Experience with CI/CD pipelines for data workloads and deployment automation
  • Strong SQL skills and experience optimizing analytical queries
  • Practical experience with Parquet and/or Avro
  • Understanding of Azure resource structures, environments, and operational best practices
  • Fluency in English
  • Knowledge of German
  • Candidates must be based in an EU country where Rhenus Overland Transport is established
  • CV provided in English
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company

What We Do

Niederrheinische Verkehrsbetriebe AG (NIAG) is a regional transport company based in Moers, Germany, that provides comprehensive bus and rail services to the Lower Rhine region.

Similar Jobs

In-Office
Barcelona, Cataluña, ESP
832 Employees

Qualifyze GmbH Logo Qualifyze GmbH

Senior Data Engineer

Software • Pharmaceutical • Big Data Analytics
Remote or Hybrid
Barcelona, Cataluña, ESP
222 Employees
60K-70K Annually

Delivery Hero Logo Delivery Hero

Senior Data Engineer

Information Technology
In-Office
Barcelona, Cataluña, ESP
32902 Employees

adm Group Logo adm Group

Senior Data Engineer

AdTech • Marketing Tech
Hybrid
Barcelona, Cataluña, ESP
933 Employees

Similar Companies Hiring

Blissway Thumbnail
Computer Vision • Fintech • Hardware • Internet of Things • Machine Learning • Software • Transportation
Denver, CO
24 Employees
Toro TMS Thumbnail
Cloud • Enterprise Web • Sales • Software • Transportation
Chicago, IL
80 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account