Senior Data Engineer

Posted 3 Days Ago
Be an Early Applicant
Hiring Remotely in Katowice, Śląskie
In-Office or Remote
12K-17K Annually
Senior level
Information Technology • Consulting
The Role
As a Senior Data Engineer, you will build and maintain data pipelines using Databricks and Azure, ensuring data governance and compliance while optimizing performance and collaborating with stakeholders.
Summary Generated by Built In
Company Description

Sopra Steria is one of the largest players in the tech industry in Europe, known for its consulting, digital services and software development. We operate in nearly 30 countries in the world, hiring more than 55,000 employees.
The Polish branch, as the Global Delivery Center, operates in Katowice since 2007 and has been growing ever since. Currently, our team consists of around 1,000 specialists.

Within the Digital Platform Services department, our teams specialize in areas such as cloud, operating systems, virtualization, databases, backup or storage, as well as networking and security. We also have 1st line support consultants who speak French and English, but also Italian, Spanish, Portuguese and German.

The Application Services department is responsible for areas such as software development, data engineering, testing services, CRM, ITSM and ERP platform integrations, as well as application management for customers in Scandinavia, Benelux, France, Germany, Switzerland and the UK.

Job Description

We are looking for Senior Data Engineer to join Sopra Steria Polska a team for a client in the banking sector. You will be working in a stable environment in an international team working for one of the most popular Dutch banks.

Note that we can only offer cooperation to people who are located in Poland and are willing to commute to our office in Katowice or Gdańsk, Poland.

Responsibilities:​
•    Build and maintain data pipelines and platforms in Databricks and Azure using Apache Spark.
•    Ensure data security, governance, and compliance using Unity Catalog and best practices.
•    Develop reusable Python libraries for integration across Databricks and Azure Functions.
•    Designing and implementing batch data pipelines in Databricks using Apache Spark (PySpark) and Delta Lake.
•    Applying Spark performance tuning techniques (e.g., partitioning, caching, broadcast joins, shuffle optimization) for large-scale data processing.
•    Setting up and managing Unity Catalog for data governance and security.
•    Building Python libraries for reusable business logic and utilities, used in Databricks Spark jobs and Azure Functions to expose APIs.
•    Developing CI/CD pipelines in Azure DevOps for data workflows and infrastructure deployment.
•    Collaborating with stakeholders to understand data requirements and deliver solutions that create customer value.

Tech stack on the project:​
•    .Net/Databricks
•    Python, API
•    Apache Spark
•    Azure 
•    SQL Server 

Qualifications

Must have requirements:​
•    5+ years of experience in data engineering roles.
•    Deep hands-on experience with Databricks, including Unity Catalog, Delta Lake, and Lakehouse architecture.
•    Strong proficiency in Apache Spark, including PySpark, Spark SQL, and Spark performance tuning.
•    Experience creating Python libraries for reusable components and API integration.
•    Experience with Azure Cloud services (Data Lake, Key Vault, Active Directory, App Services).
•    Familiarity with SQL Server and relational database concepts.
•    Understanding of data security principles and compliance requirements.
•    Experience building CI/CD pipelines in Azure DevOps for data workflows.
•    Infrastructure as Code (Bicep or Terraform).
•    Good communication skills and a team player.
•    Experience with Agile ways of working.
•    English B2/C1.   
•    Being open to occasional business trips abroad and visits in our office in Katowice or Gdańsk. 
•    EU Citizenship.  

Nice to have requirements:
•    Experience with finance or banking systems.
•    Knowledge of streaming architectures (though primary focus is batch).
•    Familiarity with Spark Structured Streaming and MLlib.
•    Advanced cost optimization strategies for Spark workloads in cloud environments.

Additional Information

What we offer:
• BENEFITS (UoP): Luxmed, Medicover Sport, Worksmile, educational platforms, languages learning platform, referral bonus, copyrights, life insurance, workation
• DEVELOPMENT OPPORTUNITIES (UoP and B2B): certifications (paid by the company), conferences, Tech Lunches,  possibility to join our Communities (Project Management, Architecture, Security, Process Management, Leadership, AI and Cloud)

The recruitment process for this position consists of three stages:
• a short phone call with a recruiter (30 min max)
• one-hour long interview on Teams (with both general and technical questions)
• one-hour long interview on Teams (with project representatives)

Salary range: 
Senior: UOP: 12 000 -17 000 PLN gross/month.
All information about salary range and its additional components will be provided during 1st stage of recruitment process.

At our organization, we are committed to fighting against all forms of discrimination. We foster a work environment that is inclusive and respectful of all differences.

Top Skills

Spark
Azure
Azure Devops
Bicep
Databricks
Python
SQL Server
Terraform
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Paris
49,329 Employees

What We Do

Sopra Steria, a major Tech player in Europe with 56,000 employees in nearly 30 countries, is recognised for its consulting, digital services and software development. It helps its clients drive their digital transformation and obtain tangible and sustainable benefits. The Group provides end-to-end solutions to make large companies and organisations more competitive by combining in-depth knowledge of a wide range of business sectors and innovative technologies with a fully collaborative approach. Sopra Steria places people at the heart of everything it does and is committed to putting digital to work for its clients in order to build a positive future for all. In 2023, the Group generated revenues of €5.8 billion.

The world is how we shape it

Similar Jobs

Capco Logo Capco

Senior Data Engineer

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
Poland
6000 Employees

Provectus Logo Provectus

Senior Data Engineer

Artificial Intelligence • Information Technology • Consulting
Remote
6 Locations
572 Employees

Airalo Logo Airalo

Senior Data Engineer

Information Technology
Remote
28 Locations
179 Employees

Provectus Logo Provectus

Senior Data Engineer

Artificial Intelligence • Information Technology • Consulting
In-Office or Remote
4 Locations
572 Employees

Similar Companies Hiring

Scrunch AI Thumbnail
Software • SEO • Marketing Tech • Information Technology • Artificial Intelligence
Salt Lake City, Utah
Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account