Senior Data Engineer

Posted Yesterday
Be an Early Applicant
Hiring Remotely in Kraków, Małopolskie, POL
In-Office or Remote
Senior level
Information Technology • Software • Consulting
The Role
Lead architecture, migration, and optimization of production data pipelines using Airflow, Spark, dbt, BigQuery, and Python. Establish engineering standards, testing and verification processes, incident response practices, and documentation. Refactor pipelines while ensuring identical outputs, validate data lifecycle rules, resolve production issues, and mentor engineers. Experience with encryption, compliance, security controls, or Kafka is advantageous.
Summary Generated by Built In

Softeta is a software engineering partner for finance, energy, industrial, and other high-stakes sectors. We specialize in building and modernizing backend-heavy, integration-critical systems where speed, accuracy, and reliability are non-negotiable. With 100+ AI and custom software experts across engineering hubs in Lithuania and Poland, we embed ourselves directly into client operations — delivering custom software, automation, and AI where they drive the most value. Clients such as SEB, NordVPN, and CarVertical trust us with systems that serve millions of users globally. We strive for excellence, that’s why we created Cobble – Softeta’s own AI-native development workflow, built by our engineers, that standardizes how developers work with AI agents from requirement to working code.

We’re looking for an experienced Senior Data Engineer to join a project in the telecommunications sector, leading the architecture, migration, and optimization of production data pipelines using Airflow, Spark, dbt, BigQuery, and Python.

Job description:
  • Propose and lead the architecture for user-data workflows across Airflow, Spark, dbt, and BigQuery (encryption points, derived tables, backfills, partitions).
  • Sequentially migrate existing pipelines behind a custom regression harness to guarantee identical output.
  • Establish lasting engineering standards post-migration: code reviews, testing protocols, incident post-mortems, and release checklists.
  • Implement verification jobs to validate end-to-end data lifecycle rules.
  • Participate in pipeline maintenance, incident response, and root-cause resolution.
  • Document design choices using Architecture Decision Records (ADRs).

Requirements
  • Deep hands-on experience with Airflow, Spark, dbt, BigQuery, and Python.
  • Proven track record leading a live pipeline migration technically from conception to completion.
  • Hands-on experience refactoring production pipelines while verifying identical output.
  • Demonstrated success establishing engineering best practices (testing, code reviews, incident resolution) within a team.
  • Concrete mentoring or technical leadership experience.

Nice to have:

  • Previous experience with encryption at rest, data retention policies, or regulatory compliance (e.g., GDPR).
  • Envelope encryption using key management services (GCP KMS), BigQuery AEAD functions, or Tink.
  • BigQuery column-level security, policy tags, and Google Cloud Data Catalog.
  • Event-driven architectures using Apache Kafka.

Benefits
  • Diverse and technically challenging projects.
  • Training budget for professional and personal growth.
  • Flexible working hours and a hybrid workplace model.
  • Flexible schedule and an Agile/SCRUM environment.
  • Technical equipment that you can choose.

Skills Required

  • Deep hands-on experience with Airflow, Spark, dbt, BigQuery, and Python
  • Experience leading a live pipeline migration technically from conception to completion
  • Hands-on experience refactoring production pipelines while verifying identical output
  • Experience establishing engineering best practices, including testing, code reviews, and incident resolution
  • Mentoring or technical leadership experience
  • Experience with encryption at rest, data retention policies, or regulatory compliance such as GDPR
  • Experience with envelope encryption using GCP KMS, BigQuery AEAD functions, or Tink
  • Experience with BigQuery column-level security, policy tags, and Google Cloud Data Catalog
  • Experience with event-driven architectures using Apache Kafka
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Vilniaus miesto, Vilniaus
75 Employees

What We Do

SOFTETA is an international full-cycle software development and consultancy partner. We implement 20 years of joint experience in IT and kick-off projects faster that probably anyone else on the market in order to save our clients time & money. In Softeta you get fast, cutting-edge service and effective, easy communication.

Similar Jobs

Xebia Logo Xebia

Senior Data Engineer

Artificial Intelligence • Cloud • Information Technology • Software • Consulting • Data Privacy
Remote
Poland
3254 Employees

Sowelo Consulting sp. z o.o. Logo Sowelo Consulting sp. z o.o.

Senior Data Engineer

HR Tech • Information Technology • Professional Services • Consulting
Remote
Poland
50 Employees

Xebia Logo Xebia

Senior Data Engineer

Artificial Intelligence • Cloud • Information Technology • Software • Consulting • Data Privacy
Remote
Poland
3254 Employees

WP Engine Logo WP Engine

Senior Data Engineer

Cloud • eCommerce • Software
Remote or Hybrid
2 Locations
1100 Employees
224K-308K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account