Softeta is a software engineering partner for finance, energy, industrial, and other high-stakes sectors. We specialize in building and modernizing backend-heavy, integration-critical systems where speed, accuracy, and reliability are non-negotiable. With 100+ AI and custom software experts across engineering hubs in Lithuania and Poland, we embed ourselves directly into client operations — delivering custom software, automation, and AI where they drive the most value. Clients such as SEB, NordVPN, and CarVertical trust us with systems that serve millions of users globally. We strive for excellence, that’s why we created Cobble – Softeta’s own AI-native development workflow, built by our engineers, that standardizes how developers work with AI agents from requirement to working code.
We’re looking for an experienced Senior Data Engineer to join a project in the telecommunications sector, leading the architecture, migration, and optimization of production data pipelines using Airflow, Spark, dbt, BigQuery, and Python.
Job description:- Propose and lead the architecture for user-data workflows across Airflow, Spark, dbt, and BigQuery (encryption points, derived tables, backfills, partitions).
- Sequentially migrate existing pipelines behind a custom regression harness to guarantee identical output.
- Establish lasting engineering standards post-migration: code reviews, testing protocols, incident post-mortems, and release checklists.
- Implement verification jobs to validate end-to-end data lifecycle rules.
- Participate in pipeline maintenance, incident response, and root-cause resolution.
- Document design choices using Architecture Decision Records (ADRs).
Requirements
- Deep hands-on experience with Airflow, Spark, dbt, BigQuery, and Python.
- Proven track record leading a live pipeline migration technically from conception to completion.
- Hands-on experience refactoring production pipelines while verifying identical output.
- Demonstrated success establishing engineering best practices (testing, code reviews, incident resolution) within a team.
- Concrete mentoring or technical leadership experience.
Nice to have:
- Previous experience with encryption at rest, data retention policies, or regulatory compliance (e.g., GDPR).
- Envelope encryption using key management services (GCP KMS), BigQuery AEAD functions, or Tink.
- BigQuery column-level security, policy tags, and Google Cloud Data Catalog.
- Event-driven architectures using Apache Kafka.
Benefits
- Diverse and technically challenging projects.
- Training budget for professional and personal growth.
- Flexible working hours and a hybrid workplace model.
- Flexible schedule and an Agile/SCRUM environment.
- Technical equipment that you can choose.
Skills Required
- Deep hands-on experience with Airflow, Spark, dbt, BigQuery, and Python
- Experience leading a live pipeline migration technically from conception to completion
- Hands-on experience refactoring production pipelines while verifying identical output
- Experience establishing engineering best practices, including testing, code reviews, and incident resolution
- Mentoring or technical leadership experience
- Experience with encryption at rest, data retention policies, or regulatory compliance such as GDPR
- Experience with envelope encryption using GCP KMS, BigQuery AEAD functions, or Tink
- Experience with BigQuery column-level security, policy tags, and Google Cloud Data Catalog
- Experience with event-driven architectures using Apache Kafka
What We Do
SOFTETA is an international full-cycle software development and consultancy partner. We implement 20 years of joint experience in IT and kick-off projects faster that probably anyone else on the market in order to save our clients time & money. In Softeta you get fast, cutting-edge service and effective, easy communication.








