[GFA] Data Platform Engineer

Posted Yesterday
Be an Early Applicant
Hiring Remotely in Warsaw, Warszawa, Masovian, POL
In-Office or Remote
Entry level
Software
The Role
Build and operate production change-data-capture pipelines from PostgreSQL into Azure using Kafka Connect and Debezium. Deploy stateful workloads on AKS, automate onboarding and recovery with Python, integrate streams with Event Hubs, ADLS, ADF, and Databricks, and manage infrastructure as code. Monitor and troubleshoot connector performance, failures, backpressure, and recovery while applying data-protection controls such as masking, hashing, access control, and retention.
Summary Generated by Built In
Company Description

Software Mind develops solutions that make an impact for companies around the globe. Tech giants & unicorns, transformative projects, emerging technologies and limitless opportunities – these are a few words that describe an average day for us. Building cross-functional engineering teams that take ownership and crave more means we’re always on the lookout for talented people who bring passion and creativity to every project. Our culture embraces openness, acts with respect, shows grit & guts and combines employment with enjoyment.

Job Description

Project – the aim you’ll have

Our customer provides innovative solutions and insights that enable our clients to manage risk and hire the best talent. Their advanced global technology platform supports fully scalable, configurable screening programs that meet the unique needs of over 33,000 clients worldwide. Headquartered in Atlanta, GA, they have an internationally distributed workforce spanning 19 countries with about 5,500 employees. Our partner perform over 93 million screens annually in over 200 countries and territories.

 

Position – how you’ll contribute

  • Build and operate change-data-capture pipelines from PostgreSQL into Azure, using Kafka Connect and Debezium as the core of the platform
  • Configure, deploy and scale connectors end to end - connector setup, task management, offsets, schema history, and snapshot strategy
  • Run these pipelines as stateful workloads on Kubernetes (AKS), covering configuration, secrets, networking and resource tuning
  • Monitor and troubleshoot the platform in production: connector failures, task rebalances, restarts, throughput and backpressure, message-size limits, retries and recovery
  • Automate the platform in Python - configuration-driven onboarding of new data sources, pipeline orchestration, monitoring and alerting, recovery workflows, and automated testing
  • Integrate CDC streams with the wider Azure data stack: Event Hubs, ADLS, Azure PostgreSQL, ADF and Databricks
  • Manage platform infrastructure as code, so environments are reproducible and changes are reviewable
  • Apply data protection requirements to sensitive data flowing through the pipelines - masking, hashing, access control and retention

Qualifications

Expectations – the experience you need

  • Solid commercial experience as a data or platform engineer, with hands-on work on streaming or CDC pipelines rather than batch reporting alone
  • Practical Kafka knowledge - topics, partitions, offsets, consumer groups and delivery semantics - including at least one Kafka Connect deployment you ran yourself
  • Strong SQL and PostgreSQL skills, with working knowledge of WAL, logical replication, replication slots and replication lag
  • Working understanding of CDC concepts: initial snapshots, inserts, updates and deletes, event ordering, at-least-once delivery, and schema evolution
  • Confident Python for automation and tooling - orchestration, monitoring, recovery scripts, and automated tests
  • Hands-on experience with Azure data services, for example Event Hubs, ADLS or Azure PostgreSQL
  • Comfortable working with Kubernetes as a user: deploying workloads, handling configuration and secrets, reading logs, debugging failing pods
  • Ability to debug a running pipeline from metrics and logs - telling throughput problems from backpressure, retries or a genuine connector failure

Additional skills – the edge you have

  • Production experience with Debezium specifically - snapshot strategies on large tables, schema history recovery, offset loss, and bringing connectors back after failure
  • Experience operating stateful workloads on AKS: StatefulSets, stable worker identity, and resource tuning under load
  • Infrastructure-as-code and CI/CD for data platform components (Terraform, Bicep or similar)
  • Hands-on work with Databricks and ADF at production scale
  • Experience implementing data protection controls for sensitive data - masking, hashing, access control and retention policies

Additional Information

Our offer – professional development, personal growth

  • Flexible employment and remote work
  • International projects with leading global clients 
  • International business trips  
  • Non-corporate atmosphere 
  • Language classes 
  • Internal & external training 
  • Private healthcare and insurance  
  • Multisport card 
  • Well-being initiatives 

Skills Required

  • Solid commercial experience as a data or platform engineer working with streaming or change-data-capture pipelines
  • Practical Kafka knowledge, including topics, partitions, offsets, consumer groups, delivery semantics, and at least one self-operated Kafka Connect deployment
  • Strong SQL and PostgreSQL skills, including WAL, logical replication, replication slots, and replication lag
  • Working knowledge of CDC concepts, including snapshots, inserts, updates, deletes, event ordering, at-least-once delivery, and schema evolution
  • Confident Python skills for orchestration, monitoring, recovery scripts, tooling, and automated testing
  • Hands-on experience with Azure data services such as Event Hubs, ADLS, or Azure PostgreSQL
  • Ability to deploy Kubernetes workloads, manage configuration and secrets, read logs, and debug failing pods
  • Ability to diagnose running pipelines using metrics and logs, including throughput issues, backpressure, retries, and connector failures
  • Production experience with Debezium, including large-table snapshot strategies, schema history recovery, offset loss, and connector recovery
  • Experience operating stateful workloads on AKS, including StatefulSets, stable worker identity, and resource tuning under load
  • Infrastructure as code and CI/CD experience for data platform components using Terraform, Bicep, or similar tools
  • Production-scale experience with Databricks and Azure Data Factory
  • Experience implementing data-protection controls for sensitive data, including masking, hashing, access control, and retention policies

Software Mind Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Software Mind and has not been reviewed or approved by Software Mind.

  • Fair & Transparent Compensation Pay is considered competitive for core hiring markets, with “good salary” cited in multiple locales. Public salary snapshots provide a baseline that helps candidates assess offers and negotiations.
  • Flexible Benefits Remote or hybrid options are prominently highlighted, and a remote‑work program is publicly noted alongside positively cited work‑from‑home experiences. Flexibility around schedules and location is presented as part of the package.
  • Wellbeing & Lifestyle Benefits Private medical care, language classes, sports/fitness support, and learning initiatives are listed for several Central/Eastern European locations, with occasional workation perks promoted. These lifestyle‑oriented offerings complement base pay and can enhance perceived total rewards.

Software Mind Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Kraków
1,000 Employees
Year Founded: 1999

What We Do

Software Mind is a global digital transformation partner with operations throughout Europe, the US and LATAM. Driven by tech and empowered by people, we provide companies with software engineers and autonomous, cross-functional development teams who manage software life cycles from ideation to release and beyond. For over 20 years we’ve been enriching organizations with the talent they need to boost scalability, drive dynamic growth and bring disruptive ideas to life. Our top-notch engineering teams combine ownership with leading technologies, including cloud, AI, data science and embedded software to accelerate digital transformations and boost software delivery. A culture, driven by trust, that embraces openness, craves more and acts with respect enables our experts to create evolutive solutions that support scale-ups, unicorns and enterprise-level companies around the world.

Similar Jobs

Sprout Social Logo Sprout Social

Staff Software Engineer

Marketing Tech • Social Media • Software • Analytics • Business Intelligence
Easy Apply
Remote or Hybrid
Poland
1400 Employees
29K-44K Annually

Samsara Logo Samsara

Senior Software Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
Poland
4000 Employees

Capco Logo Capco

Consultant

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
Poland
6000 Employees

Capco Logo Capco

Artificial Intelligence Engineer

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
Poland
6000 Employees

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account