Data Engineer

payabl. empowers businesses to grow through payments innovation and banking services. Our ambition is to expand our strong portfolio of global financial services we provide to businesses and make them all available in one place on our platform we call payabl.one. As a licensed financial company with principal membership with card schemes, we specialize in global payments and providing businesses with multi-currency accounts.

The role is about:

Data Team, where you play a vital role in collecting, analyzing, and interpreting data to support decision-making across the organization. Your tasks include data collection, ensuring quality, and developing databases. You're skilled in SQL, Python for data manipulation and visualization tools. Collaborative and communicative, you work with various teams to understand their needs and provide actionable insights. Passionate about staying updated with new technologies, you drive innovation and contribute to a culture of continuous improvement.

Location: remote Poland, Portugal  or on-site Cyprus

Reporting to: Head of Engineering

What you will do:  

Lakehouse Architecture and Data Platform Design

• Design, build, and maintain scalable data lakehouse solutions on AWS using S3, Apache Iceberg, and AWS Glue Catalog as core platform components.
• Contribute to the evolution of the medallion architecture, ensuring that bronze, silver, and gold layers are reliable, performant, and aligned with business needs.

CDC and Streaming Data Ingestion

• Build and support real-time and near-real-time ingestion pipelines that stream operational data from on-premise databases into AWS using Debezium, Kafka, Kafka Connect, and Iceberg sinks.
• Monitor and troubleshoot streaming pipelines, including connector issues, schema changes, data consistency, and ingestion reliability.

Data Modelling and Business-Ready Layers

• Design and implement silver and gold layer datasets that transform raw operational data into trusted, business-ready data products.
• Work closely with analysts, analytics engineers, and business stakeholders to understand requirements and create reusable, well-structured data models.

Batch and Distributed Processing

• Develop and maintain batch and distributed processing jobs using PySpark on AWS EMR and AWS Glue.
• Optimize data transformation jobs for performance, scalability, reliability, and cost efficiency.

Data Integration and Orchestration

• Build and maintain data workflows using Apache Airflow for API ingestion, batch processing, and orchestration across the medallion architecture.
• Support integrations from external and third-party systems using tools such as Airbyte.

Data Quality, Governance, and Reliability

• Implement data quality checks, validation processes, and reconciliation logic to ensure trusted and consistent datasets across the platform.
• Contribute to data governance practices around documentation, ownership, lineage, access, and compliance.

Infrastructure and DevOps Collaboration

• Collaborate on AWS infrastructure and deployment practices, working with services such as S3, Glue, EMR, IAM, EKS, and related platform components.
• Support infrastructure-as-code workflows using Terraform and Terragrunt in collaboration with engineering and infrastructure teams.

What we need:

• Minimum 3+ years of experience in data engineering or related roles.
• Strong experience with SQL and data modeling for analytics and reporting use cases.
• Strong programming experience with Python, ideally including PySpark.
• Experience designing and maintaining ETL/ELT pipelines in production environments.
• Experience with real-time or near-real-time data ingestion.
• Experience working with Kafka or similar streaming technologies.
• Experience with CDC concepts and tools such as Debezium.
• Experience with data lake or lakehouse architectures on cloud platforms.
• Hands-on experience with AWS data services such as: S3, Glue Catalog, Glue Jobs, EMR, IAM, Related AWS services
• Experience with Apache Iceberg, Delta Lake, or similar open table formats.
• Experience designing curated analytics layers, such as silver and gold layers in a medallion architecture.
• Experience with orchestration tools such as Apache Airflow or Dagster.
• Experience working with relational databases such as MySQL, MariaDB, or PostgreSQL.
• Working knowledge of Unix/Linux environments and shell scripting.
• Understanding of data quality, governance, lineage, and production monitoring concepts.

Good to Have

• Experience with Apache Druid, ClickHouse, Snowflake, Databricks, or other analytical databases and warehouse platforms.
• Experience with Airbyte or similar data integration tools.
• Experience with dbt or collaboration with analytics engineering teams.
• Experience with Terraform and Terragrunt.
• Experience with Docker and Kubernetes.
• Experience optimizing Spark jobs on EMR or AWS Glue.
• Experience with data visualization tools such as: Tableau, Power BI, Superset, AWS QuickSight
• Experience with data observability, alerting, and monitoring tools.

The perks of being a payabl.er in Cyprus Office:  

• Future-Proof Your Finances: Once you’ve passed probation, we’ll kickstart your Provident Fund to secure your future. 
• Grow with Us: Annual Learning Budget for professional development (eligible after probation)—because your growth is our growth. 
• Wolt Your Way Through Lunch: €150 monthly Wolt allowance to keep you fueled and happy.
• Stay Active Your Way: Enjoy a SportsBenefits membership giving you access to a wide variety of gyms and sports facilities to support your active lifestyle.
• Drive in Style:  After one year with us, you may be eligible for a company car—performance and availability permitting. 
• Park with Ease: Complimentary parking space just steps from the office, so your commute is as smooth as your workday.
• Max Out Your Downtime: 25 days of vacation + public holidays, plus an additional 10 sick days.
• Shop & Save: Exclusive local discount card + tickets for exciting events like Beonix, basketball games, and more. 
• Speak Like a Local: Join free Greek language classes, twice a week, open to all team members. 
• Celebrate Together: We bring colleagues from all offices together for unforgettable company celebrations.
• Global Collaboration & Events: Opportunities to participate in international company events and initiatives, connecting with colleagues from all regions and contributing to a truly global community

👉Please note that if you will be hired in Poland or Portugal, your assigned Talent Acquisition Partner will walk you through the specific working arrangements and any applicable conditions during the process.

🚀 Our Hiring Process:

1. Step 1 – Thinking in Action (45 minutes): Your first conversation will be with our Talent Acquisition team. We'll explore your background, career journey, motivations, and overall fit for the role. As part of this discussion, you'll also complete a short technical screening that will be reviewed by our engineering team. This stage helps us understand both your experience and how you approach technical challenges.
2. Step 2 – Build in Production (60–90 minutes): Meet with the Hiring manager and technical experts for a practical assessment. Depending on the role, this may involve a live coding exercise or a real-world scenario designed to evaluate your technical skills, problem-solving approach, and ability to work through challenges similar to those faced by our teams.
3. Step 3 – Final Interview (45 minutes): The final stage is a group interview with senior members of our Technology squad, which may include the CTO and Head of Engineering. Together, we'll discuss team fit, collaboration style, expectations from both sides, and any remaining questions about the role, team, or technology domain. This is also an opportunity for you to learn more about our culture and ways of working.

Let's embark on a journey to redefine the landscape of payments together. We're not just offering a role; we're inviting you to be a part of something bigger. Join our team, and let's innovate, disrupt, and lead the future of payments. Together, we can make an impact that resonates. Welcome to the team! 

Please review our Privacy Policy to understand how we process your personal data during the recruitment process: https://payabl.com/privacy-policy