Senior Software Engineer (Python) - Supply & Demand

Posted 2 Days Ago
Be an Early Applicant
Budapest, HUN
Hybrid
Senior level
Analytics
The Role
Lead design and technical direction to generalize the Supply & Demand data model across commodities. Develop and evolve a reusable ETL framework, ensure publication reliability and data quality, set non-functional standards (reliability, latency, observability, security), shape external APIs, respond to incidents, and mentor engineers while partnering with Product and Research.
Summary Generated by Built In

At Kpler, we are dedicated to helping our clients navigate complex markets with ease. By simplifying global trade information and providing valuable insights, we empower organisations to make informed decisions in commodities, energy, and maritime sectors.

Since our founding in 2014, we have focused on delivering top-tier intelligence through user-friendly platforms. Our team of over 700 experts from 35+ countries works tirelessly to transform intricate data into actionable strategies, ensuring our clients stay ahead in a dynamic market landscape. Join us to leverage cutting-edge innovation for impactful results and experience unparalleled support on your journey to success.

Join Kpler’s Commodities Tribe as our next Senior Software Engineer and help shape the future of our Supply & Demand products.

Our Supply & Demand platform transforms complex global commodity data-from production sites, trade flows, imports, exports, refinery activity, consumption, and stock changes-into trusted market intelligence used by our clients around the world.

Historically focused on crude oil, our team is now evolving the platform to support a much broader range of commodities, including refined products, biofuels, metals, and beyond. This is a major engineering transformation: building a scalable, reusable platform that can support new commodity markets without creating separate solutions for each product.

As a Senior Backend Software Engineer, you will influence technical direction, solve complex engineering challenges, and help shape the systems behind one of Kpler’s core products. You will work closely with experienced engineers, Product, and Research teams to build solutions that combine strong engineering practices with meaningful business impact.s.

This role is ideal for an engineer who enjoys looking beyond individual features-someone who thinks about architecture, product impact, and building systems that stand the test of time.


Your future position:

  • Lead the technical direction of generalising the S&D data model from crude oil to all commodities, owning the trade-offs between debt, design, reliability and time-to-market as the crew's call.

  • Evolve the shared ETL Framework (Reader → Transformer → Writer) in `supply-demand-core` into the reusable foundation every commodity vertical builds on, so LNG, grains and new products stop diverging into bespoke pipelines.

  • Own publication reliability end to end: the anomaly-detection guardrail (`supply-demand-ml`), the release path, and the data-quality bar that decides whether a balance is fit to ship to customers.

  • Set and raise the non-functional bar (reliability, latency, observability, security, cost) across the crew's Python engine, TypeScript data-distribution APIs and Airflow orchestration.

  • Shape the external + webapp data-distribution API contract (`supply-demand-oil-api`, `supply-demand-grains-api`) that external clients depend on: versioning, pagination, backward compatibility.

  • Lead design reviews within the crew and steward the crew's ADRs; bring engineering alignment to ambiguous, business-critical work.

  • Own the response to critical incidents in the crew's systems, and drive the preventative work that follows so the same class of failure does not recur.

  • Partner directly with Product and the Research team to shape the crew's technical and feature roadmap, including the SuDeP pipeline that Research consumes.

  • Mentor mid-level (P3) engineers toward senior scope, and act as a cross-crew technical consultant within the Commodities Tribe and the wider Engineering chapter.

Experience & Background

    Essential:
  • 5+ years of experience as a software engineer, with experience delivering production systems.
  • Experience delivering technically ambiguous, business-critical projects end to end, owning the design, the trade-offs and the production outcome, not just the implementation.

  • Deep experience building and running data-intensive backends in Python (ETL/orchestration, relational data modelling, SQL/Postgres).

  • Owning systems in production: on-call, observability, incident response and the prevention work afterwards ("you build it, you run it").

  • Experience setting technical direction for a team and being  the person other engineers consult on hard design decisions.

  • Desirable:
  • Worked with Airflow (or comparable orchestration) and TypeScript/NestJS APIs, or can credibly ramp into a polyglot Python + TS estate.

  • Exposure to a real, evolving domain data model: commodities, energy, finance, logistics or another domain where correctness of the model is the product.

  • Familiarity with data-quality / anomaly-detection approaches, or the discipline of gating publication on quality.

  • Experience with IaC and GitOps delivery (Terraform, ArgoCD, k8s) and with serving versioned external client APIs.

  • Behavioural Competencies: 
  • You take ownership of problems and outcomes, not just individual tasks.

  • You think beyond the code and understand how engineering decisions impact the product and customers.

  • You are comfortable making technical decisions, challenging ideas, and helping shape the direction of the team.

  • You enjoy working on complex problems, learning new things, and adapting in a fast-moving environment.

  • You collaborate openly with engineers, Product, and Research teams to find the best solutions.

  • You share knowledge and help the people around you grow.

Skills Required

  • 5+ years of experience as a software engineer, with experience delivering production systems.
  • Experience delivering technically ambiguous, business-critical projects end to end, owning design, trade-offs and production outcomes.
  • Deep experience building and running data-intensive backends in Python (ETL/orchestration, relational data modelling, SQL/Postgres).
  • Owning systems in production: on-call, observability, incident response and follow-up preventative work.
  • Experience setting technical direction for a team and being the person other engineers consult on hard design decisions.
  • Experience with Airflow or comparable orchestration and familiarity with TypeScript/NestJS APIs.
  • Exposure to evolving domain data models (commodities, energy, finance, logistics) where correctness is product-critical.
  • Familiarity with data-quality or anomaly-detection approaches and gating publication on quality.
  • Experience with IaC and GitOps delivery (Terraform, ArgoCD, Kubernetes) and serving versioned external client APIs.
  • Mentoring mid-level engineers and acting as a cross-crew technical consultant.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Brussels
138 Employees
Year Founded: 2014

What We Do

Kpler is the leading data & analytics firm providing real-time transparency in commodity markets. Relying on a methodology that combines artificial and human intelligence, the Kpler platform provides real-time data and analytics (global flows, storage, freight) on more than 40 commodities including crude oil, refined products, LNG, LPG, and dry bulk.

Similar Jobs

Tulip Logo Tulip

Accounts Payable Intern

Enterprise Web • Hardware • Internet of Things • Software
Easy Apply
Hybrid
Budapest, HUN
310 Employees

Wise Logo Wise

Back-end Engineer

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
Budapest, HUN
9000 Employees

Wise Logo Wise

Knowledge Delivery Senior Lead

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
Budapest, HUN
9000 Employees

PEAK6 Logo PEAK6

Software Engineer

Fintech • Information Technology • Financial Services • App development
Hybrid
Budapest, HUN
1900 Employees

Similar Companies Hiring

Northslope Thumbnail
Artificial Intelligence • Information Technology • Software • Analytics • Consulting • Generative AI
London, GB
100 Employees
Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account