Staff Engineer - Kafka Codebase and Internals

Posted 5 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Fintech • Financial Services
The Role
Own and evolve PhonePe’s internal Apache Kafka distribution, including branch management, patch curation, releases, upgrades, upstream contributions, and deep broker, controller, protocol, replication, and storage debugging. Develop production-specific patches, establish testing and benchmarking practices, mentor engineers, advise platform teams on Kafka architecture and capacity, and support audit and compliance requirements.
Summary Generated by Built In
Company Description

Our goal is to make digital payments so easy, safe and universally accepted that people never feel the need to carry cash or cards again. We believe India is at the cusp of a new mobile revolution, which will change the way we manage our money on the go. We see ourselves facilitating this change, through technology and dogged customer centricity.

At PhonePe, we take extra care to make sure you give your best at work, Everyday! And creating the right environment for you is just one of the things we do. We empower people and trust them to do the right thing. Here, you own your work from start to finish, right from day one.

Being enthusiastic about tech is a big part of being at PhonePe.

If you like building technology that impacts millions, ideating with some of the best minds in the country and executing on your dreams with purpose and speed, join us!

Job Description

 

About the Role

We are building an in-house team to maintain and contribute to our internal Apache Kafka distribution. This is not an operations role — you will work on the Kafka codebase itself: the broker, the KRaft controller, the protocol, the clients, and the storage layer. You will be our technical anchor for all things Kafka internals, driving upstream contributions, backporting critical fixes, and shaping our internal distribution to meet the needs of a large-scale production fleet.

We already do this successfully with GlusterFS, where we maintain an in-house distribution backed by deep upstream expertise. We want to replicate that model for Kafka.

Key Responsibilities

  • Own our internal Kafka distribution: branch management, patch curation, release cutting, upgrade planning
  • Contribute upstream to Apache Kafka — bug fixes, KIPs, code reviews, design discussions
  • Diagnose and fix deep broker/controller issues: replication, partition reassignment, KRaft consensus, log storage, ISR management, protocol handling
  • Build custom patches for production needs that aren't suitable for upstream (performance tuning for our workload profile, observability hooks, operational safety valves)
  • Establish engineering practices for Kafka development within the team: how we test, how we benchmark, how we validate patches before rolling them out
  • Mentor a supporting engineer and grow the team's capability over time
  • Act as the internal authority on Kafka internals — advise platform teams on configuration, capacity planning, and architectural decisions that require knowledge of broker behavior
  • Act as the primary interface for audit and compliance teams, ensuring PhonePe Kafka distribution meets various compliance and regulatory standards

Qualifications

What are we looking for?

  • Deep familiarity with the Kafka codebase — you have read, modified, and debugged the broker, controller, or client internals. Not just operated Kafka, but worked on it.
  • Track record of upstream contribution — committed patches, participated in KIP discussions, reviewed PRs, or equivalent engagement with the Apache Kafka community. Active committer/PMC status is strongly preferred but not strictly required if your contribution history demonstrates equivalent depth.
  • Strong distributed systems fundamentals — consensus protocols, replication, exactly-once semantics, log-structured storage, distributed state machines. You understand these not as buzzwords but as engineering tradeoffs you've navigated.
  • Systems-level programming comfort — JVM internals (GC tuning, memory layout, JIT behavior), OS-level I/O (page cache, fsync semantics, zero-copy), networking (TCP tuning, socket buffers). Kafka performance work lives at this layer.
  • Experience maintaining a fork or distribution — you've managed the tension between carrying local patches and staying mergeable with upstream. You know what it costs to diverge and how to minimize that cost. • 
  • 8+ years of experience in systems/infrastructure software engineering, with a meaningful portion spent on Kafka or comparable distributed systems (Pulsar, Bookkeeper, Zookeeper, etcd, CockroachDB, etc.)

Additional Information

Good to have

  • Apache Kafka Committer or PMC member
  • Experience with KRaft (the ZooKeeper-free controller)
  • Authored or co-authored a KIP
  • Experience with Kafka Streams or Kafka Connect internals (not just usage)`
  • Familiarity with Kafka's test infrastructure (system tests, Trogdor, ducktape)

Skills Required

  • Deep familiarity with the Apache Kafka codebase, including reading, modifying, and debugging broker, controller, or client internals
  • Track record of upstream Apache Kafka contributions, such as patches, KIP discussions, pull request reviews, or equivalent community engagement
  • Strong distributed systems fundamentals, including consensus protocols, replication, exactly-once semantics, log-structured storage, and distributed state machines
  • Systems-level programming knowledge, including JVM internals, garbage collection, memory layout, JIT behavior, operating-system I/O, page cache, fsync, zero-copy, networking, TCP tuning, and socket buffers
  • Experience maintaining a software fork or distribution while managing local patches and upstream integration
  • At least 8 years of systems or infrastructure software engineering experience, including meaningful experience with Kafka or comparable distributed systems
  • Apache Kafka Committer or PMC member experience
  • Experience with KRaft
  • Authored or co-authored a KIP
  • Experience with Kafka Streams or Kafka Connect internals
  • Familiarity with Kafka test infrastructure, including system tests, Trogdor, and Ducktape

PhonePe Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about PhonePe and has not been reviewed or approved by PhonePe.

  • Healthcare Strength — Health coverage is described as comprehensive, spanning medical, OPD, critical illness, accidental, and life insurance, with broad dependent eligibility. Wellbeing resources such as an assistance program, fitness support, and onsite/emergency care bolster day-to-day support.
  • Parental & Family Support — Benefits for primary and secondary caregivers, maternity and paternity leave, adoption assistance, and daycare support are provided. These options indicate meaningful support across different family needs.
  • Retirement Support — Provident Fund contributions, NPS, gratuity, flexible PF choices, and leave encashment are part of the standard offering. These structured programs signal a focus on long-term financial planning.

PhonePe Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Bengaluru
1,000 Employees
Year Founded: 2015

What We Do

PhonePe was founded in December 2015 and has emerged as India’s largest payments app, enabling digital inclusion for consumers and merchants alike. With 48 crore (480 Million) registered users, one in four Indians are now on PhonePe. The company has also successfully digitized 3.6 crore (36 Million) offline merchants spread across Tier 2,3,4 and beyond, covering 99% of the postal codes across India. PhonePe is also the leader in Bharat Bill Pay System (BBPS), processing over 45% of the transactions on the BBPS platform. PhonePe forayed into financial services in 2017, providing users with safe and convenient investing options on its platform. Since then, the company has introduced several Mutual Funds and Insurance products that offer every Indian an equal opportunity to unlock the flow of money and access to services. PhonePe was recently recognized as the Most Trusted Brand for Digital Payments as per the Brand Trust Report 2023 by Trust Research Advisory (TRA).

Similar Jobs

Hewlett Packard Enterprise Logo Hewlett Packard Enterprise

Cloud Engineer

Artificial Intelligence • Cloud • Information Technology • Consulting
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
85422 Employees

Hewlett Packard Enterprise Logo Hewlett Packard Enterprise

Cloud Engineer

Artificial Intelligence • Cloud • Information Technology • Consulting
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
85422 Employees

Hewlett Packard Enterprise Logo Hewlett Packard Enterprise

Cloud Engineer

Artificial Intelligence • Cloud • Information Technology • Consulting
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
85422 Employees

Hewlett Packard Enterprise Logo Hewlett Packard Enterprise

Senior Cloud Engineer

Artificial Intelligence • Cloud • Information Technology • Consulting
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
85422 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account