Sr Software Engineer, Platform

Posted An Hour Ago
2 Locations
Remote
150K-180K Annually
Senior level
Big Data • Cloud
StreamNative builds a cloud-native event streaming platform that enables enterprises to easily access data at real-time
The Role
Design, implement, and maintain core components of a cloud-native Kafka-compatible streaming platform. Solve distributed systems, storage, networking, reliability, and performance challenges; debug production issues; support customers through rotating on-call duties; contribute to open-source projects; and independently own projects from design through deployment.
Summary Generated by Built In

StreamNative, founded by the creators of Apache Pulsar, is redefining real-time data streaming. Our platform empowers organizations to process and analyze massive data streams at scale with unparalleled efficiency. At its core is the URSA engine, which seamlessly integrates Apache Pulsar and Apache Kafka, delivering unmatched compatibility and performance. By simplifying deployments and enabling direct integration with modern lakehouse architectures, URSA helps businesses innovate faster and more effectively. With our cost-efficient solutions, companies can build cutting-edge, real-time applications that drive measurable outcomes. Join us in revolutionizing data streaming and enabling organizations to thrive in a fast-paced, data-driven world.


About the Role

We are looking for a Senior Software Engineer to help build the Kafka service on StreamNative Cloud, a next-generation cloud-native streaming platform that combines Apache Kafka compatibility with modern storage technologies.

You will work on challenging distributed systems problems, including streaming infrastructure, storage scalability, reliability, and performance optimization. You will design and implement critical components of our streaming platform and help build reliable infrastructure that powers real-time data applications for developers and enterprises worldwide.

This is a high-impact engineering role for engineers who are passionate about Apache Kafka, distributed systems, and building scalable data infrastructure. You will join the Platform Engineering team, which builds the messaging and streaming infrastructure by combining Kafka compatibility with modern cloud-native storage technologies.

Responsibilities
  • Design, implement, and maintain core components of the streaming platform — including Kafka-compatible APIs, storage systems, metadata management, and distributed services.
  • Solve complex engineering problems involving distributed systems, storage, networking, and performance optimization, and continuously improve reliability through profiling, benchmarking, and testing.
  • Debug and resolve production issues in large-scale distributed environments.
  • Work closely with customers and field teams to understand real-world streaming use cases and help deliver effective technical solutions.
  • Contribute to open-source projects and improve the developer experience of streaming platforms.
  • On-call: one week per month, rotating, supporting customer tickets.
Qualifications
  • 5+ years of experience building large-scale distributed systems, backend infrastructure, or cloud services.
  • Strong understanding of Apache Kafka, Apache Pulsar, or other distributed messaging systems.
  • Experience with distributed systems concepts, including replication, consistency, fault tolerance, scalability, and distributed storage.
  • Experience with Kafka internals, including the Kafka protocol, broker architecture, KRaft, tiered storage, log storage, and compaction.
  • Experience building cloud-native streaming or storage systems.
  • Strong programming skills in Java, Scala, or other systems programming languages.
  • Experience designing and operating reliable production systems.
  • Strong debugging and performance optimization skills.
  • Ability to independently own projects from design through implementation and production deployment.
  • Good communication skills and ability to collaborate effectively with cross-functional teams.
Nice To-Have's
  • Experience building cloud-native streaming or storage systems.
  • Familiarity with object storage technologies such as S3, GCS, or Azure Blob Storage.
  • Experience with lakehouse technologies such as Apache Iceberg or Parquet.
  • Experience with Kubernetes and cloud-native infrastructure.

The base salary range listed for this position represents our good faith estimate of the starting compensation for this role at the time of hire. The actual salary offered will vary depending on your job-related skills, experience, qualifications, and geographic location. The compensation range and benefits for this position are based on a full-time schedule for a full calendar year. Pay increments and frequency of pay will be administered in accordance with the position's employment classification and applicable laws. 

Remote West Coast pay range
$150,000—$180,000 USD

Equal Opportunity Employer:
We are an equal opportunity employer and make employment decisions based on qualifications and merit. We do not discriminate on the basis of race, color, religion, gender, gender identity, sexual orientation, national origin, age, disability, or any other characteristic protected by law.

Skills Required

  • 5+ years of experience building large-scale distributed systems, backend infrastructure, or cloud services
  • Strong understanding of Apache Kafka, Apache Pulsar, or other distributed messaging systems
  • Experience with distributed systems concepts, including replication, consistency, fault tolerance, scalability, and distributed storage
  • Experience with Kafka internals, including the Kafka protocol, broker architecture, KRaft, tiered storage, log storage, and compaction
  • Experience building cloud-native streaming or storage systems
  • Strong programming skills in Java, Scala, or other systems programming languages
  • Experience designing and operating reliable production systems
  • Strong debugging and performance optimization skills
  • Ability to independently own projects from design through implementation and production deployment
  • Good communication skills and ability to collaborate effectively with cross-functional teams
  • Familiarity with object storage technologies such as S3, GCS, or Azure Blob Storage
  • Experience with lakehouse technologies such as Apache Iceberg or Parquet
  • Experience with Kubernetes and cloud-native infrastructure
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
55 Employees
Year Founded: 2019

What We Do

Founded by the original creators of Apache Pulsar, StreamNative offers the most cost-effective data streaming platform. It is Kafka API-compatible, easy to operate and scale. StreamNative rearchitected data streaming from ground up making sure it scales without high cost and without sacrificing performance. It’s available across all three major cloud providers (AWS, GCP and Azure) with flexible deployment options, including fully managed Hosted, BYOC (Bring Your Own Cloud), and Private Cloud.

Why Work With Us

StreamNative has a strong foundation in innovation and technology. With a deep understanding of data streaming intricacies, the team is well-equipped to explore new frontiers and drive meaningful advancements. Embracing the future of work, StreamNative operates as a remote-first company.

Gallery

Gallery

Similar Jobs

Affirm Logo Affirm

Senior Software Engineer

Big Data • Fintech • Mobile • Payments • Financial Services
Easy Apply
Remote
United States
2200 Employees
173K-233K Annually

Affirm Logo Affirm

Staff Software Engineer

Big Data • Fintech • Mobile • Payments • Financial Services
Easy Apply
Remote
United States
2200 Employees
236K-325K Annually

Affirm Logo Affirm

Senior Software Engineer

Big Data • Fintech • Mobile • Payments • Financial Services
Easy Apply
Remote
United States
2200 Employees
173K-255K Annually

Clear Street Logo Clear Street

Software Engineer

Fintech • Software • Financial Services
Easy Apply
Remote or Hybrid
USA
581 Employees
200K-350K Annually

Similar Companies Hiring

Toro TMS Thumbnail
Cloud • Enterprise Web • Sales • Software • Transportation
Chicago, IL
80 Employees
Prolaio Thumbnail
Artificial Intelligence • Big Data • Healthtech • Mobile • Wearables • Analytics
Chicago, IL
82 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account