Senior Software Engineer, Backend Systems

Posted Yesterday
Be an Early Applicant
New York City, NY, USA
In-Office
180K-220K Annually
Senior level
Artificial Intelligence • Machine Learning • Software • Defense
The Role
Design and operate scalable backend services for spectrum data ingestion, ML inference, and autonomous agent workflows. Architect tool-calling, orchestration, state, memory, and evaluation systems; own model serving and performance optimization; define APIs and data contracts; and ensure production reliability through observability, alerting, and runbooks. The role also involves architectural leadership, design reviews, mentoring, and collaboration with ML researchers to productionize models.
Summary Generated by Built In

DS creates systems that power the next generation of radio spectrum intelligence. We collect radio data from all over the world, train neural networks to decipher it, and run them on the smallest chips we can. We’re solving a new, technically hard problem where nothing from other fields works out of the box, and along the way, we’ve built our own stack from scratch, including entirely new embedding model architectures, custom GPU kernels, and much more.

Joining DS means owning major parts of a fast-growing AI research organization, joining a collaborative, talent-dense team with decades of experience in probabilistic ML, accelerated computing, embedded systems, and signal theory, and growing your career in the areas that interest you. You’ll fit in if you want to come to work for the problem itself and don’t want to choose between technical rigor, business value, and real-world impact.

We work with high ownership and trust.

The Role

We're hiring a Senior Backend Engineer to design and build the services that sit at the heart of the Distributed Spectrum platform: the systems that ingest spectrum data, orchestrate ML inference, and increasingly, power autonomous agents that reason over what our sensors see. You'll define how our backend evolves from a set of services into an agent-native system — one where models, tools, and workflows are first-class citizens of the architecture rather than bolted-on integrations.

This is a high-ownership role. You'll set technical direction, make architecture decisions that stick for years, and mentor engineers around you.


What you'll do
  • Design, build, and operate backend services that are reliable, observable, and built to scale with our sensor fleet and customer base.

  • Architect the agent layer of our platform: tool-calling interfaces, orchestration, state management, memory, and evaluation harnesses for LLM- and model-driven agents.

  • Own the ML inference architecture — model serving, batching, GPU/CPU scheduling, latency and cost optimization, and the APIs that expose inference to the rest of the system.

  • Define service boundaries, data contracts, and API standards across the backend.

  • Build for production: instrumentation, alerting, graceful degradation, and clear runbooks.

  • Partner closely with ML researchers to move models from experiment to production quickly and safely.

  • Lead design reviews, mentor engineers, and raise the bar on code quality and engineering practice.

What we're looking for
  • 4–6+ years of professional software engineering experience, with significant time spent building and running backend / distributed systems in production.

  • Strong proficiency in at least one of Python, Go, Rust, or a similar systems-capable language; comfort moving between languages.

  • Hands-on experience with AWS or another major cloud provider (GCP, Azure) — compute, networking, storage, IAM, and managed data services.

  • Experience building or integrating LLM / agent systems: tool use, orchestration frameworks, RAG, evaluation, or comparable work.

  • Experience serving ML models in production (e.g., Triton, TorchServe, vLLM, custom serving) and reasoning about throughput, latency, and cost.

  • Deep understanding of APIs (REST / gRPC), async processing, message queues / streaming (Kafka, SQS, Kinesis, etc.), and data consistency trade-offs.

  • Track record of owning systems end to end and making architecture decisions with long-lived consequences.

Nice to have
  • Experience with containers and orchestration (Docker, Kubernetes, ECS).

  • Background in signal processing, RF, geospatial, or other high-volume time-series domains.

  • Experience with GPU programming or accelerated computing.

  • Familiarity with regulated or defense-adjacent environments and their security expectations.

Who Thrives at Distributed Spectrum
  • Fast learners over specific backgrounds – We care more about how quickly you can pick up new skills than where you’ve worked before.

  • Intellectual honesty – The right answer matters more than being right. You challenge assumptions, test ideas, and pivot when needed.

  • Adaptability – We’re organized, but sometimes things change quickly. You find a way to make it work and balance short-term deliverables with long-term goals.

  • Ownership of outcomes – You optimize your own time, focus on what matters to deliver quickly, and cut out inefficiencies.

  • Not building in a vacuum – You stay connected to the rest of our teams and our customers to make sure all the pieces fit together.

What We Offer
  • Above-market salary, equity, and benefits package.

  • Early Series A Equity

  • Excellent health, dental, and vision coverage

  • 401(k) match - up to 4% of your salary

  • Flexible PTO

  • Daily office lunches in NYC

ITAR Requirements
To conform to U.S. Government technology export regulations, including the International Traffic in Arms Regulations (ITAR) you must be a U.S. citizen, lawful permanent resident of the U.S., protected individual as defined by 8 U.S.C. 1324b(a)(3), or eligible to obtain the required authorizations from the U.S. Department of State. Learn more about the ITAR here.

Skills Required

  • 4-6+ years of professional software engineering experience, including significant backend or distributed systems experience in production
  • Strong proficiency in Python, Go, Rust, or a similar systems-capable language
  • Hands-on experience with AWS, GCP, Azure, or another major cloud provider
  • Experience building or integrating LLM or agent systems, including tool use, orchestration, RAG, or evaluation
  • Experience serving machine learning models in production
  • Deep understanding of REST or gRPC APIs, asynchronous processing, message queues or streaming, and data consistency trade-offs
  • Track record of owning systems end to end and making long-term architecture decisions
  • Experience with Docker, Kubernetes, or ECS
  • Background in signal processing, RF, geospatial, or high-volume time-series domains
  • Experience with GPU programming or accelerated computing
  • Familiarity with regulated or defense-adjacent environments and related security expectations
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
33 Employees
Year Founded: 2020

What We Do

Distributed Spectrum is a venture-backed, defense tech company working at the cutting edge of signal processing, machine learning, and embedded systems. We build software and sensors to let anyone understand critical radio signals in any mission.

Similar Jobs

Palantir Technologies Logo Palantir Technologies

Software Engineer

Artificial Intelligence • Software
Hybrid
New York, NY, USA
4400 Employees
135K-200K Annually

Palantir Technologies Logo Palantir Technologies

Software Engineer

Artificial Intelligence • Software
In-Office
New York, NY, USA
4400 Employees
135K-200K Annually

Palantir Technologies Logo Palantir Technologies

Software Engineer

Artificial Intelligence • Software
Hybrid
New York, NY, USA
4400 Employees
135K-200K Annually

Palantir Technologies Logo Palantir Technologies

Software Engineer

Artificial Intelligence • Software
Hybrid
New York, NY, USA
4400 Employees
135K-200K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
43 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account