Staff Engineer

Posted Yesterday
Hiring Remotely in USA
Remote
200K-250K Annually
Senior level
Information Technology • Software • Cybersecurity
The Role
Build and evolve an AI investigation platform for cybersecurity responders. Responsibilities include developing agent tools and integrations, improving context and evidence handling, creating evaluation and guardrail systems, designing resilient distributed services, establishing API, testing, and observability standards, and partnering with product management. The role requires hands-on expertise in Go and Python, data architecture, streaming and durable workflows, event-driven pipelines, and production AI/LLM systems.
Summary Generated by Built In

Who We Are

MOXFIVE helps enterprises respond to, recover from, and build resilience against cyber attacks. Our responders have led many of the most prominent security investigations in the world, from ransomware that takes a business offline to nation-state intrusions. When an attack hits, we work alongside the executives, outside counsel, and insurers who need answers fast and need answers they can defend.

Intelligent Insurer named MOXFIVE Cyber Security Consulting Team of the Year in 2024 and 2025, and Inc. has named us one of its Best Workplaces three times.

We are building an AI investigation platform that puts that frontline experience behind every analyst on a case.

Who You Are

You are a technical leader who looks past the code to the system around it. You make high-stakes decisions under ambiguity and balance speed of delivery with long-term maintainability. You raise the team's quality through design reviews, code reviews, and the patterns you introduce.

You work well among strong peers and know when to lead and when to defer to someone closer to the problem. You pick the right problems to solve and can explain your architectural choices to engineers and executives alike.

The Impact You'll Have

You'll extend what our agents can do, measure whether their findings hold up, and keep the services around them solid as the platform grows. This is a hands-on role, and most of your time goes to designing and building.

Your core responsibilities will include:

  • Agent Capabilities: Adding investigation tools and integrations with security data sources, and improving how agents manage context, recall evidence, and trade off cost against latency.

  • Investigation Quality: Building the evaluations that show whether agents reach correct, well-sourced findings, and using them to decide model, prompt, and tool changes.

  • Platform Architecture: Evolving service boundaries and failure handling as new capabilities land.

  • Engineering Standards: Raising our practices for API governance, testing, and observability.

  • Cross-Functional Leadership: Working with product management to turn case needs into technical specifications.

What You'll Bring

  • Track Record: You've designed and shipped distributed systems that are still running in production years later, and you can tell us what you'd change. Typically this comes from time in a Staff, Principal, or Lead role.

  • AI/LLM Engineering: You've taken AI agents from prototype to production across multiple model providers, and built tool-calling agent loops, evaluation harnesses that catch regressions before release, and guardrails against hallucination.

  • AI-Native Development: You build with coding agents every day and know how to review and verify what they produce.

  • Language Expertise: Deep expertise in Go or Python and strong in the other, including the runtime, concurrency models, and memory management of each.

  • Data Architecture: You've worked across a relational system of record, columnar analytical stores that query large datasets, and vector search. You know when each fits, and you've run zero-downtime schema migrations.

  • API Design: You've designed schema-first, contract-driven APIs with generated clients and built-in validation, including streaming APIs for live updates.

  • Durable Systems: You've built long-running workflows on durable execution and event streaming, and you treat idempotency, retries, and recovery from partial failure as design requirements.

  • Data Pipelines: Experience building event-driven ingestion pipelines that move large volumes of structured data from object storage into analytical systems.

Nice to Have

  • Cloud Architecture: Experience with a major cloud provider, infrastructure as code, and container orchestration, including designs that keep each customer's or case's data isolated.

  • Security Domain: Experience building security products, or familiarity with digital forensics, incident response, or security telemetry.

 

Skills Required

  • Experience designing and shipping distributed systems that remain in production long term
  • Typically having worked in a Staff, Principal, or Lead engineering role
  • Experience taking AI agents from prototype to production across multiple model providers
  • Experience building tool-calling agent loops
  • Experience building evaluation harnesses to detect regressions before release
  • Experience implementing guardrails against hallucinations
  • Daily experience developing with coding agents and reviewing and verifying their output
  • Deep expertise in Go or Python and strong proficiency in the other language
  • Knowledge of runtime behavior, concurrency models, and memory management in Go and Python
  • Experience with relational systems of record, columnar analytical stores, and vector search
  • Experience performing zero-downtime schema migrations
  • Experience designing schema-first, contract-driven APIs with generated clients and validation
  • Experience building streaming APIs for live updates
  • Experience building long-running workflows using durable execution and event streaming
  • Experience designing idempotency, retries, and recovery from partial failure
  • Experience building event-driven ingestion pipelines moving large structured-data volumes from object storage into analytical systems
  • Experience with a major cloud provider, infrastructure as code, and container orchestration
  • Experience designing data isolation for each customer or case
  • Experience building security products or familiarity with digital forensics, incident response, or security telemetry
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Tysons Corner, VA
56 Employees
Year Founded: 2019

What We Do

MOXFIVE is cybersecurity company helping organizations respond to incidents and minimize the risk of future attacks. Over the last decade, our team of experts has helped thousands of businesses respond to major incidents and saw firsthand that there needed to be a better way for organizations to get the technical expertise they need when they need it most. Through a combination of our technical experts and proprietary platform, we bring order to chaos and deliver a tailored incident response approach and resilience-minded path forward for clients of all sizes, faster and more efficiently.

Similar Jobs

Vetcove Logo Vetcove

Staff Engineer

Healthtech • Pet
Remote
USA
65 Employees
170K-230K Annually

Pager Health Logo Pager Health

Staff Engineer

Artificial Intelligence • Healthtech • Mobile • Software • Telehealth • Generative AI
Remote
US
366 Employees
190K-210K Annually

Apollo.io Logo Apollo.io

Staff Engineer

Artificial Intelligence • Enterprise Web • Information Technology • Productivity • Sales • Software • Database
Easy Apply
Remote
United States
850 Employees
212K-265K Annually

Toast Logo Toast

Staff Engineer

Cloud • Fintech • Food • Information Technology • Software • Hospitality
Remote
US
5000 Employees
193K-309K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account