Threat Investigation Engineer

Posted Yesterday
Be an Early Applicant
Hiring Remotely in USA
Remote
160K-200K Annually
Entry level
Artificial Intelligence • Analytics • Consulting • Cybersecurity
Research Services
The Role
Build and maintain Python backend services and AI-assisted applications for threat investigations. Partner with investigators, integrate APIs and AI capabilities, troubleshoot production issues, improve reliability and observability, and participate in rotating on-call coverage. Own engineering solutions from requirements through deployment and ongoing support, including work across backend services, data pipelines, asynchronous workflows, and platform operations.
Summary Generated by Built In

About 10a Labs: 10a Labs is the safety and threat-intelligence layer trusted by frontier AI labs, AI unicorns, Fortune 10 companies, and leading global technology platforms. Our adversarial red teaming, model evaluations, and intelligence collection enable engineering, safety, and security teams to stay ahead of evolving threats and deploy AI systems safely.

Threat Investigation Engineer (Backend/Platform)

Remote | 1-year Contract

About the Role

We are seeking a Threat Investigation Engineer to build, improve, and support AI-powered systems used in high-stakes safety and threat investigations.

This is a hands-on software engineering role combining backend development, production troubleshooting, and platform reliability. You'll work closely with investigators and engineering teams to develop practical solutions, improve existing workflows, and ensure critical investigation systems operate reliably.

The ideal candidate is a strong Python engineer with experience building and maintaining production applications, troubleshooting complex systems, and integrating AI-powered capabilities. You should be comfortable navigating ambiguous technical challenges, working directly with end users, and taking ownership of solutions from initial problem definition through deployment and ongoing support.

This position includes participation in a rotating on-call schedule, including weekend and holiday coverage, to support critical investigation workflows.

What You'll Do
  • Design, develop, test, and maintain backend services and AI-assisted applications that support threat investigation workflows.
  • Partner directly with investigators to understand operational challenges, identify opportunities for improvement, and translate requirements into practical engineering solutions.
  • Build and integrate AI-powered features, APIs, and services that improve the efficiency, accuracy, and reliability of investigation processes.
  • Troubleshoot and resolve production issues, including failed workflows, processing delays, data inconsistencies, and system errors.
  • Participate in rotating on-call coverage, including weekends and holidays, to diagnose issues, implement fixes, and escalate when necessary.
  • Improve system reliability and observability through monitoring, logging, automated testing, documentation, and operational tooling.
  • Investigate complex technical issues across backend services, data pipelines, and AI-assisted workflows, identifying root causes and implementing sustainable solutions.
  • Collaborate with engineering and platform teams to deploy improvements, maintain system stability, and support evolving operational needs.
  • Own engineering tasks end-to-end, from understanding user requirements and designing solutions to implementation, testing, deployment, and maintenance.
What We're Looking For
  • Strong software engineering experience, particularly in Python and backend application development.
  • Experience with platform engineering, site reliability engineering (SRE), or production operations.
  • Experience building, deploying, debugging, and maintaining production software systems.
  • Familiarity with REST APIs, backend services, asynchronous processing, and system integrations.
  • Practical experience working with AI-powered applications, LLM APIs, or model-assisted development tools.
  • Strong troubleshooting and debugging skills, with the ability to investigate unfamiliar systems and resolve complex production issues.
  • Experience supporting production environments, including monitoring, incident response, and reliability improvements.
  • Ability to independently scope technical problems, prioritize work, and deliver maintainable solutions.
  • Strong communication skills and experience collaborating with technical and nontechnical stakeholders.
  • Sound judgment when handling sensitive information, operational incidents, and time-sensitive technical challenges.
  • Availability to participate in scheduled on-call coverage, including weekends and holidays.
Nice to Have
  • Experience with asynchronous job processing, background workers, task queues, or distributed systems.
  • Familiarity with cloud infrastructure and services such as AWS, GCP, or Azure.
  • Experience building internal tools, workflow automation, or investigator-facing applications.
  • Familiarity with observability tools, structured logging, alerting, and incident management practices.
  • Experience working in cybersecurity, trust and safety, threat intelligence, or other high-stakes operational environments.
Additional Information
  • Employment Type: 1 year contract, 40 hours full-time
  • Compensation: $160,000 - $200,000
  • Location: Remote
  • Schedule: Includes rotating on-call coverage, with weekend and holiday availability required.

This role supports sensitive safety and threat investigations and may involve exposure to potentially distressing case information.

Skills Required

  • Strong software engineering experience, particularly in Python and backend application development
  • Experience with platform engineering, site reliability engineering, or production operations
  • Experience building, deploying, debugging, and maintaining production software systems
  • Familiarity with REST APIs, backend services, asynchronous processing, and system integrations
  • Practical experience with AI-powered applications, LLM APIs, or model-assisted development tools
  • Strong troubleshooting and debugging skills for resolving complex production issues
  • Experience supporting production environments, including monitoring, incident response, and reliability improvements
  • Ability to independently scope technical problems, prioritize work, and deliver maintainable solutions
  • Strong communication skills and experience collaborating with technical and nontechnical stakeholders
  • Sound judgment when handling sensitive information, operational incidents, and time-sensitive technical challenges
  • Availability for scheduled on-call coverage, including weekends and holidays
  • Experience with asynchronous job processing, background workers, task queues, or distributed systems
  • Familiarity with cloud infrastructure and services such as AWS, GCP, or Azure
  • Experience building internal tools, workflow automation, or investigator-facing applications
  • Familiarity with observability tools, structured logging, alerting, and incident management practices
  • Experience in cybersecurity, trust and safety, threat intelligence, or other high-stakes operational environments

10a Labs Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about 10a Labs and has not been reviewed or approved by 10a Labs.

  • Healthcare Strength — Benefits include comprehensive medical, dental, and vision coverage for full-time roles, listed across multiple postings. Coverage is presented as a core part of the package rather than a role-specific perk.
  • Leave & Time Off Breadth — Positions frequently advertise generous PTO and paid holidays, with some roles noting unlimited PTO and flexible hours. This indicates substantial time-off provisions alongside remote work arrangements.
  • Strong & Reliable Incentives — Compensation commonly includes performance-based annual bonuses and occasional spot bonuses. These incentives are presented as standard components for many roles.

10a Labs Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
28 Employees

What We Do

10a Labs is an applied research and technology company specializing in AI security. We deliver intelligence collection, investigative research, and analysis for AI unicorns, Fortune 10 companies, and U.S. tech leaders.

Similar Jobs

Applied Systems Logo Applied Systems

Enterprise Account Executive

Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Remote or Hybrid
United States
3116 Employees
140K-170K Annually

ServiceNow Logo ServiceNow

Dir, Customer Success Operations (Armis/Veza)

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
New York, NY, USA
29000 Employees
184K-322K Annually

ServiceNow Logo ServiceNow

Principal Customer Success Executive

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Addison, TX, USA
29000 Employees

ServiceNow Logo ServiceNow

Machine Learning Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Dallas, TX, USA
29000 Employees
176K-308K Annually

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account