Infrastructure Security Lead

Posted 3 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
200K-300K Annually
Entry level
Artificial Intelligence • Information Technology
The Role
Own infrastructure security for globally distributed systems, lead the security team, harden cloud-native infrastructure, build internal security tooling, improve telemetry and threat detection, and remediate vulnerabilities. The role partners closely with engineering teams and will expand into securing AI infrastructure, including training clusters, GPU fleets, model artifacts, and inference endpoints.
Summary Generated by Built In

About Together AI

Together AI is a research-driven AI infrastructure company building the go-to platform for developers to run, fine-tune, and build on open models. We believe open and transparent AI systems drive innovation and create the best outcomes for society, and we're on a mission to dramatically lower the cost of modern AI systems. Our team has helped ship foundational open-source research like FlashAttention, FlexGen, and RedPajama — and we're building the next generation of AI infrastructure.

About the Role

We're looking for a hands-on security leader to own infrastructure security.

You'll be the technical owner of how we keep our systems secure, building internal security tooling, deepening our detection and telemetry, and hardening our global infrastructure against threats that range from opportunistic attackers to sophisticated nation-state actors. 

You'll report directly to our SVP of Engineering and help define infrastructure security. Over time, you'll grow the team, set the standards, and increasingly shape how we secure the systems at the heart of modern AI: training clusters, GPU fleets, model artifacts, and inference. 

Responsibilities

  • Own infrastructure security for Together AI's globally distributed systems — hands-on, as the technical leader of the function.
  • Build and lead the infrastructure security team, defining what great looks like and attracting engineers who want to build with you.
  • Partner with engineering and infrastructure teams to harden global systems — shipping security as something that speeds engineering up, not slows it down.
  • Develop and implement internal security tooling that addresses security challenges at scale.
  • Deepen our security telemetry and detection — gathering system telemetry and improving detection of and response to potential security events.
  • Identify and remediate vulnerabilities across our engineering systems, including authenticated vulnerability scanning of distributed systems.
  • Grow into securing the AI-specific surface — training clusters, GPU fleets, model artifacts, and inference endpoints — as the threat landscape evolves.

Requirements

  • Hands-on security leadership — you can lead a team and stay deep in the technical work. You lead by building, not just by delegating.
  • Strong systems and cloud-native software engineering experience, with deep proficiency in Linux configuration, security, and administration.
  • Fluency with automation and infrastructure-as-code (Terraform, Ansible, and/or Salt) to solve security problems at scale.
  • A pragmatic security instinct — you treat security as an enabler, make sound risk calls, and help the team ship safely and fast rather than piling on friction.
  • Experience with security telemetry and detection (e.g. OSQuery, Falco, SIEM) and with finding and fixing vulnerabilities in distributed systems.
  • Curiosity about how AI changes the security landscape — you don't need to be an AI-security expert today, but you're the kind of engineer who becomes one.
  • Bonus: Go or Rust development, cloud-native service experience (AWS, GCP), deep Linux/networking fundamentals, OCP familiarity (OpenBMC, Coreboot, Linuxboot), or a public security-practitioner footprint (talks, OSS, writing).
Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $200k - 300k+ equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

Skills Required

  • Hands-on security leadership experience, including leading teams while remaining technically involved
  • Strong systems and cloud-native software engineering experience
  • Deep proficiency in Linux configuration, security, and administration
  • Experience with infrastructure-as-code and automation using Terraform, Ansible, and/or Salt
  • Experience with security telemetry and detection tools such as OSQuery, Falco, or SIEM platforms
  • Experience finding and remediating vulnerabilities in distributed systems
  • Pragmatic security judgment and ability to enable secure, efficient engineering delivery
  • Curiosity about AI-related security challenges
  • Go or Rust development experience
  • Cloud-native service experience with AWS or GCP
  • Deep Linux and networking fundamentals
  • OCP familiarity, including OpenBMC, Coreboot, or Linuxboot
  • Public security-practitioner footprint through talks, open-source software, or writing

Together AI Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Together AI and has not been reviewed or approved by Together AI.

  • Fair & Transparent Compensation — Pay is considered competitive for the company’s stage, with especially strong offers for technical and research roles. A posted AI researcher range reaching into the high-$200Ks alongside equity and benefits reinforces the overall pay positioning.
  • Equity Value & Accessibility — Equity is commonly included alongside base salary, giving employees ownership exposure tied to company growth. Total compensation is often framed around salary plus equity for specialized roles.
  • Flexible Benefits — Job listings describe a flexible time‑off policy and hybrid or remote work options. Commuter perks and regular team events are also cited as part of the package.

Together AI Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Surry Hills
84 Employees
Year Founded: 2022

What We Do

Together AI is a research-driven artificial intelligence company. We contribute leading open-source research, models, and datasets to advance the frontier of AI. Our decentralized cloud services empower developers and researchers at organizations of all sizes to train, fine-tune, and deploy generative AI models. We believe open and transparent AI systems will drive innovation and create the best outcomes for society

Similar Jobs

In-Office
Redwood City, CA, USA
200 Employees
140K-190K Annually

Pfizer Logo Pfizer

Director, Solution Engineer, Data Storage and Registration

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
13 Locations
121990 Employees
147K-272K Annually

Pfizer Logo Pfizer

Senior Computational Chemist

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Hybrid
La Jolla, CA, USA
121990 Employees
106K-177K Annually

Pfizer Logo Pfizer

Sr. Manager, Solution Engineer, Visualization, Analytics & Collaboration

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
13 Locations
121990 Employees
112K-207K Annually

Similar Companies Hiring

Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account