Infrastructure & Security Engineer

Posted 4 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
Mid level
Artificial Intelligence • Marketing Tech • Software • Automation
The Role
Build and operate secure cloud and baremetal infrastructure for customer-specific AI model training and serving. Design multi-tenant isolation across data, training runs, and models; secure AWS, Kubernetes, and external providers; and develop infrastructure-as-code patterns. Lead security operations, logging, monitoring, incident response, customer trust, security reviews, and compliance efforts while partnering with research and engineering teams.
Summary Generated by Built In
About Engram

Today’s AI is a brilliant stranger: it can solve the world’s hardest math problems, but it knows next to nothing about you and your work. It rereads your files to answer even basic questions, burns an enormous amount of tokens when sifting through large corpuses, and between sessions, it retains scraps at best.

We train models to study your world and anticipate your questions in advance, forming engrams: compact memories that capture your knowledge and history. Our approach opens a new axis of scaling. The more we study your context at training time, the better we become at inference time.

We're already working with leaders in AI like Microsoft, Notion, and Harvey, and just raised $98M from General Catalyst, Kleiner Perkins, Sequoia, Factory, Modern, Amplify, Neo and others. Our investors and advisors include Assaf Rappaport, Andrej Karpathy, and Pieter Abbeel.

AI has spent years learning everything about the world. Now it should learn something about yours.

About the role

Every Engram customer gets models trained on their own context, such as their documents, messages, code, and knowledge bases, and retrained continuously as that context changes. That means isolation can't stop at where data is stored: it has to follow the data into training runs and into the models themselves.

We're looking for an infrastructure engineer to own and evolve the systems that make that true, from ingestion through training to inference, as we add customers and providers. You'll work closely with our researchers so the secure path is also the fast one.

What you'll do
  • Build and operate the cloud infrastructure responsible for training and serving Engram customer models.

  • Design and enable the boundaries that keep each customer's data, training runs, and models separate; both on the cloud and on Engram-managed baremetal compute.

  • Partner with researchers and engineers on paved roads that improve our isolation and security posture.

  • Evaluate and secure the providers and tools we build on, including Modal, Baseten, and Fireworks as well as compute on baremetal or Kubernetes.

  • Take the lead on security operations and customer trust: maintain the logging and monitoring we rely on, respond to incidents, and bring clarity to security reviews and compliance work.

Your background looks like
  • A bachelor’s degree, or equivalent practical experience, in computer science, engineering, machine learning, or a related field.

  • Four years of work experience as a software engineer or equivalent, exclusive of internships.

  • Experience building and operating production infrastructure on AWS, including IAM expertise: cross-account roles, STS, resource and key policies, KMS, and multi-account organizations.

  • Infrastructure-as-Code (Terraform or similar) at multi-account scale, with secure patterns for networks, IAM, and shared services.

  • A rigorous approach to multi-tenant isolation.

  • A track record of owning complex, production-critical systems end to end.

  • Comfort with ambiguity and high ownership at an early-stage company.

  • Strong production-grade coding skills (Python, Rust, or similar). This role involves shipping code as well as configuration.

No prior ML experience is required.

Bonus points if you have
  • Experience as an early infrastructure or security hire at a startup.

  • Experience with ML infrastructure, such as GPU training and model serving.

  • Experience supporting enterprise security reviews and compliance programs such as SOC 2.

  • Open-source contributions, talks, or writing on cloud or infrastructure security.

  • Experience on Azure or GCP.

Engram is based in San Francisco. This role is in-person in our SF office. We offer competitive cash compensation and startup equity.

Engram is an equal opportunity employer. We’re building a team that reflects a range of backgrounds and perspectives, and we welcome applicants regardless of race, color, religion, national origin, gender, gender identity, sexual orientation, age, disability, or veteran status.


Skills Required

  • Bachelor's degree or equivalent practical experience in computer science, engineering, machine learning, or a related field
  • Four years of work experience as a software engineer or equivalent, excluding internships
  • Experience building and operating production infrastructure on AWS
  • AWS IAM expertise, including cross-account roles, STS, resource and key policies, KMS, and multi-account organizations
  • Infrastructure-as-Code experience with Terraform or similar at multi-account scale
  • Experience designing secure network, IAM, and shared-services patterns
  • Experience with rigorous multi-tenant isolation
  • Track record of owning complex, production-critical systems end to end
  • Comfort with ambiguity and high ownership in an early-stage company
  • Strong production-grade coding skills in Python, Rust, or similar
  • Experience as an early infrastructure or security hire at a startup
  • Experience with ML infrastructure, including GPU training and model serving
  • Experience supporting enterprise security reviews and compliance programs such as SOC 2
  • Open-source contributions, technical talks, or writing on cloud or infrastructure security
  • Experience with Azure or GCP
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
13 Employees
Year Founded: 2025

What We Do

Engram is a GTM engineering system that connects to a company’s CRM, Slack, Google Drive, call transcripts, social platforms, and outreach tools. Its AI agent learns the business context and automates context-heavy workflows across marketing, sales, and customer success. The platform supports personalized outbound, content creation, pipeline scoring, onboarding briefs, renewal intelligence, and champion tracking in the company’s voice.

Similar Jobs

MongoDB Logo MongoDB

Senior Site Reliability Engineer

Big Data • Cloud • Software • Database
Easy Apply
Remote or Hybrid
3 Locations
5550 Employees
126K-248K Annually

MongoDB Logo MongoDB

Senior Software Engineer

Big Data • Cloud • Software • Database
Easy Apply
Remote or Hybrid
3 Locations
5550 Employees
126K-248K Annually

CoreWeave Logo CoreWeave

Senior Software Engineer

Cloud • Information Technology • Machine Learning
In-Office
2 Locations
1450 Employees
153K-204K Annually

Headway Logo Headway

Senior Security Engineer

Consumer Web • Healthtech • Professional Services • Social Impact • Software
In-Office or Remote
3 Locations
819 Employees
223K-279K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account