GPU Cluster Engineer, Hardware Operations

Posted One Month Ago
Be an Early Applicant
2 Locations
In-Office
150K-180K Annually
Mid level
Artificial Intelligence • Information Technology • Software
The Role
Own physical health and infrastructure of GPU clusters: respond to hardware outages, monitor GPU thermals/power, coordinate vendor RMAs and data center work, rack and bring up nodes, maintain Linux OS across bare-metal servers, secure networking and SSH, and manage directory and network storage services to keep compute environment stable for research and product teams.
Summary Generated by Built In

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.

Role Overview

We are looking for a dedicated Hardware Operations Engineer to own the physical health and foundational infrastructure of our GPU clusters. You will be the primary custodian of our compute hardware, responsible for everything from data center vendor coordination up to the base Linux OS layer. You will ensure our research and product teams have a stable, secure, and fully operational physical environment to run their demanding compute workloads on.

Key Responsibilities

  • System Health & Hardware Reliability

    • On-Call Response: Serve as the primary point of contact for physical system outages, hardware failures, and network interruptions to minimize downtime.

    • Cluster Monitoring: Proactively monitor hardware health, including GPU thermals, power draw, and physical system loads, catching anomalies before they impact active workloads.

    • Vendor Liaison: Work closely with data center facility staff and third-party hardware vendors to coordinate RMA processes, physical repairs, part replacements, and routine maintenance.

    • Hardware Deployment: Rack, cable, and lead the physical bring-up of new GPU nodes, ensuring power and network connectivity are fully integrated into the existing cluster.

  • Linux & Network Administration

    • OS Management: Install, patch, and maintain Linux operating systems (Ubuntu/CentOS/RHEL) across the cluster bare-metal servers.

    • Security & Access: Configure and maintain edge and internal networking, including firewalls, VPNs, and strict SSH access controls to secure our infrastructure.

    • Identity & Storage Management: Administer LDAP/Active Directory for centralized user authentication and ensure network storage systems (NFS/GPFS/Lustre) are reliably mounted and properly permissioned.

Qualifications

  • Must-Haves:

    • 3+ years of experience in Linux Systems Administration (deep knowledge of boot processes, systemd, disk management, etc.).

    • Strong background in server hardware troubleshooting, specifically within high-density environments (power, cooling, PCIe topologies).

    • Experience managing networking security (VPNs, iptables/firewalld, VLANs) and directory services (LDAP/FreeIPA/Active Directory).

    • Proficiency in Bash scripting for essential system automation.

  • Nice-to-Haves:

    • Experience using configuration management tools like Ansible, SaltStack, or Terraform for OS provisioning.

    • Familiarity with data center operations, cooling requirements for high-TDP accelerators (like NVIDIA B200 or AMD MI355x).

Benefits include
  • Medical, dental, and vision insurance

  • 401k plan

  • Daily lunch, snacks, and beverages

  • Flexible time off

  • Competitive salary and equity

Equal opportunity

Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Skills Required

  • 3+ years Linux Systems Administration (boot processes, systemd, disk management)
  • Server hardware troubleshooting in high-density environments (power, cooling, PCIe topologies)
  • Networking security experience (VPNs, iptables/firewalld, VLANs)
  • Directory services administration (LDAP/FreeIPA/Active Directory)
  • Proficiency in Bash scripting for system automation
  • Experience with configuration management/provisioning tools (Ansible, SaltStack, Terraform)
  • Familiarity with data center operations and cooling for high-TDP accelerators (e.g., NVIDIA B200, AMD MI355x)
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
7 Employees
Year Founded: 2024

What We Do

Sciforium is pioneering the future of AI infrastructure and research. Backed by AMD and SignalFire, we're developing byte-native multimodal foundation models while delivering serverless LLM serving at a fraction of traditional costs.

Similar Jobs

Cloudflare Logo Cloudflare

Systems Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Hybrid
3 Locations
4400 Employees
150K-196K Annually

ServiceNow Logo ServiceNow

Full-stack Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
San Diego, CA, USA
29000 Employees
150K-262K Annually

Parakeet Health Logo Parakeet Health

Technical Recruiter

Healthtech • Conversational AI • Generative AI
In-Office
San Francisco, CA, USA
12 Employees
130K-160K Annually

SharkNinja Logo SharkNinja

Manager, Studio Production

Beauty • Robotics • Design • Appliances • Manufacturing
In-Office
Irvine, CA, USA
4000 Employees
77K-135K Annually

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account