xAI

Network Engineer (Supercomputer Infrastructure)

Posted Yesterday

Be an Early Applicant

2 Locations

In-Office

Mid level

Information Technology

The Role

Design, deploy, operate, and troubleshoot highly available, low-latency networks for AI supercomputer campuses. Responsibilities include data-center and campus networking, hardware deployment, network automation, monitoring and telemetry, change management, cluster support, incident response, documentation, fiber infrastructure, segmentation, and cybersecurity compliance. The role provides on-call operational support, collaborates with infrastructure and site teams, supports campus expansions, and requires up to 20% travel, physical site work, and occasional extended hours.

Summary Generated by Built In

SpaceXAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

ABOUT THE ROLE:

SpaceXAI is looking for an exceptional network engineer with experience in mission-critical, large-scale production environments to support the design, build-out, and operation of networks that power our AI supercomputer campuses. As a member of the Supercomputer Infrastructure / Network Engineering team, you will provide design and operational support for the fabrics used by GPU training and inference clusters, site operations, automation and controls, and facilities teams. The ideal candidate thrives in intense, high-flux environments, brings a strong sense of urgency balanced with operational excellence, communicates clearly, and demonstrates high technical acumen.

RESPONSIBILITIES:

Design and implement highly available, low-latency, high-bandwidth networks, carefully balancing routing, congestion control, and redundancy technologies for AI training fabrics, inference front-ends, storage, and site/OT networks.
Design and maintain supercomputer data center and campus networks in accordance with company network standards. Collaborate with adjacent infrastructure, compute, storage, SiteOps, and enterprise teams.
Evaluate, procure, and deploy network hardware including data-center class switches, NICs, firewalls, optical multiplexers, and related appliances supporting 400G/800G and beyond.
Contribute to maturing network automation tooling; implement configuration analysis, linting, validation, and scalable deployment frameworks (GitOps / IaC).
Plan and coordinate network change windows with stakeholders to perform software updates, hardware refreshes, cluster expansions, and general maintenance (including evenings and weekends when required by compute schedules).
Troubleshoot and resolve network-related issues affecting cluster health and job performance; publish root cause analysis (RCA) documentation and host retrospectives.
Provide direct networking support during cluster bring-up, expansion, and production training/inference campaigns; serve as on-call or networking responsible engineer during operations.
Proactively tailor network monitoring and telemetry (fabric health, congestion, packet loss, NCCL/collective performance) so issues are detected before they impact training or inference.
Continuously create and update network documentation, including architecture overviews, design drawings, fiber/cable plant records, and operational procedures.
Collaborate with cross-functional teams to identify and resolve potential design issues, especially systemic or cascading failure modes and false redundancy in AI fabrics and site networks.
Perform job walks with customers, vendors, and contractors to gather requirements and produce implementation plans for new halls, rows, and campus interconnects.
Ensure networks are configured and maintained in compliance with industry and cybersecurity standards (e.g., ITAR, ISO, NIST), with particular attention to segmentation between compute fabrics, storage, OT/controls, and corporate networks.

BASIC QUALIFICATIONS:

Bachelor’s degree in computer science, computer engineering, or other STEM discipline and 3+ years of professional network engineering experience;

OR 5+ years of professional network engineering experience in lieu of a degree.

Extensive hands-on experience designing, deploying, supporting, and troubleshooting Layer 2 and Layer 3 networks in latency-sensitive and/or industrial / data-center environments.
Functional experience with multiple network vendors in production or lab environments.
Experience with GitOps and Infrastructure as Code frameworks, both as a user and contributor.

PREFERRED SKILLS AND EXPERIENCE:

Strong understanding of the OSI model and network standards.
Hands-on experience with Cisco, Arista, Juniper, and/or NVIDIA Spectrum-X data-center class switches.
Experience with RoCEv2 Ethernet AI/HPC fabrics; InfiniBand experience is a plus.
Working knowledge of AI training and inference traffic patterns and how they behave on the network (collectives, congestion, ECMP, adaptive routing). Familiarity with NCCL is a plus.
Experience with WDM and large-scale single-mode / multimode fiber plants, including OTDR and acceptance testing.
Experience with switch port security, network segmentation, QoS, multicast, and redundancy protocols.
Familiarity with network monitoring and Layer 1 test tools; experience building operational telemetry and dashboards.
Proficiency in scripting (Bash / PowerShell / Python) and automation frameworks (Terraform, Ansible, etc.).
Linux and Windows system administration experience professionally or from labs.
Industry-standard certifications such as CCNA or CCNP.
Experience supporting real-time systems, industrial control / OT networks, or high-reliability environments in data center, energy, aerospace, defense, or similar industries.
Excellent communication skills with internal and external customers, vendors, and management in both formal and informal settings.

ADDITIONAL REQUIREMENTS:

Ability to pass applicable background checks for site access.
Ability to work in tight quarters; physical dexterity is necessary to perform job functions.
Availability for extended hours and/or weekends as the schedule varies with cluster build-out and operational needs; flexibility is required.
Ability to provide 24x7 on-call support in emergency situations and participate in an after-hours on-call rotation.
Willingness to travel (up to 20%) between supercomputer campuses and related sites.
Ability to lift 30 lbs.
Ability to work at heights.
Ability to drive (active valid driver’s license).

SpaceXAI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.

Skills Required

Bachelor’s degree in computer science, computer engineering, or another STEM discipline and 3+ years of professional network engineering experience
Alternatively, 5+ years of professional network engineering experience in lieu of a degree
Hands-on experience designing, deploying, supporting, and troubleshooting Layer 2 and Layer 3 networks in latency-sensitive, industrial, or data-center environments
Experience with multiple network vendors in production or lab environments
Experience using and contributing to GitOps and Infrastructure as Code frameworks
Understanding of the OSI model and network standards
Hands-on experience with Cisco, Arista, Juniper, or NVIDIA Spectrum-X data-center switches
Experience with RoCEv2 Ethernet AI/HPC fabrics; InfiniBand experience is a plus
Knowledge of AI training and inference traffic patterns, collectives, congestion, ECMP, adaptive routing, or NCCL
Experience with WDM, large-scale fiber plants, OTDR, and acceptance testing
Experience with port security, network segmentation, QoS, multicast, and redundancy protocols
Familiarity with network monitoring and Layer 1 test tools, including operational telemetry and dashboards
Proficiency in Bash, PowerShell, or Python and automation frameworks such as Terraform or Ansible
Professional or laboratory Linux and Windows system administration experience
Industry-standard certification such as CCNA or CCNP
Experience supporting real-time systems, industrial control or OT networks, or high-reliability environments
Excellent communication skills with customers, vendors, management, and internal teams
Ability to pass applicable background checks for site access
Ability to work in tight quarters, at heights, and with required physical dexterity
Ability to lift 30 pounds
Active valid driver’s license and ability to drive
Availability for extended hours, weekends, 24x7 emergency support, and an after-hours on-call rotation
Willingness to travel up to 20% between supercomputer campuses and related sites