AI Inference Core - Software Integration Engineer

Posted Yesterday
2 Locations
Remote
Mid level
Artificial Intelligence • Hardware • Software • Semiconductor
The Role
Integrate, validate, and productionize cross-stack inference features across AI frameworks, runtime, compiler, kernels, distributed systems, and hardware. Drive zero-to-one projects, debug system-wide failures, manage accelerated timelines, and improve automation, diagnostics, and repeatable integration practices while collaborating across software and hardware teams.
Summary Generated by Built In

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.
This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.
Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

About the Role

We are looking for a Software Integration Ninja to join the AI Inference Core team at Cerebras. This team sits at the intersection of AI infrastructure, distributed systems, compilers, runtimes, kernels, and hardware/software co-design.

The Innovation Engine for Inference Core — turning ideas into reality.

You will help take ambitious ideas from concept to working reality across the Cerebras inference stack. You will integrate and validate cross-component projects of high complexity, often on accelerated timelines, and work directly with engineers across AI, runtime, compiler, kernel, systems, and hardware teams.

A Special Task Force, Not a Typical Engineering Role
  • Zero-to-one mission: Take incomplete ideas and early prototypes all the way to working, validated capabilities.

  • Cross-stack complexity: Move across AI frameworks, runtime, compiler, kernels, distributed systems, infrastructure, and hardware—not just one component or codebase.

  • Accelerated and dynamic cadence: Expect focused daily syncs, rapidly changing priorities, and periods of intense integration work. This is not a role for engineers seeking strictly regular, predictable work hours.

  • Comfortable on the hot seat: Take ownership when the path is unclear, make sound decisions with incomplete information, and stay effective when timelines are tight.

  • Bias for action: At critical moments, the mindset is “No Process, No Documentation, Just Get Stuff Done!!!” Cut through unnecessary ceremony, deliver the result, and then turn what you learned into better automation, diagnostics, documentation, and repeatable practices.

  • Team multiplier: Always push the work forward while raising the pace, clarity, and effectiveness of the people around you. We want people who bring the team with them—not lone heroes.

We prefer candidates with experience in software/hardware co-design or other complex systems, but that experience is not required. We welcome exceptional junior engineers who are eager to learn, do not shy away from ambiguity or hard work, and can demonstrate strong fundamentals, curiosity, ownership, and persistence.

What You Will Do
  • Turn new inference ideas and features into integrated, working capabilities across the Cerebras platform.

  • Take high-value projects from zero to one—from an incomplete idea or prototype to a working, validated capability.

  • Integrate and validate software components spanning AI frameworks, runtime, compiler, kernels, distributed systems, and hardware.

  • Drive cross-component projects of high complexity from problem definition through integration, validation, and release readiness.

  • Collaborate closely with software and hardware engineers to make co-design trade-offs and resolve system-level issues.

  • Investigate and debug difficult failures across large-scale AI workloads, distributed software, infrastructure, and hardware boundaries.

  • Work effectively on accelerated timelines while keeping technical risks, dependencies, and decisions visible.

  • Participate in focused daily syncs, manage rapidly changing priorities, and drive ambiguous situations toward concrete outcomes.

  • Identify bottlenecks, failure modes, edge cases, and integration gaps that affect inference correctness, performance, or delivery.

  • Capture the essential lessons from urgent work so the next integration is faster and less chaotic.

  • Create momentum beyond your own work by helping teammates move faster, make better decisions, and close difficult problems together.

Minimum Skills & Qualifications
  • Strong software-engineering fundamentals and programming ability in Python, C++, Go, or a similar language.

  • Demonstrated ability to break down ambiguous technical problems, form hypotheses, gather evidence, and drive issues to resolution.

  • Experience—through professional work, internships, research, academic projects, open source, or equivalent hands-on work—building or debugging software systems.

  • Curiosity about how complex systems behave across component boundaries.

  • Willingness to read unfamiliar code, learn new layers of the stack, and take ownership beyond a narrowly defined area.

  • Ability to work hard and stay effective during periods of uncertainty, rapid change, and accelerated delivery.

  • Clear communication and strong collaboration across disciplines and levels of experience.

Preferred Skills
  • Experience in a startup or similarly fast-moving, resource-constrained engineering environment.

  • Demonstrated experience taking a project from zero to one: turning an ambiguous problem, early idea, or prototype into a working and reliable capability.

  • Experience with software/hardware co-design, hardware accelerators, compilers, kernels, runtimes, or low-level systems.

  • Experience debugging complex systems, distributed software environments, or large-scale compute clusters.

  • Experience with AI infrastructure, model deployment, LLMs, or multimodal workloads.

  • Exposure to performance debugging, profiling, observability, or failure analysis.

  • Familiarity with microservices, containers, cluster orchestration, cloud infrastructure, or high-performance computing.

  • Track record of driving cross-team projects from an incomplete idea to a reliable working result.

Location
  • This role follows a hybrid schedule and requires in-office presence three days per week. Fully remote work is not available.

  • Office locations: Sunnyvale, CA or Toronto, ON.

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

  1. Build a breakthrough AI platform beyond the constraints of the GPU.

  2. Publish and open source their cutting-edge AI research.

  3. Work on one of the fastest AI supercomputers in the world.

  4. Enjoy job stability with startup vitality.

  5. Our simple, non-corporate work culture that respects individual beliefs.

Find out more about what it's like to work at Cerebras here!

Apply today and become part of the forefront of groundbreaking advancements in AI!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

Skills Required

  • Strong software-engineering fundamentals and programming ability in Python, C++, Go, or a similar language.
  • Demonstrated ability to break down ambiguous technical problems, form hypotheses, gather evidence, and drive issues to resolution.
  • Experience building or debugging software systems (professional work, internships, research, academic projects, open source, or equivalent hands-on work).
  • Curiosity about how complex systems behave across component boundaries.
  • Willingness to read unfamiliar code, learn new layers of the stack, and take ownership beyond a narrowly defined area.
  • Ability to work hard and stay effective during periods of uncertainty, rapid change, and accelerated delivery.
  • Clear communication and strong collaboration across disciplines and levels of experience.
  • In-office presence three days per week (hybrid) at Sunnyvale, CA or Toronto, ON.
  • Experience in a startup or fast-moving, resource-constrained engineering environment.
  • Experience taking a project from zero to one: turning an ambiguous problem or prototype into a reliable capability.
  • Experience with software/hardware co-design, hardware accelerators, compilers, kernels, runtimes, or low-level systems.
  • Experience debugging complex systems, distributed software environments, or large-scale compute clusters.
  • Experience with AI infrastructure, model deployment, LLMs, or multimodal workloads.
  • Exposure to performance debugging, profiling, observability, or failure analysis.
  • Familiarity with microservices, containers, cluster orchestration, cloud infrastructure, or high-performance computing.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
774 Employees
Year Founded: 2015

What We Do

Cerebras Systems develops wafer-scale semiconductor hardware, AI supercomputers, and software/cloud services for training and inference. Its CS-2 and CS-3 systems help organizations build on-premise AI supercomputers, while pay-as-you-go cloud offerings provide developers and enterprises access to its computing platform. The company focuses on making AI training and inference faster and easier for diverse research and production workloads at scale worldwide.

Similar Jobs

GitLab Logo GitLab

Back-end Engineer

Cloud • Security • Software • Cybersecurity • Automation
Easy Apply
Remote
2 Locations
2500 Employees

Block Logo Block

Strategic Programs Lead

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office or Remote
8 Locations
12000 Employees
164K-297K Annually

Block Logo Block

Head Of Product

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office or Remote
8 Locations
12000 Employees
305K-457K Annually

Block Logo Block

Software Engineer

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office or Remote
8 Locations
12000 Employees
185K-327K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account