Are you passionate about generative AI and building agentic workflows to solve real problems? Are you interested in learning more about computer hardware architecture? NVIDIA pioneered accelerated computing to tackle challenges no one else can solve. Our chips and systems power applications within artificial intelligence, computer graphics, autonomous vehicles, robotics, gaming, virtual reality, and high-performance computing.
We are now looking for a senior SW AI architect to help redefine our engineering flows. Come join the NVIDIA hardware architecture team to build agentic systems to improve our future chip designs, or put differently, use AI to design our next-generation AI systems!
What you’ll be doing:
Serve as an expert in implementing and deploying AI applications based on large language models (LLMs), internal and external agentic frameworks, and custom models.
Work with hardware architects to identify how to best design, customize, and deploy AI-based solutions to their specific problem domains.
Collaborate with infrastructure engineers to improve existing automated workflows by incorporating LLMs and establishing best practices for future solutions.
Develop and optimize retrieval and generation algorithms for enterprise data (text, code, and images) to build advanced AI applications.
Interact with internal research groups on how to solve complex chip design problems in new ways by leveraging machine learning (ML) and deep learning (DL).
Research emerging AI technologies and engineering best practices to continuously evolve our development ecosystem and maintain a competitive edge.
What we need to see:
MSc or PhD in Data Science, Computer Science/Engineering, Electrical Engineering, or equivalent experience.
5+ years of industry or research experience.
Deep practical knowledge of LLMs, DL/ML, and Agent development.
Well versed in agentic literature and eager to continue learning.
Strong background in implementing AI solutions to solve real-world engineering problems.
Experience with training/fine-tuning custom models, building multi-agent systems, retrieval augmented generation (RAG) pipelines, and vector databases.
Strong analytical, communication, and interpersonal skills.
Ways to stand out from the crowd:
Background in computer architecture or hardware development.
Good understanding of distributed systems and microservice architecture.
Hands-on experience with NVIDIA Inference Microservices (NIMs).
NVIDIA engineers the most advanced chips, systems, and software for the AI factories of the future and is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and ambitious people in the world working for us. Are you a creative and autonomous engineer who wants to make a difference? If so, we want to hear from you!
#LI-Hybrid
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.You will also be eligible for equity and benefits.
Similar Jobs
What We Do
NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”
