NVIDIA is leading the next era of AI computing, bringing Generative AI from the cloud to local devices. The Local AI team develops the software platform that enables developers, enterprises, and creators to build and run AI applications on NVIDIA client platforms, including GeForce RTX PCs, RTX PRO workstations, RTX Spark, DGX Spark, and DGX Station.
The Local AI Automation team is seeking a senior system software engineer passionate about building and maintaining robust infrastructure for deploying high-quality AI applications and models. You will collaborate with a team of highly qualified engineers dedicated to creating top-tier infrastructure for Local AI automation. If you have a real passion for setting up automation systems in the AI ecosystem to achieve excellence, this could be an excellent opportunity for us to work together!
What you'll be doing:
Design, implement, and maintain robust infrastructure to efficiently run various AI workloads through different inference backends like Llama.cpp, Ollama, Pytorch, WinML, TRT-RTX, and others.
Scope out the requirements for deploying various AI applications, benchmarks and models in automation, and develop solutions to measure accuracy, functionality and performance.
Develop Infrastructure to download AI models from various sources and efficiently manage a local repository, create an automated synchronization mechanism to keep repository up to date.
Analyze large datasets to derive insights and design visualizations, implement data processing engines to transform raw data into a more usable format for developers to review.
Collaborate with internal Local AI developers to identify and implement features in automation that help them quickly debug/isolate issues.
Design, implement, and maintain robust CI/CD pipelines for automated build and deployment. Collaborate with development teams for seamless integration and deployment.
Understand existing infrastructure and debug issues in current frameworks. Identify performance bottlenecks and devise solutions to enhance efficiency.
What we need to see:
5+ years of experience with B.Tech or higher degree in Computer Science, Information Technology, Software engineering, or related field.
Strong analytical and problem-solving abilities, with the capacity to multitask effectively in a dynamic environment.
Confirmed experience as a developer includes at least 5+ years of proficiency in application development using C#, Java, or another programming language. You should also have exposure to at least one scripting language such as Python, Perl, or PHP.
Familiarity with databases and SQL and experience working with source control systems, CI/CD pipelines. (Git, Perforce, Jenkins)
Outstanding written and oral communication skills, enabling effective collaboration with management and engineering teams.
Ways to stand out from the crowd:
Experience of building robust backend automation systems with hands on experience of working the databases.
Familiarized in setting up visualization interfaces using Grafana, Kibana, or similar platforms.
Hands on background with managing git CICD pipelines, Kubernetes and Docker.
Hands on experience with inference frameworks Llama.cpp, Ollama, Pyotrch etc.
We are an equal-opportunity employer and value diversity at our company. With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.
Skills Required
- 5+ years experience with B.Tech or higher in Computer Science, Information Technology, Software Engineering, or related field
- 5+ years proficiency in application development using C#, Java, or another programming language
- Exposure to at least one scripting language such as Python, Perl, or PHP
- Familiarity with databases and SQL
- Experience with source control systems and CI/CD pipelines (Git, Perforce, Jenkins)
- Strong analytical and problem-solving abilities and ability to multitask
- Outstanding written and oral communication skills
- Experience building backend automation systems and working with databases
- Experience setting up visualization interfaces (Grafana, Kibana, or similar)
- Hands-on experience managing CI/CD pipelines, Kubernetes and Docker
- Hands-on experience with inference frameworks (Llama.cpp, Ollama, PyTorch, etc.)
NVIDIA Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NVIDIA and has not been reviewed or approved by NVIDIA.
-
Equity Value & Accessibility — Equity awards and a discounted ESPP are highlighted as core parts of total compensation, enabling employees to share in the company’s success. Stock-based compensation and the two-year lookback ESPP are consistently described as especially valuable.
-
Healthcare Strength — Health coverage is portrayed as robust, with comprehensive medical, dental, and vision options alongside mental health support and on-site care resources. Employer HSA contributions and wellness perks reinforce the depth of the offering.
-
Retirement Support — Retirement programs are depicted as strong, featuring a meaningful 401(k) match with Roth options and support for Mega Backdoor Roth contributions. These elements position long-term savings as a notable advantage of the total rewards package.
NVIDIA Insights
What We Do
NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”
