Senior Solutions Architect, Generative AI

Reposted 19 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Role
Architect and deliver generative AI solutions centered on LLM training, optimization, deployment, and RAG workflows. The role involves customer collaboration, technical workshops, pre-sales presentations, solution integration, and technical leadership. Responsibilities include fine-tuning models, optimizing GPU-based inference, designing scalable training workflows, and partnering with NVIDIA engineering teams. Candidates need deep expertise in language models, TensorFlow, PyTorch, Hugging Face, GPU clusters, and production deployments, with cloud, containerization, and Kubernetes experience preferred.
Summary Generated by Built In

NVIDIA is seeking a dynamic and experienced Generative AI Solution Architect with specialized expertise in training Large Language Models (LLMs) and implementing workflows based on Retrieval-Augmented Generation (RAG). As a key member of our AI Solutions team, you will play a pivotal role in architecting and delivering cutting-edge solutions that leverage the power of NVIDIA's generative AI technologies. This position requires a deep understanding of language models, particularly LLMs, and a strong proficiency in designing and implementing RAG-based workflows.
What you will be doing:

  • Architect end-to-end generative AI solutions with a focus on LLMs and RAG workflows.

  • Collaborate closely with customers to understand their language-related business challenges and design tailored solutions.

  • Collaborate with sales and business development teams to support pre-sales activities, including technical presentations and demonstrations of LLM and RAG capabilities.

  • Work closely with NVIDIA engineering teams to provide feedback and contribute to the evolution of generative AI technologies.

  • Engage directly with customers to understand their language-related requirements and challenges.

  • Lead workshops and design sessions to define and refine generative AI solutions focused on LLMs and RAG workflows and lead the training and optimization of Large Language Models using NVIDIA’s hardware and software platforms.

  • Implement strategies for efficient and effective training of LLMs to achieve optimal performance.

  • Design and implement RAG-based workflows to enhance content generation and information retrieval.

  • Work closely with customers to integrate RAG workflows into their applications and systems and stay abreast of the latest developments in language models and generative AI technologies.

  • Provide technical leadership and guidance on best practices for training LLMs and implementing RAG-based solutions.

What we need to see:

  • Master's or Ph.D. in Computer Science, Artificial Intelligence, or equivalent experience

  • 5+ years of hands-on experience in a technical role, specifically focusing on generative AI, with a strong emphasis on training Large Language Models (LLMs).

  • Proven track record of successfully deploying and optimizing LLM models for inference in production environments.

  • In-depth understanding of state-of-the-art language models, including but not limited to GPT-3, BERT, or similar architectures.

  • Expertise in training and fine-tuning LLMs using popular frameworks such as TensorFlow, PyTorch, or Hugging Face Transformers.

  • Proficiency in model deployment and optimization techniques for efficient inference on various hardware platforms, with a focus on GPUs.

  • Strong knowledge of GPU cluster architecture and the ability to leverage parallel processing for accelerated model training and inference.

  • Excellent communication and collaboration skills with the ability to articulate complex technical concepts to both technical and non-technical stakeholders.

  • Experience leading workshops, training sessions, and presenting technical solutions to diverse audiences.

Ways to stand out from the crowd:

  • Experience in deploying LLM models in cloud environments (e.g., AWS, Azure, GCP) and on-premises infrastructure.

  • Proven ability to optimize LLM models for inference speed, memory efficiency, and resource utilization.

  • Familiarity with containerization technologies (e.g., Docker) and orchestration tools (e.g., Kubernetes) for scalable and efficient model deployment.

  • Deep understanding of GPU cluster architecture, parallel computing, and distributed computing concepts.

  • Hands-on experience with NVIDIA GPU technologies, and GPU cluster management and ability to design and implement scalable and efficient workflows for LLM training and inference on GPU clusters

With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you! NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Skills Required

  • Master's or Ph.D. in Computer Science, Artificial Intelligence, or equivalent experience
  • 5+ years of hands-on technical experience focused on generative AI and training Large Language Models
  • Experience deploying and optimizing LLM models for inference in production environments
  • In-depth understanding of state-of-the-art language models, including GPT-3, BERT, or similar architectures
  • Expertise training and fine-tuning LLMs with TensorFlow, PyTorch, or Hugging Face Transformers
  • Proficiency in model deployment and optimization for efficient GPU-based inference
  • Strong knowledge of GPU cluster architecture and parallel processing for model training and inference
  • Excellent communication and collaboration skills for technical and non-technical audiences
  • Experience leading workshops, training sessions, and technical presentations
  • Experience deploying LLMs in AWS, Azure, GCP, or on-premises infrastructure
  • Experience optimizing LLMs for inference speed, memory efficiency, and resource utilization
  • Familiarity with Docker and Kubernetes for scalable model deployment
  • Deep understanding of parallel and distributed computing
  • Hands-on experience with NVIDIA GPU technologies and GPU cluster management
  • Ability to design scalable workflows for LLM training and inference on GPU clusters

NVIDIA Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NVIDIA and has not been reviewed or approved by NVIDIA.

  • Equity Value & Accessibility — Feedback suggests equity grants, stock options/RSUs, and a discounted ESPP materially boost total compensation and can deliver significant wealth-building when the stock performs well.
  • Healthcare Strength — Feedback suggests medical, dental, and vision plans with in-network preventive care at 100%, telehealth, and concierge-style support are comprehensive and valued.
  • Parental & Family Support — Feedback suggests up to 22 weeks fully paid parental leave, fertility coverage, and adoption/surrogacy reimbursement provide strong family-focused benefits.

NVIDIA Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
21,960 Employees
Year Founded: 1993

What We Do

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”

Similar Jobs

NVIDIA Logo NVIDIA

Senior Solutions Architect

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
21960 Employees

Zscaler Logo Zscaler

Development Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Hybrid
Bangalore, Bengaluru, Karnataka, IND
8697 Employees

Zscaler Logo Zscaler

Escalation Engineer - ZIA/ZPA

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Hybrid
3 Locations
8697 Employees

ServiceNow Logo ServiceNow

Sr Mgr, Software Engrg Mgmt - Moveworks

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Bangalore, Bengaluru, Karnataka, IND
29000 Employees

Similar Companies Hiring

Unusual Machines, Inc. Thumbnail
Hardware • Robotics
Orlando, FL
300 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account