Software Engineer Jobs in San Jose, CA

Lead software-hardware co-design to optimize LLM and agentic AI inference. Profile and optimize model execution for memory bottlenecks, influence memory and accelerator architecture, and develop/benchmark inference and serving solutions using PyTorch and vLLM while mentoring teams on best practices.

Design, build, and operate core distributed systems in Rust powering messaging, storage, eventing, and fanout across a global real-time platform. Focus on reliability, performance, observability, incident response, capacity planning, and running services in Kubernetes-based production environments.

Build and scale AI data and ML infrastructure: evaluation systems, fine-tuning pipelines, agent-first product surfaces, high-throughput data workflows, and integrations of new models into production.

Design, build, and secure scalable distributed backend systems for AI workloads. Implement microservice-based architectures, manage Kubernetes-based deployments, apply IaC and DevOps practices, and collaborate with performance and solutions engineering to optimize model deployment and infrastructure cost, security, and scalability.

Build and own fullstack features across UI, backend APIs, and orchestration interfaces for a global GPU inference platform. Implement real-time streaming, analytics, deployment workflows, developer SDKs/CLI, and observability integrations while collaborating with founders and infrastructure teams to turn distributed systems into user-friendly products.

Lead functional verification of NVIDIA-Cumulus Linux on Mellanox Spectrum switches. Create test plans and topologies, execute tests, report and validate defects, and develop automation and continuous regression suites for Layer2/Layer3 features.

Develop, enhance, and maintain software kernels for AI hardware. Collaborate with teams to optimize hardware-software co-design and build compiler infrastructure.

Design and build core backend services for a B2B software platform, focusing on resilience and scalability of complex distributed systems. Collaborate with leadership on technology decisions and establish best practices.

The Senior Software Engineer will build and scale GPU infrastructure, maintain AWS backbone, and ensure high availability for AI video generation deployments.

As a Staff Software Engineer, you will design and build scalable backend systems, lead technical initiatives, and mentor engineers at a fintech company.

The Staff Software Engineer will architect core systems for autonomous AI investigations, collaborate on product features, and uphold high engineering standards across multiple stacks, including Python.

Lead the development of real-time video interfaces, optimizing multimodal models for performance, collaborating with research teams, and delivering core features.

Lead the development of advanced conversational AI systems, architecting solutions and ensuring scalability and performance. Collaborate with cross-functional teams to create real-time interfaces that manage complex tasks and user interactions.

Lead architectural initiatives for NVIDIA's global compute platform, operationalize AI infrastructure, and drive migrations while ensuring performance and automation at scale.

As a Senior Engineer on the OpenPath team, you will architect and build scalable systems for direct publisher integrations, mentor engineers, and collaborate cross-functionally on impactful projects.

Design, develop, and optimize embedded software for AI-driven applications. Lead technical efforts and mentor junior engineers, ensuring performance and reliability in real-time systems.

Lead design and implementation of cloud-native, microservices backend systems that power AI-enabled features (LLM assistants, RAG pipelines, recommendations). Build scalable REST and event-driven APIs, establish MLOps practices, ensure reliability/security/observability, mentor engineers, and collaborate with product, scientific, and infrastructure teams to productionize AI services in regulated scientific environments.

Design and build agentic workflows that automate code generation, testing, and tuning across NVIDIA frameworks and compilers. Partner with internal engineering teams to identify high-impact automation, iterate on proofs of concept, integrate agents into git-native CI pipelines, and enable closed-loop validation on real GPUs. Contribute to multi-agent orchestration, performance optimization, and reusable internal tooling to scale agentic engineering practices.

As a Software Development Engineer at Xoriant, you will architect, design, develop, and test IoT products in a collaborative environment.

Design and optimize applications for an energy-efficient processor. Collaborate with the compiler team on performance analysis and application deployment.

Lead architecture and design for distributed systems at Orkes, mentoring engineers, and delivering high-impact features while staying current with technology trends.

As a Senior Software Engineer at Ayama, you will build and improve AI-based systems, design data pipelines, and develop full-stack product features. This role requires strong architectural judgment and hands-on experience with optimization problems and large-scale data processing.

Lead the design and implementation of complex software systems, mentor engineers, and ensure delivery of high-quality software solutions in medical device technology.

Lead software integration for high-speed optical transceivers on advanced switch architectures, ensuring automation and system debugging, collaborating with cross-functional teams.

Build and scale core research infrastructure and agentic systems across backend, frontend, and model integrations. Own reliability, observability, and performance; ship research-proven features to production rapidly and develop shared tools and SDKs to accelerate Research, QA, and Engineering.