Senior Data Processing Platform Engineer

Posted 7 Days Ago
Be an Early Applicant
Austin, TX
Senior level
Artificial Intelligence • Hardware • Robotics • Software • Metaverse
The Role
As a Senior Data Processing Platform Engineer, you will design and operate Kubernetes-based event-driven data processing services. You will enhance service reliability and performance, train teams on adoption, and contribute to continuous improvement through on-call rotations and engineering best practices.
Summary Generated by Built In

Our technology has no boundaries! NVIDIA is building the world’s most groundbreaking and state of the art compute platforms for the world to use. It’s because of our work that data engineers and data scientists can advance their ideas. We are building a team who will be developing data processing and ML platform that can be used by data scientists to run large scale workloads and promoting a culture of MLOps.

As a data processing platform engineer, you will design, implement and operate K8s based event driven data processing service at scale, with high availability and reliability. You will lead and encourage adoption of the event driven data processing service, your work should improve time to first query (TTFQ) metrics, drive platform engagement metrics, and come up with innovative solutions that blends with pioneering Nvidia's LLMOps / DataOps enterprise scale data science platform.

What you’ll be doing:

  • Build, maintain event driven data processing service with scale-to-zero, auto-scaling features

  • Implement event driven APIs and integrate with company's broader engineering systems

  • Enhancing and maintaining a robust scale, cost optimized, real-time data processing service

  • Train data engineers, data scientists and production engineers how to adopt event driven data processing workflows

  • Participate in on-call rotation, site reliability engineering, run-book implementation and continuous improvement

What we need to see:

  • Experience in designing event driven architecture for data processing

  • Strong K8s experience on-premise and/or CSP, Dockers, Kubeflow

  • Data processing tools experience - message queues like Kafka, RabbitMQ, Distributed compute like Ray, Spark

  • Experience implementing and/or deploying eventing services like Argo events, Knative

  • Knowledge of MLOps and Data Ops lifecycle - feature engineering, training, validation, tracking, inferencing, experimentation, monitoring, security, Lambda processing, SAGA patterns

  • Building, operating and maintaining full stack software deployments coupled with excellent software programming skills

  • A minimum of 5yrs experience with a background in software engineering and math

  • BS or MS in Computer Science or equivalent program from an accredited University / College or equivalent experience

Ways to stand out from the crowd:

  • Prior data processing at scale using event driven architecture on GPUs

  • Experience with CUDA and/or using Nvidia GPUs for ML/DL

The base salary range is 148,000 USD - 230,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Top Skills

Docker
Kubernetes
The Company
HQ: Santa Clara, CA
21,960 Employees
On-site Workplace
Year Founded: 1993

What We Do

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”

Similar Jobs

The Aerospace Corporation Logo The Aerospace Corporation

Spacecraft Guidance, Navigation, and Controls (GNC) Engineer, Project Engineer/ Senior Project Engineer

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Cybersecurity • Defense
Houston, TX, USA
4600 Employees

BAE Systems, Inc. Logo BAE Systems, Inc.

F-35 Software Developer

Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Fort Worth, TX, USA
40000 Employees
84K-143K Annually

CoreWeave Logo CoreWeave

Manager, Electrical Engineering

Cloud • Information Technology • Machine Learning
6 Locations
806 Employees

CoreWeave Logo CoreWeave

Manager, Mechanical Engineering

Cloud • Information Technology • Machine Learning
6 Locations
806 Employees

Similar Companies Hiring

bet365 Thumbnail
Software • Gaming • eSports • Digital Media • Automation
Denver, Colorado
6100 Employees
Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees
RunPod Thumbnail
Software
Philadelphia, PA
51 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account