Senior Data Engineer, Network Clustering

Reposted 6 Days Ago
Be an Early Applicant
4 Locations
In-Office
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Role
The Senior Data Engineer will develop scalable data pipelines, maintain data quality, automate schema evolution, and collaborate across teams to manage telemetry data.
Summary Generated by Built In

We are looking for an expert Data Engineer to build and evolve the data backbone for our R&D telemetry and performance analytics ecosystem. Responsibilities include processing raw, large quantities of data from live systems at the cluster level: hardware, communication units, software, and efficiency indicators. You’ll be part of a fast paced R&D organization, where system behavior, schemas, and requirements evolve constantly. Your mission is to develop flexible, reliable, and scalable data handling pipelines that can adapt to rapid change and deliver clean, trusted data for engineers and researchers.

What you’ll be doing:

  • Build flexible data ingestion and transformation frameworks that can easily handle evolving schemas and changing data contracts

  • Develop and maintain ETL/ELT workflows for refining, enriching, and classifying raw data into analytics-ready form

  • Collaborate with R&D, hardware, DevOps, ML engineers, data scientists and performance analysts to ensure accurate data collection from embedded systems, firmware, and performance tools

  • Automate schema detection, versioning, and validation to ensure smooth evolution of data structures over time

  • Maintain data quality and reliability standards, including tagging, metadata management, and lineage tracking

  • Enable self-service analytics by providing curated datasets, APIs, and Databricks notebooks 

What we need to see:

  • B.Sc. or M.Sc. in Computer Science, Computer Engineering, or a related field

  • 5+ years of experience in data engineering, ideally in telemetry, streaming, or performance analytics domains

  • Confirmed experience with Databricks and Apache Spark (PySpark or Scala)

  • Understanding of streaming processes and their applications (e.g., Apache Kafka for ingestion, schema registry, event processing)

  • Proficiency in Python and SQL for data transformation and automation

  • Shown knowledge in schema evolution, data versioning, and data validation frameworks (e.g., Delta Lake, Great Expectations, Iceberg, or similar)

  • Experience working with cloud platforms (AWS, GCP, or Azure) — AWS preferred

  • Familiarity with data orchestration tools (Airflow, Prefect, or Dagster)

  • Experience handling time-series, telemetry, or real-time data from distributed systems

Ways to stand out from the crowd:

  • Exposure to hardware, firmware, or embedded telemetry environments

  • Knowledge of real-time analytics frameworks (Spark Structured Streaming, Flink, Kafka Streams)

  • Understanding of system performance metrics (latency, throughput, resource utilization)

  • Experience with data cataloging or governance tools (DataHub, Collibra, Alation)

  • Familiarity with CI/CD for data pipelines and infrastructure-as-code practices

With competitive salaries and a generous benefits package, NVIDIA is widely considered one of the technology world’s most desirable employers. Our team comprises some of the most forward-thinking and hardworking individuals in the industry. Due to unprecedented growth, our exclusive engineering teams are rapidly expanding. If you're a creative engineer with a real passion for technology, we want to hear from you.

#LI-Hybrid

Top Skills

Airflow
Apache Kafka
Spark
AWS
Azure
Dagster
Databricks
GCP
Prefect
Pyspark
Python
Scala
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
21,960 Employees
Year Founded: 1993

What We Do

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”

Similar Jobs

mPrest Logo mPrest

C# Developer

Artificial Intelligence • Software • Database
In-Office
Karmiel, ISR
177 Employees

mPrest Logo mPrest

IT Integrator

Artificial Intelligence • Software • Database
In-Office
Karmiel, ISR
177 Employees

mPrest Logo mPrest

Devops Engineer

Artificial Intelligence • Software • Database
In-Office
Karmiel, ISR
177 Employees

mPrest Logo mPrest

DevOps Team Leader

Artificial Intelligence • Software • Database
In-Office
Karmiel, ISR
177 Employees

Similar Companies Hiring

LayerOne Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account