Senior Principal Engineer, NPU Compiler

Posted Yesterday
Be an Early Applicant
Mountain View, CA, USA
In-Office
247K-312K Annually
Senior level
Automotive • Software
The Role
Leads architecture and development of an NPU inference compiler for automotive machine-learning workloads. Responsibilities include graph optimization, tiling, memory management, code generation, DMA scheduling, hardware integration, quantization, numerical validation, compiler/runtime interfaces, testing, reproducible releases, and performance optimization. The role provides technical direction, mentors engineers, coordinates cross-functional initiatives, and establishes compiler engineering and release standards.
Summary Generated by Built In

We are CARIAD, an automotive software development team with the Volkswagen Group. Our mission is to make the automotive experience safer, more sustainable, more comfortable, more digital, and more fun. To achieve that we are building the leading tech stack for the automotive industry and creating a unified software platform for over 10 million new vehicles per year. We’re looking for talented, digital minds like you to help us create code that moves the world. Together with you, we’ll build outstanding digital experiences and products for all Volkswagen Group brands that will transform mobility. Join us as we shape the future of the car and everyone around it.

​Role Summary:

The Senior Principal Engineer, NPU Compiler provides technical leadership for CARIAD’s NPU inference compiler within the NPU Hardware and Software organization. This role leads compiler architecture, implementation standards, and release-readiness criteria within the approved NPU architecture. 

The engineer translates supported machine-learning workloads into efficient target code and works with model enablement, kernel, runtime, firmware, verification, and hardware teams to define interfaces, validate numerical behavior, and improve performance. The role guides complex compiler initiatives, mentors engineers, and delivers maintainable compiler releases with documented functionality, limitations, and performance.

Role Responsibilities:

​Compiler Architecture and Design 

  • Design and evolve the NPU compiler architecture to support approved hardware capabilities, compiler/runtime interfaces, and target workloads. 
  • Implement and evaluate hardware-independent and hardware-specific graph-optimization passes. 
  • Develop and optimize tiling and memory-management algorithms to use NPU resources efficiently. 
  • Create advanced optimization passes for approved automotive neural-network inference workloads. 
  • Define model import and operator coverage, quantization semantics, fallback policy, and graph-to-target lowering. 

Code Generation and Hardware Integration

  • Map high-level operations to optimized library macros and convert them into hardware-level instructions. 
  • Generate and manage DMA commands for data movement and execution within the hardware platform. 
  • Collaborate with hardware engineers and system architects to validate NPU integration and improve performance against agreed workload metrics. 
  • Implement compile-time scheduling and resource allocation, and define runtime queueing, admission, synchronization, and recovery interfaces with the NPU software lead. 
  • Specify target code generation, binary formats, compiler/runtime ABI, memory layout, DMA and synchronization contracts, and compatibility across hardware revisions. 
  • Define and maintain compiler-readiness criteria and reference-output comparisons for numerical correctness, operator and model coverage, and performance. Document unsupported cases, limitations, and fallback costs.

Innovation and Technology Leadership

  • Use internal and external trends in compiler technology and machine learning to guide decisions and recommend how advancements can be applied at CARIAD. 
  • Evaluate compilation techniques against committed inference workloads and deliver validated improvements into maintained compiler releases. 
  • Lead complex compiler initiatives, set technical direction within the approved NPU architecture, and align engineering teams and stakeholders on priorities, tradeoffs, and delivery criteria. 
  • Establish compiler-engineering standards for design review, testing, reproducible builds, and release quality. 
  • Mentor engineers on compiler architecture, code generation, numerical correctness, and effective engineering practices. 
  • Guide compiler implementers and kernel engineers through design reviews, reproducible builds, and release planning. Coordinate runtime and model-enablement work with their respective owners.

​General Skills:

  • Communicate complex technical concepts clearly across global, cross-functional teams. 
  • Build collaboration and alignment across engineering teams without relying on formal people-management authority. 
  • Balance competing technical priorities, clarify decision ownership, and maintain productive relationships with partner engineering organizations. 
  • Manage complex cross-functional and cross-team initiatives. 
  • Provide technical leadership and mentorship to engineering teams. 
  • Apply advanced analytical and systems thinking to compiler and hardware/software integration challenges.
  • Collaborate effectively across geographies and time zones.

​Required Specialized Skills:

  • Strong understanding of machine-learning algorithms and their computational implications. 
  • Hands-on experience with at least one compiler infrastructure such as TVM, IREE, XLA, MLIR, or LLVM. 
  • Strong proficiency in C++ and Python for compiler development. 
  • Experience with compiler graph optimization and memory-management strategies.
  • Ability to translate high-level functional requirements into detailed technical designs. 
  • Deep knowledge of hardware architecture principles and AI-accelerator design concepts. 
  • Demonstrated delivery of compiler architecture from technical design through validated releases, with influence across hardware and software teams. 
  • Experience with neural-network quantization, precision selection, numerical-error analysis, and accuracy regression in collaboration with model-deployment and hardware teams. 
  • Experience with compiler testing and reproducible releases, including reference comparisons, memory-safety checks, and performance-regression diagnosis.

​Desired Skills:

  • Prior experience with NPU hardware. 
  • Knowledge of automotive standards and Functional Safety requirements. 
  • Background in high-performance computing and parallel-processing architectures. 
  • Publications or contributions to open-source compiler projects. 
  • Familiarity with generative-AI-assisted engineering tools and the ability to evaluate their benefits, limitations, and appropriate use. 
  • Commitment to continuous learning as compiler technologies and development practices evolve

​Workplace Flexibility:

  • In-office presence three to five days per week in Mountain View, California, with some hybrid flexibility. 
  • No travel is planned at this time.

​Years of Relevant Experience:

  • 13+ years of experience in compiler development or architecture, or equivalent relevant experience, particularly targeting AI or machine-learning hardware accelerators.

​Required Education:

  • Bachelor’s degree in Computer Science, Computer Engineering, or Electrical Engineering, or equivalent practical experience.

​Desired Education: 

  • Master’s degree in Computer Science, Computer Engineering, or Electrical Engineering.

Compensation

Salary range is dependent on factors such as geographical differentials, credentials or certifications, industry-based experience, qualification and training. In the city of Mountain View, CA, the salary range for this position is $247,000 - $312,000. 

By submitting your application, you acknowledge and agree to participate in the export control and sanctions compliance screening process. Your cooperation in this matter is essential to our shared success and the integrity of our operations. Thank you for your understanding and commitment to upholding these important standards.


CARIAD, Inc. provides performance-based merits and annual bonus along with a competitive benefits package. Benefits include medical, dental, vision, 401k with employer match and defined contribution plan, short- and long-term disability, basic life and AD&D insurance, employee assistance program, tuition reimbursement and student loan repayment plans, maternity and non-primary caregiver leave, adoption assistance, employee referral program and vacation and paid holidays. We also offer a unique vehicle lease program that covers registration and insurance fees. 

CARIAD is an Equal Opportunity Employer.  We welcome and encourage applicants from all backgrounds, and do not discriminate based on race, sex, age, disability, sexual orientation, national origin, religion, color, gender identity/expression, marital status, veteran status, or any other characteristics protected by applicable laws. 

Employment with CARIAD Inc. is subject to export control and sanctions compliance. Some positions may involve access to technology and/or software source code subject to U.S. legal restrictions on release to certain foreign persons based on citizenship or permanent residence. To ensure compliance, applicants will be required to provide information for screening. Employment may be contingent on the outcome, including verification of U.S. citizenship or lawful permanent resident status, or confirmation that a license, exemption, or exception applies. CARIAD retains the discretion to decline to obtain a required license in any case. By applying, you acknowledge and agree to participate in this process.

Skills Required

  • 13+ years of experience in compiler development or architecture, particularly targeting AI or machine-learning hardware accelerators, or equivalent relevant experience
  • Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience
  • Strong proficiency in C++ and Python for compiler development
  • Hands-on experience with a compiler infrastructure such as TVM, IREE, XLA, MLIR, or LLVM
  • Experience with compiler graph optimization and memory-management strategies
  • Strong understanding of machine-learning algorithms and their computational implications
  • Deep knowledge of hardware architecture principles and AI-accelerator design concepts
  • Experience delivering compiler architecture from technical design through validated releases
  • Experience with neural-network quantization, precision selection, numerical-error analysis, and accuracy regression
  • Experience with compiler testing and reproducible releases, including reference comparisons, memory-safety checks, and performance-regression diagnosis
  • Ability to translate high-level functional requirements into detailed technical designs
  • Master's degree in Computer Science, Computer Engineering, or Electrical Engineering
  • Prior experience with NPU hardware
  • Knowledge of automotive standards and functional safety requirements
  • Background in high-performance computing and parallel-processing architectures
  • Publications or contributions to open-source compiler projects
  • Familiarity with generative-AI-assisted engineering tools
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Wolfsburg
171 Employees
Year Founded: 2018

What We Do

For generations, Volkswagen AG has included a collection of legendary brands. Volkswagen alone has been one of the best-selling automobile brands in the world. Today the Group has rewritten the playbook, transforming its approach to vehicles from hardware-driven to software-defined. CARIAD, Inc. exists to bring this vision to life. Worldwide, CARIAD has around 6,000 developers, engineers, and business team members working in software competence centers in the United States, Germany, Estonia, China, and elsewhere around the world. We are currently hiring in both our Redmond, WA and Mountain View, CA offices, as well as many remote positions across the United States.

Similar Jobs

Whippy Logo Whippy

Account Executive

Artificial Intelligence • Machine Learning • Natural Language Processing • Sales • Software
Hybrid
Culver City, CA, USA
40 Employees
150K-250K Annually

Whippy Logo Whippy

Senior Product Manager

Artificial Intelligence • Machine Learning • Natural Language Processing • Sales • Software
Hybrid
Culver City, CA, USA
40 Employees
120K-150K Annually

CoreWeave Logo CoreWeave

Technical Program Manager

Cloud • Information Technology • Machine Learning
In-Office
Sunnyvale, CA, USA
1450 Employees
134K-179K Annually

Wipfli Logo Wipfli

Senior Manager, Accounting Advisory - Tribal Government Industry

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
2900 Employees
142K-195K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account