About the company
Our client is a software company.
The role
Raydar is recruiting for this role on behalf of our client. Own low-level performance work for machine learning model serving in production, tuning compute clusters and building the tooling that measures results. Partner with researchers to bring new model designs into live systems, and speak directly with customers when technical needs have to be pinned down.
What you'll do
- Design, deploy and tune model serving systems across multi-node clusters to raise throughput and cut response times for production workloads.
- Implement targeted performance improvements and benchmark their impact.
- Diagnose performance bottlenecks across the stack, from GPU execution to memory limits.
- Build test and benchmarking tooling that compares quality, speed and resource usage across different parallelism approaches.
- Partner with research scientists to move new model architectures and optimizations into production infrastructure.
- Keep up with academic and open-source work and apply promising ideas to improve performance.
- Talk with customers to understand and clarify their technical needs.
Requirements
What we're looking for
- Software engineering background at companies that build hardware or chip design tools.
- Track record of tuning performance for high-performance computing and machine learning workloads.
- Experience shipping native compiled software that runs in customer environments, in a language such as C, Rust or Go.
- Strong skills in Python and C++/CUDA, plus hands-on use of a common model serving framework such as PyTorch.
- A degree in electrical engineering, computer science or a closely related discipline.
- Comfortable engaging customers directly and representing the company in a professional manner.
Bonus points
- Background building performance-critical engines or algorithms at chip design software vendors.
- Familiarity with C++ performance modeling and simulation libraries.
- Experience with machine learning or heavy numerical workloads running on consumer devices.
- Experience in scientific or numerical computing.
Benefits
Compensation and benefits
- Base salary: USD 180,000 to 350,000 per year
- Equity
- Health, dental and vision coverage
- Retirement plan
- Flexible time off
- Relocation support
Location and work model
- San Jose, California, United States
- On-site, 5 days per week in office
- Full-time
Skills Required
- Software engineering background at companies building hardware or chip design tools
- Experience tuning performance for high-performance computing and machine learning workloads
- Experience shipping native compiled software for customer environments using a language such as C, Rust, or Go
- Strong Python and C++/CUDA skills
- Hands-on experience with a model-serving framework such as PyTorch
- Degree in electrical engineering, computer science, or a closely related discipline
- Comfort engaging customers directly and representing the company professionally
- Experience building performance-critical engines or algorithms at chip design software vendors
- Familiarity with C++ performance modeling and simulation libraries
- Experience with machine learning or heavy numerical workloads on consumer devices
- Experience in scientific or numerical computing
What We Do
Raydar is a talent acquisition and business consulting firm that connects world-class and emerging talent with growing organizations. It supports companies through team development, strategic hiring, and customized growth solutions, helping clients recruit roles such as engineers, product managers, executives, legal counsel, and quantitative traders. Raydar focuses on understanding each organization’s needs, culture, and long-term goals to build high-impact teams.
