At d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration.
We value humility and believe in direct communication. Our team is inclusive, and our differing perspectives allow for better solutions. We are seeking individuals passionate about tackling challenges and are driven by execution. Ready to come find your playground? Together, we can help shape the endless possibilities of AI.
Location:
Hybrid, working on-site at our Santa Clara, CA, headquarters 3-5 days per week.
The Role: Principal Engineer/Technical Director, Distributed Systems
What You Will Do:
The Principal Engineer/Director role requires you to be part of the team that helps productize the SW stack for our AI compute engine. As part of the software team, you will lead the development, enhancement, and maintenance of the distributed systems software stack for scale-out of the next generation AI hardware. The d-Matrix software stack consists of runtime and lowering software. The runtime software consists of host drivers, inference serving engines, and embedded chip software that support execution of large language models across single cards, multiple cards on a node, and multiple nodes on and across racks in a data center. The distributed systems team builds software to enable scale-out. This includes support for data plane operations such as protocol translation hardware NICs, as well as control and management plane operations such as telemetry, monitoring, microservices, container orchestration, and datacenter network tooling.
You possess experience building large-scale systems for novel HW architectures. You possess a very strong understanding of scale-out and data communication collectives. You also have experience in
You have had past experience working across all aspects of a full-stack toolchain for an accelerator and understand the nuances of what it takes to optimize and trade off various aspects of hardware-software co-design. You are able to build and scale software deliverables in a tight development window. This role requires collaborating with the HW and SW architecture team, the compiler team, the data science numerics team, the SW test group, the benchmark group, and the teams developing the various simulator and emulation platforms.
What You Will Bring:
BS Computer Science, Engineering, Math, Physics or related degree / MS Preferred The Role: Principal Engineer/Technical Director, Distributed Systems
Strong grasp of computer architecture, data structures, system software, and machine learning fundamentals
Leadership experience at manager or senior manager level with software for AI accelerator HW
Proficient in C/C++ and Python development in Linux environment and using standard development tools
Experience designing and implementing algorithms in high-level languages such as C/C++ and Python
Experience with host bring-up of specialized hardware such as NICs, network FPGAs, and smart NICs
Experience with distributed systems software such as message passing and MPI
Experience with designing and integrating systems for reliability, high availability, fault tolerance, and failover
Experience with cluster orchestration, including defining containers and integration with Kubernetes
Experience with performance benchmarking and tuning of large-scale distributed systems
Self-motivated team player with a strong sense of ownership and leadership
Desired:
Prior startup, small team or incubation experience
Experience scaling up large-scale machine learning systems, specifically large language models, using expert parallelism and data parallelism
Work experience at a cloud provider or AI compute/subsystem company
Equal Opportunity Employment Policy
d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication and a willingness to embrace challenges and learn together every day.
d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individual interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of al applicants. Thank you for your understanding and cooperation.
Top Skills
What We Do
d-Matrix is building a new way of doing datacenter AI inferencing using in-memory computing (IMC) techniques with chiplet level scale-out interconnects. Founded in 2019, d-Matrix has attacked the physics of memory-compute integration using innovative circuit techniques, ML tools, software and algorithms; solving the memory-compute integration problem, which is the final frontier in AI compute efficiency.
