Systems Software Engineer

Posted Yesterday
Be an Early Applicant
Richardson, TX, USA
In-Office
Expert/Leader
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Your talent powers our future.
The Role
Architects and develops systems software for emerging memory and storage technologies, with emphasis on AI inference stacks and heterogeneous computing. Responsibilities include Linux application and library development, emulator creation, system-level debugging, accelerator programming, performance evaluation, technical leadership, cross-functional collaboration, mentoring, and presenting technical findings. The role requires expertise across AI frameworks, inference engines, operating systems, kernels, hardware interfaces, memory hierarchies, and distributed serving systems.
Summary Generated by Built In
Our vision is to transform how the world uses information to enrich life for all .
Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.
As a Principal Systems Software Engineer in the Storage and Memory Systems (SMS) group within Micron's ITP Pathfinding organization, you will architect, design, and develop software that enables and demonstrates the value of future memory and storage technologies. You will work in a small, highly skilled engineering team, collaborating closely with AI/ML application and modeling specialists, software engineers, hardware engineers, and system architects. Your pathfinding work will accelerate the development of future products and influence technical direction. This role requires broad technical expertise and a willingness to contribute across multiple layers of AI and systems software stacks, from AI applications to hardware/software interfaces.
Responsibilities
  • Design and modify AI inference software stacks to enable proof-of-concept hardware capabilities.
  • Develop software to quantify and demonstrate the value of proposed system features.
  • Lead software architecture and development efforts, both independently and as a technical lead for small teams.
  • Research emerging AI software topics to identify memory and storage system challenges and opportunities.
  • Develop and modify Linux applications and libraries using C, C++, Python, Rust, CUDA, and/or SYCL for advanced heterogeneous computing systems.
  • Develop and use emulators to predict system-level performance and functional impacts in advance of hardware availability.
  • Debug system-level issues spanning applications, libraries, operating systems, kernels, system configuration, networks, and hardware/software interfaces.
  • Use emerging AI tools to improve productivity.
  • Collaborate across Micron organizations and with external partners.
  • Mentor interns and earlier-career engineers.
  • Present technical findings, insights, and innovations to internal or external customers.

Minimum Qualifications
  • Bachelor's or Master's degree with 10+ years of experience, or a PhD with 7+ years of experience, in Computer Science, Software Engineering, Computer Engineering, or a related field.
  • Working knowledge of end-to-end AI inference software stack architectures, with hands-on development experience in multiple layers, such as frameworks, inference engines, ML compilers, compiler infrastructure, hardware runtimes, or hardware abstraction layers.
  • Experience debugging issues spanning applications, libraries, operating systems, kernels, networks, and hardware/software interfaces.
  • Proficient development skills in C, C++ and Python, with Linux-specific programming experience such as multithreading, IPC, ioctl, GDB, and the /proc and /sys filesystems.
  • Experience programming GPUs or other accelerators using CUDA, SYCL, OpenCL, or a comparable programming model.
  • Demonstrated ability to lead technical initiatives without supervisory authority.
  • Familiarity with LLM serving internals, including KV-cache management, prefill and decode phases, KV-cache offloading, and disaggregated serving.
  • Familiarity with inference engines and distributed serving frameworks such as SGLang, vLLM, NVIDIA Dynamo, or TensorRT-LLM.
  • Strong understanding of heterogeneous compute architecture concepts, including memory hierarchies, NUMA, caching, accelerator architectures, and interconnects such as PCIe, CXL, NVLink, or UALink.

Preferred Qualifications
  • Technical leadership experience in a systems-focused pathfinding or research organization.
  • Technical knowledge of HBM, DRAM, and emerging memory technologies.
  • Technical knowledge of NVMe SSDs, NAND, and next-generation storage systems.

As a world leader in the semiconductor industry, Micron is dedicated to your personal wellbeing and professional growth. Micron benefits are designed to help you stay well, provide peace of mind and help you prepare for the future. We offer a choice of medical, dental and vision plans in all locations enabling team members to select the plans that best meet their family healthcare needs and budget. Micron also provides benefit programs that help protect your income if you are unable to work due to illness or injury, and paid family leave. Additionally, Micron benefits include a robust paid time-off program and paid holidays. For additional information regarding the Benefit programs available, please see the Benefits Guide posted on micron.com/careers/benefits .
Micron is proud to be an equal opportunity workplace and is an affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, citizenship status, disability, protected veteran status, gender identity or any other factor protected by applicable federal, state, or local laws.
To learn about your right to work click here.
To learn more about Micron, please visit micron.com/careers
For US Sites Only: To request assistance with the application process and/or for reasonable accommodations, please contact Micron's People Organization at [email protected] or 1-800-336-8918 (select option #3)
Micron Prohibits the use of child labor and complies with all applicable laws, rules, regulations, and other international and industry labor standards.
Micron does not charge candidates any recruitment fees or unlawfully collect any other payment from candidates as consideration for their employment with Micron.
AI alert: Candidates are encouraged to use AI tools to enhance their resume and/or application materials. However, all information provided must be accurate and reflect the candidate's true skills and experiences. Misuse of AI to fabricate or misrepresent qualifications will result in immediate disqualification.
Fraud alert: Micron advises job seekers to be cautious of unsolicited job offers and to verify the authenticity of any communication claiming to be from Micron by checking the official Micron careers website in the About Micron Technology, Inc.

Skills Required

  • Bachelor's or Master's degree with 10+ years of experience, or PhD with 7+ years of experience, in Computer Science, Software Engineering, Computer Engineering, or a related field.
  • Working knowledge of end-to-end AI inference software stack architectures and hands-on development across multiple layers.
  • Experience debugging applications, libraries, operating systems, kernels, networks, and hardware/software interfaces.
  • Proficiency in C, C++, and Python, with Linux-specific programming experience including multithreading, IPC, ioctl, GDB, /proc, and /sys.
  • Experience programming GPUs or other accelerators using CUDA, SYCL, OpenCL, or comparable programming models.
  • Ability to lead technical initiatives without supervisory authority.
  • Familiarity with LLM serving internals, including KV-cache management, prefill and decode phases, KV-cache offloading, and disaggregated serving.
  • Familiarity with SGLang, vLLM, NVIDIA Dynamo, TensorRT-LLM, or comparable inference and distributed serving frameworks.
  • Strong understanding of heterogeneous compute architectures, memory hierarchies, NUMA, caching, accelerator architectures, and interconnects such as PCIe, CXL, NVLink, or UALink.
  • Technical leadership experience in a systems-focused pathfinding or research organization.
  • Technical knowledge of HBM, DRAM, and emerging memory technologies.
  • Technical knowledge of NVMe SSDs, NAND, and next-generation storage systems.

Micron Technology Compensation & Benefits Highlights

  • Healthcare Strength — Health insurance is portrayed as comprehensive, with medical, dental, vision, prescription coverage and access to on-site or near-site health centers at many locations. Feedback suggests employees regard the coverage as very good overall.
  • Retirement Support — The 401(k) program is considered strong, with company materials citing a 5% match and multiple contribution options. Feedback suggests this match is frequently highlighted as a standout benefit.
  • Equity Value & Accessibility — Equity participation is accessible through a 15%‑discount ESPP, with RSUs offered in eligible roles. Feedback suggests these stock programs add meaningful value to total compensation.

Micron Technology Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Boise, ID
45,000 Employees
Year Founded: 1978

What We Do

We are a world leader in innovative memory solutions that transform how the world uses information to enrich life for all. For over 45 years, our company has been instrumental to the world’s most significant technology advancements, delivering optimal memory and storage systems for a broad range of applications.

Why Work With Us

Global opportunities, team member development, and career advancement—Micron invests in you and celebrates your skills, a growth mindset, and the tenacity to strive. At Micron, everyone innovates.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery

Micron Technology Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Micron recognizes the importance of maintaining a healthy work-life balance to foster a culture of collaboration, innovation and meet the needs of the business. In alignment with these values, we offer four flexible work arrangement options

Typical time on-site: Flexible
HQBoise, ID
Bengaluru, Karnataka
Folsom, CA
Hyderabad, Telangana
Longmont, CO
Madhapur, Telangana
Manassas, VA
Milpitas, CA
Singapore, SG
Singapore, SG
Sydney, AU
Ulsoor, Bengaluru
Learn more

Similar Jobs

Micron Technology Logo Micron Technology

SoC Static Timing Analysis (STA) Engineer, HBM

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
2 Locations
45000 Employees
198K-337K Annually

Micron Technology Logo Micron Technology

Principal Signal Integrity Engineer, Pathfinding

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
4 Locations
45000 Employees
119K-320K Annually

Micron Technology Logo Micron Technology

CAD Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
Richardson, TX, USA
45000 Employees

Micron Technology Logo Micron Technology

Sr Design Enablement, CAD

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
Richardson, TX, USA
45000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account