Principal Engineer, MLE, SMAI

Our vision is to transform how the world uses information to enrich life for all .
Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.
The Smart Manufacturing and AI team at Micron Technology builds advanced machine learning, GenAI, and agentic AI solutions that directly impact how memory is designed and manufactured. We work at the intersection of AI, data, and high-performance computing to solve complex, real-world problems at scale. If you're excited by pushing AI into production where it truly matters, this is the place to do it!
As a Principal Machine Learning Engineer, you will play a critical role in designing and deploying scalable AI systems that power Micron's manufacturing operations. This role combines deep technical expertise with hands-on work. It involves partnering closely with data scientists, data engineers, and domain experts to turn new AI into measurable business impact.
Responsibilities include, but not limited to:

• Architect and complete large-scale custom model training and fine-tuning jobs (SFT, RLHF) on multi-node, multi-GPU clusters.
• Optimize training throughput and memory efficiency using distributed training strategies (FSDP, DeepSpeed, Megatron-LM) and mixed-precision techniques (FP16/BF16).
• Design and develop autonomous AI Agents capable of multi-step reasoning, planning, and tool execution to automate complex manufacturing workflows.
• Implement Agentic frameworks (e.g., LangChain, LangGraph, CrewAI) to orchestrate LLM interactions with internal APIs, databases, and software tools.
• Profile and debug GPU performance bottlenecks using tools like Nsight Systems or PyTorch Profiler to improve hardware utilization.
• Build and maintain data/solution pipelines that feed machine learning models and GenAI applications.
• Design and optimize data structures in data management systems (Snowflake, and Google Cloud platforms) to enable AI/ML and Agentic solutions.
• Create/Maintain CI/CD pipelines of machine learning and AI Agent solutions in the cloud.

Minimum Qualifications:

• Deep understanding of GPU architecture (memory hierarchy, tensor cores, interconnects like NVLink) and experience managing GPU resources in both cloud environments and on-prem.
• Hands-on experience with Distributed Data Parallel (DDP), Fully Sharded Data Parallel (FSDP), and model parallelism techniques.
• Proficiency in fine-tuning Large Language Models using PEFT techniques (LoRA, QLoRA) and optimizing inference engines (vLLM, TensorRT-LLM).
• Experience developing GenAI applications and AI Agents using frameworks like LangChain, LangGraph, LlamaIndex, or AutoGen.
• Proficiency with Large Language Models (LLMs), including prompt engineering, function calling/tool use, and Chain-of-Thought (CoT) reasoning.
• Experience in building and driving end-to-end ML systems automating training, testing and deploying Machine Learning models.
• Familiarity with machine learning frameworks (PyTorch is required, TensorFlow, scikit-learn, etc.).
• Software development skills and the desire to work on innovative development in a Cloud environment.
• Strong scripting and programming skills in one of the following, Python or Java (Python preferred).
• Experience with continuous integration/continuous delivery (CI/CD) tools (Jenkins, Git, Docker, Kubernetes).
• 9+ years building scalable ETL pipelines.
• proven experience with large-scale data processing and/or developing applications and data sources.
• Outstanding analytical thinking, interpersonal, oral and written communication skills.
• Ability to prioritize and meet critical project timelines in a fast-paced environment.
• Bacehlors degree in Computer Science or Statistics background, or equivalent experience.

Preferred:

• Experience with HPC job schedulers (e.g., Slurm) or orchestrating GPU workloads on Kubernetes (Ray, KubeFlow).
• Knowledge of lower-level optimization (CUDA programming, Triton kernels, or custom C++ extensions for PyTorch).
• Experience with Multi-Agent Systems and orchestrating collaboration between specialized agents.
• Deep knowledge of math, probability, statistics and algorithms.
• Demonstrated ability to study and transform data science prototypes into production solutions.
• Knowledge of computer vision and/or signal processing including techniques for classification and feature extraction.
• Master's degree or equivalent experience in a field related to Computer Science or Statistics.

As a world leader in the semiconductor industry, Micron is dedicated to your personal wellbeing and professional growth. Micron benefits are designed to help you stay well, provide peace of mind and help you prepare for the future. We offer a choice of medical, dental and vision plans in all locations enabling team members to select the plans that best meet their family healthcare needs and budget. Micron also provides benefit programs that help protect your income if you are unable to work due to illness or injury, and paid family leave. Additionally, Micron benefits include a robust paid time-off program and paid holidays. For additional information regarding the Benefit programs available, please see the Benefits Guide posted on micron.com/careers/benefits .
Micron is proud to be an equal opportunity workplace and is an affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, citizenship status, disability, protected veteran status, gender identity or any other factor protected by applicable federal, state, or local laws.
To learn about your right to work click here.
To learn more about Micron, please visit micron.com/careers
For US Sites Only: To request assistance with the application process and/or for reasonable accommodations, please contact Micron's People Organization at [email protected] or 1-800-336-8918 (select option #3)
Micron Prohibits the use of child labor and complies with all applicable laws, rules, regulations, and other international and industry labor standards.
Micron does not charge candidates any recruitment fees or unlawfully collect any other payment from candidates as consideration for their employment with Micron.
AI alert: Candidates are encouraged to use AI tools to enhance their resume and/or application materials. However, all information provided must be accurate and reflect the candidate's true skills and experiences. Misuse of AI to fabricate or misrepresent qualifications will result in immediate disqualification.
Fraud alert: Micron advises job seekers to be cautious of unsolicited job offers and to verify the authenticity of any communication claiming to be from Micron by checking the official Micron careers website in the About Micron Technology, Inc.