Please Note:
To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period.
Advancing the World’s Technology Together
Our technology solutions power the tools you use every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more. Here, you’ll have an opportunity to be part of a global leader whose innovative designs are pushing the boundaries of what’s possible and powering the future.
We believe innovation and growth are driven by an inclusive culture and a diverse workforce. We’re dedicated to empowering people to be their true selves. Together, we’re building a better tomorrow for our employees, customers, partners, and communities.
What You’ll Learn
- Project Overview: System architecture for the memory centric system to optimize performance for large language models.
- Skills You’ll Learn:
- Inference for large language models
- Memory Centric AI System Design
- Performance modeling for LLM workloads
What You’ll Do
The Architecture Research Lab (ARL) is tackling two of the biggest challenges in AI today—memory bandwidth and communication bottlenecks. By leveraging Samsung’s world-leading memory technologies, we are developing next-generation AI systems that break through these limitations while improving developer productivity.
This summer internship aims to research various parallel algorithms for AI inference models. This position will contribute to the project's overall architecture and design for highly efficient large scale AI inference rack systems for LLM workloads.
Location: Daily onsite presence at our San Jose, CA headquarters in alignment with our Flexible Work policy
Reports to: Sr. Principal Engineer, HPC HW Architect
Req ID: 42712
- Research various parallel algorithms in LLM inference system with focuses on DP, TP, EP and PP and evaluate the performance impact on AI inference in distributed systems with CPU/GPU/Accelerators
- Analyzing the system components and guiding the selection in the area of the compute, memory and network topologies; analyze bottlenecks and come up with innovative solutions
- Conducting the performance analyzing and modeling work, to run design space exploration and system-level optimization.
- Complete other responsibilities as assigned.
What You Bring
- PhD student currently pursuing degree, 3+ years in Computer Science preferred
- Must have at least 1 academic quarter/semester remaining
- Required knowledge: LLM models, performance benchmarking
- Knowledge and experience in AI system design, performance analysis and modeling
- Required skillsets: PyTorch, Python/C++
- You’re inclusive, adapting your style to the situation and diverse global norms of our people.
- An avid learner, you approach challenges with curiosity and resilience, seeking data to help build understanding.
- You’re collaborative, building relationships, humbly offering support and openly welcoming approaches.
- Innovative and creative, you proactively explore new ideas and adapt quickly to change.
#LI-AD1
What We Offer
The pay range below is for all roles at this level across all US locations and functions. Individual pay rates depend on a number of factors—including the role’s function and location, as well as the individual’s knowledge, skills, experience, education, and training.
This is in addition to our diverse package of benefits centered around the wellbeing of our employees and their loved ones. In addition to the usual Medical/Dental/Vision, our inclusive rewards plan empowers our people to care for their whole selves. An investment in your future is an investment in ours.
Relocation Support Live 50+ miles away from your new office? No worries! We'll provide a stipend to help support your move.
Housing Stipend Signing a lease on a new place for your summer internship? We'll help you pay your way with a monthly stipend.
Give Back With a charitable giving match and frequent opportunities to get involved, we take an active role in supporting the community.
Prioritize Emotional Wellness With on-demand apps and paid therapy sessions, you’ll have support no matter where you are.
Stay Fit Eating well and being active are important parts of a healthy life. Our onsite Café and gym, plus virtual classes, make it easier.
Embrace Flexibility Benefits are best when you have the space to use them. That’s why we facilitate a flexible environment so you can find the right balance for you.
Equal Opportunity Employment Policy
Samsung Semiconductor takes pride in being an equal opportunity workplace dedicated to fostering an environment where all individuals feel valued and empowered to excel, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status.
When selecting team members, we prioritize talent and qualities such as humility, kindness, and dedication. We extend comprehensive accommodations throughout our recruiting processes for candidates with disabilities, long-term conditions, neurodivergent individuals, or those requiring pregnancy-related support. All candidates scheduled for an interview will receive guidance on requesting accommodations.
Recruiting Agency Policy
We do not accept unsolicited resumes. Only authorized recruitment agencies that have a current and valid agreement with Samsung Semiconductor, Inc. are permitted to submit resumes for any job openings.
Applicant AI Use Policy
At Samsung Semiconductor, we support innovation and technology. However, to ensure a fair and authentic assessment, we prohibit the use of generative AI tools to misrepresent a candidate's true skills and qualifications. Permitted uses are limited to basic preparation, grammar, and research, but all submitted content and interview responses must reflect the candidate’s genuine abilities and experience. Violation of this policy may result in immediate disqualification from the hiring process.
Applicant Privacy Policy
https://semiconductor.samsung.com/about-us/careers/us/privacy/
Similar Jobs
.png)
What We Do
Established in 1974 as a subsidiary of Samsung Electronics, we’re proud to be recognized as one of the leading chip manufacturers in the world.
Using our knowledge in semiconductor technology, our ambition is to spark the imagination of device manufacturers with top-of-the-line building blocks and, through that, enrich the lives of people around the world with transformative solutions.
