Research Associate - LTI - School of Computer Science

Posted 12 Days Ago
Be an Early Applicant
Pittsburgh, PA
In-Office
Entry level
Edtech
The Role
The Research Associate will develop LLM agents for software engineering tasks, execute machine learning experiments, and collaborate on research methodologies. Responsibilities include engineering reward mechanisms, integrating RL frameworks, and analyzing performance metrics.
Summary Generated by Built In

Carnegie Mellon University is a private, global research university that stands among the world’s most renowned education institutions. With ground-breaking brain science, path-breaking performances, creative start-ups, big data, big ambitions, hands-on learning, and a whole lot of robots, CMU doesn’t imagine the future, we invent it. If you’re passionate about joining a community that challenges the curious to deliver work that matters, your journey starts here!

The Language Technologies Institute (LTI) at CMU is a world-renowned research and education hub at the forefront of natural language processing, machine learning, artificial intelligence, and human-computer interaction. Established within the School of Computer Science, LTI pioneers innovative ways to understanding, processing, and generating human language in both written and spoken forms.

We are seeking a Research Assistant. This position will execute the research project "Training LLMs as SWE Agents using Intermediate Rewards". The primary purpose of this position is to develop and train Large Language Model (LLM) agents to solve software engineering tasks by solving the "cold-start" problem in Reinforcement Learning (RL).

Core Responsibilities:
  • Engineering intermediate reward mechanisms
  • Integrating them into RL frameworks (such as Areal or SkyRL) using the OpenHands agent framework
  • Conducting extensive evaluation on benchmarks like SWE-Bench Verified and SWE-Gym to improve agent training efficiency and performance.
  • Design, implement, and execute machine learning experiments to test research hypotheses.
  • Collect, process, and analyze experimental data to generate accurate performance metrics and visualizations.
  • Collaborate with faculty advisors and research teams to refine methodologies and interpret results.
  • Assist in the preparation of academic papers, technical reports, and presentations for conferences or journals.

Flexibility and cultural sensitivity are valued proficiencies at CMU. Therefore, we are in search of a team member who can optimally get along with a varied population of diverse audiences. We are looking for someone who shares our values and who will support the mission of the university through their work.

Qualifications:
  • Bachelor's Degree in Computer Science, Computer Engineering, AI or a related field.
  • Experience with Python programming and Deep Learning frameworks (PyTorch).
  • Experience with Large Language Models (LLMs) and Reinforcement Learning frameworks such as Areal or SkyRL.
  • Familiarity with coding agentic frameworks (e.g., OpenHands, SWE-Agent) and software engineering benchmarks (e.g., SWE-Bench).
  • A combination of education and substantial experience from which comparable knowledge is proven may be considered.
Requirements:
  • Successful background check investigation may be required

Joining the CMU team opens the door to an array of exceptional benefits.

Benefits eligible employees enjoy a wide array of benefits including comprehensive medical, prescription, dental, and vision insurance as well as a generous retirement savings program with employer contributions. Unlock your potential with tuition benefits, take well-deserved breaks with ample paid time off and observed holidays, and rest easy with life and accidental death and disability insurance. 

Additional perks include a free Pittsburgh Regional Transit bus pass, access to our Family Concierge Team to help navigate childcare needs, fitness center access, and much more!

For a comprehensive overview of the benefits available, explore our Benefits page.

At Carnegie Mellon, we value the whole package when extending offers of employment. Beyond credentials, we evaluate the role and responsibilities, your valuable work experience, and the knowledge gained through education and training. We appreciate your unique skills and the perspective you bring. Your journey with us is about more than just a job; it’s about finding the perfect fit for your professional growth and personal aspirations.

Are you interested in an exciting opportunity with an exceptional organization?! Apply today!

Location

Pittsburgh, PA

Job Function

Researchers

Position Type

Staff – Fixed Term (Fixed Term)

Full Time/Part time

Full time

Pay Basis

Hourly

More Information: 

  • Please visit “Why Carnegie Mellon” to learn more about becoming part of an institution inspiring innovations that change the world. 

  • Click here to view a listing of employee benefits

  • Carnegie Mellon University is an Equal Opportunity Employer/Disability/Veteran

  • Statement of Assurance

Top Skills

Deep Learning
Large Language Models
Openhands
Python
PyTorch
Reinforcement Learning
Swe-Agent
Swe-Bench
Swe-Gym
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Moffett Field, CA
9,172 Employees
Year Founded: 1990

What We Do

Carnegie Mellon University founder Andrew Carnegie said: "My heart is in the work."​

No statement better captures the passion and drive of our people to make a real difference.

At Carnegie Mellon, we're not afraid of the work.

Our educational environment creates problem solvers, drivers of innovation and pioneers in technology and the arts.

Employers in every field say our graduates are ready to hit the ground running the day they graduate.

So, join us. Whether you're looking for a career or an education. Or both.

Similar Jobs

In-Office
Pittsburgh, PA, USA
9172 Employees
Hybrid
6 Locations
205000 Employees

Wells Fargo Logo Wells Fargo

Consultant

Fintech • Financial Services
Hybrid
5 Locations
205000 Employees

Wells Fargo Logo Wells Fargo

Senior Engineering Manager

Fintech • Financial Services
Hybrid
11 Locations
205000 Employees
159K-305K Annually

Similar Companies Hiring

Britebound Thumbnail
Software • Social Impact • Edtech
Boston, MA
100 Employees
ReUp Education Thumbnail
Social Impact • Edtech
Austin, TX
180 Employees
Learneo Thumbnail
Software • Machine Learning • Edtech • Artificial Intelligence
NL
397 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account