At HackerRank, we are on a mission to change the world to value skills over pedigree. We are a high-performing, mission-driven team that truly, madly, deeply cares about what we do. We don’t see velocity and quality as tradeoffs; both matter. If you take pride in high-impact work and thrive in a driven team, HackerRank is where you belong.
Astra is HackerRank’s newest frontier, a data and benchmarking platform powering the next generation of AI coding models. We are transforming HackerRank’s decade of developer expertise into curated datasets, automated benchmarks, and human-in-the-loop evaluation systems that help leading AI labs train and measure their models.
Astra sits at the intersection of software engineering, data infrastructure, and AI research, where you will build the foundation for a product that makes AI better at coding.
Why this role mattersAI models can now write code, but teaching them to code well requires real developer data and rigorous evaluation systems. Astra’s mission is to supply that intelligence to the world’s top labs and enterprises.
As a Software Engineer on Astra, you will:
- Build high-scale data and benchmarking pipelines that turn developer interactions into structured training data.
- Design APIs and systems for code dataset creation, evaluation, and delivery.
- Work closely with ML scientists and data experts to create the tools that fuel reinforcement learning environments and model fine-tuning.
- Contribute to Astra Arena, our next-generation DPO-style evaluation platform for LLMs in software engineering.
- Automated task creation and evaluation systems (expanding SWE-Bench and internal tooling).
- Data APIs that expose curated coding datasets to customers and model labs.
- Annotation and feedback tooling for human-in-the-loop benchmarking.
- Experimental RL "gyms" for code generation models, built on real developer workflows.
- Strong software engineering fundamentals, with full-stack or backend experience.
- Background in distributed systems, data processing, or ML infrastructure.
- Interest in AI, coding models, or human-in-the-loop systems.
- Comfort operating in early-stage environments where ambiguity is common and ownership is broad.
- Bonus: contributions to open-source AI frameworks or developer platforms
- Shape the foundation of a new business that connects AI and developer intelligence
- Collaborate with a tight-knit team of engineers, researchers, and data experts.
- Build technology that powers AI model evaluation and training for top global labs.
- Competitive compensation and meaningful equity in a high-growth business line
*You will help teach AI how to code by building the data and systems that make it possible.
Compensation- Base salary range: $210,000 – $246,000.
- This range doesn’t include bonuses, stock options, or benefits for which you will be eligible.
- Final offer may vary based on skills, experience, location, and other compensation components.
Want to learn more about HackerRank? Check out HackerRank.com to explore our products, solutions and resources, and dive into our story and mission here.
HackerRank is a proud equal employment opportunity and affirmative action employer. We provide equal opportunity to everyone for employment based on individual performance and qualification. We never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines.
Linkedin |X | Blog | Instagram | Life@HackerRank|
Notice to prospective HackerRank job applicants:
- Our Recruiters use @hackerrank.com email addresses.
- We never ask for payment or credit check information to apply, interview, or work here.
Top Skills
What We Do
HackerRank is a technology hiring platform that is the standard for assessing developer skills for over 2600 companies around the world. HackerRank helps companies hire skilled developers and innovate faster by enabling tech recruiters and hiring managers to objectively evaluate talent at every stage of the recruiting process.
