Staff Software Engineer/ Engineering Manager - LLM Product

About the Role

We are seeking a seasoned Staff Software Engg/Engineering Manager to drive our LLM Products and assume a key technical leadership role in our engineering organization. This role goes beyond delivering medium-sized projects to influencing the technical vision and architecture for large-scale, cross-functional initiatives. You will take ownership of critical engineering challenges, lead the development of advanced tooling solutions, and mentor senior engineers to elevate team performance.

In this role, you will contribute to the design and delivery of scalable systems that support our data collection platforms, human operations, and research initiatives. You will act as a technical visionary, working closely with engineering leadership to establish best practices and long-term strategies for our most critical projects.

Responsibilities

1. Drive Strategic Initiatives: Own end-to-end delivery of large, complex projects, including technical design, implementation, and production rollout.
2. Define Technical Vision: Establish scalable system architectures and frameworks for AI tooling and data collection pipelines.
3. Lead by Example: Act as a technical leader, setting high standards for code quality, scalability, and security while fostering a culture of excellence.
4. Mentor and Develop Talent: Guide and support engineers at all levels, enabling them to grow technically and contribute effectively to the team’s goals.
5. Innovate in Data Generation: Design advanced human and synthetic data generation pipelines to meet cutting-edge industry needs.
6. Understand Frontier Model Needs: Align data tooling solutions with the requirements of state-of-the-art models, including training, evaluation, and deployment.
7. Collaborate with Stakeholders: Engage with product users, cross-functional teams, and leadership to gather feedback, prioritize features, and iterate rapidly.

Exceptional Candidates May Have:

1. Demonstrated leadership in delivering large-scale, high-impact engineering projects (e.g., as a principal engineer or similar role).
2. Extensive experience in cross-functional collaboration, particularly with product, research, and operations teams.
3. Expertise in fine-tuning and deploying large language models (LLMs), linking model behavior to data quality.
4. Strong ability to navigate the balance between rapid iteration and robust systems design.

Required Skills

1. Prototyping Expertise: Comfortable building MVPs rapidly and iterating with user feedback to refine solutions.
2. Tech Stack:
1. Languages: Expert proficiency in TypeScript and Python.
2. Frameworks: Deep experience with React and back-end frameworks like Node.js (e.g., Nest.js).
3. Databases: Strong hands-on experience with PostgreSQL or similar relational databases.
3. LLM Expertise:
1. Proficient in prompt engineering and Retrieval-Augmented Generation (RAG).
2. Skilled in Supervised Fine-Tuning (SFT) and Reinforcement Learning with Human Feedback (RLHF).
4. Scalable System Design: Proven ability to build robust, scalable, secure systems optimized for performance.