Jobs at Idler

Lead cybersecurity evaluation and environment development, including roadmap planning, production coding, security research, expert reviewer management, and collaboration with frontier AI labs. The role requires deep offensive security expertise, strong community connections, and the ability to assess vulnerabilities, fairness, and task quality while helping sell cybersecurity environments to research organizations.

Support three co-founders and a small team by managing travel, events, visitor and candidate logistics, office supplies, vendors, expenses, and onboarding preparation. The role requires hospitality, discretion, strong organization, budget and vendor management, clear writing, meticulous follow-through, and creating repeatable systems for administrative processes. This is an in-person position in San Francisco with occasional evening events.

As a Special Projects Operator, you'll manage multi-million-dollar projects, orchestrate a network of contributors, and optimize operational workflows while ensuring exceptional execution and quality standards.

Own the measurement and improvement of model learning from tasks. Collaborate with frontier labs to design post-training recipes and data-quality techniques, run in-house evaluation systems, develop datasets and data products, assess acquired data, and build scalable ingestion and evaluation systems. The role requires production reinforcement learning experience at a frontier lab and end-to-end LLM post-training expertise.

Own the user experience for customer and internal applications, creating intuitive interfaces for inspecting and interacting with reinforcement learning environments. Build reusable UI, layout, UX, and marketing design systems; develop performant full-stack applications; and instrument and visualize environment tracking across many steps and iterations. The role requires strong product thinking, design taste, engineering precision, user testing, and rapid iteration.

Own the end-to-end process of transforming partner workflows into evaluation datasets and reinforcement learning environments. Work directly with AI researchers, executives, and organizational leaders to identify capability gaps, manage technical and relationship lifecycles, shape the product roadmap, and build reusable infrastructure that improves partner onboarding. The role requires strong engineering, communication, systems thinking, judgment, ownership, and comfort in an ambiguous, high-intensity environment.

Build features for reinforcement learning environments, design UI and backend services, automate testing, and iterate features based on AI feedback.