We’re on a mission to democratize AI by building the definitive AI data development platform. The AI landscape has gone through incredible change between 2016, when Snorkel started as a research project in the Stanford AI Lab, to the generative AI breakthroughs of today. But one thing has remained constant: the data you use to build AI is the key to achieving differentiation, high performance, and production-ready systems. We work with some of the world’s largest organizations to empower scientists, engineers, financial experts, product creators, journalists, and more to build custom AI with their data faster than ever before. Excited to help us redefine how AI is built? Apply to be the newest Snorkeler!
Company Overview
Snorkel is at the forefront of AI development, building high-quality datasets that leverage the strengths of Large Language Models (LLMs) in language understanding and data processing. While LLMs have excelled in tasks like language generation and pattern recognition, advancing their reasoning capabilities is the next frontier. Our goal is to push the boundaries of AI by designing and scaling datasets that will shape new AI technologies focused on complex reasoning tasks across domains such as Math, Physics, Economics, and Biology.
This is an opportunity to contribute directly to the advancement of AI by developing challenging reasoning tasks and datasets that will transform LLMs into more sophisticated reasoning systems.
Role Overview
As an Expert Contributor (EC), you will play a pivotal role in creating, curating, and reviewing reasoning tasks for a groundbreaking AI benchmark. You'll help bridge the gap between what LLMs excel at now and the advanced reasoning capabilities we aim to achieve. Contributors will collaborate within a cohort environment, engaging in live learning sessions and leveraging shared incentives tied to achieving project milestones.
This role is ideal for individuals with expertise in STEM or reasoning-based fields who are detail-oriented, self-motivated, and eager to shape the future of AI reasoning.
Key Responsibilities
Tasks will include, but are not limited to:
- Reasoning Dataset Development:
- Generate challenging questions in domains such as Math, Physics, Chemistry, Economics, and common sense reasoning.
- Design datasets that test reasoning skills like deductive reasoning, causal reasoning, and pattern recognition.
- Collaboration in Cohort Environment:
- Participate in live learning sessions and peer discussions to enhance dataset quality and resolve challenges.
- Contribute to group efforts to meet project milestones and achieve shared rewards.
Workshops
While workshops are certainly not mandatory, we highly recommend that you attend them. Workshops are meant to encourage collaboration and exploration as to how to best think about the structure and makeup of a good stumper. These scheduled live sessions are a great opportunity to ask questions and receive feedback. We also have a community Slack channel. There you will find our daily newsletter with announcements and tips, fellow successful contributors.
Incentives
Accepted Submittal:
- Earn $150 per accepted AI Stumper (must pass internal evaluation)
- Daily Cap: 5 AI Stumpers (up to $750 daily)
- Contributors who consistently meet standards may qualify for an increased cap
- If you are struggling with your first few AI stumpers, then please join a workshop
Contributors who demonstrate strong accountability and quality can be invited to participate in this valuable work:
- Template-to-Stumper: Use a template of an AI stumper and inject context into it and see if you can more efficiently get an AI stumper
- Quality Control: Review other people’s AI stumpers that have passed evaluation
Qualifications
- Completed Master’s Degree or Doctorate in a STEM fields such as Math, Physics, Chemistry, Economics, or Computer Science required
- Strong analytical and reasoning skills, with the ability to create or solve complex reasoning tasks
- Ability to adhere to a predictable daily schedule and collaborate effectively within a cohort environment
- Previous experience in data annotation, question generation, or educational content creation is a plus!
Commitment Expectations for ECs
- Commitment: Contributors must adhere to a consistent daily schedule, with 20-30 hours per week over the duration of the project. Tasks require focus, consistency, and the ability to build on prior work
- Collaboration: Active participation in the cohort environment, including live learning sessions and group discussions, to collectively achieve milestones
- Accountability: Maintain clear communication through designated channels and contribute to a professional and supportive team environment
If you’re passionate about advancing AI, apply now and complete Founding Contributors - AI Reasoning to streamline the recruitment process.
Why Join Us?
You want to contribute to a groundbreaking open-source benchmark advancing AI frontiers and the chance to tackle rewarding challenges in a collaborative environment. You'll gain recognition for shaping the future of AI reasoning.
Join the Snorkel AI Team
At Snorkel AI, we’re on a mission to make machine learning practical and accessible for everyone. Achieving this starts with building a diverse, inclusive team that reflects and empowers underrepresented communities to shape the future of AI and software engineering. We work at the cutting edge of AI and software development, fostering an environment that values end-to-end ownership, diverse contributions, and personal growth opportunities.
Supporting Our Snorkelers
We provide our team members with robust support and comprehensive benefits. For full-time employees, this includes:
- Comprehensive medical, dental, and vision plans for employees and their families.
- A yearly wellness stipend to promote healthy lifestyles.
- A 401(k) program to help plan for your future.
- Up to 20 weeks of paid parental leave for new parents.
- A workstation setup allowance to create a comfortable and productive work environment.
Explore these benefits and more on our Careers page.
Our Commitment to Inclusion and Opportunity
Snorkel AI is an Equal Employment Opportunity employer dedicated to building a team from diverse backgrounds, perspectives, and skills. We do not tolerate discrimination or harassment of any kind based on race, color, religion, age, sex, national origin, disability, genetics, veteran status, sexual orientation, gender identity, or any other characteristic protected by law. Employment decisions are based solely on qualifications, performance, merit, and business needs.
We are also committed to supporting individuals with disabilities. If you need reasonable accommodations during the application or interview process, or to perform essential job functions, please contact us.
Join us in shaping the future of AI—where everyone has the opportunity to contribute and grow.
Be Your Best At Snorkel
Snorkel AI is on a mission to make machine learning practical for everyone, and it starts with building a team that welcomes, represents and gives opportunity to all. We work at the frontier of AI and software engineering, and believe that underrepresented communities need to play a part in shaping the future of these fields. At Snorkel AI, we actively work to create an environment that values end-to-end ownership, diverse forms of impact, and opportunities for personal growth.
Snorkelers are supported by an amazing team and an amazing set of benefits. For Full-time employees, we offer comprehensive medical, dental, and vision plans for Snorkelers and their families, plus a yearly wellness stipend. Our 401k program lets Snorkelers plan for their future and our parental leave program lets new parents take up to 20 weeks of paid time off. Learn more about these benefits and more — like our workstation setup allowance — on our Careers page.
Snorkel AI is proud to be an Equal Employment Opportunity employer and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. Snorkel AI embraces diversity and provides equal employment opportunities to all employees and applicants for employment. Snorkel AI prohibits discrimination and harassment of any type on the basis of race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local law. All employment is decided on the basis of qualifications, performance, merit, and business need.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
What We Do
Our mission is to empower everyone to solve their most impactful problems through data-centric AI. To do this, we have introduced Snorkel Flow, a data-centric AI platform, and are building an incredibly talented team. We empower Fortune 500 enterprises such as Chubb and BNY Mellon, and several government agencies to accelerate AI application development by 10-100x.
Why Work With Us
The founding team spent over half a decade researching programmatic labeling, weak supervision, and other techniques to break through one of the biggest bottlenecks in AI: the lack of labeled training data. This research has resulted in Snorkel research project and 60+ peer-reviewed publications. Snorkel has developed and deployed its technology