Data Annotation Reviewer (QA) — Egocentric Video

Posted 6 Days Ago
Be an Early Applicant
Manila, Metro Manila, National Capital Region, PHL
In-Office
Entry level
Software
The Role
Review auto-generated annotations for egocentric video datasets, judge segments against detailed guidelines, correct or reject language labels, action segmentation, and hand-pose tracking, and flag privacy or quality issues. Maintain high accuracy and throughput, align with calibration sets, and ensure audited batches meet client standards.
Summary Generated by Built In

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this market has been heavily underserved by technology and deserves better. Workstream has been purpose-built for the hourly workforce from day one so that these businesses and their employees can thrive.

Our customers include leading brands from multiple sectors, including Burger King, Carl's Jr./Hardee's, IHOP, KFC, and Culvers. We are a high growth series B company and quickly expanding our product portfolio to deliver on our vision. We are backed by legendary VCs and industry experts like Founders Fund, BOND, and Coatue.

In addition to our core business, Workstream is home to a small, fast-moving Robotics team focused on advancing the next generation of artificial intelligence and robotics. We partner with a leading AI and robotics company to produce high-quality, large-scale egocentric (first-person) video datasets that help train advanced AI models.

Our Robotics team develops scalable data collection and annotation pipelines that enable the efficient creation of high-quality training datasets, helping AI systems better understand human actions, environments, and everyday interactions. We're also building a new category of connected hardware designed to operate reliably throughout the day in thousands of homes and businesses. By combining cutting-edge data collection, automation, and hardware innovation, this team is helping shape the future of intelligent systems and real-world AI applications.

Grow With Us

We produce high-quality training data for a leading AI/robotics client building a large-scale egocentric (first-person) video dataset. Our pipeline auto-generates annotations at scale; your job is to review the segments flagged as potentially inaccurate, judge them against the client's guidelines, and correct or reject them so only clean data is delivered.

This is precision quality-assurance work under a strict standard — audited batches must pass at a high accuracy threshold, and low-scoring batches are rejected outright. Your judgment directly affects whether our deliveries get accepted.

Day In The Life

You will review:

  • Language annotations — check that written descriptions and action labels accurately, clearly, and consistently describe what's happening in each video, following detailed labeling guidelines.
  • Action segmentation & timing — verify that videos are broken into correctly timed, non-overlapping action segments.
  • Hand-pose tracking — sanity-check machine-generated hand and motion tracking, flagging errors and implausible results.
  • Compliance — flag privacy issues (e.g. faces or personal information) and any content that doesn't meet collection quality or content standards.
Quality standards
  • Contribute to a high, continuously audited accuracy target — consistency matters as much as speed, since weak batches can be rejected as a whole.
  • Maintain alignment with other reviewers on shared calibration sets.
  • Meet the throughput target

Who You Are

  • At least one year experience as a Data Annotation Reviewer
  • Excellent written and reading English comprehension — you must accurately apply detailed, nuanced guidelines. This is the single most important requirement.
  • Sharp attention to detail and the stamina for focused, cognitively demanding review.
  • Consistent, well-reasoned judgment on ambiguous, edge-case segments.
  • Reliable high-speed internet and a device capable of smooth video playback.
  • Comfort in a remote, target-driven environment with regular calibration checks.

Nice to have

  • Prior data annotation, labeling, QA, or content-review experience.
  • Familiarity with video annotation / labeling tools.
  • Exposure to computer vision, robotics, or hand/gesture tracking concepts.

Know More About Workstream

  • https://www.workstream.us/blog/funding-series-b
  • https://techcrunch.com/2021/08/26/workstreams-text-based-recruitment-tool-gets-a-48m-bet-from-bond-and-beyond/
  • https://techbuzz.news/buzzworthy-august-27-2021/

Additional Information 

Workstream provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training. 

We are committed to the full inclusion of all qualified individuals.

Skills Required

  • Excellent written and reading English comprehension
  • Sharp attention to detail and stamina for focused review
  • Consistent, well-reasoned judgment on ambiguous, edge-case segments
  • Reliable high-speed internet and a device capable of smooth video playback
  • Comfort in a remote, target-driven environment with regular calibration checks
  • Ability to meet throughput targets and maintain high audited accuracy
  • Prior data annotation, labeling, QA, or content-review experience
  • Familiarity with video annotation / labeling tools
  • Exposure to computer vision, robotics, or hand/gesture tracking concepts
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
238 Employees
Year Founded: 2017

What We Do

Workstream (www.workstream.us) is a text recruiting and hiring tool for local businesses, especially restaurants. We help you to hire faster with texting / SMS, cutting in half the time to engage, hire and onboard hourly workers. We save companies 30+ hours every week by making your hiring process streamlined, automated and finding you the right talent when you need it. We have helped business owners and operators from Jamba, Chick-fil-A, McDonald's, Dunkin', Applebee's, Auntie Anne's, Cinnabon and more to increase efficiency by over 150%, increasing their bottom line and creating significant cost savings. We are a team from MIT, Google, Yelp, Stanford, Cornell, and backed by investors including Peter Thiel's Founders Fund, Charles River Ventures, CEO Zoom, Jay Z, CEO DoorDash, Joe Montana, James Harden, COO Yelp, CEO Logitech, Chairman Louis Vuitton (LVMH), Chairman JetBlue, Peterson Ventures, GGV Capital, CEO Intercom, and more.

Similar Jobs

Wells Fargo Logo Wells Fargo

Customer Service Representative

Fintech • Financial Services
Hybrid
Taguig City, Metro Manila, National Capital Region, PHL
205000 Employees

Mondelēz International Logo Mondelēz International

Analytics Manager

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
4 Locations
90000 Employees

Mondelēz International Logo Mondelēz International

Global Talent and Performance Advisor

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Hybrid
Manila, Metro Manila, National Capital Region, PHL
90000 Employees

Optum Logo Optum

Career Navigator

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Makati City, Metro Manila, National Capital Region, PHL
160000 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account