Human data for video and image models
Top creative professionals who have worked for the biggest channels on the internet. They rank, score and mark up what your model makes, against your rubric.
PromptUGC style, 9:16. A woman pours coffee and tells the camera why she gets up at 6. Handheld, warm morning light.
01 Who judges your model
The professionals on Roster have worked for channels with 1B+ combined followers. For your project, we brief the ones whose experience fits the task.
02 Task types
The tasks post-training teams already run, done by people who make this content for a living. Each card shows what comes back.
Two generations, one prompt. The rater picks per dimension, ties allowed, and writes one line on why.
Feeds reward models
Each clip or image scored 1 to 5 per criterion, with a short rationale your researchers can read.
Feeds evals and graded RL
Hands, faces, text, physics and continuity across a cut, pinned to the frame and labeled by type.
Feeds fine-grained reward models
Senior creatives write the criteria and the eval prompts for what they know best: hooks, pacing, captions and thumbnails.
Feeds benchmarks and holdout evals
Creatives write the requests that should fail: a real creator's likeness, a brand logo, fake UGC for a product claim. Each failure comes back with its seeds.
Feeds safety evals
Dense captions that name shot, motion, cut and pacing, plus hand-picked reference clips with notes on why they work.
Feeds SFT and quality tuning
03 Scoping tool
Pick the modality, task, seniority and volume to see the shape of a pilot. Send it to us with the form below.
04 How a project runs
You brief us, we find the professionals and run them on your project. The method stays yours, and the shape is the usual one for a new rater pool.
01 · Brief
Share the task, your guidelines and a few labeled examples. We tell you who fits and whether we can staff it.
02 · Pilot
A handful of raters from the network work a sample batch against your gold items, in the tool you already use.
03 · Calibrate
Disagreements on subjective items are reviewed with your team and the guidelines tighten. You keep the raters who converge on your rubric.
04 · Scale
Add raters who match the calibrated profile, or end after the pilot. Each project is scoped on its own.
Calibration · gold items05 The network
countries the experts on Roster work from
combined followers across the channels on Roster
Channels on Roster
Subscribers on YouTube
Stokes Twins
147MComedy
Alan Chikin Chow
71MComedy
Jordan Matter
27MKids & Family
Chloe Ting
25MFitness
Jesser
23MSports
Nick DiGiovanni
22MFood
Rebecca Zamolo
17MLifestyle
06 Get in touch
Send us the scope and we'll reply by email.