Author rigorous, machine-verifiable problems on real production repos. Clear the rubric and your work becomes the training and evaluation data the top labs ship on. Reviewed in 24 hours, paid every week.
You have 1 task in review and feedback on 1 more.
Each program targets a different kind of frontier data, coding tasks or memory-safety crashes. Reviewed on a fixed bar, paid weekly.
Every submission gets a clear verdict and the reasons behind it, typically within 24 hours.
Clears the rubric. A payout is created automatically and the task enters the dataset.
Close, specific changes are called out. Address them and resubmit.
Needs rework on substance before it can clear review.
Doesn’t meet the bar, with the reasons why, so your next one lands.
Eleven criteria · all must pass · machine-verified by tests, no silent rejects.
Built for rigor, scoped for quality.
Eleven evaluation criteria. All must pass. The bar is the product, that is what makes the data valuable.
Every task ships with tests. Correctness is decided by execution, never by vibe.
Access is approved or invited and scoped to a real roster. Fewer, stronger contributors; no spam.
Accepted problems train and benchmark frontier models, work with a destination that exists.
Concrete rates, weekly payouts, and a rank that lifts your rate as you prove out.
We'd rather you self-select out than waste your time.
You author rigorous, machine-verifiable coding problems on real repositories. Each submission is reviewed against a fixed rubric; accepted work becomes evaluation and training data for frontier AI teams.
There is no client backlog and no open spam queue. Access is gated, work is judged purely on a quality rubric, and the output has a real downstream, model training and evaluation.
Accepted work creates a payout automatically, paid weekly by bank transfer. Your rate depends on the program and difficulty, and rises with your tier.
Python, TypeScript, Go, Rust, and Java across SWE-bench-style fixes, system-level engineering, public-repo tasks, and Dockerized terminal-agent tasks.
Apply with your background; approved engineers are placed in the right program. Some programs are invite-only and scoped to an explicit roster.