Help build a benchmark of real, expert-level problems that today’s best AI agents still can’t solve. Experts take a genuinely hard problem from their own field and turn it into a task an AI must solve from scratch in a Linux terminal.
The goal: stump the model. A task counts only if, when three frontier AI models each try it three times, they mostly fail. It’s not annotation — contributors design the problems that expose where AI still breaks.
Who we need:
Domains in demand:
Job details are sourced from the employer's original posting.
Open job postingAbout the company
An Enterprise client is seeking a Health Product Management (HPM) Technical Consultant to provide targeted technical assistance, quality assurance, and capacity strengthening across its Global Fund portfolio. Your inputs are essential during Global Fund application and grant-making processes and become particularly critical during grant start-up and early implementation. Our client implements programs supported by the Global Fund to Fight AIDS, Tuberculosis and Malaria (Global Fund) across diverse geographic and operational contexts.