Computer Science Domain Expert – Remote (Pay Per Task)

About the role

We are looking for highly qualified Computer Science domain experts to design, solve, and evaluate advanced CS problems that test AI model performance. This remote, short‑term contract role offers flexible work up to 40 hours per week with a focus on high‑quality, reasoning‑heavy tasks.

Key responsibilities

• Design challenging computer‑science problems covering algorithms, systems design, cybersecurity, databases, networks, theory of computation, operating systems, and related areas.
• Write clear, step‑by‑step reference solutions with rigorous logic and well‑structured explanations.
• Evaluate AI‑generated responses for correctness, reasoning quality, completeness, clarity, and alignment with problem requirements.
• Identify flaws, edge cases, and near‑miss reasoning patterns in AI outputs.
• Collaborate with researchers to refine benchmarks for undergraduate to PhD‑level topics.
• Provide structured feedback to improve problem quality and benchmark reliability.

Required profile

• Ph.D. (completed or in progress) in Computer Science or a closely related field.
• Deep expertise in advanced CS reasoning and problem‑solving across multiple domains.
• Strong analytical, critical‑thinking, and written communication skills.
• Attention to detail in evaluating assumptions, definitions, edge cases, and solution validity.
• Ability to deliver high‑quality feedback on AI‑generated responses.

Required skills

• Python
• Data analysis (desirable)

What we offer

• Compensation of $250 per approved task.
• Remote work with flexible scheduling, requiring a 4‑hour overlap with PST.
• Short‑term contract (3 months) with the possibility of extension.
• Opportunity to influence AI benchmark development and evaluation standards.