Computer Science Specialist – Remote (Pay‑Per‑Task)

About the role

We are seeking a Computer Science Specialist to design and evaluate advanced CS problems that benchmark AI model performance. This remote, short‑term contract focuses on creating conceptual, reasoning‑heavy tasks across a range of computer‑science domains.

Key responsibilities

• Design challenging computer‑science problems covering algorithms, systems design, cybersecurity, databases, networks, theory of computation, operating systems, and related areas.
• Develop clear, step‑by‑step reference solutions with rigorous logic and well‑structured explanations.
• Evaluate AI‑generated responses for correctness, reasoning quality, completeness, clarity, and alignment with problem requirements.
• Identify flaws, edge cases, and near‑miss reasoning patterns in AI outputs.
• Collaborate with researchers to refine benchmarks for undergraduate to PhD‑level topics.
• Provide structured feedback to improve problem quality, benchmark reliability, and model evaluation standards.

Required profile

• Ph.D. (completed or in progress) in Computer Science or a closely related field.
• Deep expertise in advanced CS reasoning and problem‑solving across multiple domains.
• Strong analytical, critical‑thinking, and written communication skills.
• Excellent attention to detail when evaluating assumptions, definitions, edge cases, and solution validity.
• LinkedIn profile must be included in the resume; background check required after onboarding.

Required skills

• Python (desirable)
• Data analysis (desirable)

What we offer

• $250 per approved task
• Up to 40 hours/week with a 4‑hour overlap in PST
• 3‑month contract with immediate start
• Fully remote work arrangement