Backend Engineer (Python/JavaScript) – Remote $15/hr

About the role

We are looking for a skilled Backend Engineer to create multi‑agent benchmark tasks that simulate real‑world code changes. This short‑term contract (4 weeks) is fully remote and offers flexible hours with a required overlap with Pacific Standard Time.

Key responsibilities

• Design and build benchmark tasks based on open‑source bug fixes, migrations, and refactors.
• Integrate tasks with the Harbor evaluation framework and run them in Docker containers.
• Write precise task instructions, including file paths, function signatures, expected behavior, and constraints.
• Develop Python verification scripts to check the correctness of agent‑generated code.
• Create decomposition strategies to split complex changes across independent sub‑agents.
• Debug, refine, and ensure reproducibility of tasks in containerized environments.
• Analyze performance signals and continuously improve task quality, clarity, and difficulty.

Required profile

• Strong experience in Python and JavaScript development.
• Familiarity with AI coding benchmark projects such as SWE‑bench or Terminal‑Bench.
• Proven ability to navigate large open‑source codebases (e.g., Django, Flask, FastAPI, Node.js).
• Comfortable with Git workflows, including pull requests, diffs, and cherry‑picking.
• Hands‑on experience with Docker, including writing Dockerfiles and debugging containers.
• Experience writing automated tests using pytest, unittest, or custom assertions.

Required skills

• Python
• JavaScript
• Docker
• Git
• pytest
• unittest

What we offer

• Competitive hourly rate of $15.
• Fully remote work with flexible scheduling.
• Opportunity to contribute to cutting‑edge AI coding benchmark development.