Data Analyst (SQL & Python) – Remote, $15/hr

About the role

We are looking for an experienced Data Analyst to design and implement multi‑agent benchmark tasks focused on complex data‑analysis workflows. This short‑term contract (4 weeks) is fully remote and offers a rate of $15 per hour.

Key responsibilities

• Design and author benchmark tasks that simulate real‑world data‑analysis scenarios.
• Create synthetic or curated datasets across finance, operations, security, and market analysis domains.
• Build tasks requiring cross‑referencing, anomaly detection, contradiction identification, and statistical computation.
• Develop decomposition guides for specialist sub‑agents (financial, technical, security, operations).
• Write oracle logic or verification scripts to validate specific analytical conclusions.
• Set up reproducible evaluation environments using Python and Docker.
• Review performance signals to differentiate weaker and stronger agentic systems.
• Refine tasks for determinism, clarity, difficulty, and scoring quality.

Required profile

• Several years of professional data‑analysis experience.
• Strong proficiency in SQL and Python (pandas, NumPy or similar).
• Hands‑on experience with messy real‑world datasets (CSV, JSON, logs, reports).
• Ability to craft non‑trivial analytical questions with verifiable answers.
• Solid grasp of statistical concepts such as averages, distributions, outliers, and correlations.
• Familiarity with AI coding benchmark environments (e.g., SWE‑bench, Terminal‑Bench).
• Comfortable writing Dockerfiles, building images, and debugging containers.
• Self‑motivated and able to work independently in a remote setting.

Required skills

• SQL
• Python
• pandas
• NumPy
• Docker
• CSV handling
• JSON handling