Senior Go Software Engineer – LLM Evaluation (Remote)

About the role

We are looking for a Senior Software Engineer with strong Go expertise to join a part‑time, remote project focused on evaluating large language models (LLMs) against real‑world software engineering tasks. You will help build and validate datasets that simulate realistic coding challenges using public repository histories.

Key responsibilities

• Analyze and triage GitHub issues from trending open‑source libraries to benchmark LLM performance.
• Set up and configure code repositories, including Docker containers and environment provisioning for testing.
• Assess unit‑test coverage and quality across complex codebases.
• Modify and execute codebases locally to evaluate LLM bug‑fixing capabilities.
• Collaborate with AI researchers to design challenging repository selections and issue sets.

Required profile

• Minimum 3 years of professional software engineering experience.
• Proficiency in Go and comfortable navigating large codebases.
• Hands‑on experience with Git, Docker, and local development environments.
• Ability to work independently on a remote, part‑time schedule.

Required skills

• Go
• Git
• Docker

What we offer

• Competitive compensation based on experience.
• Opportunity to contribute to cutting‑edge AI research in software development.
• Fully remote work with flexible hours.