Senior Software Engineer (AI Evaluation)

About the role

A remote Senior Software Engineer position, advertised by SabiRecruit, focuses on evaluating open-source code and AI bug-fixing performance. The work involves reviewing GitHub repositories, setting up development environments and working with researchers on challenging coding tasks.

Key responsibilities

• Review and troubleshoot issues in open-source GitHub repositories.
• Set up development environments using Git and Docker.
• Evaluate unit test coverage and code quality.
• Modify and test code locally to assess AI bug-fixing performance.
• Work with researchers to identify challenging coding tasks.
• Mentor junior engineers when required.

Required profile

• Strong programming skills in at least one language: Python, JavaScript, Java, Go, Rust, C/C++, C# or Ruby.
• Experience with Git, Docker and software development workflows.
• Ability to understand and navigate complex codebases, and to run, modify and test real-world software projects.
• Open-source contribution or evaluation experience is an advantage.

Preferred qualifications

• Experience with LLM research or AI evaluation projects.
• Experience building or testing developer tools and automation agents.
• Technical leadership or mentoring experience.

The work arrangement is remote, and the remuneration is stated as NGN 680,000.