Senior Software Engineer - AI Code Evaluation

About the role

We are looking for senior software engineers with 7+ years of industry experience to support the training and evaluation of large language models. In this role you will review, analyze, and improve AI-generated code, applying real-world engineering judgment to assess correctness, security, scalability, maintainability and production quality.

Key responsibilities

• Review and evaluate AI-generated code across multiple programming languages and software-engineering scenarios.
• Identify bugs, logical errors, incomplete implementations, edge-case failures and architectural weaknesses.
• Analyze unfamiliar codebases, understand impact of proposed changes, and compare alternative implementations.
• Rewrite or improve code to create high-quality reference solutions and provide clear technical explanations.
• Develop evaluation criteria, technical annotations and rubrics for code-quality assessment.
• Collaborate with researchers and engineering teams to design coding benchmarks and improve LLM evaluation methodologies.

Required profile

• 7+ years of professional software engineering experience.
• Strong proficiency in at least one programming language (e.g., Python, JavaScript/TypeScript, Java, C++, Go, C#, Ruby, PHP, Rust).
• Proven ability to identify functional, performance, security and design issues in complex codebases.
• Experience with code reviews, collaborative development workflows and Git.
• Strong written English and ability to communicate technical feedback clearly.

Required skills

• Python
• JavaScript / TypeScript
• Java
• C++
• Go
• C#
• Ruby
• PHP
• Rust
• Git
• Data structures and algorithms
• APIs and databases