AI Evaluation Engineer / Researcher

About the role

HumAngle is looking for an AI Evaluation Engineer/Researcher in Abuja. The role tests, understands and refines artificial intelligence systems designed for journalism, human security, humanitarian analysis and African contexts. It supports the organisation's goal of developing locally grounded humanitarian AI that accurately interprets African conflict environments while keeping human judgment central to decision-making.

Key responsibilities

• Learn modern methods for assessing large language models and other AI architectures
• Plan and run structured evaluation protocols under the guidance of senior researchers
• Create and curate evaluation datasets, test scenarios, scoring rubrics and performance benchmarks
• Evaluate model responses for accuracy, contextual relevance, potential bias, safety compliance and areas of failure
• Assess how AI interprets Nigerian, Sahelian and broader African conflict and humanitarian dynamics
• Carry out literature reviews and replicate relevant scientific experiments
• Use Python and research tools to automate assessment workflows and analyse outcomes
• Document methods, findings and limitations so results can be reproduced
• Work with journalists, subject-matter experts, researchers and engineers to bring local insight into evaluations
• Formulate independent research questions and design experiments with growing autonomy