Software/ML Engineer - AI Systems Evaluation

About the role

SabiRecruit is hiring a contractor Software/ML Engineer focused on evaluating AI systems. The role involves designing technical scenarios, building reference solutions and assessing the quality of AI-generated answers on topics such as LLM inference optimization, GPU kernels and system performance.

Key responsibilities

• Design realistic technical scenarios covering LLM inference optimization, GPU kernel development and systems performance engineering.
• Develop reference solutions and detailed technical explanations for challenging engineering problems.
• Evaluate AI-generated solutions for correctness, efficiency and technical depth.
• Assess approaches to GPU performance optimization and model-serving architecture.
• Identify errors in technical reasoning, implementation strategies and performance recommendations.
• Provide structured feedback to improve AI model capabilities.
• Document evaluation criteria and explain the reasoning behind technical assessments.

Required profile

• Bachelor's degree or higher in Computer Science, Computer Engineering, Electrical Engineering or a related field.
• Experience at a recognized technology or AI company in a role with practical systems-engineering responsibilities.
• Strong analytical and problem-solving skills.
• Excellent written communication, able to explain complex technical concepts clearly.

Required skills

• Hands-on experience in GPU inference optimization, custom CUDA kernel development, LLM inference and model-serving systems, quantization, optimizer design and systems performance engineering.
• Familiarity with model-serving frameworks such as vLLM, TensorRT-LLM or SGLang.