Senior Psychiatrist (AI Clinical Evaluation)

About the role

A boutique consultancy is looking for an experienced Senior Psychiatrist to contribute to an AI training and evaluation project focused on psychiatric reasoning, behavioral-health assessment, longitudinal chart review, treatment planning and patient safety. The consultant creates and reviews complex psychiatry cases, long-chart scenarios, gold-standard answers and evaluation rubrics, judging whether outputs show appropriate diagnostic reasoning, risk assessment, medication and treatment decisions, documentation quality and clinically defensible conclusions. The assignment is a 12-week contractor role, part-time or full-time (20-40 hours per week), and is remote.

Key responsibilities

• Develop high-difficulty psychiatry and behavioral-health cases and benchmark tasks.
• Review longitudinal records, psychiatric history, medications, psychosocial factors and prior treatments.
• Identify clinically important trends, contradictions, omissions and safety risks.
• Evaluate AI-generated outputs for diagnostic accuracy, safety and quality of clinical reasoning.
• Create gold-standard answers and clinically defensible reference solutions.
• Assess differential diagnosis, treatment planning, medication decisions and follow-up recommendations.
• Review suicide risk, self-harm risk, behavioral risk, capacity and escalation needs where clinically relevant.
• Evaluate documentation quality and identify incomplete or unsafe psychiatric recommendations.
• Apply structured rubrics to assess clinical reasoning, terminology, documentation and patient-safety implications.
• Take part in peer review, calibration and resolution of complex or ambiguous cases.

Required profile

• Medical degree with completed specialist training in Psychiatry.
• Active or recently held professional license, registration, board certification or recognized psychiatry credential in the candidate's country.
• Approximately 8+ years of professional psychiatry experience.
• Current or recent clinical practice within the last 3 years.
• Strong written English and the ability to give precise, clinically defensible reasoning.

The selection process consists of an online questionnaire, a 60-minute multiple-choice test and a review of the resume, education and certifications.