Overview

AI & Machine Learning Engineer - AI Training at Prolific. Prolific is building the biggest pool of quality human data in the world. Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.

Responsibilities

• Evaluate LLM architecture logic: review AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
• Audit code & notebooks: validate ML-specific code (training loops, data preprocessing scripts, model evaluations) for efficiency and correctness.
• Refine RLHF frameworks: provide high-quality human feedback to align models with human intent, safety, and usefulness.
• Analyze model reasoning: assess how an AI model navigates complex chain-of-thought prompts and identify where reasoning breaks down.
• Benchmark performance: conduct comparati...