Responsibilities
• Conduct speech-based scenario conversations with AI models in guided real-world use cases
• Evaluate model performance on accuracy, relevance, clarity, and task completion
• Provide high-quality written feedback on successes and failures
• Follow rubrics and guidelines consistently across sessions

Requirements
• Fluent in English (spoken, reading, and writing)
• Strong reading and writing skills with the ability to provide detailed feedback
• Comfortable speaking naturally and clearly on a microphone
• Reliable internet and access to a quiet environment

Preferred
• Detail-oriented and consistent work style
• Experience following evaluation rubrics

How to Apply
Click "Apply" to be taken to the SME Careers website. The application process involves filling out your profile, completing an interview, and taking an exam for certain roles. If you pass, you will receive an email and your profile will be reviewed before being contacted for project onboarding. If you do not pass, you can redo the interview. Payments are made weekly once work is approved.