Japanese-Speaking AI Voice & Vision Session Reviewer

About the role

We're building a global network of skilled reviewers who help improve the quality of voice-and-camera AI assistants. In this role, you'll watch recorded sessions where a user speaks with an AI assistant while streaming live video from their camera. Your job is to carefully compare what the assistant said with what was actually visible on screen, then score the interaction against a structured rubric.

This is judgment-driven work, not high-volume clicking. The written feedback you provide directly shapes what gets fixed and prioritized by the teams building these assistants. We're looking for detail-oriented, bilingual reviewers who take pride in precise, well-reasoned evaluations.

What you'll do

• Review recorded sessions in which a user speaks to an AI assistant while their camera streams real-world visual context
• Compare the assistant's spoken responses against what is actually visible in the video feed
• Score each session against a detailed evaluation rubric covering accuracy, relevance, and reliability
• Write clear, specific comments explaining what worked, what failed, and why
• Flag critical failures (hallucinations, missed visual cues, factual errors) so they can be prioritized for correction
• Maintain consistency and objectivity across sessions, applying the rubric fairly session after session
• Collaborate asynchronously with a review team to calibrate scoring standards over time

Requirements

• Native or professional fluency in Japanese (reading, writing, and listening comprehension)
• Strong working fluency in English, sufficient to understand rubrics and write structured feedback
• Excellent attention to detail and ability to spot subtle discrepancies between speech and visual content
• Strong written communication skills — your comments are the primary deliverable
• Comfort working independently with recorded audio/video content and structured evaluation criteria
• Reliable internet connection and a quiet environment suitable for careful audio-visual review
• Prior experience in AI training data annotation, QA, localization, or content review is a plus but not required

Compensation

This role pays $24–$30 per hour, depending on experience and review throughput/quality. Work is fully remote and flexible, ideal for reviewers who want consistent, judgment-based work they can fit around other commitments.