Senior Brand Design Evaluator – AI Model Quality Assessment

About the role

We're looking for seasoned brand design professionals to help shape how AI systems are evaluated on real-world creative work. Instead of producing brand deliverables yourself, you'll act as the expert judge: defining what excellent brand design looks like, building rigorous grading rubrics, and scoring AI-generated design work samples with clear, well-reasoned written justifications.

This is a unique opportunity for design experts who want to apply their craft knowledge to help train and benchmark next-generation AI creative tools, rather than doing traditional client-facing design work.

What you'll do

• Design precise, task-specific grading criteria for real-world brand design deliverables, including brand identity systems, brand guidelines, logo suites, and visual identity packages
• Review completed work samples (produced by AI systems) against industry standards for brand strategy, visual design, typography, color systems, and overall craft
• Score submissions using structured rubrics and provide detailed, well-reasoned written justifications for every score
• Identify gaps, inconsistencies, and quality issues in AI-generated brand design output that a professional agency-level reviewer would catch
• Calibrate scoring criteria with other expert evaluators to ensure consistency and fairness across the evaluation process
• Provide qualitative feedback that helps improve the underlying AI systems' understanding of high-quality brand design

Requirements

• Proven professional experience in brand design, ideally within an agency or in-house brand team setting
• Strong portfolio demonstrating brand identity systems, logo design, visual identity, and brand guideline development
• Excellent written communication skills — you must be able to clearly articulate *why* a piece of work is strong or weak
• Sharp critical eye for typography, color theory, layout, and overall visual craft
• Ability to work independently, manage ambiguity, and apply consistent judgment across many work samples
• Comfortable working remotely and asynchronously

**Nice to have:**

• Experience mentoring, art directing, or reviewing junior designers' work
• Familiarity with AI-generated design tools and their current limitations
• Prior experience in quality assurance, editorial review, or grading/evaluation work

Compensation

This engagement pays **$80–$150 per hour**, depending on experience level and demonstrated expertise. Work is remote and flexible, with scope calibrated to your availability.