AI Data Science Domain Expert – Model Evaluation & Prompt Refinement
Paid remote expert bounty in Expert network (Global). Work in the software you already know; rates and ladder published up front.
- $30-$250
- per hr, published up front
- 1
- slots left of 1
- Remote
- no AI experience required
What you'll be paid to show
About the role
We're looking for a seasoned Data Science domain expert to help train, evaluate, and refine AI systems through rigorous analysis and high-quality written feedback. You'll work at the intersection of data science expertise and AI development, applying your technical judgment to assess model outputs, craft precise prompts, and produce documentation that raises the bar for AI quality and reliability. This is a remote, flexible-engagement opportunity for professionals who enjoy deep analytical work and clear, structured communication.
What you'll do
- Evaluate AI-generated outputs for technical accuracy, logical soundness, and quality using structured rubrics
- Author and refine prompts to elicit better, more reliable model responses
- Conduct rubric-based and comparative assessments of AI model performance (RLHF-style evaluation)
- Fact-check and review data science content for correctness, clarity, and completeness
- Write and edit technical documentation, reports, and professional summaries of findings
- Perform independent research to validate data interpretations and model claims
- Annotate data and provide structured feedback to improve model training pipelines
- Identify edge cases, inconsistencies, and areas for improvement in AI-generated content
- Collaborate with cross-functional teams to communicate insights in clear, professional language
Requirements
- Strong background in data science, applied statistics, or a related quantitative field
- Demonstrated critical thinking and analytical reasoning skills
- Excellent written communication, technical documentation, and professional editing abilities
- Experience evaluating or annotating AI/ML outputs, or strong aptitude to learn quickly
- High attention to detail and commitment to quality assurance
- Comfort working independently on research-driven, deadline-sensitive tasks
- Familiarity with prompt engineering and AI output evaluation frameworks is a plus
Compensation
Hourly rate of $100–$200 USD, commensurate with experience and evaluation throughput. Engagement is remote and open to qualified experts globally.
What we're looking for
- Critical Thinking
- Analytical Reasoning
- Attention to Detail
- Quality Assurance
- Written Communication
- Technical Documentation
- Prompt Authoring & Refinement
- AI Output Evaluation
- Professional Writing
- Report Writing
- Data Interpretation
- Data Annotation
- Rubric-Based Evaluation
- Fact Checking
- RLHF
- Prompt Engineering