Quality Assurance Analyst
Posted
Jul 08, 2026 (7d ago)
Seniority
Senior
Work Model
Remote
Type
Contract
Category
Salary
$146k+
Skills
Description
Legal Expert AI Response Evaluator Contract | Remote Pay: $70/hour Time Commitment: Flexible / Self-scheduled Role Snapshot Evaluate and provide structured written feedback on responses generated by LLMs, contributing to high-impact research projects that improve the quality and reliability of AI systems. Core Responsibilities Review and assess outputs from LLMs against structured evaluation guidelines, identifying errors, gaps in reasoning, and areas for improvement Write clear, precise, and well-evidenced written rationales that go beyond surface-level observations Apply consistent, honest judgment including critical assessments when evaluating model-generated content Follow detailed task guidelines with strict attention to detail and accurate, reproducible scoring Ideal Candidate Profile Strong experience in legal analysis, critical reading, or structured written evaluation within a professional or academic context Strong experience in identifying nuance, implicit meaning, and logical gaps across complex written material Strong experience producing high-quality written work independently, without reliance on AI writing tools Native English fluency required; bachelor's degree from a globally ranked institution preferred Easy Apply to proceed.
Similar Jobs
Sr. Solutions Architect - Agencies
Databricks · USA
Senior Software Engineer - Data Platform
Samsara · USA
Software Developer Sr. - AI-Native .NET/ Azure (Cloud Platform)
Dayforce · USA
Staff Software Engineer, Backend (Lake Analytics Platform)
Affirm · USA