AI Legal Writing Evaluator (Remote - Contract)

Overview

We are seeking legal professionals to participate in an AI evaluation project focused on assessing the writing quality and stylistic accuracy of AI-generated legal content. Evaluators will compare responses from multiple large language models (LLMs) and assess which responses best reflect professional legal writing standards used in U.S. contracts and regulatory documents.

This project focuses specifically on writing style, terminology usage, and structural quality in legal writing.

Key Responsibilities

• Review and compare AI-generated responses to legal prompts.
• Evaluate responses based on writing quality, terminology accuracy, tone, and structure.
• Identify which response best reflects industry-standard legal writing practices.
• Provide brief justification for evaluation decisions.
• Contribute ideas for evaluation rubrics and writing-quality criteria for legal content.
• Ensure terminology and phrasing align with professional U.S. legal drafting standards.

Example Evaluation Areas

• Terminological precision and defined legal terms.
• Passive-voice formality commonly used in legal documents.
• Logical sentence and clause structure.
• Consistency of tone and professional legal style.

Qualifications

• JD, LLM, Paralegal certification, or equivalent legal education/experience.
• Experience reviewing or drafting U.S. legal contracts (NDAs, service agreements, etc.) preferred.
• Strong understanding of legal writing style and terminology.
• Excellent attention to detail and analytical skills.
• Ability to evaluate writing quality and provide structured feedback.

Compensation

• $30 to $40 per completed evaluation task.
• Tasks typically take approximately 60-90 minutes depending on complexity.
• Flexible schedule.

Project Details

• Initial pilot includes approximately 30 evaluation tasks.
• Additional tasks may be available depending on project expansion.
• Work will be completed using an online evaluation platform.

Additional Information

This role does not involve providing legal advice. The focus is on evaluating writing style, terminology accuracy, and structural quality in AI-generated legal text.

If you have experience working with legal documents and are interested in contributing to the evaluation of emerging AI technologies, we encourage you to apply.