Legal AI Evaluation Expert

1 month, 2 weeks ago
Contract
Junior
Artificial Intelligence and Machine Learning
Weekday

Weekday

Weekday helps companies hire engineers who are vouched by other software engineers, enabling passive income for engineers. They offer services like drafting outreach messages, shortlisting candidates, and conducting reference checks. Backed by Y Combin...

Construction & Engineering
11-50
Founded 2020

Description

  • Review and compare AI-generated responses to employment and workplace legal scenarios.
  • Assess outputs for legal accuracy, completeness, logical reasoning, and client readiness.
  • Verify that responses align with established U.S. employment and labor law principles.
  • Provide structured written feedback on strengths, weaknesses, and opportunities for improvement.
  • Identify factual inaccuracies, legal reasoning gaps, and inconsistencies in AI outputs.
  • Apply standardized evaluation criteria to ensure objective and consistent assessments.
  • Participate in onboarding sessions and calibration activities.
  • Collaborate with project teams by sharing domain-specific insights to improve model performance.
  • Maintain consistency and quality across evaluation tasks.

Requirements

  • Minimum of 2 years of professional experience practicing Employment or Labor Law.
  • Experience gained in a law firm, corporate legal department, government agency, labor organization, or similar legal environment.
  • Juris Doctor (J.D.) from an accredited U.S. law school, or an LL.B./LL.M. from an accredited institution.
  • Licensed to practice law in the United States; active or inactive license accepted.
  • Strong expertise in legal research, legal writing, case law analysis, and drafting legal memoranda.
  • Excellent written communication skills with exceptional attention to detail.
  • Solid understanding of the U.S. legal system and employment law practices.
  • Ability to work approximately 6–15 hours per week on a flexible schedule.
  • Immediate availability for project work, with applications reviewed on a rolling basis.
  • Visa sponsorship is not available for this opportunity.

Benefits

  • Competitive compensation of $100–$150 per hour, depending on qualifications and experience.
  • Fully remote work with the ability to work on your own schedule.
  • Flexible part-time workload of approximately 6–15 hours per week.
  • Independent contractor engagement.
  • Weekly payments processed through supported payment platforms based on approved work completed.
  • Opportunity to contribute to AI research that improves legal reasoning and analysis.
  • Intellectually engaging assignments with flexible scheduling.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Generative AI Analyst | Arabic (Morocco)

Welo Global Professional Services

Welo Data is seeking a remote freelance Generative AI Analyst fluent in Moroccan Arabic to evaluate, annotate, and quality-review AI-generated content across text, audio, images, video, and related data projects.

Generative AI
9 hours, 52 minutes ago

French Quality Control Specialist - Project Lyra

Welo Global Professional Services

Welo Data is seeking French-speaking linguistics experts for a four-week remote freelance project evaluating and improving AI-generated language outputs for accuracy, grammar, and cultural relevance.

LLM NLP
10 hours, 22 minutes ago

Generative AI Analyst | Traditional Chinese (US)

Welo Global Professional Services

Welo Data, part of Welocalize, is seeking remote freelance Traditional Chinese Generative AI Analysts in the US to evaluate, annotate, and improve AI-generated content across text, audio, images, video, and other data types.

Generative AI LLM
2 days, 9 hours ago

Freelance Agent Evaluation Engineer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift seeks experienced software developers for a project-based opportunity creating and evaluating realistic coding tasks used to assess AI coding agents for leading technology companies.

Cybersecurity Docker FastAPI JavaScript Kafka Machine Learning PostgreSQL Python React Redis TypeScript
2 days, 10 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers