Alpha Telescopii - Entertainment Media Content Reviewer (Remote in the United States)

3 months, 1 week ago
Freelance
Mid Level
Artificial Intelligence and Machine Learning
Welocalize

Welocalize

Welocalize provides translation and localization services to help businesses reach global audiences with precision and efficiency.

Professional Services
1K-5K
Founded 1997
$34M raised

Description

  • Conduct quality audits of contributor evaluations of model-generated entertainment responses to ensure adherence to project-specific guidelines and rubric dimensions.
  • Verify that contributors consistently apply all instructions, constraints, and evaluation criteria when assessing model responses.
  • Identify and confirm factual errors, hallucinations, or missing information in model responses and assess whether responses fulfill the user query.
  • Ensure contributor-selected options align with rubric dimensions and are justified by evidence present in the model response.
  • Review open-text comments from contributors to identify additional weaknesses, limitations, or opportunities not captured by rubric criteria.
  • Provide detailed, constructive feedback on contributor performance to improve evaluation quality and consistency.
  • Use domain knowledge of narrative structure, continuity, and cultural context to ensure evaluations accurately reflect entertainment-specific considerations.
  • Manage workflows and perform tasks independently in a remote, freelance environment.

Requirements

  • Must currently reside in one of the following U.S. states: Alabama, Colorado, Delaware, Florida, Georgia, Indiana, Kansas, Kentucky, Missouri, Montana, Nevada, New Hampshire, New Mexico, North Carolina, Ohio, Oklahoma, Oregon, Pennsylvania, South Carolina, Tennessee, Texas, Utah, Virginia, West Virginia, or Wisconsin.
  • Proven expertise in one or more of: film and media studies; entertainment journalism, film criticism, or media commentary; content analysis focused on movies, TV series, and streaming platforms; entertainment blogging or significant contributions to pop culture communities.
  • Relevant degree (e.g., Bachelor’s in Film and Media Studies, Journalism, or related) is highly preferred.
  • Strong familiarity with narrative structures, character arcs, continuity across cinematic universes and episodic storytelling, and contextual/cultural references in entertainment media.
  • Proven experience in AI data annotation, content quality review, search quality rating, or similar evaluation roles.
  • Experience evaluating content using structured grading criteria, performing in-depth fact-checking, and identifying factual inaccuracies.
  • Meticulous attention to detail and ability to identify nuanced issues in contributor evaluations.
  • Familiarity with data annotation platforms and model evaluation tools and the ability to work independently and manage remote workflows.
  • Preferred: prior experience conducting quality audits or content review in an entertainment-related capacity, active use of major streaming platforms, and an up-to-date understanding of pop culture and entertainment trends.

Benefits

  • Pay rate: $22 USD per hour.
  • Remote (U.S.-based) freelance role with expected capacity of approximately 20 hours per week.
  • Start date: As soon as possible.
  • Opportunity to work with Welo Data / Welocalize, a global AI-data community and contributor network, and to contribute to AI model improvement.
  • Flexible, remote work arrangement allowing independent, project-based contributions.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Hydrus -Voice Contributor — English (US)

Welo Global Professional Services

Welo Data is hiring a freelance native-level English (US) speaker to record conversational customer-service audio for a remote AI voice project.

1 day, 13 hours ago

AI / ML Consultant

Crosslake 251-1K Capital Markets

Crosslake is hiring a US-based remote consultant to help technology and private equity clients evaluate, improve, and implement AI and software-related initiatives across the investment lifecycle.

Agile Computer Vision Generative AI LLM Machine Learning MLOps NLP Statistics
1 day, 13 hours ago

Hydrus -Voice Contributor — Spanish (Spain)

Welo Global Professional Services

Welo Data is hiring a freelance native-level Spanish (Spain) speaker to record conversational customer-service voice data for a remote conversational AI project.

1 day, 13 hours ago

Senior Python Engineer - AI Coding Agent Evaluation (Freelance)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking an experienced software development specialist to create realistic coding-agent evaluation tasks and tests for project-based AI opportunities.

Docker FastAPI JavaScript Kafka PostgreSQL Python React Redis TypeScript
2 days, 13 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers