Expert Rater Project - English (US)

3 days, 12 hours ago
Freelance
Junior
Quality Assurance and Testing
Welo Global

Welo Global

Welo Global specializes in providing enterprise localization, AI training data, and multilingual content solutions, leveraging a portfolio of specialized global brands to meet diverse customer needs in the AI and language services industry.

Professional Services
Founded 1997

Description

  • Support raters in skill development by guiding best practices for accurate and consistent ratings.
  • Facilitate client test rounds and help align work with client requirements and quality benchmarks.
  • Understand templates, workflows, and annotation instructions to ensure consistent execution.
  • Cascading quality expectations to the broader rater team and maintain alignment across projects.
  • Monitor progress and deliverables to help meet client expectations.
  • Coach and mentor raters to improve rating accuracy and decision-making.
  • Analyze datasets and interpret KPIs to identify patterns and support data-informed decisions.
  • Prepare written client-facing materials such as emails, questions, and feedback.
  • Collaborate with research and development teams on experiments to improve client data.
  • Conduct independent evaluations to maintain and improve proficiency on assigned projects.

Requirements

  • 1+ years of rating experience is required.
  • Understanding of data labeling, annotation, and evaluation methodologies is required.
  • Knowledge of English language with oral and written comprehension is required.
  • Intermediate proficiency in Google Workspace.
  • Understanding of U.S. and project locale customs and societal norms.
  • Ability to evaluate content thoughtfully and understand its societal impact.
  • Understanding of survey structures and data collection methodologies.
  • Academic background in social sciences or quality roles is a plus.
  • Strong active listening, communication, empathy, proactiveness, and cultural adaptability.
  • Research skills to methodically explore online sources and cross-reference information.

Benefits

  • Hourly rate of $22.14/hour.
  • 30 hours per week with the possibility of extension to 40 hours per week.
  • Freelance engagement with the possibility of a full-time employment extension based on performance and project needs.
  • Project duration of 1 month.
  • Flexible project-based work that can fit your schedule.
  • Access to structured learning and career growth opportunities.
  • Real-time support from the Community Experience team.
  • Opportunity to work with a global AI data company and diverse contributor community.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

QA Contractor

FUTURESEARCH Internet Software & Services

FUTURESEARCH is hiring a meticulous quality checker to verify research evaluation tasks used for training and benchmarking frontier AI models.

13 hours, 29 minutes ago

Training Specialist

A Training Specialist at this company leads virtual training for Virtual Assistants, ensuring they are prepared with the soft skills, product knowledge, and procedures needed before client assignment.

macOS
1 day, 13 hours ago

Test Lead - (Temenos T24 - Mortgage & Lending)

Unison Group Technology consulting

Test Lead for Temenos T24 mortgage enhancements at a banking platform, responsible for end-to-end testing across core banking and workflow systems.

Agile
1 day, 13 hours ago

QA Engineer

Freedom24 Capital Markets

An experienced QA Engineer will join a fintech-focused team to test mobile, web, and API products supporting brokerage services and financial markets.

Appium Postman Selenium SQL
3 days, 12 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers