Expert Rater Project - Italian (Spain)

1 day, 1 hour ago
Freelance
Junior
Quality Assurance and Testing
Welo Global

Welo Global

Welo Global specializes in providing enterprise localization, AI training data, and multilingual content solutions, leveraging a portfolio of specialized global brands to meet diverse customer needs in the AI and language services industry.

Professional Services
Founded 1997

Description

  • Support Raters in building rating expertise and applying best practices for accurate, consistent ratings.
  • Facilitate client test rounds and understand client templates, workflows, and quality expectations.
  • Cascade quality standards and expectations to the broader Raters team.
  • Monitor progress and deliverables to ensure client requirements are met.
  • Coach and mentor Raters to improve rating accuracy and decision-making.
  • Ensure annotation selection and gold set creation follow template instructions and produce unbiased outcomes.
  • Analyze datasets and KPI trends to inform data-driven decisions.
  • Write client-facing emails, questions, feedback, and other materials with clarity and relevance.
  • Collaborate with research and development teams on experiments to improve client data.
  • Conduct evaluations independently to maintain and enhance project proficiency.

Requirements

  • 1+ years of rating experience.
  • Experience with data labeling, annotation, and evaluation methodologies.
  • Knowledge of Italian language is required.
  • English proficiency at B2 level, including oral and written comprehension.
  • Intermediate proficiency with Google Workspace.
  • Understanding of U.S. and local customs and societal norms.
  • Ability to evaluate content thoughtfully and understand its societal impact.
  • Understanding of survey structures and data collection methodologies.
  • Academic background in social sciences or quality roles is a plus.

Benefits

  • Hourly rate of $19.55.
  • 30 hours per week, with the possibility of extending to 40 hours per week.
  • Freelance employment with the possibility of full-time extension based on performance and project needs.
  • Project duration of 1 month.
  • Start date of 27 July.
  • Flexible project-based work schedule.
  • Access to structured learning and growth opportunities.
  • Real-time support from the Community Experience team.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI Evaluation & Annotation Reviewer (L3 - Advanced Level) - French

Volga Partners 51-250 Internet Software & Services

AI Evaluation & Annotation Reviewer at an artificial intelligence project, evaluating and annotating French language content to improve the quality and reliability of AI-generated responses.

Machine Learning
1 hour, 47 minutes ago

QA Engineer (Freelance - 40 hrs/wk)

Wing Assistant 51-250 Professional Services

Wing is hiring a QA-focused team member for M32 AI to own manual test automation and quality validation for a fast-moving product team building agentic AI for SMBs globally.

CI/CD YAML
2 hours, 2 minutes ago

QA Engineer (Freelance - 40 hrs/wk)

Wing Assistant 51-250 Professional Services

Wing is hiring a Manual QA Engineer to join M32 AI and own test validation for a fast-moving agentic AI product for SMBs worldwide.

CI/CD YAML
2 hours, 2 minutes ago

Triage Associate I (Contractor)

Latitude AI 501-1000 information technology & services

Latitude AI, a Ford Motor Company subsidiary, is hiring a Triage Operations team member to analyze autonomous vehicle test data and help identify, classify, and escalate performance issues across its ADAS development program.

JIRA Looker Superset
1 day, 2 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers