AI Evaluation & Annotation Reviewer (L3 - Advanced Level) - Italian (Canada)

3 weeks, 4 days ago
Contract
Entry Level
Artificial Intelligence and Machine Learning
Volga Partners

Volga Partners

Volga Partners is a technology company that provides innovative solutions and services to clients. With expertise in ML, AI, and crowd management, we deliver high-quality software development, data annotation, content management, data mining, analytics...

Internet Software & Services
51-250

Description

  • Review AI-generated responses for clarity, accuracy, correctness, relevance, and overall quality.
  • Annotate and label language content according to detailed project guidelines.
  • Generate or evaluate prompts based on assignment requirements.
  • Identify linguistic errors, dataset concerns, and structural inconsistencies.
  • Provide clear, structured feedback to support improvements in AI performance.
  • Communicate complex language requirements to both linguistic and non-linguistic stakeholders.
  • Collaborate with QA Leads and clients to apply feedback and maintain quality standards.
  • Participate in required client-facing meetings with camera on.
  • Submit daily work reports and meet productivity and quality expectations.

Requirements

  • Professional fluency in Italian with strong written and verbal communication skills.
  • Bachelor’s degree in Linguistics, Languages, Computer Science, or a related field, or equivalent professional experience.
  • A degree or certification in Italian, where required.
  • Strong analytical skills and exceptional attention to detail.
  • Ability to identify patterns, errors, inconsistencies, and subtle language issues.
  • Experience in annotation, evaluation, translation, localization, linguistics, research, education, or quality assurance is helpful but not required.
  • Interest in Artificial Intelligence, Machine Learning, language technology, or data annotation.
  • Ability to learn new tools, follow detailed guidelines, and adapt to changing project requirements.
  • Strong organization and task-management skills.
  • Ability to commit to the project for a minimum of six months, work consecutive eight-hour shifts, and remain available during 8:00 AM–5:00 PM PST, including daily meetings between 10:00 AM–12:00 PM PST.
  • Must reside outside the listed restricted countries.
  • Independent contractor engagement with only approved and properly logged hours compensated.

Benefits

  • $14 to $18.00 USD per hour for Italian, with rates varying by language and project requirements.
  • Project-specific training, guidance, and ongoing feedback.
  • Practical experience on a global AI project.
  • Opportunity to build skills in AI evaluation, annotation, prompt review, and language quality.
  • Experience working with QA Leads, international teams, and client stakeholders.
  • No paid holidays or paid time off, as this is an independent contractor engagement.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Record Your Daily Routine & Get Paid - AI Training (Remote)

Toloka 251-1K Internet Software & Services

Record first-person videos of everyday household activities for an AI training platform, helping AI systems and robots learn how people interact with objects in real-world environments.

11 hours, 17 minutes ago

Record Your Daily Routine & Get Paid - AI Training (Remote)

Toloka 251-1K Internet Software & Services

Record first-person videos of everyday household activities from your own environment to help train AI systems and robots to understand real-world human interactions.

Computer Vision
11 hours, 17 minutes ago

Competitive Programming Expert - Freelance AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking competitive programmers for project-based work creating and validating algorithmic problems, solutions, test cases, and graders that improve AI coding models.

C++ Python
11 hours, 17 minutes ago

Task Development Engineer

METR 51-200 nonprofit organization management

METR is seeking a remote Task Development Engineer to develop and evaluate challenging tasks for frontier AI models, supporting its Time Horizons research and broader assessments of AI capabilities and risks.

1 day, 10 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers