AI Evaluation & Annotation Reviewer (L3 - Advanced Level) - Italian (Canada)

4 days, 1 hour ago
Contract
Entry Level
Artificial Intelligence and Machine Learning
Volga Partners

Volga Partners

Volga Partners is a technology company that provides innovative solutions and services to clients. With expertise in ML, AI, and crowd management, we deliver high-quality software development, data annotation, content management, data mining, analytics...

Internet Software & Services
51-250

Description

  • Review AI-generated responses for clarity, accuracy, correctness, relevance, and overall quality.
  • Annotate and label language content according to detailed project guidelines.
  • Generate or evaluate prompts based on assignment requirements.
  • Identify linguistic errors, dataset concerns, and structural inconsistencies.
  • Provide clear, structured feedback to support improvements in AI performance.
  • Communicate complex language requirements to both linguistic and non-linguistic stakeholders.
  • Collaborate with QA Leads and clients to apply feedback and maintain quality standards.
  • Participate in required client-facing meetings with camera on.
  • Submit daily work reports and meet productivity and quality expectations.

Requirements

  • Professional fluency in Italian with strong written and verbal communication skills.
  • Bachelor’s degree in Linguistics, Languages, Computer Science, or a related field, or equivalent professional experience.
  • A degree or certification in Italian, where required.
  • Strong analytical skills and exceptional attention to detail.
  • Ability to identify patterns, errors, inconsistencies, and subtle language issues.
  • Experience in annotation, evaluation, translation, localization, linguistics, research, education, or quality assurance is helpful but not required.
  • Interest in Artificial Intelligence, Machine Learning, language technology, or data annotation.
  • Ability to learn new tools, follow detailed guidelines, and adapt to changing project requirements.
  • Strong organization and task-management skills.
  • Ability to commit to the project for a minimum of six months, work consecutive eight-hour shifts, and remain available during 8:00 AM–5:00 PM PST, including daily meetings between 10:00 AM–12:00 PM PST.
  • Must reside outside the listed restricted countries.
  • Independent contractor engagement with only approved and properly logged hours compensated.

Benefits

  • $14 to $18.00 USD per hour for Italian, with rates varying by language and project requirements.
  • Project-specific training, guidance, and ongoing feedback.
  • Practical experience on a global AI project.
  • Opportunity to build skills in AI evaluation, annotation, prompt review, and language quality.
  • Experience working with QA Leads, international teams, and client stakeholders.
  • No paid holidays or paid time off, as this is an independent contractor engagement.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI Trainer – Aeronautical Engineers - CAD/Python Expertise (Remote Advisory - US)

Prolific 51-250 Professional Services

Prolific is seeking aeronautical engineers to join a remote expert research network supporting the training of AI models with CAD design and validation workflows.

Linux Python
1 day, 1 hour ago

AI Trainer - Electrical Engineers - CAD/Python Expertise - (Remote Advisory - US)

Prolific 51-250 Professional Services

Prolific is recruiting electrical engineers for a remote advisory AI research pool focused on real-world CAD design and validation workflows.

Linux Python
1 day, 1 hour ago

Generative AI Analyst | Simplified Chinese (US)

Welo Global Professional Services

Welo Data, part of Welocalize, is hiring a remote freelance Generative AI Analyst for Simplified Chinese to review and annotate multimodal AI content and help improve dataset quality for next-generation AI systems.

Generative AI LLM
1 day, 1 hour ago

AI Trainer – Aeronautical Engineers - CAD/Python Expertise (Remote Advisory - UK)

Prolific 51-250 Professional Services

Prolific is seeking aeronautical engineers for a remote advisory talent pool supporting AI research by documenting real-world CAD design and validation workflows.

Linux Python
1 day, 1 hour ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers