AI Evaluation & Annotation Reviewer (L3 - Advanced Level) - Italian (US)

3 weeks, 2 days ago
Contract
Lead
Artificial Intelligence and Machine Learning
Volga Partners

Volga Partners

Volga Partners is a technology company that provides innovative solutions and services to clients. With expertise in ML, AI, and crowd management, we deliver high-quality software development, data annotation, content management, data mining, analytics...

Internet Software & Services
51-250

Description

  • Review AI-generated responses for clarity, accuracy, correctness, relevance, and overall quality.
  • Annotate and label language content according to detailed project guidelines.
  • Generate or evaluate prompts based on assignment requirements.
  • Identify linguistic errors, dataset concerns, and structural inconsistencies.
  • Provide structured feedback to improve AI performance.
  • Communicate language requirements clearly to linguistic and non-linguistic stakeholders.
  • Collaborate with QA Leads and clients to apply feedback and maintain quality standards.
  • Attend daily client-facing meetings with camera on.
  • Submit daily work reports and meet productivity and quality expectations.

Requirements

  • Professional fluency in Italian with strong written and verbal communication skills.
  • At least 8 years of experience in localization, AI training, or a related field.
  • Bachelor’s degree in linguistics, languages, computer science, or a related field, or equivalent professional experience.
  • Italian degree or certification where required.
  • Strong analytical skills and exceptional attention to detail.
  • Experience identifying language patterns, errors, inconsistencies, and subtle linguistic issues.
  • Experience in annotation, evaluation, translation, localization, linguistics, research, education, or quality assurance is preferred.
  • Interest in artificial intelligence, machine learning, language technology, or data annotation.
  • Ability to learn new tools, follow detailed guidelines, and adapt to changing requirements.
  • Ability to work independently and collaborate effectively with a global team.
  • Commitment to a minimum six-month engagement with consistent availability.
  • Availability for consecutive eight-hour shifts during core hours of 8:00 AM–5:00 PM PST and daily meetings from 10:00 AM–12:00 PM PST.
  • Applicants must reside outside the listed restricted countries and territories.

Benefits

  • Italian compensation of $14–$18 USD per hour.
  • Project-specific training, guidance, and ongoing feedback.
  • Hands-on experience on a global artificial intelligence project.
  • Opportunities to build skills in AI evaluation, annotation, prompt review, and language quality.
  • Collaboration with QA Leads, international teams, and client stakeholders.
  • Independent contractor engagement with no paid holidays or paid time off.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Affiliate Marketing & AI Discovery Consultant

Ooma, Inc. 1001-5000 telecommunications

Ooma is seeking an Affiliate Marketing & AI Discovery Consultant for a 4–6 month maternity-leave coverage engagement to manage its B2B affiliate program and improve visibility across traditional and AI-powered buyer discovery channels.

Affiliate Marketing Content Marketing
4 hours, 15 minutes ago

AI Voice Recording Contributor - Arabic (Gulf)

RWS Group 5K-10K Internet Software & Services

RWS is seeking freelance Arabic (Gulf) voice recording contributors to work remotely on a one-month AI voice evaluation project by recording provided text prompts in their natural dialect.

NLP
4 hours, 44 minutes ago

Radiology Expert

Weekday 11-50 Construction & Engineering

A leading AI research lab is partnering with practicing radiologists to establish expert reference standards for evaluating AI performance on real, de-identified medical imaging studies.

5 hours, 29 minutes ago

Image Annotation - Remote Work

Chemin Construtora Construction & Engineering

Kaya by Chemin Sdn Bhd is seeking AI data contributors to annotate architectural floor plans in a large-scale dataset by labeling key elements with polygon segmentation.

5 hours, 29 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers