RemoteLeads Logo
Sign Up Sign In

AI Evaluation & Annotation Reviewer (L3 - Advanced Level) - Italian (US)

2 hours, 3 minutes ago
United States
Contract
Lead
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
Machine Learning
Apply Now
Volga Partners

Volga Partners

Volga Partners is a technology company that provides innovative solutions and services to clients. With expertise in ML, AI, and crowd management, we deliver high-quality software development, data annotation, content management, data mining, analytics...

Internet Software & Services
51-250
View All Jobs 54

Description

  • Review AI-generated responses for clarity, accuracy, correctness, relevance, and overall quality.
  • Annotate and label language content according to detailed project guidelines.
  • Generate or evaluate prompts based on assignment requirements.
  • Identify linguistic errors, dataset concerns, and structural inconsistencies.
  • Provide structured feedback to improve AI performance.
  • Communicate language requirements clearly to linguistic and non-linguistic stakeholders.
  • Collaborate with QA Leads and clients to apply feedback and maintain quality standards.
  • Attend daily client-facing meetings with camera on.
  • Submit daily work reports and meet productivity and quality expectations.

Requirements

  • Professional fluency in Italian with strong written and verbal communication skills.
  • At least 8 years of experience in localization, AI training, or a related field.
  • Bachelor’s degree in linguistics, languages, computer science, or a related field, or equivalent professional experience.
  • Italian degree or certification where required.
  • Strong analytical skills and exceptional attention to detail.
  • Experience identifying language patterns, errors, inconsistencies, and subtle linguistic issues.
  • Experience in annotation, evaluation, translation, localization, linguistics, research, education, or quality assurance is preferred.
  • Interest in artificial intelligence, machine learning, language technology, or data annotation.
  • Ability to learn new tools, follow detailed guidelines, and adapt to changing requirements.
  • Ability to work independently and collaborate effectively with a global team.
  • Commitment to a minimum six-month engagement with consistent availability.
  • Availability for consecutive eight-hour shifts during core hours of 8:00 AM–5:00 PM PST and daily meetings from 10:00 AM–12:00 PM PST.
  • Applicants must reside outside the listed restricted countries and territories.

Benefits

  • Italian compensation of $14–$18 USD per hour.
  • Project-specific training, guidance, and ongoing feedback.
  • Hands-on experience on a global artificial intelligence project.
  • Opportunities to build skills in AI evaluation, annotation, prompt review, and language quality.
  • Collaboration with QA Leads, international teams, and client stakeholders.
  • Independent contractor engagement with no paid holidays or paid time off.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Weekday

PDF Annotation & Transcription Experts - Odiya

Weekday 11-50 Construction & Engineering

As an Odiya document annotation specialist for a client, you will create structural annotations and exact Odiya-script transcriptions of diverse PDF pages to build training data for document-understanding models.

India Contract Mid Level Data Annotator
$26k-$26k
2 hours, 18 minutes ago
Welo Global

Andromeda Sadiradra - Audio Rater - Generalist - English (Ireland)

Welo Global Professional Services

Welo Data is seeking freelance Audio Raters in Ireland to evaluate recorded conversations between users and AI voice agents for response quality and naturalness.

Ireland Freelance Entry Level AI (Artificial Intelligence)
$57k-$57k
1 day, 1 hour ago
Welo Global

Andromeda Sadiradra - Audio Rater - Generalist - English (United Kingdom)

Welo Global Professional Services

Welo Data is seeking UK-based freelance Audio Raters to evaluate the content and vocal quality of recorded conversations between users and AI voice agents.

United Kingdom Freelance Entry Level AI (Artificial Intelligence)
$48k-$48k
1 day, 1 hour ago
Crosslake

AI / ML Consultant

Crosslake 251-1K Capital Markets

The AI/ML Consultant will advise private equity firms and technology companies across Europe on AI strategy, technical due diligence, and hands-on implementation to improve technology value and execution.

Europe Contract Lead AI (Artificial Intelligence)
Agile Generative AI Machine Learning MLOps Statistics
1 day, 2 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers