RemoteLeads Logo
Sign Up Sign In

AI Evaluation & Annotation Reviewer (L3 - Advanced Level) - Italian

1 month, 1 week ago
Albania, Italy, Romania
Contract
Entry Level
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
Machine Learning
Apply Now
Volga Partners

Volga Partners

Volga Partners is a technology company that provides innovative solutions and services to clients. With expertise in ML, AI, and crowd management, we deliver high-quality software development, data annotation, content management, data mining, analytics...

Internet Software & Services
51-250
View All Jobs 52

Description

  • Review AI-generated responses for clarity, accuracy, correctness, relevance, and overall quality.
  • Annotate and label language content according to detailed project guidelines.
  • Generate or evaluate prompts based on assignment requirements.
  • Identify linguistic errors, dataset concerns, and structural inconsistencies.
  • Provide clear, structured feedback to support improvements in AI performance.
  • Communicate complex language requirements to linguistic and non-linguistic stakeholders.
  • Collaborate with QA Leads and clients to apply feedback and maintain quality standards.
  • Participate in required client-facing meetings with your camera on.
  • Submit daily work reports and consistently meet productivity and quality expectations.

Requirements

  • Professional fluency in Italian with strong written and verbal communication skills.
  • Bachelor’s degree in Linguistics, Languages, Computer Science, or a related field, or equivalent professional experience.
  • A degree or certification in Italian, where required.
  • Strong analytical skills and exceptional attention to detail.
  • Ability to identify patterns, errors, inconsistencies, and subtle language issues.
  • Experience in annotation, evaluation, translation, localization, linguistics, research, education, or quality assurance is helpful but not required.
  • Interest in Artificial Intelligence, Machine Learning, language technology, or data annotation.
  • Ability to learn new tools, follow detailed guidelines, and adapt to changing project requirements.
  • Strong organization and task-management skills.
  • Ability to commit to the project for a minimum of six months and maintain consistent availability.
  • Work consecutive eight-hour shifts and remain available during core hours of 8:00 AM–5:00 PM PST.
  • Attend daily client meetings scheduled between 10:00 AM–12:00 PM PST.

Benefits

  • Gain practical experience working on a global Artificial Intelligence project.
  • Build skills in AI evaluation, annotation, prompt review, and language quality.
  • Work directly with QA Leads, international teams, and client stakeholders.
  • Receive project-specific training, guidance, and ongoing feedback.
  • Italian rate of $14 to $16.00 USD per hour.
  • Independent contractor engagement.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Meridial Marketplace, by Invisible

AWS Trainium/NKI (TRN) AI Task Auditor - Freelance AI Trainer Project

Meridial Marketplace, by Invisible 501-1000 information technology & services

Remote freelance contract for an AWS Trainium and Neuron Kernel Interface (NKI) technical specialist to audit AI training and evaluation tasks for accuracy, practicality, reproducibility, and technical rigor.

Anywhere Contract Senior AI (Artificial Intelligence)
$146k-$208k
5 hours, 57 minutes ago
Prolific

US Finance Data Contributor – AI Research (Remote, Task-Based) - Cleveland

Prolific 51-250 Professional Services

Prolific is recruiting US-based adults to provide redacted, genuine financial records for a remote, task-based AI research study designed to help train AI models.

United States Contract Entry Level Data Annotator
$0k-$0k
6 hours, 27 minutes ago
Prolific

AI Training - Fluent Japanese Speakers - Kōbe, Japan

Prolific 51-250 Professional Services

Prolific is seeking fluent Japanese speakers for flexible, task-based remote video conversations that provide natural language data to train and improve AI models.

Japan Contract Entry Level AI (Artificial Intelligence)
Up to $37k
6 hours, 27 minutes ago
Prolific

US Finance Data Contributor – AI Research (Remote, Task-Based) - Raleigh

Prolific 51-250 Professional Services

Prolific is seeking US-based adults to participate remotely in a paid, task-based research study providing genuine financial data to help train AI models.

United States Contract Entry Level Data Annotator
6 hours, 27 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers