Prolific

Prolific

Prolific is a platform that enables researchers to quickly find trustworthy research participants. With a pool of over 120,000 active and verified participants, Prolific ensures high-quality responses through continuous monitoring and engagement. The p...

Professional Services
51-250
Founded 1997
$0M raised

Description

  • Evaluate LLM-generated data insights and statistical analyses for accuracy, clarity, and completeness.
  • Fact-check mathematical proofs, statistical formulas, and data-driven conclusions using authoritative references.
  • Execute data-related scripts in Python or R to verify correct results and edge-case handling.
  • Annotate model performance by identifying strengths and weaknesses in how models solve data problems and build predictive models.
  • Review AI responses for compliance with system guidelines and professional technical standards.
  • Contribute technical expertise to training and evaluation tasks for cutting-edge AI models.

Requirements

  • BS, MS, or PhD in Data Science, Statistics, Mathematics, or a closely related quantitative field.
  • Real-world experience in data analysis, predictive modeling, or machine learning engineering.
  • Ability to solve complex statistical problems and interpret high-level data visualizations independently.
  • Strong attention to detail and ability to identify subtle logical fallacies in statistical reasoning or data interpretations.
  • Significant experience using LLMs in data workflows, with understanding of where they hallucinate or fail.
  • Ability to explain complex mathematical concepts or data insights clearly and concisely.
  • Proficiency in Python (including Pandas, NumPy, and Scikit-learn) or R.
  • Advanced SQL for complex data extraction and manipulation.
  • Experience with visualization tools such as Tableau, PowerBI, Matplotlib, or Seaborn.
  • Deep understanding of machine learning frameworks such as PyTorch or TensorFlow and statistical modeling techniques.
  • A PayPal account is required to receive payment.
  • Completion of a 10- to 15-minute assessment test to evaluate suitability for AI tasks.

Benefits

  • Competitive pay rates, with researchers paying up to $80 per hour.
  • Flexible hours.
  • Ability to work from home.
  • Paid tasks that can be completed on your own schedule.
  • Quick onboarding after passing the assessment, with the ability to join in about 15 minutes.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI Product Designer

BrainLake 11-50 Software

AI Product Designer at an unspecified company, creating web and mobile product experiences with an AI-first design approach.

Design Systems Figma Prototyping UI Design UX Design Wireframing
17 hours, 45 minutes ago

Politics Content Reviewer (AI Evaluation)

Gramian Consultancy Group Professional Services

Gramian Consultancy is hiring a remote Political Science Domain Expert to support evaluation and improvement of large language models through domain-specific prompt creation, response review, and benchmark data development.

LLM
1 day, 17 hours ago

Healthcare Administrative Specialist

Weekday 11-50 Construction & Engineering

A fully remote, independent-contractor role for a healthcare operations professional supporting the development of AI systems by documenting and improving real-world administrative workflows for a client.

1 day, 17 hours ago

Remote Work From Home: Audio Evaluation Project

CrowdGen by Appen Internet Software & Services

CrowdGen is hiring a remote independent contractor for an audio evaluation project to compare paired recordings and select the better one for AI speech improvement.

4 days, 16 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers