Data Science Expert

1 month, 2 weeks ago
Contract
Senior
Data Science and Analytics
Weekday

Weekday

Weekday helps companies hire engineers who are vouched by other software engineers, enabling passive income for engineers. They offer services like drafting outreach messages, shortlisting candidates, and conducting reference checks. Backed by Y Combin...

Construction & Engineering
11-50
Founded 2020

Description

  • Design detailed, task-specific evaluation criteria for real-world data science deliverables.
  • Evaluate AI-generated and human-produced work using objective scoring frameworks.
  • Provide detailed written justifications for each evaluation.
  • Apply analytical judgment to produce reproducible and defensible assessments.
  • Incorporate reviewer feedback and refine evaluation methodologies.
  • Collaborate with cross-functional teams to improve AI training quality and evaluation standards.
  • Review data analyses, predictive and statistical models, dashboards, visualizations, experiment results, and executive recommendations.

Requirements

  • 5+ years of professional experience in Data Science within an industry environment.
  • Strong background in business operations, product analytics, growth analytics, or similar data science functions at technology-driven organizations.
  • Deep expertise in experimental design and A/B testing.
  • Deep expertise in statistical analysis.
  • Deep expertise in SQL and Python.
  • Deep expertise in metric development and performance measurement.
  • Experience translating analytical findings into business recommendations.
  • Excellent written communication skills and ability to explain technical reasoning clearly.
  • Exceptional attention to detail and ability to evaluate work consistently against structured rubrics.
  • Experience contributing to AI evaluation, model training, human feedback, or data annotation initiatives (preferred).
  • Familiarity with large language models (LLMs), AI-assisted analytics, or machine learning workflows (preferred).
  • Experience reviewing technical work or mentoring analytical teams (preferred).

Benefits

  • Compensation of $120-$170 per hour.
  • Fully remote work with flexible scheduling and working hours.
  • Weekly payments based on approved work completed.
  • Independent contractor engagement.
  • Project duration may be extended based on project requirements and performance.
  • Reasonable accommodations and equal opportunity commitment.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Freelance Agent Evaluation Engineer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking experienced software developers for a project-based, remote opportunity creating and evaluating realistic coding tasks and tests for AI coding agents used by leading technology companies.

Cybersecurity Docker FastAPI JavaScript Kafka Machine Learning PostgreSQL Python React Redis TypeScript
14 hours, 46 minutes ago

AI Trainer - Fluent Kazakh Speaker - Stuttgart, Germany

Prolific 51-250 Professional Services

Prolific is seeking fluent Kazakh speakers to evaluate AI-generated text for naturalness, authenticity, tone, and cultural fit, helping improve AI language models.

NLP
2 days, 13 hours ago

AI Trainer - Fluent Kazakh Speaker - Leipzig, Germany

Prolific 51-250 Professional Services

Prolific is seeking fluent Kazakh speakers to evaluate AI-generated text for naturalness, authenticity, tone, and cultural accuracy as part of human-data projects that improve language models.

2 days, 13 hours ago

AI Trainers - United States

Prolific 51-250 Professional Services

Prolific is seeking U.S.-based people from diverse professional and educational backgrounds to participate in academic and applied research studies that train and evaluate AI systems and inform products, services, and research.

LLM
2 days, 13 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers