Weekday

Weekday helps companies hire engineers who are vouched by other software engineers, enabling passive income for engineers. They offer services like drafting outreach messages, shortlisting candidates, and conducting reference checks. Backed by Y Combin...

Construction & Engineering

Industrials

11-50 (45)

Founded 2020

84 open positions

Links

View All Jobs

Data Science Expert

3 weeks, 4 days ago

United States

Contract

Senior

AI (Artificial Intelligence)

Data Science and Analytics

LLM Machine Learning Python SQL

Apply Now

Weekday

Construction & Engineering

11-50

Founded 2020

View All Jobs 84

Description

Design detailed, task-specific evaluation criteria for real-world data science deliverables.
Evaluate AI-generated and human-produced work using objective scoring frameworks.
Provide detailed written justifications for each evaluation.
Apply analytical judgment to produce reproducible and defensible assessments.
Incorporate reviewer feedback and refine evaluation methodologies.
Collaborate with cross-functional teams to improve AI training quality and evaluation standards.
Review data analyses, predictive and statistical models, dashboards, visualizations, experiment results, and executive recommendations.

Requirements

5+ years of professional experience in Data Science within an industry environment.
Strong background in business operations, product analytics, growth analytics, or similar data science functions at technology-driven organizations.
Deep expertise in experimental design and A/B testing.
Deep expertise in statistical analysis.
Deep expertise in SQL and Python.
Deep expertise in metric development and performance measurement.
Experience translating analytical findings into business recommendations.
Excellent written communication skills and ability to explain technical reasoning clearly.
Exceptional attention to detail and ability to evaluate work consistently against structured rubrics.
Experience contributing to AI evaluation, model training, human feedback, or data annotation initiatives (preferred).
Familiarity with large language models (LLMs), AI-assisted analytics, or machine learning workflows (preferred).
Experience reviewing technical work or mentoring analytical teams (preferred).

Benefits

Compensation of $120-$170 per hour.
Fully remote work with flexible scheduling and working hours.
Weekly payments based on approved work completed.
Independent contractor engagement.
Project duration may be extended based on project requirements and performance.
Reasonable accommodations and equal opportunity commitment.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Competitive Programming Expert - Freelance AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking competitive programmers for project-based work creating and validating algorithmic problems, solutions, test cases, and graders that improve AI coding models.

Singapore South Korea New Zealand Japan Freelance Senior AI (Artificial Intelligence)

Up to $187k

C++ Python

18 hours, 5 minutes ago

Apply

18 hours, 5 minutes ago

Task Development Engineer

METR 51-200 nonprofit organization management

METR is seeking a remote Task Development Engineer to develop and evaluate challenging tasks for frontier AI models, supporting its Time Horizons research and broader assessments of AI capabilities and risks.

Anywhere Contract Mid Level AI (Artificial Intelligence)

$312k-$624k

1 day, 17 hours ago

Apply

1 day, 17 hours ago

Mathematician with Python Proficiency - AI Trainer

kake 1-10 Internet Software & Services

A company is building a talent pool of Mathematics professionals with Python proficiency to support project-based AI initiatives focused on evaluating and improving frontier AI models.