Lead Applied Scientist

3 months ago
Contract
Lead
Data Science and Analytics
Prolific

Prolific

Prolific is a platform that enables researchers to quickly find trustworthy research participants. With a pool of over 120,000 active and verified participants, Prolific ensures high-quality responses through continuous monitoring and engagement. The p...

Professional Services
51-250
Founded 1997
$0M raised

Description

  • Prototype AI/ML methods to improve human data quality, judgment aggregation, and AI evaluation workflows.
  • Design experiments, benchmarks, and reliability tests to assess quality, efficiency, and customer outcomes.
  • Apply classical machine learning, statistics, LLMs, and agentic techniques to practical problems.
  • Use modern AI tools to accelerate prototyping, experimentation, and iteration.
  • Partner with product and engineering teams to turn scientific methods into scalable platform capabilities.
  • Communicate technical assumptions, trade-offs, and recommendations to both technical and non-technical stakeholders.
  • Translate ambiguous product and customer problems into clear hypotheses, experiments, metrics, and reusable methodologies.

Requirements

  • PhD or MSc in Computer Science, Mathematics, Statistics, Machine Learning, or a related field.
  • 3+ years of applied ML, AI research, or data science experience with demonstrated real-world impact.
  • Experience with human-in-the-loop AI systems, including RLHF, annotation pipelines, data quality modelling, judgment aggregation, benchmarks, or AI evaluation.
  • Fluency with modern LLM and agentic techniques such as Retrieval-Augmented Generation (RAG), LLM-as-judge, multi-agent workflows, synthetic data generation, and automated quality review.
  • Strong Python skills and the ability to quickly build, test, and iterate on working prototypes.
  • Strong judgment on when to use simple statistical methods, classical ML, LLMs, or agentic approaches.
  • Experience partnering with product and engineering teams and strong cross-functional communication skills.
  • Ability to work on ambiguous problems and turn them into clear methodologies and metrics.
  • Fixed-term contract position for 12 months.
  • Experience in human-in-the-loop AI systems is preferred.

Benefits

  • Competitive salary.
  • Remote working.
  • Benefits package.
  • Mission-driven culture.
  • Access to Prolific's unique human data platform.
  • Opportunities for groundbreaking research.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Research Fellow - Occupational Licensing & Labor Mobility

AlphaHire Professional Services

Workforce Intelligence Lab seeks a Senior Research Fellow to support quasi-experimental research on how occupational licensing reforms affect employment, wages, labor supply, and interstate worker mobility.

Python R SQL
2 weeks, 1 day ago

Sr Data Scientist Lead

Coderio 51-250 Internet Software & Services

Coderio is seeking a Senior Data Scientist Lead to guide international client initiatives across the full data science lifecycle, from business problem definition through production deployment and optimization, while delivering measurable business value.

Apache Spark AWS Docker Feature Engineering Generative AI Kubernetes Machine Learning MLOps NumPy Pandas Python Scikit-learn SQL
2 weeks, 5 days ago

Senior Data Scientist

Xometry 251-1K Industrial Conglomerates

Xometry is hiring a Senior Data Scientist on a one-year contract with potential extension to develop data-driven solutions, including cost prediction, for its two-sided digital manufacturing marketplace.

Agile Git Looker Machine Learning MongoDB NumPy Pandas Python Scikit-learn SciPy Snowflake SQL
3 weeks, 2 days ago

박사(PhD) 전문가 — 한국어 | 사회·행동과학, 인문학, 예술, 언어학 분야

Welo Global Professional Services

Welo Data is building a pipeline of Korea-based PhD-level experts for future remote projects supporting AI model training and evaluation.

LLM
4 weeks ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers