Prolific

Prolific

Prolific is a platform that enables researchers to quickly find trustworthy research participants. With a pool of over 120,000 active and verified participants, Prolific ensures high-quality responses through continuous monitoring and engagement. The p...

Professional Services
51-250
Founded 1997
$0M raised

Description

  • Evaluate AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
  • Audit ML code and notebooks, including training loops, data preprocessing scripts, and model evaluations, for correctness and efficiency.
  • Provide human feedback to refine RLHF frameworks and improve model alignment, safety, and helpfulness.
  • Analyze model reasoning on complex chain-of-thought prompts and identify where reasoning breaks down.
  • Benchmark and compare model outputs using technical taxonomies and performance metrics.
  • Review technical content for hallucinations, biased outputs, and logical failures.
  • Help train and evaluate next-generation LLMs through paid expert tasks.

Requirements

  • BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a focus on Machine Learning.
  • Experience building, deploying, or fine-tuning ML models in a production environment.
  • Professional-level understanding of neural network architectures such as Transformers, CNNs, and RNNs, plus optimization techniques.
  • Hands-on experience with Prompt Engineering, RLHF, or RAG workflows.
  • Ability to audit complex model logic, identify training data contamination, and evaluate mathematical proofs behind ML algorithms.
  • High attention to detail in spotting hallucinations, biased outputs, and logical failures in AI-generated technical content.
  • Expert proficiency in PyTorch or TensorFlow/Keras.
  • Advanced Python experience, including NumPy, Pandas, Scikit-learn, and Hugging Face Transformers.
  • Experience with AWS SageMaker, Google Cloud Vertex AI, Weights & Biases, or LangChain.
  • Familiarity with Pinecone, Milvus, or Weaviate for RAG evaluation.

Benefits

  • Pay rates up to $80 per hour for researchers seeking your skills.
  • Flexible hours.
  • Ability to work from home.
  • Quick 10- to 15-minute assessment and fast onboarding if successful.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior IA Engineer

Coderio 51-250 Internet Software & Services

Coderio is hiring a Senior AI Engineer for its AI Engineering Core to build and operate reusable AI foundations, LLM infrastructure, and agentic capabilities that enable global engineering and product teams to adopt Generative AI safely and efficiently.

AWS CI/CD Datadog Docker Generative AI Kubernetes Microservices Python REST API Terraform
2 days, 9 hours ago

Data & AI Engineer

RevStar 51-250 Internet Software & Services

RevStar is seeking a remote, US-based contract Data & AI Engineer to build and deploy scalable Databricks Lakehouse, data pipeline, and production AI solutions for enterprise clients.

Agile Apache Spark AWS Azure CI/CD Databricks Feature Engineering GCP HIPAA MLflow MLOps Python SQL Terraform
3 days, 10 hours ago

Senior Forward Deployed AI Architect (GenAI, AWS)

Provectus 251-1K Professional Services

Provectus is hiring a Forward Deployed AI Engineer to embed with enterprise clients in financial services, insurance, healthcare, or life sciences, learn operational work firsthand, and rebuild critical business processes using production AI systems.

AWS AWS CDK Azure CI/CD CloudFormation GCP Generative AI Kubernetes LLM Microservices MLflow MLOps Neo4j Python PyTorch Terraform TypeScript
1 week, 1 day ago

Senior AI Architect

kake 1-10 Internet Software & Services

Senior AI Architect at a company building production-grade AI applications and platforms that solve complex real-world problems at scale.

AWS Azure Docker GCP Kubernetes LLM Next.js Python React
1 week, 3 days ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers