RemoteLeads Logo
Sign Up Sign In

Freelance Agent Evaluation Engineer

9 hours, 28 minutes ago
Canada
Freelance
Senior
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
Cybersecurity Docker FastAPI JavaScript Kafka Machine Learning PostgreSQL Python React Redis TypeScript
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 10

Description

  • Build realistic simulated developer environments with codebases, infrastructure, tickets, documentation, and conversation history.
  • Design challenging tasks from intermediate environment states, including prompts and clear success criteria.
  • Write functional and integration tests that accept valid solutions and reject incorrect ones.
  • Review AI-generated solutions and analyze failures to identify weaknesses in tasks or evaluations.
  • Iterate on tasks and tests based on quality-assurance feedback to ensure fair, robust assessments.
  • Define scenarios that reveal meaningful differences between strong and weak AI coding solutions.

Requirements

  • At least 5 years of software development experience.
  • Proficiency with Python and FastAPI.
  • Experience with JavaScript or TypeScript and React.
  • Experience with Docker, PostgreSQL, Kafka, and Redis.
  • Experience writing functional and integration tests.
  • English proficiency at B2 level or higher.
  • Master’s degree in computer science, software engineering, data science, artificial intelligence, NLP, information systems, or a related field.
  • Bachelor’s degree accepted with at least 5 years of relevant experience.
  • At least 3 years of professional experience in related roles; specifically required for QA automation/testing or cybersecurity roles.

Benefits

  • Remote, part-time freelance work that can fit around other professional or academic commitments.
  • Payment per accepted task, with rates based on qualification tier and efficiency.
  • Potential compensation of up to the equivalent of $50 per hour.
  • Opportunity to work on advanced AI projects and strengthen your portfolio.
  • Opportunity to influence how future AI models perform in software development.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Binance

Binance Accelerator Program - QA Engineer, App testing (Java, SQL)

Binance 5K-10K Capital Markets

Binance is seeking an early-career QA testing participant for its six-month Accelerator Program to test the Binance mobile app and support reliable delivery across Android and iOS in a Web3 environment.

Taiwan Hong Kong Contract Entry Level QA Engineer
Android Blockchain iOS Java MySQL SQL
8 hours, 28 minutes ago
Welo Global

Generative AI Analyst | Traditional Chinese (US)

Welo Global Professional Services

Welo Data, part of Welocalize, is seeking remote freelance Traditional Chinese Generative AI Analysts in the US to evaluate, annotate, and improve AI-generated content across text, audio, images, video, and other data types.

United States Freelance Mid Level AI (Artificial Intelligence) Data Annotator
$31k-$31k
Generative AI LLM
8 hours, 58 minutes ago
Loadsmart

QA Engineer (Remote-Brazil)

Loadsmart 251-1K Air Freight & Logistics

Loadsmart is hiring a Senior QA Engineer in Brazil to validate complex edge cases across its logistics products and expand automation coverage throughout the development lifecycle.

Brazil Contract Senior QA Engineer
Cypress JIRA Playwright Selenium
8 hours, 58 minutes ago
Toloka

Freelance Annotator (English) - AI Trainer

Toloka 251-1K Internet Software & Services

Mindrift is seeking freelance AI annotators to review and label text, images, and videos for project-based opportunities that help leading technology companies evaluate and improve AI systems.

Canada Freelance Junior AI (Artificial Intelligence)
Up to $42k
9 hours, 28 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers