Senior Python Engineer - AI Coding Agent Evaluation (Freelance)

1 day, 3 hours ago
Freelance
Lead
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Build realistic developer environments with codebases, infrastructure, and supporting context such as tickets, docs, and conversations.
  • Design tasks from intermediate environment states, including prompts and clear definitions of what counts as solved.
  • Write tests that verify agent solutions and fairly accept valid approaches while rejecting incorrect ones.
  • Review agent solutions, analyze failures, and iterate on tasks and tests based on QA feedback.
  • Refine evaluation criteria until tasks are robust, solvable, and balanced for AI coding agents.
  • Work within project-based engagements where tasks are completed independently by deadline.

Requirements

  • 8+ years of experience in software development.
  • Experience with a core stack including Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, and Redis.
  • Experience writing functional and integration tests.
  • English proficiency at B2 level or higher.
  • CV must be submitted in English.
  • Ability to complete project tasks within the stated deadline.
  • Comfort working in a project-based model rather than permanent employment.

Benefits

  • Up to $200/hr equivalent compensation, depending on level and pace.
  • Flexible schedule with self-directed working hours.
  • Estimated ~30 hours per task, with workload varying by complexity.
  • Project-based paid work with leading tech companies.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior software Engineer

Apache API Gateway AWS CI/CD Go Java Node.js Python Scala System Design TypeScript
17 hours, 28 minutes ago

Record Your Daily Routine & Get Paid - AI Training (Remote)

Toloka 251-1K Internet Software & Services

Project-based freelance work for an AI training platform where contributors record first-person videos of everyday household activities to help train AI systems and robots.

1 day, 2 hours ago

Record Your Daily Routine & Get Paid - AI Training (Remote)

Toloka 251-1K Internet Software & Services

A project-based freelance opportunity on an AI training platform to record first-person videos of everyday household activities for training AI systems and robots.

1 day, 2 hours ago

Record Your Daily Routine & Get Paid - AI Training (Remote)

Toloka 251-1K Internet Software & Services

Project-based freelance work on an AI training platform recording first-person videos of everyday household activities to help train AI systems and robots.

1 day, 2 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers