MCP & Plug In Connectors Expert

1 week, 3 days ago
Contract
Senior
Artificial Intelligence and Machine Learning
Weekday

Weekday

Weekday helps companies hire engineers who are vouched by other software engineers, enabling passive income for engineers. They offer services like drafting outreach messages, shortlisting candidates, and conducting reference checks. Backed by Y Combin...

Construction & Engineering
11-50
Founded 2020

Description

  • Design realistic prompts that reflect complex, real-world personal workflows.
  • Execute multi-step tasks using AI while recording your screen for evaluation.
  • Use AI plugins and connectors throughout workflow execution.
  • Assess AI-generated outputs for practicality, personalization, reasoning quality, and usefulness.
  • Identify failures in context handling, tool use, constraint awareness, and recommendations.
  • Write detailed, structured evaluations of AI strengths, weaknesses, and improvement opportunities.
  • Develop and apply structured rubrics to measure AI performance consistently across task types.

Requirements

  • Must be based in the United States.
  • Strong hands-on experience with Model Context Protocol (MCP) and AI plugin/connector ecosystems.
  • Frequent use of AI plugins/connectors such as Google Drive, Expedia, and Notion.
  • At least 6 months of heavy personal use of large language models.
  • Experience using AI for multi-step planning, research, decision-making, and everyday personal workflows.
  • Strong analytical thinking, written communication, and attention to detail.
  • Ability to evaluate AI outputs for accuracy, usefulness, personalization, safety, and reasoning quality.
  • Willingness to sign a data-sharing consent agreement through DocuSign.
  • Experience designing, applying, or reviewing structured evaluation rubrics.
  • Preferred: 100+ hours of AI evaluation or quality assessment work.
  • Preferred: Deep familiarity with AI-assisted productivity workflows involving multiple connected applications.
  • Preferred: Experience identifying AI limitations and recommending improvements from real-world usage scenarios.
  • Desktop or laptop computer required; Chromebooks are not supported.
  • Able to complete assigned work within 24 hours of task assignment.
  • Expected commitment of 20+ hours per week.
  • H1-B and STEM OPT candidates are not supported.

Benefits

  • Compensation of $50-$190 per hour.
  • Fully remote work with flexible working hours.
  • Weekly payments based on approved work completed.
  • Trial period with potential for continued engagement based on performance.
  • Reasonable accommodations available throughout the application and engagement process.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI Trainer - Electrical Engineers - CAD/Python Expertise - (Remote Advisory - Norway)

Prolific 51-250 Professional Services

Prolific is recruiting Electrical Engineers for a remote advisory expert network project that helps train AI models using real-world CAD design and validation workflows.

Linux Python
16 hours, 21 minutes ago

AI Training - Open Source CAD Research - Aerospace Engineers - US

Prolific 51-250 Professional Services

Prolific is seeking aerospace engineers for a remote, task-based AI training project that captures real-world CAD design and validation workflows to help train next-generation AI models.

Linux Python
16 hours, 36 minutes ago

AI Trainer - Mechanical Engineers - CAD Expertise - (Remote Advisory - Netherlands)

Prolific 51-250 Professional Services

Prolific is seeking mechanical engineers to join its remote expert network and help train AI models by completing CAD design and validation tasks based on real-world engineering workflows.

Linux Python
16 hours, 36 minutes ago

AI Trainer - Mechanical Engineers - CAD Expertise - (Remote Advisory - Switzerland)

Prolific 51-250 Professional Services

Prolific is seeking mechanical engineers to join a remote advisory talent pool supporting AI research by demonstrating real-world CAD design and validation workflows.

Linux Python
16 hours, 36 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers