RemoteLeads Logo
Sign Up Sign In

MCP & Plug In Connectors Expert

2 months, 1 week ago
United States
Contract
Senior
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
LLM Notion
Apply Now
Weekday

Weekday

Weekday helps companies hire engineers who are vouched by other software engineers, enabling passive income for engineers. They offer services like drafting outreach messages, shortlisting candidates, and conducting reference checks. Backed by Y Combin...

Construction & Engineering
11-50
Founded 2020
View All Jobs 126

Description

  • Design realistic prompts that reflect complex, real-world personal workflows.
  • Execute multi-step tasks using AI while recording your screen for evaluation.
  • Use AI plugins and connectors throughout workflow execution.
  • Assess AI-generated outputs for practicality, personalization, reasoning quality, and usefulness.
  • Identify failures in context handling, tool use, constraint awareness, and recommendations.
  • Write detailed, structured evaluations of AI strengths, weaknesses, and improvement opportunities.
  • Develop and apply structured rubrics to measure AI performance consistently across task types.

Requirements

  • Must be based in the United States.
  • Strong hands-on experience with Model Context Protocol (MCP) and AI plugin/connector ecosystems.
  • Frequent use of AI plugins/connectors such as Google Drive, Expedia, and Notion.
  • At least 6 months of heavy personal use of large language models.
  • Experience using AI for multi-step planning, research, decision-making, and everyday personal workflows.
  • Strong analytical thinking, written communication, and attention to detail.
  • Ability to evaluate AI outputs for accuracy, usefulness, personalization, safety, and reasoning quality.
  • Willingness to sign a data-sharing consent agreement through DocuSign.
  • Experience designing, applying, or reviewing structured evaluation rubrics.
  • Preferred: 100+ hours of AI evaluation or quality assessment work.
  • Preferred: Deep familiarity with AI-assisted productivity workflows involving multiple connected applications.
  • Preferred: Experience identifying AI limitations and recommending improvements from real-world usage scenarios.
  • Desktop or laptop computer required; Chromebooks are not supported.
  • Able to complete assigned work within 24 hours of task assignment.
  • Expected commitment of 20+ hours per week.
  • H1-B and STEM OPT candidates are not supported.

Benefits

  • Compensation of $50-$190 per hour.
  • Fully remote work with flexible working hours.
  • Weekly payments based on approved work completed.
  • Trial period with potential for continued engagement based on performance.
  • Reasonable accommodations available throughout the application and engagement process.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

RWS Group

AI Linguistic Evaluator - Telugu

RWS Group 5K-10K Internet Software & Services

Freelance AI Linguistic Evaluator supporting a remote United States project by assessing Telugu AI-generated content for accuracy, naturalness, and cultural relevance.

United States Contract Mid Level AI (Artificial Intelligence)
$37k-$37k
Android iOS macOS
17 hours, 19 minutes ago
RWS Group

AI Linguistic Evaluator - Bengali (India)

RWS Group 5K-10K Internet Software & Services

RWS is seeking remote freelance AI Linguistic Evaluators in the United States to assess Bengali AI-generated content for linguistic accuracy, localization quality, and cultural relevance during a short-term project.

United States Contract Mid Level AI (Artificial Intelligence) Linguist
$37k-$37k
Android iOS macOS
17 hours, 19 minutes ago
RWS Group

AI Linguistic Evaluator - Bengali (India)

RWS Group 5K-10K Internet Software & Services

RWS is seeking remote freelance AI Linguistic Evaluators in Canada to assess Bengali AI-generated content for linguistic accuracy, localization quality, and cultural relevance.

Canada Freelance Mid Level AI (Artificial Intelligence) Linguist
$33k-$33k
Android iOS macOS NLP
17 hours, 19 minutes ago
RWS Group

AI Linguistic Evaluator - Malayalam

RWS Group 5K-10K Internet Software & Services

Freelance AI Linguistic Evaluator for a remote U.S.-based project assessing Malayalam AI-generated content for linguistic accuracy, localization quality, and cultural relevance.

United States Contract Mid Level AI (Artificial Intelligence)
$37k-$37k
Android iOS macOS
17 hours, 34 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers