RemoteLeads Logo
Sign Up Sign In

Project Lion - Lead Prompt Engineer - United States (Remote, Part-Time)

3 months ago
United States
Freelance
Lead
AI Engineer
Data Science and Analytics
LLM SQL
Apply Now
Welo Global

Welo Global

Welo Global specializes in providing enterprise localization, AI training data, and multilingual content solutions, leveraging a portfolio of specialized global brands to meet diverse customer needs in the AI and language services industry.

Professional Services
Founded 1997
View All Jobs 405

Description

  • Lead and manage the technical migration from templates to LLM autoraters.
  • Use Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
  • Run and supervise Automated Prompt Optimization (APO) workflows and identify deadlocks or plateaus in output.
  • Manually draft, test, and refine prompts for complex architectures, anti-patterns, and tooling gaps.
  • Solve edge cases by designing and iterating on manual prompt solutions.
  • Monitor shadowbot runs to ensure disagreements between human and LLM ratings are generated and tracked.
  • Run prompt versions against gold data to measure autorater quality against the human crowd baseline.
  • Calculate evaluation metrics such as F1 score, precision, and recall.
  • Draft technical launch readiness and certification documentation for final release.
  • Mentor junior engineers and help shape prompt strategy for AI system improvement.

Requirements

  • Must be based in the United States.
  • Native fluency in English.
  • Master’s or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
  • At least 7 years of experience as a Prompt Engineer.
  • Proven experience tuning large language models (LLMs) for strict, structured outputs and complex classification tasks.
  • Familiarity with chain-of-thought and few-shot learning approaches.
  • Strong proficiency in identifying error patterns and analyzing model performance.
  • Experience using SQL or other data analytics tools.
  • Ability to quickly learn and master proprietary tools with minimal supervision.
  • Excellent verbal and written communication skills.
  • Familiarity with enterprise-grade LLM interfaces like the Goose API (preferred).
  • Experience in AI model evaluation, data science, computational linguistics, or software engineering (preferred).
  • Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows (preferred).
  • Linguistic expertise, including an understanding of semantics and logic (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Multiplica

AI Engineer (Freelance)

Multiplica 251-1K Internet Software & Services

Multiplica busca un AI Engineer freelance para diseñar e implementar soluciones de inteligencia artificial y automatización en una plataforma propia conectada con sistemas internos y externos.

Mexico Contract Senior AI Engineer
GitHub GitLab JavaScript Python React
1 day, 13 hours ago
Mindrift.ai: Be the “I” in AI

Chatbot Developer (WhatsApp, Telegram, Discord) - Freelance

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a part-time freelance Bot Developer for the Tendem project to build and refine conversational bots and messaging-platform integrations in a hybrid AI + human workflow.

Mexico Argentina Brazil Chile Colombia Peru Freelance Mid Level AI Engineer Backend Engineer
Up to $62k
Docker Node.js OAuth Python REST API Serverless
2 days, 13 hours ago
Mindrift.ai: Be the “I” in AI

Chatbot Developer (WhatsApp, Telegram, Discord) - Freelance

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a freelance, part-time remote Bot Developer for the Tendem project to build and refine conversational bots and messaging-platform integrations in a hybrid AI + human workflow.

India Freelance Mid Level AI Engineer Backend Engineer
Up to $73k
Docker Node.js OAuth Python REST API Serverless
2 days, 13 hours ago
Coderio

Desarrollador Full stack Senior

Coderio 51-250 Internet Software & Services

Coderio busca un Desarrollador Fullstack Senior para un equipo internacional que desarrolla aplicaciones web de արտադրcción con componentes de IA y orquestación de LLMs para múltiples mercados.

Mexico Contract Senior AI Engineer Full-stack Engineer
Next.js PostgreSQL Tailwind CSS TypeScript
3 days, 13 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers