Project Lion - Prompt Engineer - United States (Remote, Part-Time)

2 months, 4 weeks ago
Freelance
Junior
Data Science and Analytics
Welo Global

Welo Global

Welo Global specializes in providing enterprise localization, AI training data, and multilingual content solutions, leveraging a portfolio of specialized global brands to meet diverse customer needs in the AI and language services industry.

Professional Services
Founded 1997

Description

  • Use Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
  • Run and supervise Automated Prompt Optimization (APO) workflows and identify when optimization reaches deadlocks or plateaus.
  • Manually draft, test, and refine prompts for complex template architectures, anti-patterns, and edge cases.
  • Design and refine manual prompts to resolve scenarios where tooling is missing or broken.
  • Monitor shadowbot runs to ensure sufficient human-versus-LLM disagreements are generated and tracked.
  • Run prompt versions against gold data to measure autorater quality against the human crowd baseline.
  • Calculate evaluation metrics such as F1 score, precision, and recall.
  • Draft technical launch readiness documentation to support final certification decisions.

Requirements

  • Native fluency in English.
  • Must be based in the United States.
  • Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
  • At least 2 years of experience as a Prompt Engineer.
  • Proven experience tuning large language models (LLMs) for strict, structured outputs and complex classification tasks.
  • Familiarity with chain-of-thought prompting and few-shot learning.
  • Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools.
  • Ability to quickly learn and master proprietary tools with minimal supervision.
  • Excellent verbal and written communication skills.
  • Experience with enterprise-grade LLM interfaces such as the Goose API is preferred.
  • Background in AI model evaluation, data science, computational linguistics, or software engineering is preferred.
  • Hands-on experience with APO systems or prompt tuning workflows is preferred.
  • Linguistic expertise, including semantics and logic, is preferred.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Production Designer, AI & Creative Systems

Bridgit 51-250 Construction & Engineering

Bridgit is hiring a Production Designer, AI and Creative Systems to create on-brand marketing and product creative while building AI-powered workflows and reusable design systems that help scale design across the company.

After Effects CSS Design Systems Figma HTML HubSpot Illustrator JavaScript Photoshop Webflow WordPress
1 month, 1 week ago

Shape the Future of AI — Hebrew Speakers in Israel

Welocalize 1K-5K Professional Services

Welo Data is building a freelance talent pool for future AI language projects in Tel Aviv and remote settings, where Hebrew speakers in Israel will help shape language data, annotation, evaluation, and prompt creation work.

3 months, 1 week ago

AI-Native Copywriter & Conversion Specialist - Remote (Contractor)

ShaeWellness 1-10 health, wellness & fitness

An AI-first technology and services group is hiring a remote contractor AI-Native Copywriter & Conversion Specialist to create high-velocity, conversion-focused copy across funnels, websites, email, and product messaging.

CRM SEO
3 months, 1 week ago

Project Lion - Senior Prompt Engineer - Spain (Remote, Part-Time)

Welocalize 1K-5K Professional Services

Welo Data is hiring a remote, part-time Senior Prompt Engineer in Spain to manage the end-to-end migration of templates to LLM autoraters and improve model performance using internal prompt engineering tools.

LLM SQL
3 months, 1 week ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers