Project Lion - Prompt Engineer - United States (Remote, Part-Time)

3 months, 1 week ago
Contract
Junior
Data Science and Analytics
Welocalize

Welocalize

Welocalize provides translation and localization services to help businesses reach global audiences with precision and efficiency.

Professional Services
1K-5K
Founded 1997
$34M raised

Description

  • Lead the end-to-end technical migration workflow for transitioning templates to LLM autoraters.
  • Use internal tools and prompt engineering techniques to maximize model performance.
  • Create baseline prompts for complex parent-child template clusters using Automatic Prompt Generation (APG) tools.
  • Run and supervise Automated Prompt Optimization (APO) tools and flag deadlocks or plateaus.
  • Manually draft, test, and refine prompts for complex template architectures and edge cases.
  • Solve edge-case scenarios by designing and improving manual prompts when tooling is missing or broken.
  • Monitor shadowbot runs to ensure disagreements between human and LLM ratings are generated and tracked.
  • Run prompt versions against gold data to measure autorater quality against the human crowd baseline.
  • Calculate model performance metrics such as F1 score, precision, and recall.
  • Draft technical launch readiness and certification documentation for final release.

Requirements

  • Native fluency in English.
  • Must be based in the United States.
  • Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
  • At least 2 years of experience as a Prompt Engineer.
  • Proven experience tuning large language models for strict, structured outputs and complex classification tasks.
  • Familiarity with chain-of-thought and few-shot learning techniques.
  • Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools.
  • Ability to quickly learn and master proprietary tools with minimal supervision.
  • Excellent verbal and written communication skills.
  • Preferred: Familiarity with enterprise-grade LLM interfaces such as the Goose API.
  • Preferred: Experience in AI model evaluation, data science, computational linguistics, or software engineering.
  • Preferred: Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows.
  • Preferred: Linguistic expertise, including understanding of semantics and logic.
  • Must complete U.S. work authorization verification and a live video I-9 identity check within the first 3 days of employment.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Production Designer, AI & Creative Systems

Bridgit 51-250 Construction & Engineering

Bridgit is hiring a Production Designer, AI and Creative Systems to create on-brand marketing and product creative while building AI-powered workflows and reusable design systems that help scale design across the company.

After Effects CSS Design Systems Figma HTML HubSpot Illustrator JavaScript Photoshop Webflow WordPress
1 month, 1 week ago

Sheratan-Prompt Optimization Spanish (Spain)

Welo Global Professional Services

Welo Data is hiring a freelance remote language specialist in Spain to review and optimize AI translation prompts for travel and attraction content in Spanish (Spain).

1 month, 2 weeks ago

Sheratan-Prompt Optimization Dutch (Netherlands)

Welo Global Professional Services

Welo Data is seeking a freelance remote Dutch language specialist to review and refine AI translation prompts for attraction and travel content.

1 month, 3 weeks ago

Sheratan-Prompt Optimization French (France)

Welo Global Professional Services

Welo Data is hiring a freelance remote French (France) language specialist to review and refine AI translation prompts for attraction and travel content so outputs sound natural, fluent, and culturally appropriate.

1 month, 3 weeks ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers