RemoteLeads Logo
Sign Up Sign In

Project Lion - Senior Prompt Engineer - United States (Remote, Part-Time)

4 months, 1 week ago
United States
Freelance
Senior
Prompt Engineer
Data Science and Analytics
LLM SQL
Apply Now
Welocalize

Welocalize

Welocalize provides translation and localization services to help businesses reach global audiences with precision and efficiency.

Professional Services
1K-5K
Founded 1997
$34M raised
View All Jobs 336

Description

  • Lead the end-to-end technical migration workflow for transitioning templates to LLM autoraters.
  • Use internal tools and prompt engineering techniques to maximize model performance.
  • Create baseline prompts for complex parent-child template clusters using Automatic Prompt Generation (APG).
  • Run and supervise Automated Prompt Optimization (APO) workflows and identify deadlocks or plateaus.
  • Manually draft, test, and refine prompts for complex template architectures, anti-patterns, and broken or missing tooling.
  • Design and refine manual prompts to solve edge-case scenarios.
  • Monitor shadowbot runs to ensure disagreements between human and LLM ratings are generated and tracked.
  • Run prompt versions against gold data and measure autorater quality against the human crowd baseline.
  • Calculate model performance metrics such as F1 score, precision, and recall.
  • Draft launch readiness justifications and final Launch Certification Documentation.

Requirements

  • Native fluency in English.
  • Must be based in the United States.
  • Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
  • At least 4 years of experience as a Prompt Engineer.
  • Proven experience tuning large language models (LLMs) for strict structured outputs and complex classification tasks.
  • Familiarity with chain-of-thought and few-shot learning.
  • Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools.
  • Ability to quickly learn and master proprietary tools with minimal supervision.
  • Excellent verbal and written communication skills.
  • Familiarity with enterprise-grade LLM interfaces such as the Goose API (preferred).
  • Experience in AI model evaluation, data science, computational linguistics, or software engineering (preferred).
  • Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows (preferred).
  • Linguistic expertise, including an understanding of semantics and logic (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Weekday

Biology Expert (PhD) - AI Safety

Weekday 11-50 Construction & Engineering

A client is seeking a PhD-level biologist for a remote AI safety project that evaluates and improves AI responses on complex biological sciences.

United States Contract Senior AI (Artificial Intelligence) Prompt Engineer
$0k-$0k
3 weeks, 4 days ago
Bridgit

Production Designer, AI & Creative Systems

Bridgit 51-250 Construction & Engineering

Bridgit is hiring a Production Designer, AI and Creative Systems to create on-brand marketing and product creative while building AI-powered workflows and reusable design systems that help scale design across the company.

Canada Contract Senior Graphic Designer Prompt Engineer
$187k-$337k
After Effects CSS Design Systems Figma HTML HubSpot Illustrator JavaScript Photoshop Webflow WordPress
2 months, 1 week ago
Welo Global

Shape the Future of AI - Tamil Talent Hub

Welo Global Professional Services

Welo Data, part of Welocalize, is building a global contributor network for remote AI data projects involving Tamil-language annotation, evaluation, and prompt creation.

Malaysia India Sri Lanka Europe Freelance Entry Level AI (Artificial Intelligence) Prompt Engineer
LLM
3 months, 3 weeks ago
Welo Global

Project Lion - Senior Prompt Engineer - Japan (Remote, Part-Time)

Welo Global Professional Services

Welo Data is hiring a remote, part-time Senior Prompt Engineer in Japan to lead the technical migration of templates to LLM autoraters and improve model performance using internal prompt engineering tools.

Japan Freelance Senior Prompt Engineer
LLM NLP SQL
4 months ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers