RemoteLeads Logo
Sign Up Sign In

Project Lion - Senior Prompt Engineer - Italy (Remote, Part-Time)

3 months, 1 week ago
Italy
Freelance
Senior
Prompt Engineer
Data Science and Analytics
LLM SQL
Apply Now
Welocalize

Welocalize

Welocalize provides translation and localization services to help businesses reach global audiences with precision and efficiency.

Professional Services
1K-5K
Founded 1997
$34M raised
View All Jobs 336

Description

  • Lead the end-to-end technical migration workflow for transitioning templates to LLM autoraters.
  • Use internal prompt engineering tools to maximize model performance.
  • Create baseline prompts for complex parent-child template clusters using Automatic Prompt Generation (APG) tools.
  • Run and supervise Automated Prompt Optimization (APO) workflows and identify deadlocks or plateaus.
  • Manually draft, test, and refine prompts for complex template architectures and edge cases.
  • Troubleshoot anti-patterns and cases where tooling is lacking or broken.
  • Monitor shadowbot runs to ensure disagreements between human and LLM ratings are generated and tracked.
  • Run prompt versions against gold data to measure autorater quality against the human crowd baseline.
  • Calculate evaluation metrics such as F1 score, precision, and recall.
  • Draft technical launch readiness justifications and Launch Certification Documentation.

Requirements

  • Must be based in Italy.
  • Native fluency in Italian and fluent English.
  • Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
  • At least 4 years of experience as a Prompt Engineer.
  • Proven experience tuning LLMs for strict, structured outputs and complex classification tasks.
  • Familiarity with chain-of-thought and few-shot learning approaches.
  • Strong ability to identify error patterns and analyze model performance.
  • Experience using SQL or other data analytics tools.
  • Ability to quickly learn and master proprietary tools with minimal supervision.
  • Excellent verbal and written communication skills.
  • Familiarity with enterprise-grade LLM interfaces such as the Goose API (preferred).
  • Experience in AI model evaluation, data science, computational linguistics, or software engineering (preferred).
  • Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows (preferred).
  • Linguistic expertise, including an understanding of semantics and logic (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Bridgit

Production Designer, AI & Creative Systems

Bridgit 51-250 Construction & Engineering

Bridgit is hiring a Production Designer, AI and Creative Systems to create on-brand marketing and product creative while building AI-powered workflows and reusable design systems that help scale design across the company.

Canada Contract Senior Graphic Designer Prompt Engineer
$187k-$337k
After Effects CSS Design Systems Figma HTML HubSpot Illustrator JavaScript Photoshop Webflow WordPress
1 month, 1 week ago
Welo Global

Sheratan-Prompt Optimization Spanish (Spain)

Welo Global Professional Services

Welo Data is hiring a freelance remote language specialist in Spain to review and optimize AI translation prompts for travel and attraction content in Spanish (Spain).

Spain Freelance Mid Level Prompt Engineer Translator
$0k-$0k
1 month, 2 weeks ago
Welo Global

Sheratan-Prompt Optimization Dutch (Netherlands)

Welo Global Professional Services

Welo Data is seeking a freelance remote Dutch language specialist to review and refine AI translation prompts for attraction and travel content.

Netherlands Freelance Mid Level Prompt Engineer Translator
$67k-$67k
1 month, 3 weeks ago
Welo Global

Sheratan-Prompt Optimization French (France)

Welo Global Professional Services

Welo Data is hiring a freelance remote French (France) language specialist to review and refine AI translation prompts for attraction and travel content so outputs sound natural, fluent, and culturally appropriate.

France Freelance Junior Prompt Engineer Translator
$0k-$0k
1 month, 3 weeks ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers