RemoteLeads Logo
Sign Up Sign In

Project Lion - Senior Prompt Engineer - Italy (Remote, Part-Time)

5 months, 3 weeks ago
Italy
Freelance
Senior
Prompt Engineer
Data Science and Analytics
LLM SQL
Apply Now
Welocalize

Welocalize

Welocalize provides translation and localization services to help businesses reach global audiences with precision and efficiency.

Professional Services
1K-5K
Founded 1997
$34M raised
View All Jobs 336

Description

  • Lead the end-to-end technical migration workflow for transitioning templates to LLM autoraters.
  • Use internal prompt engineering tools to maximize model performance.
  • Create baseline prompts for complex parent-child template clusters using Automatic Prompt Generation (APG) tools.
  • Run and supervise Automated Prompt Optimization (APO) workflows and identify deadlocks or plateaus.
  • Manually draft, test, and refine prompts for complex template architectures and edge cases.
  • Troubleshoot anti-patterns and cases where tooling is lacking or broken.
  • Monitor shadowbot runs to ensure disagreements between human and LLM ratings are generated and tracked.
  • Run prompt versions against gold data to measure autorater quality against the human crowd baseline.
  • Calculate evaluation metrics such as F1 score, precision, and recall.
  • Draft technical launch readiness justifications and Launch Certification Documentation.

Requirements

  • Must be based in Italy.
  • Native fluency in Italian and fluent English.
  • Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
  • At least 4 years of experience as a Prompt Engineer.
  • Proven experience tuning LLMs for strict, structured outputs and complex classification tasks.
  • Familiarity with chain-of-thought and few-shot learning approaches.
  • Strong ability to identify error patterns and analyze model performance.
  • Experience using SQL or other data analytics tools.
  • Ability to quickly learn and master proprietary tools with minimal supervision.
  • Excellent verbal and written communication skills.
  • Familiarity with enterprise-grade LLM interfaces such as the Goose API (preferred).
  • Experience in AI model evaluation, data science, computational linguistics, or software engineering (preferred).
  • Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows (preferred).
  • Linguistic expertise, including an understanding of semantics and logic (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Boosta

AI Artist | 2D Illustrator (Freelance) | Honeytech

Boosta 501-1000 information technology & services

Boosta is seeking a remote freelance AI Artist | 2D Illustrator for Honeytech, a webcomics platform producing original content, to create consistent high-quality static visuals for animation production.

Ukraine Freelance Mid Level Graphic Designer Prompt Engineer
1 day, 17 hours ago
Weekday

Biology Expert (PhD) - AI Safety

Weekday 11-50 Construction & Engineering

A client is seeking a PhD-level biologist for a remote AI safety project that evaluates and improves AI responses on complex biological sciences.

United States Contract Senior AI (Artificial Intelligence) Prompt Engineer
$0k-$0k
2 months, 1 week ago
Welo Global

Shape the Future of AI - Tamil Talent Hub

Welo Global Professional Services

Welo Data, part of Welocalize, is building a global contributor network for remote AI data projects involving Tamil-language annotation, evaluation, and prompt creation.

Europe India Malaysia Sri Lanka Freelance Entry Level AI (Artificial Intelligence) Prompt Engineer
LLM
5 months, 1 week ago
Welo Global

Project Lion - Senior Prompt Engineer - Japan (Remote, Part-Time)

Welo Global Professional Services

Welo Data is hiring a remote, part-time Senior Prompt Engineer in Japan to lead the technical migration of templates to LLM autoraters and improve model performance using internal prompt engineering tools.

Japan Freelance Senior Prompt Engineer
LLM NLP SQL
5 months, 2 weeks ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers