Welo Global

Welo Global specializes in providing enterprise localization, AI training data, and multilingual content solutions, leveraging a portfolio of specialized global brands to meet diverse customer needs in the AI and language services industry.

Professional Services

Industrials

Founded 1997

476 open positions

Links

View All Jobs

Project Lion - Lead Prompt Engineer - United States (Remote, Part-Time)

4 months, 1 week ago

United States

Freelance

Lead

AI Engineer

Data Science and Analytics

LLM SQL

Apply Now

Welo Global

Professional Services

Founded 1997

View All Jobs 476

Description

Lead and manage the technical migration from templates to LLM autoraters.
Use Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
Run and supervise Automated Prompt Optimization (APO) workflows and identify deadlocks or plateaus in output.
Manually draft, test, and refine prompts for complex architectures, anti-patterns, and tooling gaps.
Solve edge cases by designing and iterating on manual prompt solutions.
Monitor shadowbot runs to ensure disagreements between human and LLM ratings are generated and tracked.
Run prompt versions against gold data to measure autorater quality against the human crowd baseline.
Calculate evaluation metrics such as F1 score, precision, and recall.
Draft technical launch readiness and certification documentation for final release.
Mentor junior engineers and help shape prompt strategy for AI system improvement.

Requirements

Must be based in the United States.
Native fluency in English.
Master’s or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
At least 7 years of experience as a Prompt Engineer.
Proven experience tuning large language models (LLMs) for strict, structured outputs and complex classification tasks.
Familiarity with chain-of-thought and few-shot learning approaches.
Strong proficiency in identifying error patterns and analyzing model performance.
Experience using SQL or other data analytics tools.
Ability to quickly learn and master proprietary tools with minimal supervision.
Excellent verbal and written communication skills.
Familiarity with enterprise-grade LLM interfaces like the Goose API (preferred).
Experience in AI model evaluation, data science, computational linguistics, or software engineering (preferred).
Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows (preferred).
Linguistic expertise, including an understanding of semantics and logic (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior IA Engineer

Coderio 51-250 Internet Software & Services

Coderio is hiring a Senior AI Engineer for its AI Engineering Core to build and operate reusable AI foundations, LLM infrastructure, and agentic capabilities that enable global engineering and product teams to adopt Generative AI safely and efficiently.

Argentina Brazil Uruguay Contract Senior AI Engineer

AWS CI/CD Datadog Docker Generative AI Kubernetes Microservices Python REST API Terraform

2 days, 9 hours ago

Apply

2 days, 9 hours ago

Data & AI Engineer

RevStar 51-250 Internet Software & Services

RevStar is seeking a remote, US-based contract Data & AI Engineer to build and deploy scalable Databricks Lakehouse, data pipeline, and production AI solutions for enterprise clients.

Mexico Brazil Chile Colombia Costa Rica Venezuela Contract Mid Level AI Engineer

Agile Apache Spark AWS Azure CI/CD Databricks Feature Engineering GCP HIPAA MLflow MLOps Python SQL Terraform

3 days, 10 hours ago

Apply

3 days, 10 hours ago

Senior Forward Deployed AI Architect (GenAI, AWS)

Provectus 251-1K Professional Services

Provectus is hiring a Forward Deployed AI Engineer to embed with enterprise clients in financial services, insurance, healthcare, or life sciences, learn operational work firsthand, and rebuild critical business processes using production AI systems.