Software Engineering Expert

1 month ago
Contract
Junior
Software Development
Weekday

Weekday

Weekday helps companies hire engineers who are vouched by other software engineers, enabling passive income for engineers. They offer services like drafting outreach messages, shortlisting candidates, and conducting reference checks. Backed by Y Combin...

Construction & Engineering
11-50
Founded 2020

Description

  • Design realistic, multi-step software engineering benchmarks based on practical development workflows.
  • Develop reproducible Python reference solutions with validation checks.
  • Use AI coding assistants in the workflow and evaluate their strengths and failure modes.
  • Review benchmark tasks from other experts for correctness, clarity, completeness, and difficulty.
  • Analyze AI-generated solutions to find implementation errors, debugging challenges, and reasoning gaps.
  • Collaborate with AI researchers and engineering teams to improve evaluation methods and benchmark quality.
  • Document technical solutions and engineering decisions clearly.
  • Help maintain high technical standards across benchmark development.

Requirements

  • Master's degree, PhD, or equivalent practical experience in Computer Science, Software Engineering, or another STEM discipline.
  • At least 1 year of professional experience in software engineering, research engineering, applied research, or another technical engineering role.
  • Strong hands-on proficiency in Python, including design, scripting, debugging, testing, and clean code practices.
  • Solid experience with Git, IDEs, and modern software development workflows.
  • Strong understanding of software architecture, debugging methodologies, and engineering best practices.
  • Experience with AI coding assistants, prompt engineering, or AI agent workflows preferred.
  • Experience with AI evaluation, benchmark development, AI training, or task authoring highly desirable.
  • Ability to commit approximately 35 hours per week consistently.
  • Excellent analytical thinking, creativity, attention to detail, and independent problem-solving skills.
  • Strong written communication skills for technical documentation.

Benefits

  • Compensation of $60-$90 per hour.
  • Fully remote engagement with flexible working hours.
  • Weekly payments based on approved work completed.
  • Independent contractor arrangement.
  • Opportunity to work on frontier AI evaluation research with leading researchers.
  • Potential for project duration to be extended based on requirements and performance.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Generative AI Analyst | Arabic (Morocco)

Welo Global Professional Services

Welo Data is seeking a remote freelance Generative AI Analyst fluent in Moroccan Arabic to evaluate, annotate, and quality-review AI-generated content across text, audio, images, video, and related data projects.

Generative AI
9 hours, 49 minutes ago

Senior Software Engineer, Fullstack

CoderPad 11-50 Internet Software & Services

Senior Software Engineer at CoderPad building fullstack, AI-powered technical interviewing and assessment products, production infrastructure, and internal engineering workflows for users across Latin America.

AWS Datadog Docker GCP GitLab CI GraphQL Java Node.js PostgreSQL Python React Redis Ruby on Rails Sidekiq TypeScript
10 hours, 4 minutes ago

Senior Software Engineer (Platform/Scala)

Sprout Social 251-1K Professional Services

Sprout Social is hiring a Senior Software Engineer in Kraków to build, scale, monitor, and improve reliable backend platform systems supporting its social media management product.

Agile ClickHouse Kafka MySQL Python Redis Scala SQL
10 hours, 19 minutes ago

French Quality Control Specialist - Project Lyra

Welo Global Professional Services

Welo Data is seeking French-speaking linguistics experts for a four-week remote freelance project evaluating and improving AI-generated language outputs for accuracy, grammar, and cultural relevance.

LLM NLP
10 hours, 19 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers