hireclover
All jobs

Crossing Hurdles

Prompt Curator | $40/hr Remote

Remote Middle $6.5k/mo

Summary

Crossing Hurdles is hiring a Prompt Curator (Generalist Evaluator Expert) on an hourly contract to create and evaluate prompt–answer data for advanced language models. The role focuses on writing high-quality prompt and golden-answer pairs and building rubrics to assess model outputs in consumer contexts.

What you'll do

  • Author prompt–golden answer pairs to train and evaluate advanced language models.

  • Create detailed prompts with multiple constraints and instructions.

  • Define expectations for correct responses in general consumer contexts and develop comprehensive rubrics.

  • Run prompts through models and assess outputs against defined expectations.

  • Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor and remain consistent before integration into official benchmarks.

Requirements

  • BS or BA from a reputable institution (completed or in progress).

  • Strong writing and critical thinking skills.

  • Ability to work independently and meet deadlines.

  • Familiarity with ChatGPT or similar tools for personal decision-making or general interests.

  • Experience in teaching or research (preferred).

Conditions

  • Hourly contract role.

  • Compensation: $35–$40 per hour.

  • Remote.

  • Commitment: at least 20 hours per week.

  • Application process: upload resume, 15-minute interview, submit form (about 20 minutes total).

Browse jobs