Crossing Hurdles
Prompt Curator | $40/hr Remote
Summary
Crossing Hurdles is hiring a Prompt Curator (Generalist Evaluator Expert) on an hourly contract to create and evaluate prompt–answer data for advanced language models. The role focuses on writing high-quality prompt and golden-answer pairs and building rubrics to assess model outputs in consumer contexts.
What you'll do
Author prompt–golden answer pairs to train and evaluate advanced language models.
Create detailed prompts with multiple constraints and instructions.
Define expectations for correct responses in general consumer contexts and develop comprehensive rubrics.
Run prompts through models and assess outputs against defined expectations.
Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor and remain consistent before integration into official benchmarks.
Requirements
BS or BA from a reputable institution (completed or in progress).
Strong writing and critical thinking skills.
Ability to work independently and meet deadlines.
Familiarity with ChatGPT or similar tools for personal decision-making or general interests.
Experience in teaching or research (preferred).
Conditions
Hourly contract role.
Compensation: $35–$40 per hour.
Remote.
Commitment: at least 20 hours per week.
Application process: upload resume, 15-minute interview, submit form (about 20 minutes total).