About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Dutch Audio Generalist Evaluator Expert Type:Contract
Compensation:$50/hour
Location:Remote Duration:3–6 months
Role Responsibilities
- Transcribe audio and video with precision in Dutch and English. Ensure adherence to multiple constraints and instructions.
- Define and document evaluation standards for consumer audio contexts. Develop comprehensive rubrics and guidelines in Dutch and English.
- Conduct model testing by running prompts and assessing outputs against expectations.
- Support benchmarking and quality assurance. Collaborate in QA review processes to ensure high standards of rigor.
- Maintain consistency and reliability before integration into official benchmarks. Work independently and meet deadlines.
Qualifications
Must-Have
- Strong writing and critical thinking skills
- Ability to work independently and meet deadlines
- Fluent in Dutch and English
- Able to work within GMT or PST working hours
Preferred
- College students or graduates
Application Process (Takes 20–30 mins to complete)
- Complete an AI-led interview (approximately 15 minutes)
- If selected, you will be invited to work on the project
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas
Time-zone restrictions (UTC offsets): 0