About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Internet-Native Bilingual Evaluator Expert (French) Type:Contract
Compensation:$50/hour
Location:Remote Commitment:10–20 hours/week
Role Responsibilities
- Evaluate AI outputs for linguistic accuracy, cultural relevance, and internet authenticity in French and English.
- Analyse content from French- and English-speaking online communities to identify errors involving slang, memes, cultural references, sarcasm, and code-switching.
- Build evaluation rubrics for bilingual internet communication and define expectations for culturally appropriate and platform-native language.
- Test language models using real-world bilingual prompts and provide detailed feedback to improve performance.
- Participate in QA reviews and benchmark creation to ensure consistency across evaluators and datasets.
Qualifications
Must-Have
- Native or near-native fluency in French and professional fluency in English.
- Strong familiarity with online communities across France, Québec, Belgium, Switzerland, or other French-speaking regions.
- Active participation in internet culture across both languages.
- Strong writing, analytical, and critical thinking skills.
- Available to commit 10–20 hours per week.
Preferred
- Background in linguistics, translation, localisation, social media, journalism, humanities, or AI evaluation.
- Familiarity with differences between European French, Québec French, and other French varieties.
- Experience evaluating online content and internet-native communication.
- Interest in AI and multilingual language technologies.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas
Time-zone restrictions (UTC offsets): 1