AI Researcher
AI Researcher
Mercor
Mercor is a profitable Series C company valued at $10 billion, focused on AI research and model evaluation. The company partners with leading AI labs and enterprises to enhance AI development through human intelligence. The AI Researcher role involves advancing model evaluations, publishing impactful research, and collaborating with various teams to drive improvements in AI models.
Qualification
- PhD or M.S. and 2+ years of work experience in a computer science, electrical engineering, econometrics, or another STEM field that provides a solid understanding of ML and model evaluation.
- Strong publication record in AI research, ideally in LLM evaluation. Dataset and evaluation papers are preferred.
- Strong understanding of LLMs and the data on which they are trained and evaluated against.
- Strong communication skills and ability to present findings clearly and concisely.
- Familiarity with data annotation workflows.
- Good understanding of statistics.
- Willingness to work 6 days a week, with Monday-Friday in person in San Francisco.
Responsibility
- Build benchmarks that measure real world value of AI models.
- Publish LLM evaluation papers in top conferences with the support of the Mercor Applied AI and Operations teams.
- Push the frontier of understanding data ROI in model development including multi-modality, code, tool-use, and more.
- Design and validate novel data collection and annotation offerings for leading industry labs and big tech companies.
