Mercor is seeking native Italian speakers with exceptional writing skills to contribute to a high-impact AI research project with a leading lab. Freelancers will author Italian/English prompt–golden answer pairs that train and evaluate advanced language models. This is a short-term, flexible opportunity for professionals who combine language mastery, strong critical thinking, and a knack for instructional clarity. Ideal for those who enjoy distilling complex concepts into well-crafted, culturally grounded Italian text while maintaining technical precision in English.
Job Details
Multilingual Prompt Design & Optimization:
Create detailed prompts in Italian and/or English with multiple constraints and instructions, ensuring natural phrasing and real-world relevance for Italian-speaking users.
Define and Document Evaluation Standards:
Establish high-level expectations for correct responses in Italian consumer contexts, and develop comprehensive rubrics that account for linguistic nuance, tone, and cultural conventions.
Model Testing and Grading (Bilingual):
Run prompts through models and assess preliminary outputs for accuracy, fluency, and cultural fit in Italian, comparing results against English where needed.
Benchmarking & Quality Assurance:
Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor—maintaining consistency and reliability across Italian-language benchmarks before integration into official evaluations.
Minimum Qualifications
Native-level fluency in Italian (written) with strong reading/writing ability in English.
BS or BA from a reputable institution (completed or in progress).
Strong writing and critical thinking skills.
Ability to work independently and meet deadlines.
Significant familiarity with ChatGPT or similar tools for personal decision-making, hobbies, or general interests.
Based in Italy (or able to reliably produce Italy-specific , culturally accurate Italian).
Preferred Qualifications
Experience in teaching, research, editing, or academic writing.
Experience creating evaluation criteria, rubrics, or grading guidelines.
Familiarity with LLMs, prompting, or model evaluation (helpful but not required).
Application & Onboarding Process
Complete an AI-led interview (about 15 minutes).
Complete a 45-minute written assessment focused on writing and rubric creation.
If selected, you will be invited to work on the project.
More Details About This Role
Expect to contribute at least 20 hours per week.
Expect a commitment of around 2+ months.
You’ll be working in a structured project environment with clear goals and tools.
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
...DIBH, and use Varian's RPM for gated treatments, and we are currently in the process of switching to Identify. We have a very active HDR program using a Bravos HDR unit, treating a variety of HDR skin sites, and have a growing HDR GYN program. Physicists with HDR planning...
...of the role. Ideal Profile: Proven experience as a Personal Assistant Must reside/base in the US or Canada and must be authorized... ...Self-motivated and capable of working independently in a remote environment. Flexibility and adaptability to changing priorities...
...next generation of multi-physics simulation. We are moving beyond legacy solvers to build a platform defined by speed and physical fidelity. We are seeking a Computational Scientist to lead the development of our new structural mechanics solver. We prioritize...
...shit, scrolling their feed, geeking out on design and/or watching weird film-school deep... ...aesthetics who feels torn between picking between graphic and motion design. A curious learner... ...but not necessary ~ This role can sit remote, but preference is Troy, MI, New York or...
...insurance Training & development Job Summary The Fitness Instructor will be responsible for running the Planet Fitness group... ...interactions while using appropriate behavior and language. Current CPR Certification required. Nationally Certified Training...