Quality Assurance Specialist Job at Mercor, San Francisco, CA

cTJ1U0FjaG0xbSt3bFJyanJhaUg3ZytHY0E9PQ==
  • Mercor
  • San Francisco, CA

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey .

Position: Quality Control Lead

Type: W2 Employment

Compensation: $80$105/hour

Location: Remote

Commitment: 40 hours/week

Role Responsibilities

  • Audit and evaluate detailed personas digital environments and tasks created by AI Training Scenario Designers. Ensure they are logically sound and properly structured.
  • Apply strict rubrics to score scenarios objectively. Ensure tasks challenge an AI agents ability to reason filter and prioritize.
  • Identify logical inconsistencies factual errors missing context and technical flaws such as invalid JSON structures.
  • Provide clear constructive and actionable feedback to scenario designers to refine their worlds and improve output.
  • Document outcomes by logging review results scores and feedback in Airtable and Crucible .

Qualifications

Must-Have

  • Undergrad degree
  • 2 years professional experience

Preferred

  • Editing / QA background Senior editor QA tester technical reviewer compliance auditor or peer-reviewer.
  • Technical / data comfort JSON familiarity Jira/Asana power user data analyst SQL/Python exposure.
  • Process & Systems thinking Operations managers technical PMs or systems designers.

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Job Tags

Full time, Summer work

Similar Jobs

Teach Oklahoma

Middle School Band Director Job at Teach Oklahoma

Position Areas Music Description Job Title:Classroom TeacherCredentials:Current Oklahoma Teaching Certificate with endorsements for the appropriate level/subject area.Education:Bachelor's Degree in Education or related field...

Confidential

Program Mechanical Engineer Job at Confidential

job summary: Are you a Mechanical Engineer interested in the strategic, regulatory, and organizational side of the industry? This could...  ...standards and government regulations. qualifications: Experience level: Entry Level Minimum 2 years of experience... 

AFSCME Ohio Council 8

Organizer I Job at AFSCME Ohio Council 8

 ...AFSCME Ohio Council 8 Organizer I Based in Worthington, OH A vacancy exists in the staff representative position in the...  ...to read, analyze, and interpret general business periodicals, professional journals, technical procedures, or governmental regulations.... 

Moes Feedlot LLC

Farm Hand Job at Moes Feedlot LLC

 ...Job Description Seeking a full-time farm hand for a feedlot operation. Main duties include; feeding cattle, cleaning pens and daily walk throughs of pens. Also, will need to know or be willing to learn how to drive semi to haul -hay, commodities, etc. Some field work... 

Baylor College of Medicine

Pediatric Neurology Nurse Practitioner/Physician Assistant - San Antonio, TX Job at Baylor College of Medicine

 ...San Antonio, serves as a focal point for pediatric services throughout the community. In 2...  ...(BCM) to recruit, employ, and oversee physicians and advanced practice providers at...  ...Support (BLS) Certification Physician Assistant Candidate: Current PA licensure with...