Quality Assurance Specialist Job at Mercor, San Francisco, CA

cTJ1U0FjaG0xbSt3bFJyanJhaUg3ZytHY0E9PQ==
  • Mercor
  • San Francisco, CA

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey .

Position: Quality Control Lead

Type: W2 Employment

Compensation: $80$105/hour

Location: Remote

Commitment: 40 hours/week

Role Responsibilities

  • Audit and evaluate detailed personas digital environments and tasks created by AI Training Scenario Designers. Ensure they are logically sound and properly structured.
  • Apply strict rubrics to score scenarios objectively. Ensure tasks challenge an AI agents ability to reason filter and prioritize.
  • Identify logical inconsistencies factual errors missing context and technical flaws such as invalid JSON structures.
  • Provide clear constructive and actionable feedback to scenario designers to refine their worlds and improve output.
  • Document outcomes by logging review results scores and feedback in Airtable and Crucible .

Qualifications

Must-Have

  • Undergrad degree
  • 2 years professional experience

Preferred

  • Editing / QA background Senior editor QA tester technical reviewer compliance auditor or peer-reviewer.
  • Technical / data comfort JSON familiarity Jira/Asana power user data analyst SQL/Python exposure.
  • Process & Systems thinking Operations managers technical PMs or systems designers.

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Job Tags

Full time, Summer work

Similar Jobs

Chipton‑Ross Inc

217647 - Aircraft Structural Mechanics Job at Chipton‑Ross Inc

Chipton-Ross is seeking 6 Aircraft Structural Mechanics for a contract opportunity in San Antonio, TX. BASIC QUALIFICATIONS (REQUIRED SKILLS/EXPERIENCE): 4+ years of experience working with non-porous metals, such as aluminum, titanium, and stainless 4+ years of...

J&H Janitorial Company LLC

Cleaner - Panama City, FL - Part Time Evening Shift Job at J&H Janitorial Company LLC

 ...Part-Time Cleaner Job Summary The Cleaner performs cleaning and general upkeep of an assigned area. Job Duties Cleaners are assigned areas and could perform one or more of the following duties: # Empty trash and replace can liners. # Dust, wipe and... 

Baker Cadillac

AUTOMOTIVE DIESEL TECHNICIAN/ MECHANIC Job at Baker Cadillac

```htmlBaker Cadillac is seeking a skilled Diesel Technician to join our team in Cadillac, MI. In this role, you will be responsible...  ...inspections.* Use diagnostic tools and equipment to identify mechanical and electrical issues.* Maintain accurate records of repairs... 

Integral Psychological Services

Counselor/Social Worker Job at Integral Psychological Services

 ...other providers when clinically appropriate Engage in continued professional development Qualifications: Masters degree in Social Work, Counseling, Psychology, or a related field Active New Hampshire license (MSW, LPC, PhD, PsyD required) Strong clinical... 

Confidential

Construction Laborer Job at Confidential

 ...surface restoration. Perform tasks involving physical labor, including working on bent knees. Lift and carry...  ...up to 50 pounds. Essential Skills Knowledge of construction and labor practices. Experience with hand tools and power tools. Ability to perform...