Software Engineer Job at Mercor, San Francisco, CA

T0ZIUWQyVFpGblJCeXJ0aG5IbHMreWY5
  • Mercor
  • San Francisco, CA

Job Description

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Software Engineering, Data Science, and Systems Design Experts
Type: Contract
Compensation: $60–$100/hour
Location: Remote

Role Responsibilities

  • Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness.
  • Conduct fact-checking using trusted public sources and authoritative references.
  • Conduct accuracy testing by executing code and validating outputs using appropriate tools .
  • Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies.
  • Assess code quality, readability, algorithmic soundness, and explanation quality.
  • Ensure model responses align with expected conversational behavior and system guidelines.

Qualifications

Must-Have

  • BS, MS, or PhD in Computer Science or a closely related field .
  • Significant (3+ years) real-world experience in software engineering or related technical roles.
  • Expert in at least two relevant programming languages (e.g., Python, Java, C++, C, JavaScript, Go, Rust, Ruby, SQL, Powershell, Bash, Swift, Kotlin, R, TypeScript, HTML/CSS ).
  • Able to solve HackerRank or LeetCode Medium and Hard–level problems independently .
  • Experience contributing to well-known open-source projects, including merged pull requests.
  • Significant experience using LLMs while coding and understanding their strengths and failure modes.
  • Strong attention to detail and comfortable evaluating complex technical reasoning , identifying subtle bugs or logical flaws.

Preferred

  • Prior experience with RLHF , model evaluation, or data annotation work.
  • Track record in competitive programming.
  • Experience reviewing code in production environments.
  • Familiarity with multiple programming paradigms or ecosystems.
  • Experience explaining complex technical concepts to non-expert audiences.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check:
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Job Tags

Contract work, Summer work, Remote work

Similar Jobs

DCS Corp

Logistics & Acquisition Specialist - DoD (Huntsville) Job at DCS Corp

 ...A defense contractor is looking for professionals to support logistics, acquisition, and Foreign Military Sales tasks on the PM Air Warrior...  ...Analysts. Candidates must be U.S. citizens with an adjudicated DoD clearance from day one. The position follows a hybrid work... 

Host Healthcare

Travel Nurse RN - Long-Term Acute Care - $1,995 to $2,148 per week in Brattleboro, VT Job at Host Healthcare

 ...Registered Nurse (RN) | Long-Term Acute Care Location: Brattleboro, VT Agency: Host Healthcare Pay: $1,995 to $2,148 per week Shift...  ...the Position Host Healthcare is an award-winning travel healthcare company with an immediate opening for this Registered... 

Manpower

EHS Manager Job at Manpower

 ...Our client, a leading manufacturing organization, is seeking an EHS Manager to join their team. As an EHS Manager, you will be part of the Environmental, Health, and Safety department supporting the plant operations team. The ideal candidate will have strong leadership... 

Worldwide Flight Services

Air Cargo Office Agent -ORD Job at Worldwide Flight Services

 ...Platform including gift cards and more! ~ Multiple options for both full and part-time employees! ~ Travel Discounts, Pet insurance, Discount Shopping & More! ~ Wellness Programs offered to all employees! ~401k program offered! ~ Opportunity for Internal Mobility... 

Amazon

Amazon Picker Packer Job at Amazon

Join Amazon as an Amazon Picker Packer in our Transportation & Logistics warehouse department. In this fast-paced role, youll accurately pick, pack, and stage customer orders using scanners and warehouse systems, ensuring items are handled safely and efficiently. Youll...