Responsibilities
• Design and oversee the creation of evaluations for coding tasks across multiple languages, including JavaScript, TypeScript, Python, Java, and C
• Develop test cases to assess system performance in diverse engineering scenarios accurately
• Analyze system behavior on real-world user use cases to identify strengths and areas for improvement
• Communicate evaluation results effectively to the research team to support continued development and optimization

Requirements
• Strong GitHub or similar presence with frequent high-quality contributions to top open source projects in the last 12 months
• Expertise in one or more of the following languages: Python, Java, C, JavaScript, or TypeScript
• Deep familiarity with widely used libraries, frameworks, and tools in your chosen languages
• Excellent understanding of software architecture, performance tuning, and scalable code patterns
• Strong collaboration skills and experience working within distributed asynchronous teams
• Ability to independently identify areas for contribution and execute improvements with minimal oversight
• Comfortable using Git, CI/CD systems, and participating in open source governance workflows

How to Apply
Click "Apply" to be taken to the Mercor website. This is a fully remote contract role with flexible scheduling. Payments are made weekly via Stripe or Wise. Please note this role cannot support H1B or STEM OPT candidates at this time. Applying through our link supports WFH Bulletin as a referral partner of Mercor, but you are welcome to apply directly if you prefer.