Skip to main content
McCarthy Search

Test Job Prompt Engineer

L5

gsobaFort Wayne, INyesterday

Occupations

Software DevelopersSoftware Quality Assurance Analysts and TestersComputer Programmers

Industries

Custom Computer Programming ServicesComputer Systems Design ServicesSoftware Publishers
About the project We are seeking a project team of skilled Software Engineers to work as project consultants in our AI Labor Marketplace. This is not a full-time employment position — you will be engaged as an expert project consultant on a contract basis.
Location: U.S.-based experts only
Engagement: Part-time, project-based expert evaluation work Work Type: Remote Contributors will design and evaluate realistic software engineering tasks, including bug resolution, feature implementation, refactoring/migration, and test generation. Work includes both creating complex coding scenarios and reviewing peer submissions for quality and accuracy. This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors’ allowances).
Responsibilities: Contributors will:
  • Design and implement multi-file coding tasks across bug fixing, feature development, refactoring, and testing
  • Write clear natural-language specifications and reference implementations
  • Develop and extend unit and integration test suites
  • Review peer-generated tasks for correctness, clarity, and realism
  • Identify edge cases, ambiguities, and potential failure modes
  • Ensure alignment between specifications, code, and expected outputs
  • Expected Outcomes:
  • High-quality, production-realistic coding tasks
  • Complete and correct reference implementations
  • Robust test coverage and validation artifacts
  • Structured, actionable peer review feedback
Qualifications:
  • Advanced professional written proficiency in English3–5 years of professional software engineering experience
  • Strong proficiency in Python and JavaScript/TypeScript; working knowledge of Java, C#, or GoBackend or full‑stack development experience in production systemsExperience with testing frameworks (e.g., pytest, Jest, JUnit, xUnit, Go testing)
  • Proven ability to debug and navigate large, multi‑file codebases
  • Experience with code reviews, refactoring, and production migrations
  • Prior experience with data annotation, evaluation, or structured labeling for AI/ML systemsExperience defining solution trajectories and writing evaluation rubrics
  • Familiarity with LLM evaluation, prompt design, or benchmarking workflows
LinkedIn Data Security and Privacy Notice:https://legal.linkedin.com/content/dam/legal/
Apply now (opens in a new tab)
Apply now (opens in a new tab)

Level

SeniorL5

Location

Fort Wayne, IN

Occupation

Software Developers

Industry

Custom Computer Programming Services

Posted

yesterday

To get sharper similar jobs, create your profile using the link below.

Create profile