Senior Software Engineer, Model Evaluation
Free to start · No card · 5 credits the moment you sign up
Job description
About the Role
Join an early-stage AI company building agents for manufacturing and supply chain operations. In this research-focused engineering role, you will work with procurement and manufacturing experts to create benchmarks, train models, and improve agents used in real operational workflows.
What You'll Do
Design benchmarks and evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking.
Work with domain experts to scope tasks, write reference answers and rubrics, and build graders.
Train and fine-tune models hands-on, using evaluation results to guide experiments.
Identify agent failures, develop improvements, and validate those improvements with measured results.
Help establish research and evaluation practices as an early member of the team.
What We're Looking For
At least 3 years of experience, with senior- or staff-level capability.
Experience designing and writing benchmarks or evaluations.
Experience authoring tasks, including defining scope, creating reference solutions or rubrics, and checking task quality.
Hands-on experience training and fine-tuning models, beyond using models through APIs.
Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks.
Supply chain, procurement, manufacturing, or early-stage startup experience is a plus.
Compensation & Benefits
Base salary is $180,000 to $250,000 annually, plus equity. Visa sponsorship policy was not provided.
Location
Fully remote in the United States.
Compensation Range: $180K - $250K
Originally posted on Himalayas
Prepare your application
Use the description above to assess your fit for Clera. This checklist is guidance from Resumize, rather than additional requirements from the employer. Imported listings can be shortened or change after collection, so confirm the complete description and current availability before sending an application.
Match requirements to evidence
Identify the responsibilities and skills the employer explicitly names. For each important requirement, choose one example from your work, education, training, or projects. Explain what you did, how you did it, and what changed as a result. Include a measurable outcome when you can support it. If you lack a requirement, describe related experience accurately instead of adding an unfamiliar skill to your resume.
Put the most relevant examples near the top of your resume. Keep job titles, dates, qualifications, and contact details consistent across your application materials. Use the employer’s terminology when it describes your experience accurately; a copied list of keywords does not explain your contribution. A short, specific bullet is easier to review than a paragraph that mixes several unrelated duties.
Check the working arrangement
Confirm the location, schedule, employment type, and any eligibility requirements on the employer’s site. A remote label does not establish worldwide eligibility or flexible hours. If compensation, benefits, equipment, travel, or contract duration are missing from this listing, write down your questions for the recruiter. Do not assume details from another opening at the same company apply to this role.
Review before submitting
Follow the employer’s requested file format and application instructions. Open your exported resume and check that its text is selectable, its sections read in order, and its links work. Proofread names, dates, and contact information. Share confidential work samples only when you have permission, and use an anonymized example when necessary.
Submit through a trusted employer or recruiting destination. If the original listing has disappeared, search the employer’s careers page for the title rather than assuming the vacancy remains open. Save the application date, job reference, and the version of your resume you sent. Those details help you prepare for a later conversation and avoid submitting conflicting information through several job boards.
Review your resume for writing and readability feedback, or browse other openings if this opportunity is unavailable.