AI Model Evaluation Data Scientist

OpenTrain AIAnywhereAdded 2d ago

AI Evaluation Engineer

Free to start · No card · 5 credits the moment you sign up

Job description

The WorkYou will develop Python solutions and analyze datasets that help improve AI models. The work combines model evaluation, response ranking, supervised fine-tuning, and reinforcement learning with human feedback. You will also explain your decisions clearly, review code and documentation, and turn complex findings into practical improvements for AI systems. Write and maintain Python code for training and optimizing AI models.Benchmark model performance and analyze evaluation results.Evaluate and rank model responses to user queries using set criteria.Write clear explanations and rationales for evaluation decisions.Create and maintain datasets for supervised fine-tuning.Help researchers and annotators improve reinforcement learning with human feedback and reward models.Create and refine responses for clarity, relevance, and technical accuracy.Review code and documentation, identify issues, and give constructive feedback.Use public datasets, including Kaggle, United Nations, and United States government data, to answer business questions.What It Pays and TakesThis is a fully remote contractor assignment with a one-month contract term. The role is listed as entry level and requires technical data analysis, clear written reasoning, and effective communication with researchers and other stakeholders. Expected commitment of at least 20 hours per week.Choose 20, 30, or 40 hours per week.Four hours of daily overlap with Pacific Time is required.Open worldwide as a remote assignment.Fluent conversational and written English.Proficiency in Python and strong data analysis skills.Strong problem-solving ability and sound business judgment when interpreting data.Ability to explain technical reasoning clearly in Jupyter notebooks or comparable formats.Bachelor's or master's degree in engineering or computer science, or equivalent experience.How It WorksApply on OpenTrain with your resume, then complete the application on the hiring site. About AI Training WorkAI training is the human work behind modern AI systems, including reviewing model responses, preparing datasets, evaluating results, and giving feedback. People with technical experience help models improve by applying careful analysis and clear judgment to challenging examples.

Prepare your application

Use the description above to assess your fit for OpenTrain AI. This checklist is guidance from Resumize, rather than additional requirements from the employer. Imported listings can be shortened or change after collection, so confirm the complete description and current availability before sending an application.

Match requirements to evidence

Identify the responsibilities and skills the employer explicitly names. For each important requirement, choose one example from your work, education, training, or projects. Explain what you did, how you did it, and what changed as a result. Include a measurable outcome when you can support it. If you lack a requirement, describe related experience accurately instead of adding an unfamiliar skill to your resume.

Put the most relevant examples near the top of your resume. Keep job titles, dates, qualifications, and contact details consistent across your application materials. Use the employer’s terminology when it describes your experience accurately; a copied list of keywords does not explain your contribution. A short, specific bullet is easier to review than a paragraph that mixes several unrelated duties.

Check the working arrangement

Confirm the location, schedule, employment type, and any eligibility requirements on the employer’s site. A remote label does not establish worldwide eligibility or flexible hours. If compensation, benefits, equipment, travel, or contract duration are missing from this listing, write down your questions for the recruiter. Do not assume details from another opening at the same company apply to this role.

Review before submitting

Follow the employer’s requested file format and application instructions. Open your exported resume and check that its text is selectable, its sections read in order, and its links work. Proofread names, dates, and contact information. Share confidential work samples only when you have permission, and use an anonymized example when necessary.

Submit through a trusted employer or recruiting destination. If the original listing has disappeared, search the employer’s careers page for the title rather than assuming the vacancy remains open. Save the application date, job reference, and the version of your resume you sent. Those details help you prepare for a later conversation and avoid submitting conflicting information through several job boards.

Review your resume for writing and readability feedback, or browse other openings if this opportunity is unavailable.