AI Red Team Engineer for LLMs

OpenTrain AIAnywhereAdded 2d ago

AI Evaluation Engineer

Free to start · No card · 5 credits the moment you sign up

Job description

The workYou will evaluate and red team large language models and AI agents for safety issues and security vulnerabilities. You will create repeatable tests that can run offline and be evaluated automatically. The work also includes building scripts, custom tools, test environments, and test harnesses. You may contribute to security research, create realistic attack scenarios, advise on secure coding and platform hardening, and document findings with clear steps for reproducing them. Test AI models and agents for safety risks and vulnerabilities.Create offline, reproducible, and automatically evaluated test cases.Build automation scripts, custom tools, environments, and test harnesses.Design realistic attacks and document findings with clear reproduction steps.Work with LLM risks such as prompt injection and the OWASP Top 10 for LLMs.What it pays and takesThis is an intermediate-level, part-time contractor role. You must be able to work in English at C1 level or higher and submit your resume in English. Pay: $40 per hour.Hours: Fewer than 20 hours per week with flexible scheduling.Work setup: Remote and open worldwide, subject to location eligibility.Education: Bachelor’s or Master’s degree in computer science, software engineering, cybersecurity, digital forensics, or a related field.Certification: At least one recognized cybersecurity or red-team certification with a public Credential.net link for verification.Technical skills: Strong scripting in Python, Bash, or PowerShell.Security experience: Penetration testing across web, API, network, and infrastructure systems.Tools and methods: Experience with Docker and CI/CD security tooling.LLM security: Familiarity with prompt injection and the OWASP Top 10 for LLMs.Helpful experience: Frameworks such as garak or PyRIT.How it worksApply on OpenTrain. The employer reviews applications there. About AI training workAI training work uses human expertise to test, review, and improve artificial intelligence systems, including checking whether models respond safely to realistic attacks. OpenTrain AI is the hiring and contracting organization for this role, and experienced cybersecurity contributors help make these systems more secure.

Prepare your application

Use the description above to assess your fit for OpenTrain AI. This checklist is guidance from Resumize, rather than additional requirements from the employer. Imported listings can be shortened or change after collection, so confirm the complete description and current availability before sending an application.

Match requirements to evidence

Identify the responsibilities and skills the employer explicitly names. For each important requirement, choose one example from your work, education, training, or projects. Explain what you did, how you did it, and what changed as a result. Include a measurable outcome when you can support it. If you lack a requirement, describe related experience accurately instead of adding an unfamiliar skill to your resume.

Put the most relevant examples near the top of your resume. Keep job titles, dates, qualifications, and contact details consistent across your application materials. Use the employer’s terminology when it describes your experience accurately; a copied list of keywords does not explain your contribution. A short, specific bullet is easier to review than a paragraph that mixes several unrelated duties.

Check the working arrangement

Confirm the location, schedule, employment type, and any eligibility requirements on the employer’s site. A remote label does not establish worldwide eligibility or flexible hours. If compensation, benefits, equipment, travel, or contract duration are missing from this listing, write down your questions for the recruiter. Do not assume details from another opening at the same company apply to this role.

Review before submitting

Follow the employer’s requested file format and application instructions. Open your exported resume and check that its text is selectable, its sections read in order, and its links work. Proofread names, dates, and contact information. Share confidential work samples only when you have permission, and use an anonymized example when necessary.

Submit through a trusted employer or recruiting destination. If the original listing has disappeared, search the employer’s careers page for the title rather than assuming the vacancy remains open. Save the application date, job reference, and the version of your resume you sent. Those details help you prepare for a later conversation and avoid submitting conflicting information through several job boards.

Review your resume for writing and readability feedback, or browse other openings if this opportunity is unavailable.