Back to jobs

Member of Technical Staff, Enterprise AI, Remote- Full-time

Xperteez TechnologyRemote (United States)Posted 1w ago
AI Evaluation Engineer
USD 300000-700000 per annual
Full Time
Remote
Craft my tailored resume free

Free to start · No card

Job description

Job Title: Member of Technical Staff, Enterprise AI

Job Type: Full-time

Location: Remote

Required Skills:

  • Research Signal Judgment

  • ML-Oriented Data Design

  • Ops-to-Research Translation

  • Enterprise AI

The Role: As a Member of Technical Staff, you will function as a forward-deployed research partner embedded directly within enterprise AI systems. You will work on live workflows, uncover real-world failure modes, and drive rapid experimental cycles to improve system performance.

What You’ll Do:

  • Embed within enterprise AI workflows as a research collaborator, working alongside domain experts and client teams.

  • Surface, formalize, and prioritize system failure modes in real-world deployments.

  • Design high-signal datasets and evaluation protocols to target identified weaknesses.

  • Run tight experimental loops to validate hypotheses and quantify improvements.

  • Produce clear, decision-oriented analyses of system behavior and performance.

  • Develop and benchmark agentic workflows, focusing on robustness and scalability.

  • Build lightweight tooling to support evaluation, data curation, and rapid iteration.

  • Contribute to internal and external research artifacts, including reports and benchmarks.

Who You Are:

  • Master’s degree in Computer Science, Machine Learning, Artificial Intelligence, or a related technical field.

  • Strong judgment for research signal quality, including data selection and evaluation design.

  • Experience designing datasets and evaluation frameworks for ML systems.

  • Ability to translate ambiguous operational issues into structured research problems.

  • Familiarity with RL environments and/or agentic system evaluation.

  • Clear, concise communicator with a bias toward actionable insight.

  • Proven ability to execute in fast iteration cycles and high-ambiguity settings.

  • Collaborative mindset with experience working across research, product, and domain teams.

Preferred:

  • Strong client-facing experience, particularly in technical or research-driven environments.

  • Experience building internal research or evaluation tooling.

  • Contributions to benchmarks, research publications, or open research initiatives.

  • Exposure to enterprise AI deployments or forward-deployed research models.

Originally posted on Himalayas

Prepare your application

Use the description above to assess your fit for Xperteez Technology. This checklist is guidance from Resumize, rather than additional requirements from the employer. Imported listings can be shortened or change after collection, so confirm the complete description and current availability before sending an application.

Match requirements to evidence

Identify the responsibilities and skills the employer explicitly names. For each important requirement, choose one example from your work, education, training, or projects. Explain what you did, how you did it, and what changed as a result. Include a measurable outcome when you can support it. If you lack a requirement, describe related experience accurately instead of adding an unfamiliar skill to your resume.

Put the most relevant examples near the top of your resume. Keep job titles, dates, qualifications, and contact details consistent across your application materials. Use the employer’s terminology when it describes your experience accurately; a copied list of keywords does not explain your contribution. A short, specific bullet is easier to review than a paragraph that mixes several unrelated duties.

Check the working arrangement

Confirm the location, schedule, employment type, and any eligibility requirements on the employer’s site. A remote label does not establish worldwide eligibility or flexible hours. If compensation, benefits, equipment, travel, or contract duration are missing from this listing, write down your questions for the recruiter. Do not assume details from another opening at the same company apply to this role.

Review before submitting

Follow the employer’s requested file format and application instructions. Open your exported resume and check that its text is selectable, its sections read in order, and its links work. Proofread names, dates, and contact information. Share confidential work samples only when you have permission, and use an anonymized example when necessary.

Submit through a trusted employer or recruiting destination. If the original listing has disappeared, search the employer’s careers page for the title rather than assuming the vacancy remains open. Save the application date, job reference, and the version of your resume you sent. Those details help you prepare for a later conversation and avoid submitting conflicting information through several job boards.

Review your resume for writing and readability feedback, or browse other openings if this opportunity is unavailable.