[Remote] Senior Applied AI Engineer (GenAI & LLM Evaluation)

Note: The job is a remote job and is open to candidates in USA. Acuity Analytics is a business with a strong global reputation, and they are seeking a Senior AI & Data Engineer (GenAI & LLM Evaluation) to help build and improve AI-powered data products. The role involves developing scalable data pipelines and deploying production-ready AI solutions while working on cutting-edge Generative AI technologies. Responsibilities Build and maintain scalable data pipelines and workflowsDevelop evaluation frameworks for GenAI and LLM applicationsCreate and maintain golden datasets for model testingEvaluate and benchmark LLM performanceBuild ML-assisted tools to improve delivery and automationDeploy production-ready AI solutionsWork closely with delivery teams to solve technical challengesContinuously improve data quality, automation, and operational efficiency Skills 5+ years' experience in Data Engineering, Machine Learning, AI Engineering, or Data ScienceStrong Python and SQL skillsHands-on experience with Generative AI and Large Language Models (LLMs)Experience evaluating LLMs using golden datasets, model benchmarking, or LLM-as-a-Judge techniquesExperience building and deploying production-ready ML solutionsStrong understanding of data pipelines, validation, and quality frameworksExperience integrating APIs and cloud-based AI servicesStrong problem-solving and analytical skillsComfortable owning solutions end-to-endExcellent communication and stakeholder managementExperience working in Agile, cross-functional teamsConsulting or customer-facing experience is a plus Company Overview Acuity Analytics is a financial services company that delivers research, analytics, data, and AI services to financial firms. It was founded in 2002, and is headquartered in London, England, GBR, with a workforce of 5001-10000 employees. Its website is https://www.acuityanalytics.com.