AIML Evaluation - Senior ML Engineer

AIML Evaluation - Senior ML Engineer

At Apple new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Apple is a place where extraordinary people come together to do their life's best work. Together, we build technologies and experiences people once couldn't have imagined — and now can't imagine living without! The AI/ML team in Madrid, Spain, is seeking an experienced ML Engineer to work on the evaluation of next-generation features for Apple Intelligence. This role is at the intersection of software engineering, machine learning and human-centered design. You will be responsible for developing the tools and infrastructure that allow Apple to assess and optimize the intelligence, responsiveness, and quality of Siri and other Apple Intelligence features before it reaches millions of users around the world!

Description

In this role you will work with highly skilled engineers building scalable systems and frameworks for end-to-end (E2E) evaluation of Apple Intelligence products such as Siri. Your work will be critical in validating the performance and reliability of unreleased software and models, ensuring that Siri and Apple Intelligence continues to set the standard for intelligent voice assistants. The position requires a motivated, technically qualified Senior ML Engineer with the ability to coordinate work between multiple teams across different time zones and geographical locations. A strong understanding of ML evaluation strategies, software lifecycle, excellent problem-solving and communication skills are also required.

Minimum Qualifications

Proven experience in implementation and evaluation of large scale, AI based, solutions. Experience crafting evaluation datasets and strategies for ML based products. Experience in Large Language Models usage and benchmarking. Strong programming background in Python, Swift, or similar languages, with a focus on Machine Learning, test automation, or data tooling.

Preferred Qualifications

Experience working on voice assistants, NLP systems, or real-time AI-powered applications. Experience designing and scaling systems for software validation, quality assessment, or ML model evaluation. Strong organizational skills and problem solving skills on large cross functional team. B.S. in Computer Science or equivalent required. M.S or Ph.D preferred.