View All Jobs 153511
Domain Expert Lead - STEM (contract), AGI - Data Services
Refine AI data collection processes to enhance large language model accuracy
Boston
Expert
yesterday
Amazon
A global e-commerce giant offering a vast array of products, cloud services, and digital streaming content.
2074 Similar Jobs at Amazon
Domain Expert Lead
This is a 12 month contract opportunity with the possibility to extend based on business needs. Embark on a transformative journey as our Domain Expert Lead, where intellectual rigor meets cutting-edge technological innovation. In this pivotal role, you will serve as a strategic architect of data integrity, leveraging your domain expertise to advance AI model training and evaluation. Your domain knowledge and experience will be instrumental in elevating our artificial intelligence capabilities, meticulously refining data collection processes and ensuring the highest standards of quality and precision across complex computational landscapes.
Key job responsibilities:
- Critically analyze and evaluate responses generated by our LLMs across various domains and use cases in your area of expertise.
- Develop and write demonstrations to illustrate "what good data looks like" in terms of meeting benchmarks for quality and efficiency.
- Participate in the creation of tooling that helps create such data by providing your feedback on what works and what doesn't.
- Champion effective knowledge-sharing initiatives by translating domain expertise into actionable insights, while cultivating strategic partnerships across multidisciplinary teams.
- Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output.
- Collaborate with the AI research team to identify areas for improvement in the LLM's capabilities.
- Stay abreast of the latest developments in how LLMs and GenAI can be applied to your area of expertise to ensure our evaluations remain cutting-edge.
About Amazon
A global e-commerce giant offering a vast array of products, cloud services, and digital streaming content.