View All Jobs 133686
Software Dev Engineer, Artificial General Intelligence
Evaluate AI-generated code to improve large language model performance and accuracy
Bellevue, Washington, United States
yesterday
Amazon
A global e-commerce giant offering a vast array of products, cloud services, and digital streaming content.
1038 Similar Jobs at Amazon
Artificial General Intelligence (AGI) Data Services
This is currently a temporary contract opportunity (12 to 24 months duration) based on business needs. Artificial General Intelligence (AGI) Data Services is at the forefront of AI innovation, specializing in the development and refinement of large language models (LLMs). Our mission is to create AI systems that can understand and generate high-quality code, revolutionizing the software development landscape.
Key Job Responsibilities
- Critically analyze and evaluate code responses generated by our LLMs across various programming languages and paradigms.
- Exercise expert judgment to select the most appropriate and efficient code solutions from multiple LLM-generated options.
- Make informed decisions on behalf of our customers, ensuring that selected code meets industry standards, best practices, and specific client needs.
- Develop and write coding demonstrations to illustrate "what good looks like" in AI-generated code, setting benchmarks for quality and efficiency.
- Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output.
- Collaborate with the AI research team to identify areas for improvement in the LLM's coding capabilities.
- Stay abreast of the latest developments in software engineering, coding standards, and AI to ensure our evaluations are accurate.
A Day in the Life
As a SDE in Amazon AGI, you will play a crucial role in assessing and improving our language models' coding capabilities. Your expertise will be instrumental in evaluating LLM-generated code responses, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted coding.
Software Dev Engineer, Artificial General Intelligence
Bellevue, Washington, United States
Engineering
About Amazon
A global e-commerce giant offering a vast array of products, cloud services, and digital streaming content.