View All Jobs 126221

Eval Engineer

Own end-to-end SIT testing strategy and integration for Eval Engine deployment.
Sydney
Mid-Level
yesterday
Cognizant

Cognizant

Provides global IT consulting, digital transformation, and business process services to help enterprises modernize technology and improve operations.

Eval Engineer

The Eval Engineer ensures solution quality, reliability, and risk compliance across the ADLC lifecycle. This role owns testing strategies, evaluation skills (Eval Driven Development), and quality gates, providing confidence before governance and production release.

Key Responsibilities:

  • Design and own test suite and test case following Eval Driven Development
  • Follow and review execution of Eval Test Suites by AI Agent
  • Orchestrate end-to-end system integration testing (SIT)
  • Lead with the help of AI Agent the "Reflection" phase to generate lesson learned use to optimize the Agent Harness
  • Author and maintain custom evaluation instructions
  • Provide formal quality score sign-off prior to governance gates

Required Skills & Experience:

  • GitHub Copilot (CLI/IDE Integration)
  • Python
  • pytest
  • Data pipeline testing
  • Risk domain knowledge

Benefits:

Joining Cognizant will give you the opportunity to learn and collaborate with some of the most talented people in the industry, while having your finger on the pulse of emerging industry trends and working on the cutting edge of technology in your field of expertise.

We recognize that our people perform at their best when they feel valued as significant contributors and that is why at Cognizant, taking care of our employees is a priority:

路 You can pursue innovative career tracks and opportunities here

路 You can enhance your professional development through education and dedicated training

路 We'll give you the skills you need to keep pace with the changing workplace while our compensation, benefits and wellness packages help you stay healthy and plan for the future.

Next Steps:

Please reach out to our friendly and welcoming team today to apply and register your interest for this full-time role. We'd love to help you get your next role and enable you to fulfil your professional ambitions.

What we offer:

  • The chance to work with impact. Here, you're empowered to bring your biggest thinking to help our company and clients improve everyday life.
  • Ownership over your career. Stay at the top of your game through our award-winning learning and development ecosystem. And when your ambitions change or we offer new opportunities, we help you pivot by providing reskilling, on-the-job learning and guidance to find new roles that might be a better fit.
  • The opportunity to thrive on a high caliber team with heart. We celebrate each other's experiences and perspectives and promote a sense of belonging through our affinity groups and diversity and inclusion initiatives.
  • A comprehensive total rewards package, including a competitive salary and a pension plan with matching contributions.
  • Flexible health and financial benefits to support you and your eligible dependents鈥攆rom day one.
  • True work-life balance. Be at your best through paid time off, flexible work arrangements, volunteering opportunities, social events, and so much more.

About us:

Cognizant (Nasdaq: CTSH) is an AI Builder and technology services provider, building the bridge between AI investment and enterprise value by building full-stack AI solutions for our clients. Our deep industry, process and engineering expertise enables us to build an organization's unique context into technology systems that amplify human potential, realize tangible returns and keep global enterprises ahead in a fast-changing world. See how at www.cognizant.com.

Other employment-related information:

Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, provincial or local laws.

If you have a disability that requires reasonable accommodation to search for a job opening or submit an application, please email CareersNA2@cognizant.com with your request and contact information.

Language requirements vary depending on roles, but we ask that all candidates have basic English proficiency for company-wide communications purposes. For roles based in Quebec, professional English proficiency is required, as you'll deliver services to and collaborate with stakeholders outside the province who may not speak French.

+ Show Original Job Post
























Eval Engineer
Sydney
Engineering
About Cognizant
Provides global IT consulting, digital transformation, and business process services to help enterprises modernize technology and improve operations.