Engineer IV - Req002206_1 - 3175 - Remote Eligible

Engineer IV

We are a team of technologists working together to solve complex technical problems and develop innovative solutions. Embracing a culture of continuous improvement, we look for ways to incorporate new technologies in the delivery of systems that are responsible for analysis and scoring of tests of SAT/PSAT and AP programs, all with the singular purpose of providing comprehensive assessments to millions of students. We regularly collaborate while pitching and sharing our ideas to help define the future of our applications. Our team is characterized by our positive team culture, strong technical skills, focus on delivering value and our ability to have fun while being productive.

As an Engineer IV focused on quality, you are responsible for ensuring the quality and reliability of key scoring capabilities of College Board\'s assessments through advanced testing strategies, automation frameworks and an advanced knowledge of QA best practices. Leveraging your AWS expertise, strong analytical and problem-solving skills, you will analyze complex feature requirements, automate testing processes, and drive efficiencies. Collaborating with cross-functional teams, you will contribute to improving reliability and efficiency of systems. This role is ideal for someone who thrives in a fast-paced, Agile environment and is eager to make a meaningful impact on the digital transformation of SAT, PSAT, and AP exams.

In this role, you will:

• Design, develop, implement and maintain comprehensive test plans, test cases and automated test suites
• Collaborate with product managers and developers to review requirements and ensure testability
• Design and develop automated testing frameworks for scoring products
• Maintain CI/CD pipelines with integrated automated testing
• Identify, recommend and implement tools to enhance testing efficiency
• Conduct functional, regression, performance and security testing
• Track and analyze test results, defect trends and root causes
• Ensure compliance with quality and security standards
• Collaborate with business and technical teams to translate data insights into actionable recommendations
• Develop and participate in the review of requirements, data mappings, user stories, and other artifacts, clearly communicating to both business and technical team members
• Assist in resolving production issues by troubleshooting and working with engineering teams to implement fixes
• Support functional testing by validating data accuracy, system behavior, and process integrity

About you, you have:

• Bachelor\'s degree in computer science, Computer Engineering, Software Engineering or equivalent preferred
• 5+ years of professional experience in enterprise-wide software quality assurance
• Strong analytical and problem-solving skills with a keen eye for detail
• Excellent communication and collaboration skills to work across technical and business teams
• Understanding of Agile methodology with a willingness/ability to work in a DevOps environment
• Strong proficiency in test automation
• Experience with CI/CD tools
• Knowledge of scripting/programming languages/tools (e.g. JavaScript, Nodejs, cucumber, etc.)
• Minimum of 1-2 years of hands-on experience working with AWS services, including Lambda, S3, Step Functions, DynamoDB, SNS, SQS, CloudWatch and more
• Proactive with a strong sense of ownership and responsibility
• Capable of analyzing, planning, designing, and owning vaguely defined issues with little supervision
• Collaborative attitude that incorporates various perspectives
• Strong problem solving and organizational skills

Additional nice to have qualifications:

• Experience with TypeScript
• Any experience applying AI-driven test automation or predictive analytics for defect detection
• Hands-on experience with CI/CD and NoSQL
• Skilled at creating/generating complex test data that aligns with business rules, covering edge cases and complex scenarios.

Application review will begin immediately and will continue until the position is filled. While the hiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks.