Software Test Engineer II

Software Test Engineer

We are seeking a Software Test Engineer to join PNNL's TestOps team, helping assure the quality, reliability, and performance of innovative systems spanning agentic AI platforms, large-scale data orchestration, and real-time intelligence processing. This is an excellent opportunity for mid-career test engineers to apply modern QA and full-stack test engineering practices to mission-critical national security applications, strengthening expertise in end-to-end system validation across APIs, data pipelines, and production-like environments.

You're a motivated test engineer with experience developing test strategies and test artifacts (test plans, test cases, and test reports) and building/maintaining test automation, with strong fundamentals in software engineering and QA best practices. You're comfortable partnering across the full development lifecycle to translate requirements into measurable acceptance criteria and comprehensive test coverage. You're detail-oriented and analytical, with strong debugging skills, and you communicate clearly with both technical and non-technical stakeholders.

Test Strategy, Planning, and Coverage

• Design, develop, document, execute, and debug test strategies for new and existing software systems, applications, and hardware/software interfaces, applying QA best practices
• Collaborate with cross-functional teams across the full development lifecycle to analyze user needs and requirements; translate requirements into test plans, test cases, traceability, and acceptance criteria
• Ensure comprehensive functional, integration, system, regression, and performance coverage using risk-based approaches and clear release criteria
• Produce high-quality test reports and quality summaries that communicate coverage, results, and risk

Test Automation, Manual Validation, and CI/CD

• Build and maintain automated and manual test solutions across API, UI, integration, end-to-end, and regression layers
• Implement automated tests using Cypress.io, Playwright, or similar frameworks; reduce flakiness and improve reliability
• Integrate test tooling and automated tests into CI/CD pipelines (e.g., GitLab or GitHub), including reporting and quality gates
• Validate end-to-end workflows and integrations across APIs, databases, pipelines, and services using SQL and/or GraphQL where appropriate

AI/ML and Data-Intensive System Validation

• Validate models, data, and end-to-end workflows using data/model validation plus integration, E2E, and regression testing, including handling non-deterministic outputs
• Assess AI quality attributes such as accuracy, precision/recall, relevance, bias/fairness, robustness/consistency, and verify guardrails/safety/explainability expectations
• Evaluate data quality signals including completeness, correctness, representativeness, drift, and label quality
• Partner with engineers to define and automate AI evaluation and regression approaches that fit mission needs
• Work with AI agents/skills and MCP servers to support test automation workflows and system validation

Platform, Cloud, and Reliability Readiness

• Contribute to quality practices for cloud and containerized deployments by applying a general understanding of cloud concepts (e.g., AWS/Azure services) and common container tooling (e.g., Docker/Podman and Kubernetes fundamentals)
• Use observability (logs/metrics/traces) to debug failures, validate monitoring, and improve system testability
• Support performance testing and reliability validation (latency, scalability, stability) for mission-critical services

Stakeholder Partnership and Continuous Improvement

• Partner with end users and stakeholders to prototype, configure, refine, verify, and troubleshoot systems to meet intended use
• Identify and evaluate new testing tools, technologies, and methods to improve quality, reliability, and test efficiency through continuous improvement

Collaboration & Professional Growth

• Collaborate effectively with software engineers, DevOps/platform teams, data scientists, and stakeholders across the full development and release lifecycle
• Communicate clearly in writing and verbally by documenting test plans, test results, defects; articulate technical risks and quality status in team discussions
• Participate actively in code reviews, test strategy/design discussions, and continuous improvement efforts, with openness to constructive feedback and a willingness to learn best practices
• Incorporate feedback from defects and incidents to improve test coverage, automation reliability, and overall system quality through peer collaboration, self-study, and hands-on learning

This position is based in Richland, WA or Seattle, WA and requires an onsite presence Monday through Thursday, with Friday as required by business needs.

Minimum Qualifications:

• PhD -OR-
• MS/MA -OR-
• BS/BA and 2 years of relevant experience

Preferred Qualifications:

• Degree in Computer Science, Software Engineering, or a related field
• Experience implementing automated tests using Cypress.io, Playwright, or similar testing frameworks
• Experience using AI-assisted development tools within an IDE, such as VS Code, to write automated tests and troubleshoot issues
• Experience in JavaScript and Python programming languages
• Knowledgeable in using SQL or GraphQL
• Experience developing software test plans, test cases, and test reports
• Knowledge of software engineering best practices and software development lifecycles
• Experience with DevOps and MLOps, including automated tests within CI/CD processes such GitLab or GitHub
• 1+ years of experience using AI tools (i.e. Cline, Roo Code, etc.) within an IDE to write automated tests and/or troubleshoot issues
• Familiarity with AI models such as Claude, Co-Pilot. Knowledgeable in using MCP servers, AI skills, and AI agents
• Experience in validating models, data, and end-to-end workflows/integrations (APIs, databases, pipelines) using data/model validation plus integration, E2E, and regression testing, including handling non-deterministic outputs and real-world/edge/failure scenarios
• Experience in assessing AI quality attributes (accuracy, precision/recall, relevance, bias/fairness, robustness/consistency), data quality (completeness, correctness, representativeness, drift, label quality), plus safety/explain ability/guardrails and performance (latency, scalability, reliability)
• Experience with cloud computing (AWS/Azure)
• Familiar with containerization using Docker/Podman/Kubernetes
• Strong analytical and troubleshooting skills with attention to detail

This position requires the ability to obtain and maintain a federal security clearance (Q/SCI).

A security clearance background investigation includes review of your employment, education, financial, and criminal history, as well as interviews with you and your personal references, neighbors, and co-workers to determine trustworthiness, reliability, and loyalty to the United States. The investigation also examines your foreign connections, drug and alcohol use, foreign influence, and overall conduct.

Requirements:

• U.S. Citizenship
• Background Investigation: Applicants selected will be subject to a Federal background investigation and must meet eligibility requirements for access to classified matter in accordance with 10 CFR 710, Appendix B.
• Drug Testing: All Security Clearance positions are Testing Designated Positions, which means that the applicant selected for hire is subject to pre-employment drug testing, and post-employment random drug testing. In addition, applicants must be able to demonstrate non-use of illegal drugs, including marijuana, for the 12 consecutive months preceding completion of the requisite Questionnaire for National Security Positions (QNSP).

Note: Applicants will be considered ineligible for security clearance processing by the U.S. Department of Energy if non-use of illegal drugs, including marijuana, for 12 months cannot be demonstrated.

This position is a Testing Designated Position (TDP). The candidate selected for this position will be subject to pre-employment and random drug testing for illegal drugs, including marijuana, consistent with the Controlled Substances Act and the PNNL Workplace Substance Abuse Program.

Pacific Northwest National Laboratory (PNNL) is a world-class research institution powered by a highly educated, diverse workforce committed to the values of Integrity, Creativity, Collaboration, Impact, and Courage. Every year, scores of dynamic, driven people come to PNNL to work with renowned researchers on meaningful science, innovations and outcomes for the U.S. Department of Energy and other sponsors; here is your chance to be one of them!

At PNNL, you will find an exciting research environment and excellent benefits including health insurance, and flexible work schedules. PNNL is