Staff Test Engineer - Remote Eligible

Senior Test Engineer

Our client is seeking a Senior-level Test Automation Engineer who can fully own testing from strategy through execution. This is a hands-on engineering role for someone who writes production-grade test code across a Python and AWS stack, not someone executing predefined QA tasks. In this role, you will evaluate the existing platform, identify testing and reliability gaps, design a comprehensive coverage strategy, and implement scalable automation frameworks. You will propose and drive improvements to testing infrastructure, modify production code when required to improve testability, and establish testing patterns that other engineers can adopt. You will operate as a self-directed technical consultant, working with minimal supervision, and serve as the authoritative owner of automated testing and quality for a cloud-native platform.

• Evaluate the existing platform and identify testing and reliability gaps.
• Design a comprehensive coverage strategy and implement scalable automation frameworks.
• Propose and drive improvements to the testing infrastructure.
• Modify production code to improve testability when necessary.
• Establish testing patterns that other engineers can adopt.
• Operate as a self-directed technical consultant with minimal supervision.
• Serve as the authoritative owner of automated testing and quality.

• 5+ years of experience.
• Hands-on Python skills for writing production-grade test code.
• Experience in automated testing, not manual QA.
• Experience with AWS-based backend systems.
• Backend and integration testing experience.
• Ability to own test strategy.

• Experience testing AI/ML or LLM-based systems.
• Knowledge of agentic workflows and LLM evaluation frameworks.
• Output consistency validation and hallucination risk awareness.
• AI safety principles and prompt-injection risk awareness.
• PII and test-data governance.
• Use of AI developer tools (e.g., Cursor, Codex).
• Building automation frameworks from scratch.
• Integration, E2E, and backend testing.
• Pytest or Python-native test frameworks.
• CI/CD pipelines (GitHub Actions, quality or serverless architectures).
• DynamoDB single-table design exposure.

100% remote