QA Test Engineer

Quality Assurance Analyst (Automation)

Intercontinental Exchange, Inc. (ICE) is a leading operator of global exchanges, clearing houses, data, and listings services. We connect businesses around the world to unique opportunities in markets that drive the global economy. We are a diverse and inclusive company that values innovation, collaboration, and excellence. ICE team members work across departments and traditional boundaries to innovate and respond to industry demand. A successful candidate will be able to multitask in a dynamic team-based environment demonstrating strong problem-solving and decision-making abilities and the highest degree of professionalism.

As an Identity and Access Management (IAM) professional, you will be responsible for ensuring the security and integrity of our IT systems and applications. You will design, implement, and maintain policies and systems that control user identities, credentials, roles, and permissions across various IT platforms and applications. You will also monitor and audit user activities, troubleshoot issues, and comply with IT standards and regulations. To succeed in this role, you will need strong technical skills, analytical thinking, problem-solving abilities, and knowledge of IT security best practices.

The Quality Assurance Analyst (Automation) is responsible for designing, developing, and maintaining scalable automation solutions for UI and API testing. This role will build robust automation frameworks using Playwright or similar tools, integrate automated tests into CI/CD pipelines, and perform deep failure analysis to improve test reliability, coverage, and release confidence. The analyst will collaborate closely with developers and product teams, participate in code reviews, and actively incorporate AI-driven testing tools to accelerate test lifecycle outcomes.

Responsibilities

• Requirement Analysis & Test Planning
  • Analyze business and functional requirements, user stories, and design documents to understand expected system behavior.
  • Participate in requirement review and validation sessions with product owners and developers to ensure clarity and testability.
  • Contribute to test planning activities by identifying scope, dependencies, risks, and test approach.
• Test Case & Test Scenario Design
  • Create detailed test scenarios and test cases covering functional, regression, smoke, and negative test scenarios.
  • Ensure test cases align with business requirements and compliance standards.
  • Maintain and update test cases based on requirement changes and defect fixes.
• Manual Test Execution
  • Execute manual test cases across development, UAT, and production-like environments.
  • Perform different types of testing such as:
    • Functional testing, Regression testing, Smoke and sanity testing
    • Exploratory testing for complex or high-risk areas
    • Validate application behavior across multi-application and integrated environments.
• Test Automation Development (Playwright)
  • Automate test cases using Playwright (ie., JavaScript), covering functional, regression, and smoke test scenarios.
  • Design and develop a scalable automation framework using Playwright to support long-term maintainability and reuse.
  • Build and maintain end-to-end UI automation suites with strong stability practices (reliable selectors, assertions, retries where appropriate).
  • Develop and maintain API automation and integration test suites using REST principles and tooling aligned with team standards.
  • Create structured test data strategies and validations using SQL where required.
• CI/CD Integration & Quality Engineering
  • Integrate test automation into CI/CD pipelines to enable automated execution on pull requests, nightly runs, and release gates.
  • Work with DevOps and engineering teams using tools such as Jenkins, GitHub, Azure DevOps, or similar platforms to maintain stable pipeline execution.
  • Implement reporting, logging, and artifacts (screenshots, traces, videos as applicable) to support fast triage and debugging.
• Code Quality, Reviews & Best Practices
  • Participate in code reviews for test automation code and promote best practices (coding standards, maintainable patterns, reusable utilities).
  • Contribute to automation strategy, test design, and continuous improvement initiatives to improve efficiency and reduce manual effort.
• Failure Analysis & Debugging
  • Perform failure analysis and debugging of automation runs to identify root causes (environment issues, application defects, flaky tests, data dependency gaps).
  • Track, document, and communicate defects clearly with reproducible steps and evidence.
  • Continuously improve reliability by addressing flaky tests, stabilizing selectors, and optimizing test execution performance.
• AI-Driven Testing Enablement
  • Integrate AI-driven tools into the testing lifecycle to improve efficiency, coverage, and speed (e.g., assisted test creation, intelligent failure triage, test maintenance suggestions).
  • Leverage modern engineering practices and tools to reduce cycle time and increase automation throughput.
• Tools & Technologies
  • Test Automation: Playwright
  • API platform: Postman
  • IDE/Dev Tools: Visual Studio Code
  • Source Control: GitHub
  • Data Validation: SQL
  • CI/CD: Jenkins / GitHub Actions / Azure DevOps (or similar)

Knowledge and Experience

• 3+ years of hands-on experience in test automation using Playwright.
• Strong proficiency in JavaScript (writing clean, modular, maintainable automation code).
• Experience building scalable automation frameworks using Playwright (Page Object Model or comparable patterns).
• Strong understanding of REST APIs and experience validating API workflows (status codes, payload validations, contracts).
• Experience with CI/CD integration and automated execution in pipelines (Jenkins/GitHub/Azure DevOps or similar).
• Solid debugging skills with the ability to isolate root causes across test code, application changes, and environment instability.
• Strong communication skills and ability to collaborate effectively across QA, Dev, and DevOps teams.
• Automation mindset with strong engineering discipline.
• Ownership and accountability for automation quality and stability.
• Continuous improvement focus (reduce manual testing, improve coverage, improve speed).
• Collaborative approach and comfort working in agile delivery environments.

Preferred Knowledge and Experience

• Experience with GitHub Copilot, MCP, and agent-assisted coding tools such as Claude Code (or similar).
• Familiarity with test reporting dashboards and automation metrics (pass rate, flakiness, execution time trends).
• Exposure to performance or reliability testing concepts.