Senior Quality Engineer

Your Future Evolves Here

Position Summary

The Senior Quality Engineer leads the quality strategy for complex software applications, owning test planning, test automation frameworks, and the quality signals that determine release readiness. Working in an Agile, globally dispersed team, this role designs and maintains robust UI and API automation, integrates it into CI/CD pipelines, and partners with developers, business analysts, and stakeholders to build quality into every phase of the software lifecycle.

This individual works independently with minimal supervision, applies creativity to testing challenges, sets and upholds the automation patterns others follow, and mentors quality engineers across the team. The role is expected to use approved AI-assisted tools to accelerate testing and improve quality while remaining fully accountable for every delivered result.

AI-Assisted Engineering Expectations

Evolent engineers are expected to effectively leverage approved AI-assisted development and productivity tools (e.g., code assistants, copilots, automation agents, knowledge assistants, and analytics tools) to improve quality, efficiency, and innovation while maintaining accountability for all delivered work. These expectations span the full engineering lifecycle, not only code generation, including iterating with AI on test strategy and solution design, evaluating alternatives, and producing design artifacts. Engineers remain responsible for validating outputs, ensuring solution quality, protecting sensitive information, and complying with security, privacy, regulatory, and Responsible AI standards.

Key Responsibilities

Quality Strategy and Leadership

• Develop, implement, and manage comprehensive test plans and strategies for complex software applications, covering functional, regression, and performance testing.

• Participate in code reviews, design discussions, and product planning to ensure quality is built into all phases of the software lifecycle.

• Define and uphold test automation development patterns and standards in partnership with testing automation architects.

• Conduct exploratory and automated testing to validate software functionality, performance, and security.

• Mentor quality engineers, promoting best practices in testing, automation, and quality assurance.

• Drive continuous improvement initiatives in testing processes, tools, and methodologies, and evaluate emerging testing technologies for applicability.

Test Automation and CI/CD

• Lead the creation, maintenance, and optimization of UI and API test automation frameworks (e.g., Selenium WebDriver, Playwright) to improve efficiency and coverage.

• Integrate and execute automated test suites in CI/CD pipelines (e.g., Jenkins, GitHub Actions), maintaining a consistently high pass rate and reliable results.

• Create and maintain test data, and fix or refactor test scripts as applications evolve.

Defect Management and Quality Reporting

• Isolate, analyze, document, and prioritize defects before escalating, and collaborate with developers, business analysts, and stakeholders for timely resolution.

• Analyze test results and quality data, generate quality metrics, and report on quality state and release readiness to stakeholders.

• Present work in Agile ceremonies and lead technical knowledge-sharing sessions.

AI-Enabled Quality Engineering

• Utilize approved AI-assisted engineering tools to accelerate test design, test script development, test data generation, documentation, troubleshooting, and defect analysis.

• Evaluate and validate AI-generated tests, scripts, and analysis for correctness, security, maintainability, compliance, and business appropriateness.

• Continuously identify opportunities to improve testing productivity and solution quality through AI-enabled workflows and automation.

• Contribute reusable prompts, skills, agents, testing playbooks, and AI-assisted testing patterns to benefit the broader engineering organization.

• Develop test strategies for AI-enabled capabilities integrated into enterprise applications, in partnership with architecture, security, and platform teams.

Governance and Compliance

• Follow enterprise policies governing AI usage, intellectual property protection, security, privacy, PHI handling, and Responsible AI practices.

• Ensure no confidential, regulated, or protected information (including PHI in test data) is used with unapproved AI services or tooling.

• Participate in peer reviews and validation processes for AI-assisted solutions.

Required Qualifications

• 5+ years of experience in software quality assurance, with hands-on UI and API automation and manual testing.

• Strong hands-on experience building robust automation frameworks with Java and Selenium WebDriver and/or TypeScript/JavaScript with Playwright.

• Proficiency with test frameworks and build tools (e.g., TestNG, JUnit, Maven, Karate, Cypress).

• Strong coding skills in languages such as Java, C#, Python, or JavaScript/TypeScript for test automation.

• Experience creating and maintaining automation jobs in CI/CD tools (e.g., Jenkins, GitHub Actions with YAML, GitLab) and version control with Git.

• Proficiency in SQL for test data creation and maintenance.

• Knowledge of test management and defect tracking tools (e.g., JIRA, ALM).

• In-depth knowledge of testing methodologies, including functional, regression, performance, and security testing.

• Experience working in Agile development environments.

• Strong problem-solving skills and a proactive approach to troubleshooting and issue resolution.

• Excellent communication and collaboration skills, with the ability to mentor others.

Preferred Qualifications

• Experience using AI-assisted development and testing platforms such as GitHub Copilot, Cursor, Claude Code, or similar tools.

• Hands-on experience with AI-driven testing, prompt engineering, and an understanding of underlying LLMs and MCP servers (e.g., Playwright MCP).

• Experience testing AI services, models, or agents integrated into production applications.

• Experience with additional frameworks such as PyTest with Python.

• Experience in healthcare or other regulated environments handling PHI.

Education

• Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or a related field, or equivalent experience.

To ensure a secure hiring process we have implemented several identity verification steps, including submission of a government issued photo ID. We conduct identity verification during interviews, and final interviews may require onsite attendance. All candidates must complete a comprehensive background check, in-person I-9 verification, and may be subject to drug screening prior to employment. The use of artificial intelligence tools during interviews is prohibited and monitored. Misrepresentation will result in immediate disqualification from consideration.

Technical Requirements:

We require that all employees have the following technical capability at their home: High speed internet over 10 Mbps and, specifically for all call center employees, the ability to plug in directly to the home internet router.

Evolent is an equal opportunity employer and considers all qualified applicants equally without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability status. If you need reasonable accommodation to access the information provided on this website, please contact [email protected] for further assistance.