The QA Analyst performs manual, automated, and AI-assisted testing across multiple products and release cycles. Responsibilities include developing and maintaining automated tests, creating scripts, evaluating AI-generated outputs, analyzing results, identifying defects and coverage gaps, documenting outcomes, and supporting release-readiness decisions. The role collaborates with developers, QA engineers, business analysts, and stakeholders to clarify requirements, resolve defects, manage testing risks, and improve quality processes.
Position Summary
We are seeking a QA Analyst to support testing across multiple products and release cycles through a combination of AI-assisted, automated, and manual testing. This role will use AI tools and agentic workflows to enhance test design, automation development, results analysis, and documentation, while applying professional judgment to validate outputs and identify risks. The ideal candidate brings foundational automation and scripting skills, strong analytical abilities, and a collaborative approach to delivering reliable results within project timelines.
Key Responsibilities
- Incorporate AI tools and agentic workflows into test design, data generation, automation development, results analysis, and documentation.
- Evaluate AI-generated outputs, identify inaccuracies or coverage gaps, and perform additional validation when necessary.
- Determine the appropriate combination of AI-assisted, automated, and manual testing based on risk, complexity, and release priorities.
- Develop, execute, and maintain automated tests using Playwright, Selenium, or comparable frameworks.
- Create and maintain automation scripts using JavaScript, TypeScript, Python, C#, or similar languages.
- Document and communicate test outcomes, escalate quality concerns, and contribute to release-readiness decisions.
- Collaborate with QA engineers, developers, business analysts, and other stakeholders to clarify requirements, resolve defects, and improve testing processes.
- Support multiple products and releases while balancing testing coverage, efficiency, risk, and quality.
Required Qualifications
- 1–3 years of software quality assurance experience, including manual and automated testing.
- Experience with, or demonstrated aptitude for, using AI tools and agentic workflows in software testing.
- Familiarity with Playwright, Selenium, or comparable test-automation frameworks.
- Basic scripting or programming skills in JavaScript, TypeScript, Python, C#, or a similar language.
- Strong analytical and investigative skills, with the ability to identify defects, coverage gaps, regression risks, and unreliable AI-generated outputs.
- Ability to select appropriate testing methods based on product risk, requirements, and project priorities.
- Effective communication and collaboration skills, including the ability to clarify requirements and raise quality concerns.
- Ability to learn product and business processes, adapt to changing priorities, and contribute across multiple products and release cycles.
Salary range: $50,000 - $60,000 USD per year.
Similar Jobs
Artificial Intelligence • Cloud • Information Technology • Cybersecurity
Performs daily quality assurance checks across federal and DoD-aligned digital platforms. Validates content, links, UI components, interactive tools, accessibility, and platform updates. Executes QA checklists, documents defects in ticketing systems, tracks corrective actions, supports regression testing, escalates outages, and collaborates with content, UX, and technical teams to maintain digital quality and operational readiness.
Top Skills:
Section 508Wcag
Information Technology
Tests and validates AI-powered products, machine learning models, and Generative AI applications. Designs test strategies, executes functional, regression, and user acceptance testing, validates model outputs, identifies defects, analyzes quality metrics, documents evidence, and supports compliance and release readiness. Collaborates with AI engineers, product managers, and business teams to improve testing methodologies, quality frameworks, and AI evaluation practices.
Top Skills:
Artificial IntelligenceChatbotsGenerative AiMachine LearningPrompt EngineeringQa Automation Tools
Legal Tech • Software
The Quality Assurance Analyst II will analyze requirements, create test cases and plans, execute manual and exploratory testing, troubleshoot and reproduce defects, document bug reports, verify fixes, and prioritize test execution. The role also collaborates with QA engineers to expand automated test coverage based on business priorities and risks. Strong communication, analytical problem-solving, attention to detail, and familiarity with test management and bug-tracking tools are required.
Top Skills:
Azure Test PlansSdlcTestrail
What you need to know about the Montreal Tech Scene
With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.
Key Facts About Montreal Tech
- Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
- Major Tech Employers: SAP, Google, Microsoft, Cisco
- Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
- Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
- Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
- Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal
