Workiy Logo

Workiy

QA Lead – Agentic AI Platform

Posted 13 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in CAN
Senior level
Remote
Hiring Remotely in CAN
Senior level
Lead QA for an Agentic AI platform: define and execute testing strategy, implement automation, validate LLM outputs and conversational workflows, oversee functional/integration/regression/performance testing, integrate CI/CD, mentor QA engineers, and promote quality best practices across teams.
The summary above was generated by AI

This is a remote position.

Job Description :

We are seeking an experienced QA Lead to oversee quality assurance efforts for a next-generation Agentic AI platform. The ideal candidate will be responsible for defining and executing comprehensive testing strategies that ensure the reliability, accuracy, scalability, and performance of AI-driven applications. This role requires close collaboration with product managers, software engineers, data scientists, and business stakeholders to validate end-to-end system functionality and deliver high-quality releases.

The QA Lead will drive the implementation of automated testing frameworks, establish quality standards and release criteria, and oversee functional, integration, regression, performance, and user acceptance testing activities. The role also involves validating AI model outputs, conversational workflows, API integrations, data pipelines, and overall user experience. Candidates should possess strong leadership skills, hands-on experience with test automation, API testing, CI/CD processes, and data validation, along with a deep understanding of Agile development practices.

The successful candidate will mentor QA engineers, promote quality best practices across teams, identify risks early in the development lifecycle, and continuously improve testing processes to support the delivery of robust, enterprise-grade AI solutions. Experience with Generative AI, Large Language Models (LLMs), Agentic AI systems, cloud platforms, and modern software quality engineering methodologies is highly preferred.



Requirements
  • AI/LLM Testing and Validation
  • Agentic AI and Conversational AI Platforms
  • Test Automation Frameworks (Selenium, Playwright, Cypress, or equivalent)
  • API Testing (REST, GraphQL)
  • Python or Java for Test Automation
  • Data Quality and Data Validation Testing
  • SQL and Database Testing
  • CI/CD Pipeline Integration (Jenkins, GitHub Actions, GitLab CI)
  • Functional, Integration, Regression, and End-to-End Testing
  • Performance and Load Testing
  • Defect Management and Test Planning
  • Quality Strategy, Release Gates, and Risk-Based Testing
  • Agile/Scrum Methodologies
  • QA Leadership and Team Mentoring
  • Strong Analytical and Problem-Solving Skills
  • Experience with Cloud Platforms (AWS, Azure, or GCP)


Similar Jobs

10 Hours Ago
Remote or Hybrid
Montréal, QC, CAN
Internship
Internship
Information Technology • Insurance • Software
Support review, rebranding, updating, and restructuring of English and French product documentation. Validate workflows, capture screenshots, apply adult learning principles, update release-driven changes, partner with product teams, and help establish repeatable documentation and version-control processes to improve usability and bilingual consistency.
Top Skills: Content Management SystemsDocumentation ToolsKnowledge BasesMS OfficeSharepoint
10 Hours Ago
Remote
Canada
Expert/Leader
Expert/Leader
Artificial Intelligence • Cloud • Consumer Web • Productivity • Software • App development • Data Privacy
Lead vision, strategy, and execution for Dropbox's next-generation design system and design technology platform. Build reusable patterns, components, tokens, and governance; partner with product, engineering, research, and brand; raise interaction, accessibility, and implementation quality; create adoption and measurement models; and develop a multidisciplinary team to scale coherent, high-quality multi-product experiences including AI-native capabilities.
Top Skills: Accessibility InfrastructureAi-Assisted ExperiencesComponent ArchitectureContent SystemsDesign SystemsDesign TechnologyDesign TokensFront-End EngineeringPrototyping Tools
11 Hours Ago
Remote or Hybrid
Montréal, QC, CAN
Senior level
Senior level
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Lead data curation and validation for production ML: coordinate with ML/product/TPM teams, define data and training specs, oversee pipelines, ensure representative, high-quality behavioral datasets, and translate product goals into actionable data requirements.
Top Skills: ConfluenceData Visualization ToolsExperiment Tracking FrameworkGitGit ServerJIRAPythonSlackUnix Shell

What you need to know about the Montreal Tech Scene

With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.

Key Facts About Montreal Tech

  • Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
  • Major Tech Employers: SAP, Google, Microsoft, Cisco
  • Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
  • Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
  • Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
  • Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account