The Senior Quality Engineer ensures software quality across engineering by developing test strategies, automating tests, and validating releases. Focused on automation and collaboration, they enhance QE practices and mentor others in a fast-paced Agile environment.
About Wyllo
About the Role
You will
You have
Additional Expectations
Education and Experience
What We Value
Working at Wyllo
Wyllo is a CX-first, end-to-end risk intelligence platform that helps ecommerce merchants manage fraud, policy abuse, and customer experience across the entire commerce lifecycle. By combining identity signals with behavioral intelligence, Wyllo enables merchants to better understand shopper intent and make smarter decisions across checkout, returns, refunds, and customer support. Wyllo works with leading ecommerce brands and integrates directly into the platforms where merchants manage orders and customer interactions. Learn more at www.wyllo.ai
About the Role
We are seeking a Senior Quality Engineer responsible for ensuring the quality, stability, and production readiness of software delivered across engineering teams. This role focuses on test strategy, automation engineering, release validation, and quality governance across complex distributed systems.
The role requires strong technical depth, ownership mindset, and the ability to operate across engineering, product, and DevOps functions in a fast-paced Agile environment.
The Senior Quality Engineer is responsible for ensuring every engineering change is production-ready, reliable, and aligned with system-level quality expectations. This role owns the end-to-end quality lifecycle across development, enhancements, and releases, ensuring software is validated not only against requirements but also for real-world reliability and edge-case behavior.
This includes driving a risk-based, automation-first quality approach across test strategy, design, execution, and continuous validation through CI/CD pipelines. The role is accountable for building and evolving scalable automation systems, improving release confidence, and ensuring quality signals are accurate and trusted by engineering and product teams.
It also involves ownership of automation architecture, defect prevention, release readiness, and CI/CD-integrated validation, while collaborating cross-functionally to improve system testability and embed quality early in the development lifecycle. Additionally, the role contributes to QE maturity by mentoring engineers and adopting modern practices such as AI-assisted testing and intelligent automation.
You will
- Prepare and own QA artifacts including test strategy, test plans, test cases, and release sign-off documentation
- Define and execute end-to-end test planning, QA strategy, and quality governance across multiple systems
- Design and maintain scalable automation frameworks for UI, API, and system-level testing
- UI automation using Playwright with a focus on reliability and maintainability
- Build and maintain API and backend automation testing systems across distributed services and integrations
- Integrate automated tests into CI/CD pipelines (Jenkins-based workflows) for continuous validation
- Perform release testing, regression testing, and production readiness validation for all major deployments
- Work extensively in Amazon Web Services (AWS) environments to validate cloud-based and distributed system behavior
- Identify, document, track, and manage defects across the full lifecycle using Jira
- Perform deep root cause analysis for production and pre-production issues
- Improve test coverage, automation efficiency, and system reliability over time
- Ensure internal QA documentation is accurate, updated, and aligned with system changes
- Participate in Agile ceremonies including sprint planning, refinement, and release discussions
- Collaborate closely with engineering, product, DevOps, and support teams to ensure quality alignment
- Use AI tools and AI-assisted workflows to improve test design, automation development, debugging, and regression optimization
- Apply an AI-first mindset to improve QE efficiency and reduce manual effort through smart automation practices
- Mentor and guide QE engineers and contribute to improving overall QA maturity across teams
- 5+ years of experience in software quality assurance, QA automation, or SDET roles
- Strong hands-on experience designing and executing test strategy, test plans, and structured test cases
- Proven experience building automation frameworks from scratch (UI + API + system level)
- Strong expertise in UI automation using Playwright
- Experience with API testing, backend validation, and distributed system testing
- Strong experience with CI/CD pipelines (Jenkins or equivalent tools)
- Experience working in Amazon Web Services (AWS) environments
- Strong working knowledge of Jira and defect lifecycle management systems
- Experience working in Agile/Scrum development environments
- Strong analytical, debugging, and problem-solving skills with attention to detail
- Ability to communicate technical concepts clearly across engineering and non-technical stakeholders
- Strong ownership mindset and ability to operate independently in ambiguous environments
- Experience using or integrating AI tools into engineering or QA workflows (preferred)
- Ability to prioritize and execute testing activities in fast-paced release cycles
- Strong understanding of software QA methodologies, tools, and processes
- Experience with regression testing, release validation, and production support activities
- Ability to identify system-level improvements and prevent recurring defects
- Strong collaboration and relationship-building skills across cross-functional teams
- Ability to operate under high-pressure release environments with clarity and precision
- Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience)
- 5+ years of experience in QA / QE / test automation roles
- Demonstrated track record of improving software quality through automation and process improvements
- Strong ownership of outcomes, not just tasks
- Systems thinking over test-case thinking
- Prevention-first mindset over defect detection
- High critical thinking and structured problem-solving ability
- Ability to work independently and drive clarity in ambiguous situations
- Smart work through automation and AI-driven engineering practices
We’re a high-performing team that is passionate about fraud and a community driven by values that shape everything we do. We seek passionate and dedicated individuals who align with our core principles; Integrity, Pride, Humility and Impact.
- Integrity: We do the right thing, even when it’s tough, and even if no one sees it. We always consider the customer’s best interest in every decision we make.
- Pride: We know that the work we do is important, and we take great pride in doing it well. We show up every day with the best intentions, ready to deliver superb outcomes for our team, our customers, and ourselves.
- Humility: We leave our egos at the door, approaching problems as a team, with openness and collaboration. We’re willing to be wrong in order to get things right.
- Impact: We are results-oriented, we take ownership, and we hold ourselves accountable to get things done and deliver results.
If you are excited to collaborate in a fast-paced, purpose-driven environment where your contributions truly matter, we’d love to have you join us!
Equal Employment Opportunity
Wyllo LLC provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics, sexual orientation, political affiliation, military veteran status, domestic violence victim status, or any other protected characteristic under applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.
Similar Jobs
Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
The Senior Supplier Quality Engineer resolves supplier quality issues through audits, data analysis, and leading improvement projects while ensuring compliance with standards.
Top Skills:
ApqpAs9100Business ObjectsExcelIso 9001Ms Office SuitePower BIPowerPointPpap
Healthtech • Software
The role involves leading validation and testing activities in regulated environments, collaborating with teams, and improving testing processes.
Top Skills:
Automation FrameworksBug Tracking ToolsSoftware TestingTest Management Systems
Artificial Intelligence • Information Technology • Machine Learning • Software • Cybersecurity
The Senior Quality Engineer will lead risk-based testing for roaming client software across multiple OS platforms, ensuring robust security and effective issue resolution.
Top Skills:
DnsIpmacOSPowershellPythonShellTcpUdpVpnWindows
What you need to know about the Montreal Tech Scene
With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.
Key Facts About Montreal Tech
- Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
- Major Tech Employers: SAP, Google, Microsoft, Cisco
- Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
- Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
- Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
- Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal
