Medeloop Logo

Medeloop

Senior Software Development Engineer in Test

Posted 5 Days Ago
Be an Early Applicant
In-Office
Montréal, QC, CAN
Senior level
In-Office
Montréal, QC, CAN
Senior level
The Senior SDET will build and own the quality infrastructure for AI systems, enhancing testing processes and frameworks, ensuring reliability, and integrating automated tests into CI/CD pipelines.
The summary above was generated by AI

We're looking for a Senior SDET who thinks deeply about quality in systems that are inherently non-deterministic. Agentic AI doesn't fail the same way traditional software does — and testing it requires a new toolkit: eval frameworks, prompt regression, tool-call reliability, adversarial scenarios, and more.

You'll own the entire quality infrastructure across our product portfolio — from test data and CI pipelines to the standards and culture of how we ship. You'll work directly with product, devops, and AI engineering, with no layers between your decisions and their impact.

What You'll Own
  • Test infrastructure, test data, test processes across the entire product portfolio while working with Devops and Infrastructure engineers
  • Test Framework - build and enhance automated testing frameworks and tools that facilitate automated testing across different layers of application.
  • The reliability bar for all Web applications, Mobile applications and AI agent outputs — from hallucination detection to latency regressions and tool-call correctness
  • Test infrastructure, test data, and test processes across the entire product portfolio, alongside DevOps and Infrastructure engineers
  • Automated testing frameworks that span all layers of the application — unit, integration, contract, and end-to-end
  • Evaluation frameworks designed for LLM-based systems: non-deterministic output scoring, prompt regression, and adversarial test suites
  • HIPAA-aware test data management — de-identification pipelines, synthetic data generation, and audit trail validation
  • Integration of automated tests into CI/CD pipelines for continuous delivery confidence
  • Build stability monitoring and release gate enforcement before any deployment
  • Documentation of test plans, test results, and evaluation standards to support knowledge sharing
  • The "safety net" for product quality — you define what done looks like
What We're Looking For
  • 8+ years of hands-on SDET experience, with recent work building or testing agentic AI systems (single- or multi-agent) in production
  • Experience in healthcare or life sciences — you understand what's at stake when a system fails in this domain
  • A true tester's mindset: you seek out edge cases, adversarial inputs, and failure modes others overlook
  • Proficiency across the full test pyramid — unit, integration, system, performance, and exploratory — plus familiarity with LLM-specific evaluation approaches
  • Strong debugging skills across multi-tier web and mobile architectures; comfortable jumping into production incidents
  • Proficiency with testing frameworks such as Jest, React Testing Library, Supertest, and pytest.
  • Hands-on experience with testing tools like Cypress, Playwright, Supertest, and pytest (including requests or Selenium-based testing)
  • Experience testing RESTful APIs using tools like Postman or Supertest
  • Solid command of JavaScript and Python
Bonus Points
  • Multi-cloud experience (AWS, Azure, GCP)
  • Experience with red-teaming or adversarial testing of AI systems
  • Native mobile testing experience (iOS, Android)
  • Prior work with 21 CFR Part 11, GxP, or similar regulated-software validation frameworks
Why Medeloop
  • Ownership from day one: small team, high-trust, no layers between your work and its impact
  • Technically ambitious: you'll build AI-powered workflows, not just support them
  • Real-world stakes: your work accelerates drug development, addresses health equity, and improves clinical research for institutions that matter

Strong foundation: Series A, top-tier investors, and a data asset (200M+ patient records) that most companies spend years trying to build

Top Skills

Cypress
JavaScript
Jest
Playwright
Postman
Pytest
Python
React Testing Library
Supertest

Medeloop Montréal, Québec, CAN Office

Montréal, Quebec, Canada

Similar Jobs

Yesterday
In-Office or Remote
Canada
Mid level
Mid level
Sports
Responsible for ensuring quality through testing and automation in web and mobile platforms, involving all stages from development to launch.
Top Skills: Android StudioAppiumAWSDockerJavaJenkinsKubernetesMs SqlMySQLPostmanPythonSeleniumVue
An Hour Ago
Remote or Hybrid
CA
Senior level
Senior level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Manage global import compliance, customs clearance, and strategic sourcing initiatives across Block's hardware portfolio, ensuring compliance and operational excellence.
Top Skills: DescartesGlobal Trade Management SystemsOracleSAP
9 Hours Ago
Easy Apply
Remote or Hybrid
Canada
Easy Apply
Senior level
Senior level
Marketing Tech • Real Estate • Software • PropTech • SEO
As a Staff Software Engineer, you'll develop and improve the AI platform for real estate, working on APIs, services, and collaborations to enhance user experiences.
Top Skills: AWSDynamoDBElasticsearchJavaScriptKafkaKubernetesLambdaNode.jsPostgresReactSqsTypescript

What you need to know about the Montreal Tech Scene

With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.

Key Facts About Montreal Tech

  • Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
  • Major Tech Employers: SAP, Google, Microsoft, Cisco
  • Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
  • Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
  • Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
  • Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account