Design and maintain test frameworks, implement CI/CD enhancements, automate testing, and improve software quality for AI and ML systems.
About Us
We believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.
Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at companies like Amazon, Google, Microsoft Research, Nvidia, Intel, Qualcomm, and IBM. Our co-founder and CEO, Gennady Pekhimenko, is a world-renowned expert in ML systems who holds multiple academic and industry research awards from Google, Amazon, Facebook, and VMware.
About the Position
We are looking for a Software Developer in Test (SDET) to design comprehensive test plans and establish a scalable test automation strategy across all of CentML’s products, ensuring reliability, performance, and efficiency. You will be responsible for designing and building automated testing, CI/CD enhancements, and robust validation frameworks.
This role is ideal for someone passionate about quality, and test automation, who thrives in a fast-paced startup environment.
What you’ll do
- Evaluate our existing quality and performance testing frameworks, identify and document gaps
- Design, build, and maintain test frameworks for backend APIs, and user-facing UIs.
- Develop and automate end-to-end integration tests, performance tests, and stress tests for workloads running on distributed systems.
- Enhance CI/CD pipelines with automated test execution, validation, and reporting.
- Identify, document, and track defects, working with teams to troubleshoot and resolve issues quickly.
- Improve test coverage and reliability while optimizing execution time.
- Conduct exploratory and manual testing when necessary to supplement automation.
What you’ll need to be successful
- 5+ years of experience in software development or test automation, ideally in ML systems, distributed computing, or cloud infrastructure.
- Strong programming skills in Python (preferred), Go, or C++, with experience in test automation frameworks.
- Hands-on experience with PyTest, Playwright, JUnit, or similar frameworks.
- Deep understanding of CI/CD pipelines (GitHub Actions, Jenkins, or GitLab CI) and how to integrate automated tests.
- Experience with containerization (Docker, Kubernetes) and cloud platforms like AWS, GCP, or Azure
- Experience in performance testing, load testing, and profiling distributed systems is a plus.
- Knowledge of ML frameworks (TensorFlow, PyTorch, JAX) and experience testing ML models or infrastructure is a big bonus
- Familiarity with GPU/accelerator testing, scheduling, and monitoring tools is big bonus.
Benefits & Perks
- An open and inclusive work environment
- Employee stock options
- Best-in-class medical and dental benefits
- Parental Leave top-up
- Professional development budget
- Flexible vacation time to promote a healthy work-life blend
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation.
CentML strives to respect the dignity and independence of people with disabilities and is committed to giving them the same opportunity to succeed as all other employees.
Inclusiveness is core to our culture at CentML, and we strive to ensure you get the most from your interview experience. CentML makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to the Talent team.
Top Skills
AWS
Azure
C++
Docker
GCP
Github Actions
Gitlab Ci
Go
Jax
Jenkins
Junit
Kubernetes
Playwright
Pytest
Python
PyTorch
TensorFlow
Similar Jobs
Information Technology • Software
Responsible for developing AI testing frameworks, automation tools, and pipelines to enhance software quality within the R&D team, while collaborating across departments.
Top Skills:
Ai ToolsAngularAzure DevopsC#CypressJavaScriptSelenium
Software
The Senior Software Development Engineer in Test will design and maintain automated testing frameworks, drive test strategies, and mentor junior engineers, all within a remote-first startup environment.
Top Skills:
AWSAzureCi/CdGCPGithub ActionsGoJenkinsKubernetesPython
Healthtech
As a Senior SDET, you'll design and implement automated testing frameworks for healthcare applications, collaborate with teams, and mentor other engineers.
Top Skills:
Api Testing ToolsAzure CloudBrowserstackGitJavaSelenium
What you need to know about the Montreal Tech Scene
With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.
Key Facts About Montreal Tech
- Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
- Major Tech Employers: SAP, Google, Microsoft, Cisco
- Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
- Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
- Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
- Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal
