About the company
Our client is a software company.
The role
Raydar is recruiting for this role on behalf of our client. Own the path that takes trained machine learning models into reliable production serving, with a focus on speed, efficiency and dependability at high request volume. The work combines performance tuning of models and GPU-based code with the design of distributed serving systems that run across many machines.
What you'll do
- Optimize serving latency and throughput for machine learning models.
- Take models from research through containerization and into stable production deployment.
- Profile and tune code to make efficient use of GPU hardware.
- Design and run distributed serving systems across multiple GPUs and nodes.
- Apply model acceleration methods such as quantization, batching and caching.
Requirements
What we're looking for
- Senior-level experience, comparable to a senior software or inference engineer at a large technology company.
- Track record of developing server-side or learning-based software and getting it running live for real users.
- Hands-on experience with machine learning inference optimization frameworks.
- Proficiency in systems programming and GPU optimization in languages such as C++, CUDA, Rust or optimized Python.
- Familiarity with methods that speed up and shrink models, such as weight compression, knowledge transfer between models or token prediction.
- Experience with distributed systems, container orchestration and handling high concurrency.
- Based in an eligible country for this remote role.
Bonus points
- Public technical work, such as open-source contributions to inference engines or detailed technical write-ups.
- A history of internal progression and promotions within one employer.
- A doctorate in a quantitative field, or equivalent hands-on systems experience, with study at a leading university as a further advantage.
Benefits
Compensation and benefits
- Base salary: $250K to $300K
- Equity
- Annual performance bonus
- Health, dental and vision coverage
- Flexible time off
- 401(k) retirement plan
- Health savings account
Location and work model
- Remote (Canada or UK)
- Full-time
Similar Jobs
What you need to know about the Montreal Tech Scene
Key Facts About Montreal Tech
- Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
- Major Tech Employers: SAP, Google, Microsoft, Cisco
- Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
- Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
- Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
- Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal
