Software Engineer, AI — Code Evaluation & Training (Remote)
Help train large-language models (LLMs) to write production-grade code across a wide range of programming languages:
Compare & rank multiple code snippets, explaining which is best and why.
Repair & refactor AI-generated code for correctness, efficiency, and style.
Inject feedback (ratings, edits, test results) into the RLHF pipeline and keep it running smoothly.
End result: the model learns to propose, critique, and improve code the way you do.
RLHF in one line
Generate code ➜ expert engineers rank, edit, and justify ➜ convert that feedback into reward signals ➜ reinforcement learning tunes the model toward code you’d actually ship.
4+ years of professional software engineering experience in one or more of the following:
Python, Java, JavaScript, TypeScript, Go, C++, PHP, COBOL, C, Ruby, or Rust.
(Constraint programming experience is a bonus but not required for all languages.)Strong code-review instincts—you can spot logic errors, performance traps, and security issues quickly.
Extreme attention to detail and excellent written communication skills.
Much of this role involves explaining why one approach is better than another. This cannot be overstated.You enjoy reading documentation and language specs and thrive in an asynchronous, low-oversight environment.
No prior RLHF (Reinforcement Learning with Human Feedback) or AI training experience.
No deep machine learning knowledge. If you can review and critique code clearly, we’ll teach you the rest.
We are looking for engineers with strong command of at least one of the following languages:
Python, Java, JavaScript, TypeScript, Go, C++, PHP, COBOL, C, Ruby, or Rust.
Location: Fully remote — work from anywhere
Compensation: Up to $30/hr
Hours: Minimum 15 hrs/week, up to 40 hrs/week available
Engagement: 1099 contract
Straightforward impact, zero fluff. If this sounds like a fit, [apply here].
Top Skills
Similar Jobs
What you need to know about the Montreal Tech Scene
Key Facts About Montreal Tech
- Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
- Major Tech Employers: SAP, Google, Microsoft, Cisco
- Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
- Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
- Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
- Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal