Train and operate machine learning models on Amazon SageMaker using AWS Trainium. Develop and optimize PyTorch training code for NeuronCore hardware, diagnose device and compiler issues, tune distributed workloads for throughput and cost, and deliver production training pipelines while collaborating directly with client and engineering teams.
Robots & Pencils is an AWS Partner building production AI systems for enterprise clients who need real engineering, not proofs of concept that never ship. We work forward-deployed, embedded directly with client teams, solving the problems that are too new or too specialized for a typical vendor relationship to handle.
The Role
We're looking for an engineer who can operate and train models on Amazon SageMaker running on AWS Trainium, AWS's custom silicon built specifically for large-scale model training. This isn't a role where you call an API and wait. You'll be walking up the stack: understanding what a training request actually looks like at the Trainium hardware and compiler level, then carrying that understanding all the way up through PyTorch training code and into a production SageMaker pipeline.
PyTorch is the backbone of this work. If you know the framework deeply and you're comfortable reasoning about how your code actually behaves on custom accelerator hardware rather than treating it as a black box, this role is built around that skill set specifically.
What You'll Do
- Train and operate models on Amazon SageMaker with AWS Trainium as the underlying compute
- Write and optimize PyTorch training code with a real understanding of how it compiles and executes on Trainium (NeuronCore architecture, compiler behavior, memory and throughput tradeoffs)
- Diagnose training run issues that show up specifically because of the hardware, not just the model, distinguishing a data or code problem from a compiler or device-level one
- Translate a request for "a Trainium job" into an actual working, cost-aware training pipeline, end to end
- Tune distributed training runs for throughput and cost on SageMaker's training infrastructure
- Work directly with client and internal engineering teams to scope and deliver real production training workloads, not experiments that stay in a notebook
What You'll Bring
- Strong, hands-on PyTorch experience, ideally including distributed or multi-device training
- Production experience with Amazon SageMaker for training and/or inference
- Comfort working close to the hardware layer: you understand device-specific compilation and can debug issues that are actually about the accelerator, not just the model
- AWS Trainium or Inferentia (Neuron SDK) experience is a strong plus; if you don't have it yet but have deep PyTorch and a track record of picking up new hardware targets fast, we want to talk to you
- Solid Python fundamentals and comfort operating in a client-facing, production engineering environment
Similar Jobs
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Lead Samsara’s AI initiatives across the software development lifecycle, including developer agents and SRE AI. Manage five to ten senior engineers, set technical direction without an established roadmap, evaluate build-versus-buy decisions, control AI and infrastructure costs, scale automated incident response, and build trust in actions such as root-cause analysis, severity escalation, and deployment rollbacks. Partner directly with R&D leaders and developers while hiring, mentoring, and developing an inclusive, high-performing team.
Top Skills:
Ai AgentsClaudeCloud InfrastructureCodexIotModel Context Protocol (Mcp)Sre Automation
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Build agentic AI products that enable customers to create custom detections and workflows. Own solutions from customer discovery through design, implementation, deployment, monitoring, and ongoing improvement. Develop backend services, APIs, and customer-facing experiences while partnering with platform, machine learning, product, and design teams. Improve AI detection quality, reliability, performance, and cost, shape technical direction, and mentor engineers.
Top Skills:
Ai Coding AgentsAPIsCloud ComputingComputer VisionEdge ComputingIotLarge Language Models
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Leads front-end engineering and design of biscuit manufacturing lines, including layouts, mass balancing, utility requirements, technology selection, CAPEX estimation, and capital approvals. Manages equipment vendors and engineering partners, governs technical adherence during installation and commissioning, and collaborates with R&D, operations, quality, finance, and procurement. Supports Lean Six Sigma, innovation, manufacturing standards, energy efficiency, and large-scale capital projects across regional facilities.
Top Skills:
AutocadBiscuit Manufacturing TechnologyCapex EstimationFood Processing EquipmentLean Six SigmaManufacturing Line DesignMass BalancingMicrosoft Project
What you need to know about the Montreal Tech Scene
With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.
Key Facts About Montreal Tech
- Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
- Major Tech Employers: SAP, Google, Microsoft, Cisco
- Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
- Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
- Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
- Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal
