Design realistic, specialty-specific clinical case scenarios and gold-standard attending-level responses, evaluate and grade AI-generated outputs using structured rubrics, provide detailed written feedback to improve model clinical reasoning, and participate in onboarding, calibration, and review sessions in a fully remote, asynchronous contractor role (~20 hours/week).
This role is for one of our clients
Compensation: $130-$300 per hour
We are partnering with a leading AI research lab to develop high-quality healthcare reasoning data for training next-generation AI models. As a Clinical AI Specialist, you will contribute your medical expertise to design realistic clinical scenarios, evaluate AI-generated outputs, and help improve how advanced models reason about patient care in real-world settings.
Requirements
What You’ll Do
- Design clinically accurate and realistic case scenarios based on your specialty, including diagnostic reasoning, treatment planning, risk stratification, and guideline-based care
- Develop “gold standard” responses at an attending-physician level to guide AI model learning
- Evaluate and grade AI-generated outputs using structured rubrics and evidence-based medical standards
- Provide detailed written feedback to enhance model accuracy, safety, and clinical reasoning
- Participate in onboarding sessions, office hours, and specialty-specific calibration discussions
Who You Are
- Attending Physicians: Board-certified with a current, active, and unrestricted medical license
- Resident Physicians: Final year of residency (recent graduates must be board-eligible)
- Fellows: Board-certified/board-eligible in primary specialty with an active, unrestricted license
- Strong understanding of evidence-based medicine and clinical guidelines within your specialty
- Excellent analytical and written communication skills
Engagement Details
- Fully remote, asynchronous work environment
- Standard commitment of ~20 hours per week (with potential to increase based on performance and demand)
- Flexible schedule—work at your convenience
- Ongoing engagement with monthly performance reviews
- Start date: Rolling, following onboarding completion
Compensation
- Rates vary by specialty and experience level
- Final compensation details will be shared during the offer stage
- Payments are processed weekly via supported global payment platforms
Additional Information
- Engagement is on an independent contractor basis
- Work must not involve sharing confidential or proprietary information from any affiliated organization
- Projects may be extended, modified, or concluded based on business needs and individual performance
- At this time, visa sponsorship is not available for certain work authorization categories
Onboarding Process
Upon acceptance, you will receive onboarding materials along with an invitation to attend orientation and office hours sessions before beginning your first assignment.
Similar Jobs
Information Technology • Consulting
Own clinical quality for member-facing AI products by partnering with product, engineering, and clinical teams. Design clinical AI evaluations, define quality thresholds and rubrics, assess accuracy, omissions, hallucinations, medication-safety risks, and translate clinical reasoning into prompts and decision logic. Monitor evolving evidence and standards of care, validate product launches, and communicate findings to technical and clinical audiences.
Top Skills:
Clinical AiContext EngineeringLlmsMachine LearningPrompt Engineering
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Coordinates cross-functional product go-to-market programs from planning through launch, adoption, and optimization. Builds project plans, operating mechanisms, documentation, feedback loops, status reporting, and decision processes. Partners with Product, Sales, Marketing, Enablement, Analytics, Finance, and leadership to align stakeholders, track dependencies, surface insights, improve workflows, and support product readiness and commercial execution.
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Build and operate highly reliable card-issuing software and tooling across authorization, clearing, settlement, certification, and network integrations. Serve as a technical expert on card-network specifications, protocols, mandates, and production behavior. Lead complex cross-team engineering work, debug protocol-level issues, influence network requirements, mentor engineers, improve platform reliability, and participate in on-call support for critical financial systems.
Top Skills:
Ai-Assisted Engineering ToolsAmerican ExpressCard NetworksIso 8583MastercardVisa
What you need to know about the Montreal Tech Scene
With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.
Key Facts About Montreal Tech
- Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
- Major Tech Employers: SAP, Google, Microsoft, Cisco
- Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
- Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
- Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
- Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal

