LexisNexis Logo

LexisNexis

Sr Data Scientist II

Posted 4 Days Ago
Be an Early Applicant
In-Office
Toronto, ON
Senior level
In-Office
Toronto, ON
Senior level
Lead the design, refactoring, testing, deployment, and operational support of production-grade generative AI applications. Build agentic systems using retrieval, embeddings, reranking, LLMs, and advanced search. Improve reliability through resilient architecture, observability, validation, testing, monitoring, and incident response while optimizing latency, scalability, token usage, cost, and retrieval quality.
The summary above was generated by AI

Are you excited about shaping the next generation of AI-powered legal technology through generative AI, retrieval systems, and production-grade machine learning?

Do you enjoy building reliable, scalable applications that transform complex AI capabilities into impactful customer solutions?

About our Team

LexisNexis Legal & Professional, which serves customers in more than 150 countries with 11,800 employees worldwide, is part of RELX (http://www.relx.com), a global provider of information-based analytics and decision tools for professional and business customers. Our company has been a long-time leader in deploying AI and advanced technologies to the legal market to improve productivity and transform the overall business and practice of law, deploying ethical and powerful generative AI solutions with a flexible, multi-model approach that prioritizes using the best model from today’s top model creators for each individual legal use case. The company employs over 2,000 technologists, data scientists, and experts to develop, test, and validate solutions in line with RELX Responsible AI Principles (https://stories.relx.com/responsible-ai-principles/index.html).

About the Role

We are looking for a Senior Data Scientist II with deep expertise in Generative AI, Retrieval-Augmented Generation (RAG), and agentic AI systems, combined with strong software-engineering fundamentals and demonstrated ownership of production applications. This role will focus on improving LLM-powered drafting and retrieval solutions through advanced search, embeddings, reranking, evaluation, and production-grade ML components.

The successful candidate must be able to independently design, refactor, test, review, deploy, and support clean, reliable Python applications. This includes separating agent responsibilities, designing for failure, applying sound algorithmic reasoning, and establishing appropriate logging, monitoring, testing, and operational controls.

The ideal candidate has advanced Python proficiency, experience with OpenSearch or Solr, success working in monorepo environments, and a strong record of cross-functional delivery.

Key Responsibilities

  • Architect modular agentic applications with clear separation among retrieval, prompt construction, model invocation, tool execution, state and history management, orchestration, validation, and response formatting.

  • Independently refactor complex or legacy Python code to improve correctness, readability, modularity, extensibility, testability, and runtime performance.

  • Own production readiness for AI components, including input validation, exception handling, timeout management, retries with backoff, fallback behavior, configuration management, and secure handling of credentials.

  • Establish observability for LLM and retrieval workflows through structured logging, metrics, distributed tracing, alerting, and actionable error reporting.

  • Design clear interfaces and data contracts between retrieval, orchestration, model, and downstream application components.

  • Write comprehensive unit, integration, regression, and end-to-end tests, including tests for failure modes, malformed model responses, empty retrieval results, and unavailable dependencies.

  • Review Python and agentic application code, identify architectural and operational risks, and provide actionable feedback aligned with production engineering standards.

  • Diagnose and optimize latency, memory usage, retrieval performance, token consumption, model cost, and application scalability.

  • Apply appropriate data structures, algorithms, and computational-complexity analysis when designing and optimizing solutions.

  • Participate in production deployments, incident investigation, root-cause analysis, remediation, and continuous reliability improvements.

Required Qualifications

  • Advanced Python proficiency demonstrated through independently designing, implementing, debugging, testing, reviewing, and refactoring production applications.

  • Strong command of Python fundamentals, standard data structures, common algorithms, object-oriented and functional design principles, type annotations, and time and space complexity analysis.

  • Demonstrated ability to transform prototype or experimental code into modular, maintainable, observable, and production-ready systems.

  • Strong understanding of software design principles, including separation of concerns, dependency injection, interface design, configuration management, and effective abstraction.

  • Experience implementing automated unit, integration, regression, and end-to-end testing using tools such as pytest, including appropriate mocking of external services.

  • Experience designing resilient distributed applications that account for timeouts, retries, rate limits, partial failures, malformed responses, idempotency, and graceful degradation.

  • Experience with production observability, including structured logging, metrics, tracing, alerting, and incident troubleshooting.

  • Demonstrated ability to conduct rigorous code reviews and identify correctness, maintainability, performance, security, testing, and operational risks.

  • Experience taking technical ownership of applications across their lifecycle, from design and experimentation through deployment, monitoring, incident response, and ongoing improvement.

  • Strong understanding of production LLM concerns, including structured output validation, context management, model and tool failures, prompt versioning, token and cost controls, security, and evaluation.

Preferred Qualifications

  • Experience with Python quality tooling such as pytest, ruff, mypy, profiling tools, and automated CI quality gates.

  • Experience defining typed schemas and validating LLM inputs and outputs using tools such as Pydantic.

  • Experience building evaluation frameworks for agentic systems, including task-completion, retrieval-quality, groundedness, hallucination, latency, reliability, and cost metrics.

  • Experience implementing model fallbacks, tool-use controls, guardrails, human-in-the-loop workflows, and auditability for AI applications.

  • Experience supporting production services and participating in incident response, root-cause analysis, and post-incident remediation.

The successful candidate will:

  • Demonstrate senior-level Python proficiency and sound computer-science fundamentals.

  • Treat correctness, maintainability, testing, resilience, security, and observability as core design requirements.

  • Recognize architectural issues and improve code beyond simply making it functional.

  • Independently review and refactor complex agentic application code.

  • Make clear engineering tradeoffs involving quality, latency, scalability, reliability, and cost.

  • Take end-to-end ownership from experimentation through production deployment and operational support.

  • Communicate technical decisions and code-review feedback clearly and constructively.

  • Combine strong LLM and retrieval expertise with disciplined software-engineering practices.

Work in a Way That Works for You

We promote a healthy work/life balance across the organisation. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals.

Working Pattern

Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive.

About the Business

LexisNexis Legal & Professional® provides legal, regulatory, and business information and analytics that help customers increase their productivity, improve decision-making, achieve better outcomes, and advance the rule of law around the world. As a digital pioneer, the company was the first to bring legal and business information online with its Lexis® and Nexis® services. #AIFluent

Primary Location Base Pay Range: Canada - Toronto (Yonge St) $108,100 - $158,100 (CAD). This job is eligible for an annual incentive bonus. This posting is not for an immediate existing vacancy but for a future opportunity.

We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location.

We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120.

Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here.

Please read our Candidate Privacy Policy.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.

USA Job Seekers:

EEO Know Your Rights.

Similar Jobs

4 Days Ago
In-Office
Senior level
Senior level
Information Technology • Legal Tech • Analytics
Build and own production-grade generative AI and retrieval systems for legal technology. Responsibilities include architecting agentic applications, developing and refactoring Python services, implementing RAG, embeddings, reranking, testing, observability, resilience, security, and operational controls. The role also involves optimizing latency, cost, scalability, and retrieval quality; conducting code reviews; supporting deployments and incidents; and evaluating LLM and agentic system performance.
Top Skills: AlertingCiDistributed TracingGenerative AiMetricsMypyOpensearchPydanticPytestPythonRetrieval-Augmented Generation (Rag)RuffSolrStructured Logging
One Month Ago
In-Office or Remote
Senior level
Senior level
Information Technology • Legal Tech • Professional Services • Analytics • Business Intelligence
Lead design and validation of AI-driven legal product capabilities: develop NLP/LLM and generative AI solutions (RAG, prompts), design agentic workflows, build retrieval/hybrid search strategies with embeddings and vector DBs, analyze large legal datasets, establish model evaluation best practices, translate results into product recommendations, collaborate with product and engineering, and mentor junior team members.
Top Skills: AutogenEmbeddingsGenerative AiHybrid SearchLangchainLanggraphLlmNlpPrompt EngineeringPythonRagVector Databases
2 Months Ago
In-Office
Mid level
Mid level
Insurance • Financial Services
As a Data Scientist II, you will build and deliver data science solutions, validate models, support teams, and communicate insights to stakeholders.
Top Skills: GitPython

What you need to know about the Montreal Tech Scene

With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.

Key Facts About Montreal Tech

  • Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
  • Major Tech Employers: SAP, Google, Microsoft, Cisco
  • Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
  • Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
  • Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
  • Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account