Seeking a Senior AI/ML Engineer to design and develop AI-native systems using Generative AI and multi-agent frameworks for real-time networking solutions. Responsibilities include modeling agent behaviors, developing LLM-driven agents, building ML models, and collaborating on AI projects.
At Extreme Networks, we create effortless networking experiences that empower people and organizations to advance. As part of our growing AI Competence Center, we are seeking a Senior AI/ML Engineerwith expertise in Generative AI, multi-agent systems, and LLM-based application development.
In this role, you will help build the next generation of AI-native systems that combine traditional machine learning, generative models, and autonomous agents. Your work will power intelligent, real-time decisions for network design, optimization, security, and support.
Key Responsibilities
- Design and implement the business logic and modeling that governs agent behavior, including decision-making workflows, tool usage, and interaction policies.
- Develop and refine LLM-driven agents using prompt engineering, retrieval-augmented generation (RAG), fine-tuning, or function calling.
- Understand and model the domain knowledge behind each agent: engage with network engineers, learn the operational context, and encode this understanding into effective agent behavior.
- Apply traditional ML modeling techniques (classification, regression, clustering, anomaly detection) to enrich agent capabilities.
- Contribute to the data engineering pipeline that feeds agents, including data extraction, transformation, and semantic chunking.
- Build modular, reusable AI components and integrate them with backend APIs, vector stores, and network telemetry pipelines.
- Collaborate with other AI engineers to create multi-agent workflows, including planning, refinement, execution, and escalation steps.
- Translate GenAI prototypes into production-grade, scalable, and testable services in collaboration with platform and engineering teams.
- Work with frontend developers to design agent experiences and contribute to UX interactions with human-in-the-loop feedback.
- Stay up to date on trends in LLM architectures, agent frameworks, evaluation strategies, and GenAI standards.
Qualifications
- Master’s or PhD in Computer Science, Artificial Intelligence, Machine Learning, or a related field.
- 5+ years of experience in ML/AI engineering, including 2+ years working with transformer models or LLM systems.
- Strong knowledge of ML fundamentals, with hands-on experience building and deploying traditional ML models.
- Solid programming skills in Python, with experience integrating AI modules into cloud-native microservices.
- Experience with LLM frameworks (e.g., LangChain, AutoGen, Semantic Kernel, Haystack), and vector databases (e.g., FAISS, Weaviate, Pinecone).
- Familiarity with prompt engineering techniques for system design, memory management, instruction tuning, and tool-use chaining.
- Strong understanding of RAG architectures, including semantic chunking, metadata design, and hybrid retrieval.
- Hands-on experience with data preprocessing, ETL workflows, and embedding generation.
- Proven ability to work with cloud platforms like AWS or Azure for model deployment, data storage, and orchestration.
- Excellent collaboration and communication skills, including cross-functional work with product managers, network engineers, and backend teams.
Nice to Have
- Experience with LLMOps tools, open-source agent frameworks, or orchestration libraries .
- Familiarity with Docker, Docker Compose, and container-based development environments.
- Background in enterprise networking, SD-WAN, or network observability tools.
- Contributions to open-source AI or GenAI libraries.
Top Skills
AWS
Azure
Docker
Genai Standards
Llm Frameworks
Python
Vector Databases
Similar Jobs
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Provide technical application assistance, troubleshoot application issues, respond to customer requests, and communicate with IT groups while maintaining excellent customer service in a hybrid work environment.
Top Skills:
AWSAzureBashC++CiscoDb2GlobalscapeJavaJbossLinuxLoad BalancersMicrosoft SharepointPostgresPythonSplunkSpring BootSQL ServerSterling File GatewayTcp/IpTomcatTruesightWindows
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
The Corporate and External Communications Advisor will manage communications strategy, media relations, and reputation building for TransUnion in Canada, driving high-impact campaigns and advising executives on sensitive matters.
Top Skills:
Content MarketingDigital CommunicationsNewsroom Cms ToolsSocial Media
Fintech • HR Tech
The Senior Data Engineer will build scalable data systems, optimize data workflows, and collaborate with teams to enhance data-driven decisions.
Top Skills:
BigQueryDatabricksDbtPythonRedshiftSnowflakeSQL
What you need to know about the Montreal Tech Scene
With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.
Key Facts About Montreal Tech
- Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
- Major Tech Employers: SAP, Google, Microsoft, Cisco
- Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
- Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
- Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
- Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal


