Vena Solutions Logo

Vena Solutions

Senior Software Developer in Test (AI Portfolio)

Posted 2 Hours Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in Toronto, Ontario
Senior level
In-Office or Remote
Hiring Remotely in Toronto, Ontario
Senior level
Develop and maintain automated UI and API testing for Vena’s agentic AI products. Define functional, integration, performance, exploratory, and regression strategies; validate AI model accuracy, consistency, bias, boundaries, and performance; enhance scalable test frameworks and CI/CD pipelines; troubleshoot automation issues; perform root cause analysis; and collaborate with engineering and product teams to improve quality, reliability, and test coverage.
The summary above was generated by AI
As a Senior Software Developer in Test, you will be responsible for the development, execution, and maintenance of automated tests to support the Software Test Life Cycle for Vena’s agentic AI solutions. You will collaborate closely with development and product teams to define and execute functional, integration, and regression testing strategies, while continuously improving the scalability, stability, and reliability of testing processes.
You will play a key role in defining and implementing testing approaches for AI-powered products, validating model accuracy, output consistency, performance, edge cases, and overall product quality. Additionally, you will leverage Generative AI and modern AI tools to enhance test automation, streamline test case development, and improve testing efficiency and coverage.


How You'll Make an Impact
  • Analyze functional and technical requirements to define comprehensive test strategies and automation needs
  • Design, write, maintain, and manage automated UI and API test suites
  • Contribute to building and enhancing scalable automation frameworks (e.g., Playwright, Rest-Assured)
  •  Identify, plan, and execute exploratory, functional, integration, performance, and regression tests
  • Collaborate with development and product teams to validate testing requirements and optimize test coverage
  • Champion best practices for automation, test data management, CI/CD integration, and code quality
  • Monitor, troubleshoot, and optimize automation pipelines and test frameworks for dependability, scalability, and stability
  • Perform root cause analysis and support teams in identifying and preventing defects



We'd Love to See
  • 5+ years’ experience in QA/QE and test automation development roles, within a fast-paced Agile environment
  • AI Testing Expertise: Proven track record testing AI/ML products (including prompt evaluation, bias detection, or model boundary testing) 
  • Hands-on experience integrating AI tools or LLM APIs into CI/CD pipelines to accelerate test execution and automatically detect flaky tests.
  • Strong understanding of software testing methodologies, automation design patterns, and the fundamentals of high-quality test case development
  • 3+ years of hands-on experience with at least one automation framework for both UI and API test automation (Playwright, Cypress, Selenium, RestAssured, RestSharp, Pytest, etc.)
  • Hands-on experience with version control, issue tracking, and test case management tools (GitHub, Gitlab, JIRA, Xray, Zephyr, Qase, etc.)
  • Proficiency with relational databases and data validation (SQL, MS SQL, Oracle, GraphQL, or DB2)
  • Proficiency in one or more programming languages (Java, JavaScript, Typescript, C#, or Python)
  • Ability to think critically about system architecture and assess the impact of product changes across components
  • Strong troubleshooting, analytical, and problem-solving skills
  • Exceptional written and verbal communication skills, with the ability to articulate both technical and non-technical concepts
  • Interest in AI and willingness to explore AI-driven solutions to enhance performance and drive efficiencies
The base salary range for this role is $114,750-155,250 CAD.
*Our salaries are tailored to roles, levels and locations. Your individual pay within this range is influenced by factors like work location, skills, experience and education. As you progress in your role, your compensation may adapt, offering flexibility for growth beyond initial levels. For specifics, your recruiter will provide details and address any questions during the hiring process.

About
At Vena, we’re reimagining how businesses plan and grow: powered by data, collaboration, and innovation 🌱 Headquartered in Toronto with a global reach, we help finance teams work smarter using the tools they already love (yes, we’re talking about Excel!). Trusted by over 1,800 organizations and 150,000+ users every day, Vena Solutions brings clarity to complexity. We're a people led company that leads with our CORE values (Customer Trust, One Team, Respect & Authenticity and Execution Excellence) and are driven by our mission We’re growing fast, thinking big, and having fun along the way. The future of finance is being built here, and we’d love for you to be part of it 🚀Why Choose Us:💰 CompensationWe offer competitive and comprehensive total rewards packages that we review yearly to stay ahead of the market! Transparency is key, we keep you in the loop on how we design our comp programs. Build your future with our Employee Stock Option Program, Retirement Savings, Support & 401k Matching Programs.🎓 Personal Growth & LearningLevel up your skills with Vena!  We support your journey with education subsidies, professional development programs, and learning opportunities to help you grow your career and reach your goals. Your future is bright and we’re here to invest in it!🧘‍♀️ Health & WellnessYour well-being = our priority!  Great health & dental plans, wellness sessions (virtual & in-person), Employee Assistance Program (EAP), and a free Headspace subscription to support your mental health.🌍 Global ReachVena is everywhere you are!  With offices in Toronto, London, and Indore, as well as team members across the United States, EMEA and beyond, we're a truly global company. Collaborate with colleagues around the world and bring diverse ideas to life: no passport required!🌴 Time OffRecharge with generous leave options - perfect for vacation, wellness, personal time, parental support, volunteering, and more.🏡 FlexibilityWe embrace a flexible culture that supports different ways of working, depending on the role and location. While some of our teams enjoy hybrid arrangements, others thrive in-office or remotely. With modern workspaces in Toronto, Indore, and London, we offer inspiring environments when you need them - and the freedom to work in ways that work best for you and your team.✨ AI-Powered InnovationAt Vena, we don’t just keep up, we're leading the way! 🚀We empower team members at every level to actively explore AI best practices, identify meaningful opportunities to apply AI in their work, and champion innovative solutions that drive impact.By fostering a culture of curiosity, innovation, and responsible use, we’re building a future where AI enhances how we work, think, and lead. From automating workflows to enhancing insights, AI is woven into everything we do.While every hiring decision is made by people, we may use AI to support application review.👉 Check us out:▶️YouTube💼 LinkedIn🔗GlassDoor* Vacancy Disclosure: Unless otherwise stated, all job postings on our careers site are for existing vacancies. Where explicitly stated, certain postings may be for anticipated vacancies that we expect to open in the near future.

Similar Jobs

6 Minutes Ago
Remote or Hybrid
CA
Expert/Leader
Expert/Leader
Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Lead Block’s global Workforce Optimization function across customer-facing and regulated operations. Establish strategy for forecasting, capacity planning, staffing, real-time management, analytics, automation, and vendor governance. Build predictive workforce systems, align operational and financial plans, manage risk and compliance capacity, oversee incidents and escalations, and develop a multidisciplinary global team supporting employees, outsourced partners, and AI systems.
Top Skills: AIAssembledAutomation ToolsGoogle WorkspaceMachine LearningSnowflakeSQL
An Hour Ago
Easy Apply
Remote
Canada
Easy Apply
Senior level
Senior level
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Build and maintain GTM data pipelines, marts, semantic models, and dashboards supporting headcount planning, quota attainment, pipeline, and sales effectiveness. Partner with GTM analysts and stakeholders to establish trusted metrics, document data systems, enable self-service analytics, and develop AI-powered natural-language data tools. Translate complex data concepts for executives and engineers while advancing the GTM data roadmap.
Top Skills: Ai Data ToolingBigQueryDbtGitHexSalesforceSemantic ModelsSnowflakeSQL
2 Hours Ago
Remote or Hybrid
Canada
Senior level
Senior level
Big Data • Information Technology • Productivity • Software • Analytics • Business Intelligence • Consulting
Lead AI- and data-driven business transformation for North American enterprise customers. Own value realization from discovery through ROI across finance, supply chain, order-to-cash, procure-to-pay, inventory, and related processes. Manage complex transformation programs, executive stakeholders, governance, change management, and strategic roadmaps while using Celonis and AI tools to accelerate technical outputs, automate project management, and drive platform adoption.
Top Skills: Ai CopilotsCelonis Context ModelCelonis PlatformOracleProcess MiningSalesforceSAPWorkday

What you need to know about the Montreal Tech Scene

With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.

Key Facts About Montreal Tech

  • Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
  • Major Tech Employers: SAP, Google, Microsoft, Cisco
  • Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
  • Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
  • Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
  • Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account