Build and operate reliability and observability capabilities for an internal AWS Bedrock AgentCore platform. Responsibilities include OpenTelemetry instrumentation, CloudWatch and enterprise observability integrations, distributed tracing, SLOs, alerting, token and compute cost monitoring, dashboards, runbooks, incident response, and post-incident improvements. The role requires strong AWS, SRE, observability, FinOps, scripting, and coding experience, with preferred exposure to LLM monitoring, infrastructure as code, and regulated industries.
About us
Appnovation is the AI Product Company. Headquartered in Vancouver, Canada, with teams around the world, Appnovation builds AI products, delivers enterprise AI and digital solutions, and co-invests with clients to bring new AI products to market.
Open source has been the foundation of Appnovation's work since 2007, and it remains the foundation underneath every AI product the company builds today. Appnovation teams work with organizations in highly regulated industries, including global leaders such as Pfizer, Google and AstraZeneca, to help them adopt AI they can govern and own.
We’re putting together a dedicated delivery pod to build and run an internal agent platform on AWS Bedrock AgentCore for a global life sciences client. The pod works as one team with the client’s engineers to deliver the platform other teams will build their agents on.
In this role you make the platform visible and dependable. You’ll build the OpenTelemetry instrumentation, observability integrations, tracing, SLOs, alerting, and cost monitoring for token and compute spend. When an agent is slow, wrong or expensive, your work is how the team finds out and fixes it. This is a named-team engagement, so the person we propose is the person who starts.
ROLE RESPONSIBILITIES- Instrumentation: Build OpenTelemetry instrumentation standards for agents, tools and platform services, and make it easy for teams to adopt.
- Observability Integration: Connect AgentCore Observability and CloudWatch with the client’s existing observability tools (e.g., Datadog, Splunk, Grafana).
- Tracing: Set up end-to-end tracing across agent steps, model calls, tool calls and multi-agent handoffs so issues can be traced to their source.
- SLOs and Alerting: Define SLOs for latency, availability and error rates, and build alerting that is useful and not noisy.
- Cost Monitoring: Track token usage and compute spend by team, agent and environment, with dashboards, budgets and alerts for unexpected spikes.
- Incident Readiness: Write runbooks, support incident response and run post-incident reviews that lead to real fixes.
- 6+ years in SRE, platform reliability or observability engineering, with strong hands-on AWS experience.
- Hands-on experience with OpenTelemetry (SDKs, collectors, exporters) and distributed tracing.
- Experience with Amazon CloudWatch and at least one enterprise observability platform (Datadog, Splunk, Grafana, New Relic or similar).
- Experience defining and running SLOs, error budgets and alerting strategies.
- Experience building cost visibility and FinOps reporting on AWS (Cost Explorer, CUR, tagging strategies).
- Scripting and coding skills in Python, Go or TypeScript.
- Clear communication and able to turn data into decisions for technical and non-technical audiences.
- Experience monitoring LLM or agent-based applications, including token usage, latency and quality signals.
- Familiarity with LLM observability tools (e.g., Langfuse, Arize, LangSmith) or AgentCore Observability.
- Experience with infrastructure as code (Terraform or AWS CDK) for monitoring resources.
- Experience in pharma, life sciences or another regulated industry.
- You want to know what’s happening in a system before a user tells you
- You build alerts people trust and dashboards people actually open
- You treat cost as a reliability concern, not an afterthought
- You stay calm in incidents and focus on learning afterward
- You work well inside a client team and build trust quickly
- You have prior experience in consulting
- Prior experience and connections in the Life Sciences industry is preferred
Thank you for your interest in a career with Appnovation Technologies! Please note that only those selected for an interview will be contacted.
At Appnovation, we recognize that diverse teams are the strongest teams. Diversity, Equity & Inclusion is not only something that we embrace - we celebrate it! We are proud to be an Equal Opportunity Employer and we encourage applicants from all backgrounds, lived experiences and industries to apply. Come join us at Appnovation, and learn more about how we stay true to our company values as we build better lives through better digital.
Accommodations are available upon request throughout the recruitment process.
Accommodations are available upon request throughout the recruitment process.
Similar Jobs
Aerospace • Hardware • Software • Defense • Manufacturing
Build scalable automated solutions for device fleet management, own and optimize MDM platforms, write OS-level scripts for self-healing, gather telemetry to prevent end-user disruption, translate compliance (CMMC) into code-managed baselines, and create dashboards and alerts measuring end-user SLOs.
Top Skills:
AnsibleBashChefFleet DmIntuneJAMFOsqueryPowershellPulumiPuppetPythonSaltTerraformWorkspace One
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Partners with GTM and Sales leaders to align talent strategies with business outcomes. Diagnoses organizational and people challenges, delivers talent management and compensation programs, supports retention, collaborates with People teams, reinforces company culture, and uses data and AI tools to inform decisions. Requires strong consulting, coaching, communication, analytical, and project execution skills. Travel is required approximately once per quarter.
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Own bookings growth across new and existing enterprise accounts in Northern California. Develop territory and account strategies, generate pipeline, prospect, qualify, manage, and close complex sales opportunities. Acquire net-new customers, expand existing accounts, exceed quotas, and collaborate with sales engineers, development teams, distributors, VARs, and channel partners. Present solutions in complex data center environments and provide market feedback to leadership.
Top Skills:
Data Center TechnologiesIt InfrastructureSaas Security
What you need to know about the Montreal Tech Scene
With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.
Key Facts About Montreal Tech
- Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
- Major Tech Employers: SAP, Google, Microsoft, Cisco
- Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
- Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
- Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
- Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal
