MassMutual Logo

MassMutual

AI Platform Engineer

Posted 22 Days Ago
Hybrid
Boston, MA
Junior
Hybrid
Boston, MA
Junior
Design, build, and operate AI platform components (LLM gateway, model serving, developer tooling). Own features from development to production, contribute to reliability, observability, governance, and cross-functional integration while producing technical documentation and participating in design reviews.
The summary above was generated by AI
AI Platform Engineer | AI Platform Engineering
Full-Time Hybrid Onsite (3 days/week in office)
The Opportunity
MassMutual's AI Platform Engineering team is seeking a skilled AI Platform Engineer to contribute to the design, development, and operation of our growing AI platform. You will work on meaningful platform challenges, collaborate closely with senior engineers, and take ownership of platform components that power MassMutual's AI initiatives.
The Team
This is a unique opportunity to work on the team that builds and operates the platform powering MassMutual's AI initiatives. The team operates at the intersection of cloud infrastructure, AI/ML systems, and developer experience-delivering foundational capabilities that shape how the entire organization builds and deploys AI. We partner closely with AI engineering, product, and cloud engineering teams across the enterprise, and we invest in growth through a culture of peer learning, candid feedback, and shared technical standards. This team is defined by a shared commitment to engineering excellence, clear documentation, and a drive to make hard problems tractable.
The Impact
  • Contribute to the design and implementation of platform components-cloud infrastructure, AI serving layers, and developer tooling-with guidance from senior engineers.
  • Take ownership of discrete features or modules within critical platform systems such as the LLM gateway, model serving infrastructure, and enterprise integration patterns. Participate in writing ADRs and technical documentation.
  • Participate in design reviews, contribute constructive feedback on pull requests, and collaborate with teammates on complex engineering challenges.
  • Execute platform initiatives end to end within your scope-breaking down tasks, managing your work, and delivering quality outcomes in production.
  • Support platform reliability efforts: contribute to Service Level Objective definitions, implement observability instrumentation, participate in incident response, and help improve platform stability.
  • Implement governance and compliance controls-data residency, access management, audit logging-in alignment with enterprise requirements and established patterns.
  • Collaborate with AI engineering, product, and cloud engineering teams; communicate technical context and trade-offs clearly in cross-functional settings.
  • Contribute to team documentation habits, code quality, and shared engineering standards.

The Minimum Qualifications
  • 2+ years of experience in platform, infrastructure, or SRE roles, with demonstrated ownership of platform components or services.
  • 2+ years of experience with cloud-native architecture across AWS, GCP, or Azure-containerized deployments, managed services, and basic multi-tenancy patterns.
  • 2+ years of experience delivering platform features from development through production, with the ability to manage ambiguity within a defined scope.
  • 2+ years of experience working with IaC and GitOps tools: Terraform or Pulumi, ArgoCD, and standard deployment patterns.
  • Bachelor's Degree in Computer Science, Technology, Engineering, or Mathematics is required

The Ideal Qualifications
  • Familiarity with Kubernetes (CKA, CKAD, or equivalent AWS certifications a plus); working knowledge of cloud-native concepts including managed services, networking, and identity.
  • Exposure to AI/ML infrastructure: model serving, inference pipelines, or LLM integration patterns.
  • Clear written communication: ability to produce useful technical documentation and explain implementation decisions to teammates.
  • Hands-on experience with LLM serving frameworks-vLLM, Triton, Ray Serve-or familiarity with AI gateway patterns.
  • Exposure to FinOps principles or GPU cost considerations in inference workloads.
  • Experience contributing to internal developer platforms (IDPs) with an appreciation for developer experience.
  • Open-source contributions to platform or ML infrastructure tooling.
  • Ability to influence peers through technical credibility and collaborative problem-solving.
  • Comfort operating in ambiguous environments, with a habit of asking good clarifying questions and building shared understanding.

What to Expect as Part of MassMutual and the Team
  • Regular meetings with the AI Platform Engineering team
  • Focused one-on-one meetings with your manager
  • Networking opportunities including access to Asian, Hispanic/Latinx, African American, women, LGBTQIA+, veteran and disability-focused Business Resource Groups
  • Access to learning content on Degreed and other informational platforms
  • Your ethics and integrity will be valued by a company with a strong and stable ethical business with industry leading pay and benefits

#LI-SC1
MassMutual is an equal employment opportunity employer. We welcome all persons to apply.
If you need an accommodation to complete the application process, please contact us and share the specifics of the assistance you need.
California residents: For detailed information about your rights under the California Consumer Privacy Act (CCPA), please visit our California Consumer Privacy Act Disclosures page.
Salary Range: $134,400-$176,400

Similar Jobs at MassMutual

3 Hours Ago
Hybrid
Senior level
Senior level
Big Data • Fintech • Information Technology • Insurance • Financial Services
Lead design and delivery of MassMutual's AI platform components (LLM gateway, model serving, multi-tenant compute). Own architecture, technical execution, reliability (SLOs/observability), governance controls, and cross-team alignment. Provide technical leadership through design reviews, ADRs, and hands-on pairing.
Top Skills: ArgocdAWSAzureCkaCkadFinopsGCPGitopsGpu Resource ManagementIdentity FederationInference PipelinesKubernetesLlm GatewayModel ServingMulti-TenancyPulumiRay ServeTerraformTritonVllm
3 Hours Ago
Hybrid
Senior level
Senior level
Big Data • Fintech • Information Technology • Insurance • Financial Services
Lead design and delivery of MassMutual's AI platform components (LLM gateway, model serving, multi-tenant compute). Own architecture, technical execution, reliability (SLOs/observability), governance controls, and cross-team alignment. Provide technical leadership through design reviews, ADRs, and hands-on pairing.
Top Skills: ArgocdAWSAzureCkaCkadFinopsGCPGitopsGpu Resource ManagementIdentity FederationInference PipelinesKubernetesLlm GatewayModel ServingMulti-TenancyPulumiRay ServeTerraformTritonVllm
5 Hours Ago
Hybrid
Senior level
Senior level
Big Data • Fintech • Information Technology • Insurance • Financial Services
Senior SOC analyst performing advanced malware analysis, extracting IOCs, building SOAR automations, partnering with data science for AI capabilities, tuning detections and alerting, mentoring junior analysts, and ensuring QA and documentation.
Top Skills: AWSAzureDnsHttp/SMitre Att&CkOauthPowershellPythonSAMLSIEMSoarTask SchedulerTcp/IpThreat Intelligence PlatformWindows RegistryWmic

What you need to know about the Montreal Tech Scene

With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.

Key Facts About Montreal Tech

  • Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
  • Major Tech Employers: SAP, Google, Microsoft, Cisco
  • Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
  • Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
  • Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
  • Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account