Skip to main content
Kelly Services logo

Lead Distributed Systems Engineer (AI/ML Platform) - Watertown, MA

Kelly Services

Watertown, MA · HybridFull-time$200–265K/yrSeen 1w agoIn the employer's feed · checked in the last 2 days

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
$200–265K/yr
Location
Watertown, MAHybrid
Schedule
Full-time
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Job overview

A fast-growing AI and data platform company seeks a Lead Distributed Systems Engineer to architect and scale infrastructure for enterprise AI and machine learning solutions. The role provides technical leadership across platform engineering, MLOps, and AI infrastructure, building production-grade distributed systems and cloud-native services for large-scale customers in complex, regulated environments. It is a hybrid opportunity in Watertown, Massachusetts.

Skills & qualifications

RequiredNice to have

Skills

Distributed Systems Architecture, requiredScalability, requiredReliability, requiredPerformance Optimization, requiredAI/ML Infrastructure, requiredLLM Application Deployment, requiredRetrieval-Augmented Generation, requiredEmbeddings, requiredPrompt Management, requiredAI Application Architecture, requiredPython, requiredTypeScript, requiredModel Registries, requiredModel Serving, requiredML Lifecycle Management, requiredAWS, requiredContainerization, requiredInfrastructure as Code, requiredCloudFormation, requiredCDK, requiredTerraform, requiredSecure Multi-Tenant Platforms, requiredSensitive Data Handling, requiredObservability, requiredMonitoring, requiredAlerting, requiredLogging, requiredDistributed Tracing, requiredCommunication, requiredMentoring, requiredTechnical Influence, requiredAI Agent Frameworks, nice to haveLLM Orchestration, nice to haveModel Context Protocol, nice to haveAI Workload Optimization, nice to haveMultimodal AI, nice to haveImage-Based Machine Learning, nice to haveModel Fine-Tuning, nice to haveQuantization, nice to haveDistillation, nice to have

Qualifications

10+ Years Distributed Systems Experience, requiredTechnical Lead or Principal Engineer Experience, required

Benefits

Medical Insurance
Dental Insurance
Vision Insurance
Paid Time Off
401(k) Match

Full job description

$200000 - $265000

Job Description A fast-growing AI and data platform company is seeking a Lead Distributed Systems Engineer (AI/ML Platform) to architect and scale the infrastructure that powers enterprise AI and machine learning solutions. This is a highly visible technical leadership role focused on building distributed systems, production AI platforms, and cloud-native services used by large-scale customers operating in complex, regulated environments.

You will serve as a key technical authority across platform engineering, machine learning operations, and AI infrastructure. Working closely with software engineers, data engineers, and AI teams, you'll design and build the foundational systems that support model deployment, LLM applications, agent frameworks, observability, governance, and large-scale distributed workloads.

This opportunity is ideal for an engineer who enjoys solving difficult scalability challenges, driving platform strategy, and building production-grade AI systems that operate at enterprise scale. Required Skills & Experience

  • 10+ years of experience building and operating distributed, cloud-native systems in production environments

  • Proven experience serving as a technical lead, principal engineer, or architect for large-scale platform initiatives

  • Deep expertise in distributed systems architecture, scalability, reliability, and performance optimization

  • Extensive experience building and supporting production AI/ML infrastructure

  • Hands-on experience deploying and operating LLM-based applications in production

  • Strong understanding of Retrieval-Augmented Generation (RAG), embeddings, prompt management, and AI application architecture

  • Expert-level software development experience with Python and TypeScript

  • Experience with model registries, model serving platforms, and ML lifecycle management

  • Strong AWS experience and knowledge of containerized environments

  • Experience with Infrastructure as Code tools such as CloudFormation, CDK, or Terraform

  • Experience designing secure multi-tenant platforms and handling sensitive data

  • Strong background in observability, monitoring, alerting, logging, and distributed tracing

  • Excellent communication skills with the ability to mentor engineers and influence technical direction

Desired Skills & Experience

  • Experience with AI agent frameworks and advanced LLM orchestration

  • Familiarity with Model Context Protocol (MCP) implementations

  • Experience optimizing AI workloads for latency, throughput, and cost efficiency

  • Knowledge of multimodal AI systems and image-based machine learning workloads

  • Experience with model fine-tuning, quantization, distillation, or inference optimization

  • Understanding of compliance-focused environments, including regulated industries

  • Experience within life sciences, scientific software, healthcare, or laboratory data platforms

What You Will Be Doing Daily Responsibilities: 100% Hands On

  • Own the architecture and technical direction of the AI/ML platform

  • Design and build highly scalable distributed services supporting production AI workloads

  • Develop infrastructure supporting model deployment, lifecycle management, and serving

  • Create platform capabilities for LLM applications, AI agents, and retrieval-based systems

  • Build reliable real-time and batch inference systems

  • Define observability standards across monitoring, alerting, tracing, and performance analytics

  • Implement evaluation frameworks and automated quality controls for AI applications

  • Design and enforce security controls, tenant isolation, and data protection strategies

  • Contribute to cloud infrastructure automation and deployment processes

  • Lead architectural reviews and serve as a technical mentor for engineering teams

  • Evaluate emerging technologies and drive strategic platform decisions

  • Partner with cross-functional teams to improve reliability, scalability, and operational excellence

The Offer

  • Competitive base salary

  • Performance-based bonus opportunity

  • Hybrid opportunity in Watertown, MA

  • Significant architectural ownership and influence

  • Opportunity to build cutting-edge AI and machine learning infrastructure

  • Collaborative, engineering-focused environment with strong technical leadership

You will receive the following benefits

  • Medical Insurance

  • Dental Benefits

  • Vision Benefits

  • Paid Time Off (PTO)

  • 401(k)

Applicants must be currently authorized to work in the US on a full-time basis now and in the future. Visa sponsorship is not available for this position.

Motion Recruitment Partners (MRP) is an Equal Opportunity Employer. All applicants must be currently authorized to work on a full-time basis in the country for which they are applying, and no sponsorship is currently available. Employment is subject to the successful completion of a pre-employment screening. Accommodation will be provided in all parts of the hiring process as required under MRP’s Employment Accommodation policy. Applicants need to make their needs known in advance.

How this job compares

Set against the 967 open Distributed Systems Engineer jobs on Olive Jobs, counted November 18, 2026.

Pay
  • This posting$200–265K/yr
  • Massachusetts median$123–235K/yr25 salary ranges
  • US median$115–235K/yr859 salary ranges

This range's midpoint, $233K, is 33% above the Massachusetts median midpoint ($175K) — in the top quarter of Distributed Systems Engineer salary ranges in Massachusetts.

Openings
Olive Jobs lists 32 open Distributed Systems Engineer jobs in Massachusetts and 967 across the US. 4% of them nationwide are listed as remote or flexible.
Hiring the most in Massachusetts
Experience
This posting asks for at least 10 years of experience — more than three in four Distributed Systems Engineer postings that state a minimum ask for (median 6 years, across 821 postings).
Education
74 of the 967 open Distributed Systems Engineer jobs (8%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on November 18, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.