Senior Systems Engineer - AI Infrastructure
Palo Alto, CAFull-time$150–230K/yrPosted 8mo agoStill listed 3 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near Palo Alto, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
Clockwork Systems is hiring a Senior Systems Engineer - AI Infrastructure. Clockwork Systems is building fault‑tolerant, high‑performance distributed GPU training infrastructure. The senior systems engineer will design and implement low‑level software for GPU clusters, work with frameworks like PyTorch and CUDA, and create reliable, efficient large‑scale training components while debugging complex distributed systems.
Key focus areas include Design and implement low‑level systems software for GPU clusters, Work with internals of frameworks like PyTorch, NCCL, CUDA runtime, modifying and extending them, and Build components that make large‑scale GPU training more reliable and efficient.
Successful candidates bring Systems Building Experience. Important skills include C/C++, Concurrency, Memory Models, Failure Modes, Distributed System Behavior, and Consistency. Preferred (not required): Lead Design, Navigate Ambiguity, Define Technical Direction, and Mentor Engineers.
Skills & qualifications
Skills
Qualifications
Full job description
About Clockwork Systems Clockwork.io – Software Driven Fabrics to increase GPU cluster utilization
Clockwork Systems was founded by Stanford researchers and veteran systems engineers who share a vision for redefining the foundations of distributed computing. As AI workloads grow increasingly complex, traditional infrastructure struggles to meet the demands of performance, reliability, and precise coordination. Clockwork is pioneering a software-driven approach to AI fabrics by delivering cross-stack observability to catch and quickly resolve problems, workload fault tolerance to keep jobs running through failures, and performance acceleration that dynamically routes and paces traffic to avoid congestion.
To learn more, visit www.clockwork.io . About the Role We're building infrastructure for fault-tolerant, high-performance distributed GPU training. You'll work at the intersection of GPU systems, high-speed networking, and distributed coordination—designing and implementing systems that run at scale.
This is a systems building role. You'll dig into internals, understand why things break under pressure, and design solutions that handle the messy reality of distributed systems.
What You'll Do
-
Design and implement low-level systems software for GPU clusters
-
Work with internals of frameworks like PyTorch, NCCL, CUDA runtime—not as a user, but modifying and extending them
-
Build components that make large-scale GPU training more reliable and efficient
-
Debug complex distributed/concurrent systems where failures are subtle and non-deterministic
-
Own systems end-to-end: from design through production
What We're Looking For Required: Systems building experience
You've designed and built complex systems—not just deployed or operated them. Examples:
-
Kernel subsystems, device drivers, or OS-level components
-
Distributed storage, databases, or coordination systems
-
Runtimes, profilers, or performance tooling
-
Network stacks, protocols, or high-performance I/O systems
-
Large-scale infrastructure at the systems layer
Core technical skills:
-
Strong C/C++ in systems contexts (not just application code)
-
Deep understanding of concurrency, memory models, and failure modes
-
Experience reasoning about distributed system behavior: consistency, ordering, partial failures
-
Comfortable reading and modifying large, unfamiliar codebases
Nice to have:
-
GPU programming (CUDA) or GPU systems experience
-
High-performance networking (RDMA, InfiniBand)
-
ML framework or runtime internals
-
Cluster scheduling or orchestration systems
We believe strong systems engineers pick up domain-specific tools quickly. We value your ability to reason about complex systems over checkbox familiarity with our specific stack.
Senior Expectations
-
Lead design of significant system components
-
Navigate ambiguity and define technical direction
-
Mentor engineers and raise team capabilities
-
8+ years building systems software
Enjoy
-
Challenging projects.
-
A friendly and inclusive workplace culture.
-
Competitive compensation.
-
A great benefits package.
-
Catered lunch.
Compensation for this position will vary based on the skills and experience you bring, as well as internal equity considerations. For candidates hired at the posted level, the expected base salary range is $150,000 - $230,000. In addition to cash compensation, this role is eligible to participate in the company’s equity program , which may include stock options granted in accordance with the company’s equity plan and subject to approval and applicable vesting schedules.
Clockwork Systems is an equal opportunity employer. We are committed to building world-class teams by welcoming bright, passionate individuals from all backgrounds. All qualified applicants will receive consideration for employment without regard to race, color, ancestry, religion, age, sex, sexual orientation, gender identity or expression, national origin, disability, or protected veteran status. We believe diversity drives innovation, and we grow stronger together.
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
Senior Responsible AI Systems EngineerWorkday · Pleasanton, CA (Flexible) · $169–253K/yrPosted 1w agoPosted 1w ago
Senior AI Systems Engineer — C++ / Applied AIAdobe · San Jose, CA · $159–302K/yrPosted 2w agoPosted 2w ago
Senior Applications Engineer, Corporate InfrastructureRobinhood · Menlo Park, CA (Hybrid) · $162–190K/yrPosted 3w agoPosted 3w ago
Senior Software Engineer, InfrastructureCommure · Mountain View, CA (Hybrid) · $170–220K/yrPosted 4w agoPosted 4w ago
Senior DevOps Engineer, Cloud Simulation InfrastructureNVIDIA · Santa Clara, CA · $184–288K/yrPosted 4w agoPosted 4w ago
You've read the whole posting — now see how you match it.