Lead Software Engineer, Model Serving Platform
San Francisco, CAFull-timePosted 11mo agoStill listed · checked in the last 2 days
See where you stand before you apply. No sign-up to start.
You apply on the posting's application page, with no Olive account needed.
Watch jobs like this. New roles like this one near San Francisco, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive focuses on jobs in the United States, including remote roles you can work from there.
Requirements
Credentials this posting asks for.
Job overview
Sciforium is hiring a Lead Software Engineer, Model Serving Platform. Sciforium seeks a senior technical leader to architect and lead the development of a high‑performance model serving platform, guiding engineering direction, building core components, and mentoring engineers while shaping the full AI stack from GPU kernels to distributed inference APIs.
Key focus areas include Lead the technical direction of the model serving platform, owning architecture decisions and guiding engineering execution, Build core serving components including execution runtimes, batching, scheduling, and distributed inference systems, and Develop high‑performance C++ and CUDA/HIP modules, including custom GPU kernels and memory‑optimized runtimes.
Successful candidates bring Bachelor's Degree In Computer Science, Computer Engineering, Electrical Engineering Or Equivalent Practical Experience and 5+ Years Designing And Building Scalable, Reliable Backend Systems Or Distributed Infrastructure. Important skills include C++, HIP, Python, Kubernetes, Ray, and Containerization. Preferred (not required): CUDA, Profiling, ML Systems Engineering, and Distributed GPU Scheduling.
Skills & qualifications
Skills
Qualifications
Benefits
Full job description
Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.
ABOUT THE ROLE
This is a rare chance to help architect and lead the development of Sciforium’s next-generation model serving platform, the high-performance engine that will bring a multimodal, highly efficient foundation model to market. As a senior technical leader, you’ll not only build core components yourself but also guide and mentor other engineers, influencing engineering direction, standards, and execution quality.
You will learn and shape the full AI stack: from GPU kernels and quantized execution paths to distributed serving, scheduling, and the APIs that power real-time AI applications. If you enjoy deep systems work, thrive on ownership, and want to lead engineers in building foundational AI infrastructure, this role puts you at the center of SciForium’s mission and growth.
WHAT YOU'LL DO
-
Lead the technical direction of the model serving platform, owning architecture decisions and guiding engineering execution.
-
Build core serving components including execution runtimes, batching, scheduling, and distributed inference systems.
-
Develop high-performance C++ and CUDA/HIP modules, including custom GPU kernels and memory-optimized runtimes.
-
Collaborate with ML researchers to productionize new multimodal models and ensure low-latency, scalable inference.
-
Build Python APIs and services that expose model capabilities to downstream applications.
-
Mentor and support other engineers through code reviews, design discussions, and hands-on technical guidance.
-
Drive performance profiling, benchmarking, and observability across the inference stack.
-
Ensure high reliability and maintainability through testing, monitoring, and engineering best practices.
-
Troubleshoot and resolve complex issues across GPU, runtime, and service layers.
IDEAL CANDIDATE PROFILE
-
Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience
-
5+ years of experience designing and building scalable, reliable backend systems or distributed infrastructure.
-
Strong understanding of LLM inference mechanics (prefill vs decode, batching, KV cache)
-
Experience with Kubernetes/Ray, Containerization
-
Strong proficiency in C++, Python.
-
Strong debugging, profiling, and performance optimization skills at the system level.
-
Ability to collaborate closely with ML researchers and translate model or runtime requirements into production-grade systems.
-
Effective communication skills and the ability to lead technical discussions, mentor engineers, and drive engineering quality.
-
Comfortable working from the office and contributing to a fast-moving, high-ownership team culture.
NICE-TO-HAVE
-
Experience with ML systems engineering, distributed GPU scheduling, open source inference engine like vLLM, Sglang, or TRT-LLM
-
Experience in building large scale ML/MLOps infrastructure
-
Proficiency in CUDA or ROCm and experience with GPU profiling tools
-
Experience at an AI/ML startup, research lab, or Big Tech infrastructure/ML team.
-
Familiarity with multimodal model architectures, raw-byte models, or efficient inference techniques.
-
Contributions to open-source ML or HPC infrastructure
BENEFITS INCLUDE
-
Medical, dental, and vision insurance
-
401k plan
-
Daily lunch, snacks, and beverages
-
Flexible time off
-
Competitive salary and equity
EQUAL OPPORTUNITY
Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
How this job compares
Set against the 180 open Lead Software Engineer jobs on Olive Jobs, counted November 18, 2026.
- Pay
- This postingNot listed
- California median$157–221K/yr21 salary ranges
- Openings
- Olive Jobs lists 24 open Lead Software Engineer jobs in California and 180 across the US. 1% of them nationwide are listed as remote or flexible.
- Hiring the most in California
- JPMorgan Chase7 open
- SpaceX5 open
- Cadence Design Systems, Inc.4 open
- Experience
- This posting asks for at least 5 years of experience; Lead Software Engineer postings that state a minimum ask for 5 years at the median (174 postings).
- Education
- This posting asks for a bachelor's degree; 47 of the 180 open Lead Software Engineer jobs (26%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on November 18, 2026. Figures based on too few postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.



