Runware logo

Staff Software Engineer - Serverless

Runware

Remote · GBFull-timePosted 4mo agoStill listed 2w ago

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this.

At a glance

Compensation
No compensation found
Location
Remote · GB
Schedule
Full-time
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

Runware is hiring a Staff Software Engineer - Serverless. Runware is seeking a Staff/Senior Software Engineer to lead the development of its serverless platform. This role involves building the core systems for workload execution, routing, scheduling, isolation, and scaling, leveraging Runware's inference engine. The engineer will work closely with senior leadership to bring a new product line to market, focusing on creating a compelling developer experience for AI workloads.

Key focus areas include Build the core systems behind Runware's serverless platform, Make it simple for developers to deploy models and run AI workloads, and Design and improve the control plane for serverless execution.

Important skills include Technical Leadership, Building Core Systems, Workload Execution, Routing, Scheduling, and Isolation. Preferred (not required): Building Serverless Platforms, Job Execution Systems, Container Platforms, and Compute Orchestration Systems.

Skills & qualifications

RequiredNice to have

Skills

Technical LeadershipBuilding Core SystemsWorkload ExecutionRoutingSchedulingIsolationScalabilitySDK Interface DesignControl Plane DesignAPI DesignWorker ManagementLifecycle ManagementRetriesFailure HandlingWorkload Startup Time ImprovementGPU Utilisation ImprovementModel Warm-UpCachingPlacementObservabilityDebuggingOperating at ScaleMentoring EngineersDefining Engineering StandardsBuilding Backend ServicesDistributed SystemsDeveloper PlatformsWorkload Orchestration SystemsAsync ProcessingQueuesBack PressureAPIControl PlanesWorkersDatabasesPythonGoTrade-Off JudgementClear CommunicationStrong OwnershipLeading Technical DirectionBuilding Serverless PlatformsJob Execution SystemsContainer PlatformsCompute Orchestration SystemsGPU-Backed WorkloadsAI/ML InferenceModel ServingBatch ProcessingHigh-Performance Compute

Qualifications

Staff Engineer ExperienceSenior Software Engineer ExperienceBackend Engineer ExperiencePlatform Engineer Experience

Benefits

Paid Time Off
Parental Leave

Full job description

We’re looking for a Staff/Senior Software Engineer to technically lead and build Runware’s serverless platform. You’ll be part of a small team working closely with senior leadership to bring a new product line to market.

Runware is evolving beyond model APIs into a platform where developers can deploy models and run AI workloads without managing GPUs, servers or infrastructure. You’ll build the software layer that connects our proprietary high-performance sonic inference engine and turns complex infrastructure into a compelling developer experience.

This is a role for someone who enjoys technical leadership, hard platform problems and clean, simple systems. Your work will help enterprises, model labs and developers move from idea to production faster, then scale without needing to build and operate the infrastructure themselves.

What you’ll do

  • Build the core systems behind Runware’s serverless platform, including workload execution, routing, scheduling, isolation and scaling leveraging our inference engine
  • Make it simple for developers to deploy models and run AI workloads without managing GPUs, servers, queues or infrastructure through a simple SDK interface
  • Design and improve the control plane for serverless execution, including APIs, workers, lifecycle management, retries and failure handling
  • Work closely with our infrastructure and ML teams to improve workload startup time, GPU utilisation, model warm-up, caching and placement
  • Build observability that makes serverless workloads easy to monitor, debug and operate at scale globally
  • Lead the technical design, mentor other engineers and help define the engineering standards for a new product area
  • Strong experience as a Staff Engineer, Senior Software Engineer, Backend Engineer, Platform Engineer or similar
  • Experience building backend services, distributed systems, developer platforms or workload orchestration systems
  • Strong understanding of async processing, queues, scheduling, retries, back pressure and failure handling
  • Comfortable working across APIs, control planes, workers, databases and observability systems
  • Strong engineering fundamentals in one or more backend languages such as Python, Go or similar
  • Good judgement around trade-offs between reliability, latency, scale, cost and developer experience
  • Clear communication, strong ownership and the ability to lead technical direction in a fast-moving environment Nice to have
  • Experience building serverless platforms, job execution systems, container platforms or compute orchestration systems
  • Experience with GPU-backed workloads, AI/ML inference, model serving, batch processing or high-performance compute
  • Familiarity with technologies such as vLLM, TensorRT, Triton, Kubernetes, Nomad or Knative
  • Experience improving workload performance through batching, autoscaling, model warm-up, caching, request routing or queue management
  • Experience with multi-tenant isolation, sandboxing, quotas, rate limits, resource accounting or usage-based billing We’re a remote-first collective, meeting in person twice a year to plan, brainstorm, celebrate wins, and enjoy some face-to-face time. We have core hours for cooperative working and calls, but outside of that your calendar is yours. Work the hours that let you perform at your peak while also building a healthy life.

Our release cycles are fast and intense, but they’re followed by real downtime. After big pushes we expect the team to unplug, recharge, and come back ready & stronger than ever for the next leap.

  • Generous paid time off – vacation, sick days, public holidays
  • Meaningful stock options – share in the upside you create
  • Remote-first setup – work from home anywhere we can employ you
  • Flexible hours – own your schedule outside core collaboration blocks
  • Family leave – paid maternity, paternity, and caregiver time
  • Company retreats – twice-yearly gatherings in inspiring locations

Similar jobs, posted recently

Open roles like this one, listed in the last 30 days.

You've read the whole posting — now see how you match it.