
GPU Cluster Infrastructure Engineer
New York, NYContract$10,500–18,000/moSeen 3w agoStill listed 2 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near New York, NY, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
Beam, an ultrafast AI inference platform, seeks an experienced contractor to design, build, and operationalize high‑performance GPU clusters. The role covers design review, hardware acceptance testing, storage validation, management‑plane security, telemetry integration, documentation, and post‑go‑live escalation support, ensuring a robust foundation for the team.
Skills & qualifications
Skills
Benefits
Full job description
Beam is an ultrafast AI inference platform. We built a serverless runtime that launches GPU-backed containers in less than 1 second and quickly scales out to thousands of GPUs. Developers use our platform to serve apps to millions of users around the globe. We're backed by Y Combinator, Tiger Global, and prominent developer-tool founders, including the founder of Snyk and former CTO of GitHub. About the Role We're building out our own GPU capacity and we're looking for an experienced contractor to help us stand up high-performance GPU clusters. The work runs from design review through bring-in, and you'll leave behind the operational foundation our team needs to run them.
- Review cluster designs and bills of materials across compute, networking, and storage, and catch gaps before hardware is ordered.
- Lead acceptance testing: validate cabling and optics, bring up the InfiniBand fabric, run burn-in, and hold vendors to their deliverables.
- Stand up and validate high-performance storage alongside vendor teams.
- Build the out-of-band management layer and firmware baselines, and secure the management plane for customer-facing environments.
- Integrate hardware, fabric, and storage telemetry into our observability stack, with alerting and automated health checks.
- Write runbooks, as-builts, and remote-hands procedures.
- Provide escalation support after go-live and help our team ramp up.
Skills & Experience
- You've built and operated NVIDIA HGX or DGX clusters in production at a GPU cloud, HPC center, or AI lab.
- Hands-on experience with InfiniBand: subnet management and UFM, fabric bring-up, and diagnosing degraded links and optics. NDR or newer.
- GPU node bring-up and burn-in: firmware, BMC/Redfish, DCGM, NCCL testing, PXE and imaging, and XID error triage.
- Parallel storage experience: WEKA, VAST, GPFS, Lustre, or similar.
- Equally effective on the data center floor and remotely, including directing colo remote hands.
- You troubleshoot methodically across hardware, fabric, and software, document as you go, and communicate clearly with technical and non-technical people.
- Bonus: recent-generation NVIDIA platforms, bare-metal cloud operations, Ansible or similar automation, Prometheus/Grafana, NVIDIA certifications.
Benefits
- Competitive salary and meaningful equity
- Join a fast-growing pre-series A company at the ground floor
- Health, dental, and vision benefits with 90% coverage for you and 50% for dependents
- Opportunities to participate in events across the cloud native community
- Fitness stipend, learning budget, and much, much more
How this job compares
Set against the 4,484 open Infrastructure Engineer jobs on Olive Jobs, counted October 29, 2026.
- Pay
- This posting$10,500–18,000/mo
- New York median$160–230K/yr214 salary ranges
- US median$48–56/hr110 hourly ranges
- Openings
- Olive Jobs lists 269 open Infrastructure Engineer jobs in New York and 4,484 across the US. 8% of them nationwide are listed as remote or flexible.
- Experience
- This posting asks for at least 3 years of experience — less than three in four Infrastructure Engineer postings that state a minimum ask for (median 5 years, across 3,447 postings).
- Education
- 1,029 of the 4,484 open Infrastructure Engineer jobs (23%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on October 29, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
Sr./Staff Forward Deployed EngineerGroq · New York · $270–402K/yrPosted 3w agoPosted 3w ago
Head of Compute OperationsBeam · New York, NY (Hybrid) · $110–150K/yr
Operations Engineer, Fleet ReliabilityCoreWeave · Livingston, NJ · $83–110K/yr
Infrastructure EngineerElevenLabs · Remote · GBPosted 2w agoPosted 2w ago
Lead Platform Engineer/Architect - HPC, KubernetesEPAM Systems · Remote · US · $145–170K/yr
You've read the whole posting — now see how you match it.