
Founding Infrastructure Engineer
New York, NYFull-time$180–250K/yrSeen 2w agoStill listed 2 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near New York, NY, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
Structured AI is hiring its first infrastructure engineer to own the platform that runs its AI agents and set technical direction for the systems beneath the product. The role focuses on secure, fast execution of generated code, scaling worker and LLM traffic, resilient streaming, document processing, and infrastructure operations. The engineer will also contribute Python and FastAPI code alongside product engineers.
Skills & qualifications
Skills
Qualifications
Benefits
Full job description
Structured AI builds AI agents that check construction drawings and CAD models. Design engineers at architecture and engineering firms run their drawing sets through us and get back verified findings: code issues, coordination clashes, things that don't match the schedule. A set can be 3,000 sheets. We've raised $5m and are backed by Y Combinator, 20VC, Cherry Ventures, Airtree, and others. Syska Hennessy Group, GPD Group, and Auld & White already run their reviews through us. ENR, Forbes, The Wall Street Journal, and Business Insider have covered what we're doing. You'd be our first infrastructure hire on a team of ten engineers. Right now that means owning the platform the agents run on. Over time it means setting the technical direction for everything underneath the product: how we isolate untrusted code, how we scale, and what we run it on. What you'd own Our agents generate code and execute it as part of every check. You'd own the execution platform that runs it: sandboxed and isolated, with warm pools for instant startup and controlled network egress. That platform is the core of the role, and it has to stay fast and secure as agent traffic grows. You'd also own:
- The worker fleet: thousands of sheets per project, scaling from zero to hundreds of jobs and back.
- The LLM traffic layer: multi-tenant, metered, every token accounted for in customer billing.
- Streaming for chat and progress updates that survives deploys and dropped connections.
- The document pipeline: rendering, OCR, extraction on very large PDFs.
- CI/CD, the self-hosted runner fleet, and incident response.
You'd also ship in the codebase (Python, FastAPI) alongside the product engineers. We're on Azure: Container Apps with KEDA-scaled jobs, Bicep, GitHub Actions, Postgres, Redis, Front Door, Entra ID. Models from Anthropic, Gemini, and OpenAI. We're hiring for depth in containers and isolation, not for any one tool. If you'd run part of it differently, you'll be the one deciding. Who you are
- You've run cloud infrastructure in production for at least three years. Azure, AWS, or GCP; Azure is a plus, not a requirement.
- You've isolated workloads in production. Containers, microVMs, or Linux sandboxing in a system with real users. We'll go deep on this in the interview.
- Deep production container experience: Container Apps, ECS, AKS, EKS, or similar.
- You've owned infrastructure as code and CI/CD end to end.
- You've run Postgres and Redis in production and been on call for them.
- You use AI coding agents in your own work and check what they produce. We use Claude Code and Codex daily.
- You're in New York or willing to move here. We're in the office in the Financial District five days a week.
Strong signals
- Infrastructure for AI agents specifically: sandboxes for generated code, agent orchestration, inference fleets, vector search.
- KEDA or other event-driven autoscaling.
- Agent harnesses: MCP, tool-use loops, the Claude Agent SDK, LangGraph.
- Document processing, computer vision, or time spent in AEC.
- Python beyond scripts. Our deploy tooling is Python.
Compensation
- Base salary: $180,000 to $250,000, depending on experience.
- Equity up to 1%, sized for a founding engineer.
- Health and dental.
How this job compares
Set against the 4,536 open Infrastructure Engineer jobs on Olive Jobs, counted October 29, 2026.
- Pay
- This posting$180–250K/yr
- New York median$158–230K/yr216 salary ranges
- US median$124–220K/yr3,729 salary ranges
This range's midpoint, $215K, is 13% above the New York median midpoint ($190K) — in the middle half of Infrastructure Engineer salary ranges in New York.
- Openings
- Olive Jobs lists 271 open Infrastructure Engineer jobs in New York and 4,536 across the US. 8% of them nationwide are listed as remote or flexible.
- Experience
- This posting asks for at least 3 years of experience — less than three in four Infrastructure Engineer postings that state a minimum ask for (median 6 years, across 3,490 postings).
- Education
- 1,020 of the 4,536 open Infrastructure Engineer jobs (22%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on October 29, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
AI Infrastructure EngineerPercepta · New York City, NY · $180–400K/yrInfrastructure EngineerRoboflow · New York, NY (Flexible) · $180–230K/yrPosted 2w agoPosted 2w ago
Infrastructure LeadClosure · New York City, NY (Hybrid) · $160–250K/yr
Cloud - Staff Site Reliability EngineerBedrock Robotics · New York City, NY (Hybrid)Posted 1w agoPosted 1w agoSenior Software Engineer, Platform EngineeringDistributed Spectrum · New York City, NY · $150–200K/yrPosted 3w agoPosted 3w ago
You've read the whole posting — now see how you match it.