Structured AI logo

Founding Infrastructure Engineer

Structured AI

New York, NYFull-time$180–250K/yrSeen 2w agoStill listed 2 days ago

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
$180–250K/yr
Location
New York, NY
Schedule
Full-time
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

Structured AI is hiring its first infrastructure engineer to own the platform that runs its AI agents and set technical direction for the systems beneath the product. The role focuses on secure, fast execution of generated code, scaling worker and LLM traffic, resilient streaming, document processing, and infrastructure operations. The engineer will also contribute Python and FastAPI code alongside product engineers.

Skills & qualifications

RequiredNice to have

Skills

Microsoft AzureKubernetesPythonDockerTerraformCloud InfrastructureWorkload IsolationContainerizationInfrastructure as CodeCI/CDPostgreSQLRedisAI Coding AgentsKEDAEvent-Driven AutoscalingAgent OrchestrationInference FleetsVector SearchMCPTool-Use LoopsClaude Agent SDKLangGraphDocument ProcessingComputer VisionAECFastAPI

Qualifications

3+ Years Cloud Infrastructure ExperienceProduction Workload Isolation ExperienceProduction Container ExperienceInfrastructure as Code and CI/CD OwnershipProduction Postgres and Redis ExperienceNew York or Willing to Relocate

Benefits

Medical Insurance
Dental Insurance

Full job description

Structured AI builds AI agents that check construction drawings and CAD models. Design engineers at architecture and engineering firms run their drawing sets through us and get back verified findings: code issues, coordination clashes, things that don't match the schedule. A set can be 3,000 sheets. We've raised $5m and are backed by Y Combinator, 20VC, Cherry Ventures, Airtree, and others. Syska Hennessy Group, GPD Group, and Auld & White already run their reviews through us. ENR, Forbes, The Wall Street Journal, and Business Insider have covered what we're doing. You'd be our first infrastructure hire on a team of ten engineers. Right now that means owning the platform the agents run on. Over time it means setting the technical direction for everything underneath the product: how we isolate untrusted code, how we scale, and what we run it on. What you'd own Our agents generate code and execute it as part of every check. You'd own the execution platform that runs it: sandboxed and isolated, with warm pools for instant startup and controlled network egress. That platform is the core of the role, and it has to stay fast and secure as agent traffic grows. You'd also own:

  • The worker fleet: thousands of sheets per project, scaling from zero to hundreds of jobs and back.
  • The LLM traffic layer: multi-tenant, metered, every token accounted for in customer billing.
  • Streaming for chat and progress updates that survives deploys and dropped connections.
  • The document pipeline: rendering, OCR, extraction on very large PDFs.
  • CI/CD, the self-hosted runner fleet, and incident response.

You'd also ship in the codebase (Python, FastAPI) alongside the product engineers. We're on Azure: Container Apps with KEDA-scaled jobs, Bicep, GitHub Actions, Postgres, Redis, Front Door, Entra ID. Models from Anthropic, Gemini, and OpenAI. We're hiring for depth in containers and isolation, not for any one tool. If you'd run part of it differently, you'll be the one deciding. Who you are

  • You've run cloud infrastructure in production for at least three years. Azure, AWS, or GCP; Azure is a plus, not a requirement.
  • You've isolated workloads in production. Containers, microVMs, or Linux sandboxing in a system with real users. We'll go deep on this in the interview.
  • Deep production container experience: Container Apps, ECS, AKS, EKS, or similar.
  • You've owned infrastructure as code and CI/CD end to end.
  • You've run Postgres and Redis in production and been on call for them.
  • You use AI coding agents in your own work and check what they produce. We use Claude Code and Codex daily.
  • You're in New York or willing to move here. We're in the office in the Financial District five days a week.

Strong signals

  • Infrastructure for AI agents specifically: sandboxes for generated code, agent orchestration, inference fleets, vector search.
  • KEDA or other event-driven autoscaling.
  • Agent harnesses: MCP, tool-use loops, the Claude Agent SDK, LangGraph.
  • Document processing, computer vision, or time spent in AEC.
  • Python beyond scripts. Our deploy tooling is Python.

Compensation

  • Base salary: $180,000 to $250,000, depending on experience.
  • Equity up to 1%, sized for a founding engineer.
  • Health and dental.

How this job compares

Set against the 4,536 open Infrastructure Engineer jobs on Olive Jobs, counted October 29, 2026.

Pay
  • This posting$180–250K/yr
  • New York median$158–230K/yr216 salary ranges
  • US median$124–220K/yr3,729 salary ranges

This range's midpoint, $215K, is 13% above the New York median midpoint ($190K) — in the middle half of Infrastructure Engineer salary ranges in New York.

Openings
Olive Jobs lists 271 open Infrastructure Engineer jobs in New York and 4,536 across the US. 8% of them nationwide are listed as remote or flexible.
Hiring the most in New York
Experience
This posting asks for at least 3 years of experience — less than three in four Infrastructure Engineer postings that state a minimum ask for (median 6 years, across 3,490 postings).
Education
1,020 of the 4,536 open Infrastructure Engineer jobs (22%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on October 29, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.

Similar jobs, posted recently

Open roles like this one, listed in the last 30 days.

You've read the whole posting — now see how you match it.