Staff Software Engineer - Backend/Infra [NYC or SF]
New York City, NYFull-time$260–300K/yrPosted 1mo agoStill listed 3 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
You apply on the employer's site, with no Olive account needed.
Watch jobs like this. New roles like this one near New York City, NY, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
Concurrence is building a platform for healthcare organizations to create clinical AI agents. The Staff Backend/Infra Engineer will build and own core platform services handling millions of conversations, from design through production. The role emphasizes concurrency, reliability, service design, and operational health, with work performed in person in New York City or San Francisco.
Skills & qualifications
Skills
Qualifications
Benefits
Full job description
About Concurrence Concurrence (formerly Amigo) is building the platform healthcare organizations use to build their own clinical AI agents. Our mission is to make excellent care accessible to every patient, not rationed by the limits of clinician time. Underneath our platform is the Health World Model, which unifies a health system’s data into a living, event-level record of every patient’s care. On top of it, agents handle work across the patient journey, from intake and scheduling to medication management and clinical decision support. Our agents have supported more than 10 million patient encounters and are on track to grow tenfold this year. We run natively on Databricks, integrate with every major EHR, and are backed by Madrona, General Catalyst, and Optum Ventures. We’re about 35 people, working in person in New York and San Francisco.
About this role As a Staff Backend/Infra Engineer at Concurrence, you'll build the core services behind our agent platform. The systems you own handle millions of conversations a month, so concurrency, reliability, and clean design are the job itself, not an afterthought. You'll own services end to end, from design through production.
What you'll do
-
Designing high-throughput services that handle concurrent conversations at scale
-
Owning a core platform service from design to production
-
Building systems that stay available and degrade gracefully when things fail
-
Handling sensitive healthcare data with the care it requires
-
Improving performance, observability, and operational health across services
-
Shaping architectural decisions as the platform grows
-
Think carefully and holistically about system design under time pressure.
What we're looking for
-
You've built and operated production backend systems at scale and owned the outcome
-
You're strong with concurrency, distributed systems, and service design
-
You prefer simple, maintainable solutions to hard problems
-
You debug well across services, queues, and databases
-
You're low ego, direct, and hold yourself to a high bar
-
You can work on site in New York City or San Francisco
Nice to have
-
Experience in a regulated or high-reliability domain (healthcare, finance, legal)
-
High-throughput or low-latency system design
-
Experience with production AI or ML systems
Benefits (available to Full-Time Employees)
Health & Wellness
-
Comprehensive health, dental, and vision insurance
-
Daily catered lunch and dinner
-
Mental health support and wellness coaching
-
Flexible wellness stipend for fitness, therapy, or personal growth
Growth & Development
-
Annual learning budget for courses, books, or conferences
-
Conference attendance budget for professional development
-
Annual team offsite
-
Academic collaboration opportunities
-
Unlimited PTO
Our Core Values
-
Patients Win, We Win If patients aren't getting better care, we haven't earned the right to scale. Every internal decision gets pressure-tested: does this make patients' lives better? If we can't draw the line, we question why we're doing it.
-
High Standards, High Care We hold a high bar for the team because patients are counting on us to get this right. But high standards only work with genuine investment in each other. You can take risks, admit mistakes, and challenge ideas. Not despite our standards, but because of them.
-
Thoughtful Urgency We move fast by default, but speed without judgment is recklessness. The discipline is knowing which decisions are reversible vs. not. In healthcare AI, the companies that win will be fast everywhere they can be and careful everywhere they must be. We build the muscle to do both.
-
Intensely Measured We instrument patient outcomes, provider ROI, system performance, and clinical accuracy. But data without action is surveillance. Every metric should have an owner, a threshold, and a response plan. If we're measuring something but never acting on it, we stop measuring it.
Who Builds With Us
-
Low ego: Politics and territory don't interest you. The best ideas win, regardless of who has them.
-
Direct: You say the hard thing, challenge ideas openly, and commit fully once decided.
-
High agency: You thrive on trust rather than instruction. When you see something is broken, you fix it. You don’t file tickets and wait for someone else.
-
Bar of excellence: You hold yourself to a bar most people wouldn't, and you want teammates who do the same.
-
Skeptical: You push back on rules that don’t make sense and question assumptions that haven’t earned their place.
How this job compares
Set against the 8,496 open Software Engineering jobs on Olive Jobs, counted November 8, 2026.
- Pay
- This posting$260–300K/yr
- New York median$172–250K/yr464 salary ranges
- US median$149–247K/yr6,363 salary ranges
This range's midpoint, $280K, is 31% above the New York median midpoint ($214K) — in the top quarter of Software Engineering salary ranges in New York.
- Openings
- Olive Jobs lists 664 open Software Engineering jobs in New York and 8,496 across the US. 10% of them nationwide are listed as remote or flexible.
- Hiring the most in New York
- salesforce.com, inc.24 open
- PwC22 open
- Google16 open
- Experience
- Software Engineering postings that state a minimum ask for 7 years of experience at the median; the middle half ask for 5 to 10 years (6,502 postings).
- Education
- 2,185 of the 8,496 open Software Engineering jobs (26%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on November 8, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.
