Software Engineer, Inference
San Francisco, CAFull-timeSeen 2w agoStill listed 2w ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near San Francisco, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
Pulse is tackling a persistent data infrastructure challenge by extracting accurate, structured information from complex documents at scale. The small, fast‑growing San Francisco team powers Fortune 100 enterprises, YC startups, and investment firms with a multi‑stage architecture that combines layout understanding, low‑latency OCR, advanced reading‑order algorithms, and fine‑tuned vision‑language models.
Skills & qualifications
Skills
Qualifications
Benefits
Full job description
Overview Pulse is tackling one of the most persistent challenges in data infrastructure: extracting accurate, structured information from complex documents at scale. We have a breakthrough approach to document understanding that combines intelligent schema mapping with fine-tuned extraction models where legacy OCR and other parsing tools consistently fail. We are a small, fast-growing team of engineers in San Francisco powering Fortune 100 enterprises, YC startups, public investment firms, and growth-stage companies. We are backed by tier 1 investors and growing quickly. What makes our tech special is our multi-stage architecture:
-
Layout understanding with specialized component detection models
-
Low-latency OCR models for targeted extraction
-
Advanced reading-order algorithms for complex structures
-
Proprietary table structure recognition and parsing
-
Fine-tuned vision-language models for charts, tables, and figures
If you are passionate about the intersection of computer vision, NLP, and data infrastructure, your work at Pulse will directly impact customers and shape the future of document intelligence. What we are looking for
-
5 days in-office at our San Francisco office
-
Eager to learn and adapt quickly
-
Prior startup or founding experience is a plus
What we are looking for
-
5 days in-office at our San Francisco office
-
Eager to learn and adapt quickly
-
Prior startup or founding experience is a plus
About the Role Specialize in low-latency, high-throughput inference for OCR and multimodal models. Own profiling, batching, and autoscaling across single-tenant and multi-tenant environments. Responsibilities
-
Build inference services with smart batching and caching
-
Optimize kernels, tokenization, and model graphs
-
Evaluate vLLM, TensorRT LLM, and Triton tradeoffs
-
Implement autoscaling and admission control with clear SLOs
-
Own performance dashboards and capacity planning
Requirements
-
3+ years in performance engineering or ML systems
-
Strong Python, plus C++ or CUDA exposure
-
Experience with GPU profiling and model serving
Nice to have
- Experience reducing p95 and cost in production ML systems
Sponsorship Sponsorship available. Compensation and benefits Competitive base salary plus equity, performance-based bonus, relocation assistance for Bay Area moves, daily meal stipend, medical, vision, and dental coverage.
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
Inference Performance EngineerAdaption · San Francisco, CA (Hybrid)Posted 2w agoPosted 2w ago
Senior Software Engineer, Model InfrastructureHarvey · San Francisco, CA (Hybrid) · $193–290K/yrPosted 2 days agoPosted 2 days agoSenior Software Engineer, Consumer ExperienceHandshake · San Francisco, CA · $225–250K/yrPosted 1 day agoPosted 1 day ago
Software Engineer, Model RuntimeOpenAI · San Francisco, CA (Hybrid) · $266–445K/yrPosted 2w agoPosted 2w ago
Senior Software Developer, SearchMaintainX · Remote · US · $143–249K/yrPosted 4 days agoPosted 4 days ago
You've read the whole posting — now see how you match it.