
AI/ML Infrastructure Engineer
San Francisco, CAFull-timePosted 6mo agoStill listed 6 days ago
See where you stand before you apply. No sign-up to start.
You apply on the posting's application page, with no Olive account needed.
Watch jobs like this. New roles like this one near San Francisco, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive focuses on jobs in the United States, including remote roles you can work from there.
Requirements
Credentials this posting asks for.
Job overview
Zensors is hiring an AI/ML Infrastructure Engineer. The AI Infrastructure team at Zensors is seeking a Machine Learning Engineer to optimize core ML pipelines and accelerate the training and inference of computer vision models. This role involves identifying bottlenecks, collaborating with research and platform teams, applying advanced model optimization techniques, and building efficient operators to reduce compute costs and enable massive scalability for their SaaS product.
Key focus areas include Optimize core ML pipelines by identifying bottlenecks and performing in-depth analysis., Collaborate with AI research and platform engineering teams to optimize parallel algorithms., and Influence the design of next-generation inference infrastructure..
Successful candidates bring Bs/Ms Or Ph.D. In Computer Science and Bs/Ms Or Ph.D. In Electrical Engineering. Important skills include C/C++, Python, Model Optimization, Quantization, Efficient Deep Learning Techniques, and Knowledge Distillation. Preferred (not required): SQL, Neo4j, Computer Vision, and Vision Transformers.
Skills & qualifications
Skills
Qualifications
Full job description
The AI Infrastructure team at Zensors builds the engine that powers our visual sensing platform. We provide the tools to automate the lifecycle of our AI workflow, including model development, evaluation, optimization, deployment, and monitoring across thousands of video streams.
As a Machine Learning Engineer in ML Runtime & Optimization, you will develop technologies to accelerate the training and inference of computer vision models that power smart spaces and cities.
Your responsibilities will include:
-
Optimizing Core ML Pipelines: Identifying key bottlenecks in our current video analytics pipeline and performing in-depth analysis to ensure the best possible performance on current server and edge compute architectures.
-
Cross-Stack Collaboration: Collaborating closely with AI research and platform engineering teams to optimize core parallel algorithms and influence the design of our next-generation inference infrastructure.
-
Model Acceleration: Applying advanced model optimization techniques—such as quantization (Int8/FP16), pruning, and layer fusion—to our Vision Transformers (ViTs) and CNNs to maximize throughput and minimize latency.
-
Building Efficient Operators: Working across the entire ML framework/compiler stack (e.g., PyTorch, CUDA, TensorRT, and NVIDIA DeepStream) to write custom optimized ML operator libraries.
-
Resource Efficiency: Reducing the compute cost per video stream to enable massive scalability of our SaaS product.
-
Data Management: Building, improving, maintaining, and operating systems to facilitate the collection, labeling, and use of visual data for ML training.
REQUIREMENTS
-
BS/MS or Ph.D. in Computer Science, Electrical Engineering, or a related discipline.
-
Strong programming skills in C/C++ and Python.
-
Experience with model optimization, quantization, and efficient deep learning techniques (e.g., knowledge distillation, pruning).
-
Deep understanding of GPU hardware performance, including execution models, thread hierarchy, memory/cache management, and the cost/performance trade-offs of video processing.
-
Experience with profiling and benchmarking tools (e.g., Nsight Systems, Nsight Compute) to validate performance on complex architectures.
-
Experience identifying and resolving compute and data flow bottlenecks, particularly in high-bandwidth video processing pipelines.
-
Strong communication skills and the ability to work cross-functionally between research and infrastructure teams.
PREFERRED QUALIFICATIONS
-
Familiarity with database systems (e.g., SQL, Neo4j).
-
Work in Computer Vision, Deep Learning, and Vision Transformers.
-
Experience with video processing frameworks such as NVIDIA DeepStream, DALI, or FFmpeg.
-
Familiarity with ML compilers (e.g., TVM, MLIR) or inference engines like TensorRT or ONNX Runtime.
-
Knowledge of distributed training systems or cloud-scale inference serving (e.g., Triton Inference Server).
How this job compares
Set against the 6,360 open Machine Learning Engineer jobs on Olive Jobs, counted November 16, 2026.
- Pay
- This postingNot listed
- California median$175–261K/yr1,420 salary ranges
- California median$50–70/hr23 hourly ranges
- Openings
- Olive Jobs lists 1,833 open Machine Learning Engineer jobs in California and 6,360 across the US. 8% of them nationwide are listed as remote or flexible.
- Hiring the most in California
- Apple182 open
- Google132 open
- Capital One63 open
- Experience
- Machine Learning Engineer postings that state a minimum ask for 5 years of experience at the median; the middle half ask for 3 to 7 years (5,294 postings).
- Education
- This posting asks for a doctorate or professional degree; 73 of the 6,360 open Machine Learning Engineer jobs (1%) ask for a doctorate or professional degree.
Counted across the open, public US postings on Olive Jobs on November 16, 2026. Figures based on too few postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.


