Skip to main content
Zensors logo

AI/ML Infrastructure Engineer

Zensors

San Francisco, CAFull-timePosted 6mo agoStill listed 6 days ago

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
No compensation found
Location
San Francisco, CA
Schedule
Full-time
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Requirements

Credentials this posting asks for.

Doctorate, required

Job overview

Zensors is hiring an AI/ML Infrastructure Engineer. The AI Infrastructure team at Zensors is seeking a Machine Learning Engineer to optimize core ML pipelines and accelerate the training and inference of computer vision models. This role involves identifying bottlenecks, collaborating with research and platform teams, applying advanced model optimization techniques, and building efficient operators to reduce compute costs and enable massive scalability for their SaaS product.

Key focus areas include Optimize core ML pipelines by identifying bottlenecks and performing in-depth analysis., Collaborate with AI research and platform engineering teams to optimize parallel algorithms., and Influence the design of next-generation inference infrastructure..

Successful candidates bring Bs/Ms Or Ph.D. In Computer Science and Bs/Ms Or Ph.D. In Electrical Engineering. Important skills include C/C++, Python, Model Optimization, Quantization, Efficient Deep Learning Techniques, and Knowledge Distillation. Preferred (not required): SQL, Neo4j, Computer Vision, and Vision Transformers.

Skills & qualifications

RequiredNice to have

Skills

C/C++, requiredPython, requiredModel Optimization, requiredQuantization, requiredEfficient Deep Learning Techniques, requiredKnowledge Distillation, requiredPruning, requiredGPU Hardware Performance, requiredExecution Models, requiredThread Hierarchy, requiredMemory/Cache Management, requiredVideo Processing Cost/Performance Trade-Offs, requiredNsight Systems, requiredNsight Compute, requiredIdentifying Compute and Data Flow Bottlenecks, requiredHigh-Bandwidth Video Processing Pipelines, requiredCommunication, requiredCollaboration, requiredSQL, nice to haveNeo4j, nice to haveComputer Vision, nice to haveVision Transformers, nice to haveNVIDIA DeepStream, nice to haveDALI, nice to haveFFmpeg, nice to haveTVM, nice to haveMLIR, nice to haveTensorRT, nice to haveONNX Runtime, nice to haveDistributed Training Systems, nice to haveCloud-Scale Inference Serving, nice to haveTriton Inference Server, nice to have

Qualifications

BS/MS or Ph.D. In Computer Science, Electrical Engineering, or Related Discipline, requiredExperience With Model Optimization, Quantization, and Efficient Deep Learning Techniques, requiredExperience With Profiling and Benchmarking Tools, requiredExperience Identifying and Resolving Compute and Data Flow Bottlenecks, requiredFamiliarity With Database Systems, nice to haveWork in Computer Vision, Deep Learning, and Vision Transformers, nice to haveExperience With Video Processing Frameworks, nice to haveFamiliarity With ML Compilers or Inference Engines, nice to haveKnowledge of Distributed Training Systems or Cloud-Scale Inference Serving, nice to have

Full job description

The AI Infrastructure team at Zensors builds the engine that powers our visual sensing platform. We provide the tools to automate the lifecycle of our AI workflow, including model development, evaluation, optimization, deployment, and monitoring across thousands of video streams.

As a Machine Learning Engineer in ML Runtime & Optimization, you will develop technologies to accelerate the training and inference of computer vision models that power smart spaces and cities.

Your responsibilities will include:

  • Optimizing Core ML Pipelines: Identifying key bottlenecks in our current video analytics pipeline and performing in-depth analysis to ensure the best possible performance on current server and edge compute architectures.

  • Cross-Stack Collaboration: Collaborating closely with AI research and platform engineering teams to optimize core parallel algorithms and influence the design of our next-generation inference infrastructure.

  • Model Acceleration: Applying advanced model optimization techniques—such as quantization (Int8/FP16), pruning, and layer fusion—to our Vision Transformers (ViTs) and CNNs to maximize throughput and minimize latency.

  • Building Efficient Operators: Working across the entire ML framework/compiler stack (e.g., PyTorch, CUDA, TensorRT, and NVIDIA DeepStream) to write custom optimized ML operator libraries.

  • Resource Efficiency: Reducing the compute cost per video stream to enable massive scalability of our SaaS product.

  • Data Management: Building, improving, maintaining, and operating systems to facilitate the collection, labeling, and use of visual data for ML training.

REQUIREMENTS

  • BS/MS or Ph.D. in Computer Science, Electrical Engineering, or a related discipline.

  • Strong programming skills in C/C++ and Python.

  • Experience with model optimization, quantization, and efficient deep learning techniques (e.g., knowledge distillation, pruning).

  • Deep understanding of GPU hardware performance, including execution models, thread hierarchy, memory/cache management, and the cost/performance trade-offs of video processing.

  • Experience with profiling and benchmarking tools (e.g., Nsight Systems, Nsight Compute) to validate performance on complex architectures.

  • Experience identifying and resolving compute and data flow bottlenecks, particularly in high-bandwidth video processing pipelines.

  • Strong communication skills and the ability to work cross-functionally between research and infrastructure teams.

PREFERRED QUALIFICATIONS

  • Familiarity with database systems (e.g., SQL, Neo4j).

  • Work in Computer Vision, Deep Learning, and Vision Transformers.

  • Experience with video processing frameworks such as NVIDIA DeepStream, DALI, or FFmpeg.

  • Familiarity with ML compilers (e.g., TVM, MLIR) or inference engines like TensorRT or ONNX Runtime.

  • Knowledge of distributed training systems or cloud-scale inference serving (e.g., Triton Inference Server).

How this job compares

Set against the 6,360 open Machine Learning Engineer jobs on Olive Jobs, counted November 16, 2026.

Pay
  • This postingNot listed
  • California median$175–261K/yr1,420 salary ranges
  • California median$50–70/hr23 hourly ranges
Openings
Olive Jobs lists 1,833 open Machine Learning Engineer jobs in California and 6,360 across the US. 8% of them nationwide are listed as remote or flexible.
Hiring the most in California
Experience
Machine Learning Engineer postings that state a minimum ask for 5 years of experience at the median; the middle half ask for 3 to 7 years (5,294 postings).
Education
This posting asks for a doctorate or professional degree; 73 of the 6,360 open Machine Learning Engineer jobs (1%) ask for a doctorate or professional degree.

Counted across the open, public US postings on Olive Jobs on November 16, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.