Olive Jobs
Quadric logo

AI Inference Engineer

Quadric

Burlingame, CAJobNo compensation foundPosted 7mo agoVerified open 5 days ago
Evaluate my fit

Most applications go out cold — see where you stand first. No sign-up to start.

Don't just apply. Show up ready.

Olive works from this exact posting — no sign-up to start.

Evaluate your fitSee where you stand — strengths, gaps, and what to fix first.Get started →Tailor your résuméRewritten against this posting, with a diff of every change.Get started →Practice the interviewA voice mock interview built from this job description.Get started →

At a glance

Compensation
No compensation found
Location
Burlingame, CA
Work Authorization
Not specified

Requirements

Credentials this posting asks for.

Bachelor's degree

Job overview

Quadric seeks an AI Inference Engineer to bridge AI/LLM models with its unique platforms, handling model porting, optimization, quantization, and performance benchmarking for edge and automotive devices, while developing tools and supporting customers.

Skills & qualifications

RequiredNice to have

Skills

Systems ArchitectureBenchmarkingProblem SolvingDebuggingModel QuantizationModel PruningModel ConversionModel PortingInference OptimizationProfilingC/C++PythonONNXRuntimePyTorchvLLMHuggingface-TransformerNeural-CompressorLlamaCPPCommunication

Qualifications

Bachelor's in Computer Science or Electrical EngineeringMaster's in Computer Science or Electrical Engineering5+ Years AI/LLM Model Inference Experience

Benefits

Medical Insurance
401(k) Match
Paid Time Off
Parental Leave

Full job description

Quadric has created an innovative general purpose neural processing unit (GPNPU) architecture. Quadric's co-optimized software and hardware is targeted to run neural network (NN) inference workloads in a wide variety of edge and endpoint devices, ranging from battery operated smart-sensor systems to high-performance automotive or autonomous vehicle systems. Unlike other NPUs or neural network accelerators in the industry today that can only accelerate a portion of a machine learning graph, the Quadric GPNPU executes both NN graph code and conventional C++ DSP and control code.

Role: The AI Inference Engineer in Quadric is the key bridge between the world of AI/LLM models and Quadric unique platforms. The AI Inference Engineer at Quadric will [1] port AI models to Quadric platform; [2] optimize the model deployment for efficient inference; [3] profile and benchmark the model performance. This senior technical role demands deep knowledge of AI model algorithms, system architecture and AI toolchains/frameworks.

Responsibilities:

  • Quantize, prune and convert models for deployment
  • Port models to Quadric platform using Quadric toolchain
  • Optimize inference deployment for latency, speed
  • Benchmark and profile model performance and accuracy
  • Develop tools to scale and speed up the deployment
  • Make Improvement to SDK and runtime
  • Provide technical support and documents to customers and developer community

Requirements:

  • Bachelor’s or Master’s in Computer Science and/or Electric Engineering.

  • 5+ years of experience in AI/LLM model inference and deployment frameworks/tools

  • experience with model quantization (PTQ, QAT) and tools

  • experience with model accuracy measures

  • experience with model inference performance profiling

  • experience with at least one of the following frameworks: onnxruntime, Pytorch, vLLM, huggingface-transformer, neural-compressor, llamacpp

  • Proficiency in C/C++ and Python

  • Demonstrate good capability in problem solving, debug and communication

  • Health Care Plan (Medical, Dental & Vision)

  • Retirement Plan (401k, IRA)

  • Life Insurance (Basic, Voluntary & AD&D)

  • Paid Time Off (Vacation, Sick & Public Holidays)

  • Family Leave (Maternity, Paternity)

  • Short Term & Long Term Disability

  • Training & Development

  • Work From Home

  • Free Food & Snacks

  • Stock Option Plan

You've read the whole posting — now see how you match it.

Evaluate my fit