Quadric logo

AI Kernel Engineer

Quadric

Burlingame, CARemoteFull-timeNo compensation foundPosted 7mo agoVerified open 5 days ago

Most applications go out cold — see where you stand first. No sign-up to start.

At a glance

Compensation
No compensation found
Location
Burlingame, CARemote
Schedule
Full-time
Work Authorization
Not specified

Requirements

Credentials this posting asks for.

Bachelor's degree

Job overview

Quadric is hiring an AI Kernel Engineer. The AI Kernel Engineer at Quadric plays a key role in enabling efficient execution of AI kernels/operators on the Quadric platform. This senior technical position involves developing a highly efficient Quadric kernel library for various AI/LLM models, analyzing performance, and optimizing kernels for different hardware configurations. The role demands deep knowledge of hardware architecture, compiler toolchains, and optimization techniques.

Key focus areas include Develop AI/LLM kernels/operators on Quadric platform for efficient inference, Optimize kernel performance for different hardware configurations and workloads, and Profile and analyze kernel performance in terms of compute, data and parallelism.

Successful candidates bring Bachelor's Or Master's In Computer Science Or Electric Engineering, AI Kernel Development And Optimization, and Model And Kernel Inference Performance Profiling. Important skills include AI Kernel Development, Kernel Optimization, Hardware Architecture, Compiler Toolchain, Optimization Techniques, and AI/LLM Kernels/Operators Development. Preferred (not required): Assembly.

Skills & qualifications

RequiredNice to have

Skills

AI Kernel DevelopmentKernel OptimizationHardware ArchitectureCompiler ToolchainOptimization TechniquesAI/LLM Kernels/Operators DevelopmentKernel Performance ProfilingMicro-Architecture AnalysisSoftware Bottleneck IdentificationC/C++ OptimizationHardware Utilization MaximizationToolchain ImprovementCompiler ImprovementRuntime ImprovementTechnical SupportDocumentationCUDADSPNEONTriton-LangPythonProblem SolvingDebugCommunicationAssembly

Qualifications

Bachelor's in Computer Science and/or Electric Engineering5+ Years AI Kernel Development and Optimization Experience

Benefits

Medical Insurance
Dental Insurance
Vision Insurance
401(k) Match
Paid Time Off
Parental Leave

Full job description

Quadric has created an innovative general purpose neural processing unit (GPNPU) architecture. Quadric's co-optimized software and hardware is targeted to run neural network (NN) inference workloads in a wide variety of edge and endpoint devices, ranging from battery operated smart-sensor systems to high-performance automotive or autonomous vehicle systems. Unlike other NPUs or neural network accelerators in the industry today that can only accelerate a portion of a machine learning graph, the Quadric GPNPU executes both NN graph code and conventional C++ DSP and control code.

Role:

The AI Kernel Engineer in Quadric plays the key role to enable a large number of AI kernels/operators to run efficiently on the Quadric platform. The AI Kernel Engineer at Quadric will [1] develop a highly efficient Quadric kernel library for a variety of AI/LLM models; [2] analyze the performance and optimize the kernel for different hardware configurations; This senior technical role demands deep knowledge of hardware architecture, compiler toolchain and optimization techniques.

Responsibilities:

  • Develop AI/LLM kernels/operators on Quadric platform for efficient inference
  • Optimize the kernel performance for different hardware configurations and workloads
  • Profile and analyze kernel performance in terms of compute, data and parallelism; identify micro-architecture and software bottlenecks and provide optimization solutions
  • Optimize kernel C/C++ codes, maximize hardware utilization
  • Make Improvement to Quadric toolchain, compiler and runtime
  • Provide technical support and documents to customers and developer community
  • Bachelor’s or Master’s in Computer Science and/or Electric Engineering.
  • 5+ years of experience in AI kernel development and optimization
  • experience with model and kernel inference performance profiling
  • experience with at least one of the following compute development: CUDA, DSP, NEON, Triton-lang
  • Proficiency in C/C++ and Python, experience with assembly language a plus
  • Demonstrate good capability in problem solving, debug and communication
  • Health Care Plan (Medical, Dental & Vision)
  • Retirement Plan (401k, IRA)
  • Life Insurance (Basic, Voluntary & AD&D)
  • Paid Time Off (Vacation, Sick & Public Holidays)
  • Family Leave (Maternity, Paternity)
  • Short Term & Long Term Disability
  • Training & Development
  • Work From Home
  • Free Food & Snacks
  • Stock Option Plan

You've read the whole posting — now see how you match it.