Skip to main content
Majestic Labs ai logo

AI Kernel Engineer

Majestic Labs ai

Los Altos, CAFull-timePosted 1w agoStill listed · checked in the last 2 days

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
No compensation found
Location
Los Altos, CA
Schedule
Full-time
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Job overview

Majestic Labs ai is building custom AI servers for large-scale inference and training. The AI Kernel Engineer designs and optimizes high-performance compute kernels, integrates them into compiler and runtime pipelines, and evaluates precision formats. The role also involves profiling workloads and collaborating with compiler, runtime, and hardware teams on kernel integration and hardware co-design.

Skills & qualifications

RequiredNice to have

Skills

Parallel Computing, nice to haveNvidia CUDA, nice to haveTrident, nice to havePOSIX Threads, nice to haveOpenMP, nice to havePerformance Analysis, nice to haveC++14, nice to haveParallel Programming, requiredCUDA, requiredTriton, requiredRISC-v Vector, requiredMemory Layout, requiredVectorization, requiredThread Scheduling, requiredCache Behavior, requiredSIMD Programming, requiredMatrix Engine Programming, requiredBLAS/BLIS, requiredDense Linear Algebra, requiredParallel Scan/Reduce/Sort, requiredParallel Debugging, requiredGNU Debugger, requiredNsight, requiredWorkload Profiling, requiredWorkload Optimization, requiredNumerical Stability, requiredMixed Precision Arithmetic, requiredC++17, requiredStandard Algorithms, requiredData Structures, requiredGeneric Programming, requiredCollaboration, requiredIrregular Algorithm Optimization, nice to haveGraph Computations, nice to haveSparse Numerical Linear Algebra, nice to haveLLVM/MLIR, nice to haveRISC-v Systems, nice to haveBare-Metal Programming, nice to haveRISC-v Vector and Matrix Extensions, nice to have

Qualifications

Degree in Computer Science, Computer Engineering, or Related Field, required

Full job description

AI Kernel Engineer

  • Engineering
  • Los Altos, California
  • Senior
  • Full-time

Description

We’re a fast-moving, US-Israeli AI startup building next-generation infrastructure for the world’s most demanding AI workloads. Our mission is to accelerate the future of intelligence and make it ubiquitously accessible by delivering full stack custom AI servers optimized for large-scale inference and training. Backed by top-tier investors and led by industry veterans, we’re scaling rapidly. We seek forward-thinking engineers and operators who thrive in a collaborative environment and excel at solving complex challenges from first principles. If you want to build infrastructure that fundamentally changes what the world can accomplish with AI, come join us!

About the position

  • Design and implement high-performance compute kernels for AI primitives such as GEMM, attention, normalization, and convolution.
  • Optimize for throughput, latency, and memory hierarchy across heterogeneous compute units (SIMD, matrix engines, DMA).
  • Collaborate with compiler and runtime teams to integrate kernels into Triton and PyTorch pipelines.
  • Profile and tune kernels using tools like Perfetto, VTune, Tracy, Nsight, or custom simulators.
  • Prototype and evaluate precision formats (FP16/BF16/FP8/e5m2, MXFP/FP4, etc.).
  • Contribute to micro-architecture feedback loops, helping co-design ISA and memory features with the hardware team.

Requirements

  • Degree at any level in Computer Science, Computer Engineering, or a related field from a recognized university.
  • Strong background in parallel programming (CUDA, Triton, RISC-V Vector (RVV), POSIX Threads, or OpenMP).
  • Deep understanding of memory layout, vectorization, thread/block scheduling, and cache behavior.
  • Experience programming wide-SIMD vector units and matrix/systolic engines.
  • Familiarity with the parallel-computing ecosystem and its high-performance libraries and
  • primitives, such as BLAS/BLIS, dense linear algebra, and parallel scan/reduce/sort.
  • Skilled in performance analysis and parallel debugging using tools such as GNU Debugger and Nsight.
  • Hands-on experience profiling and optimizing compute or AI workloads (e.g., GEMM, softmax, attention).
  • Solid grasp of numerical stability, precision formats, and mixed precision arithmetic.
  • Proficiency in C++17 or higher, with strong knowledge of standard algorithms, data structures, and generic programming paradigms.
  • Collaborative work style with the ability to operate effectively in multicultural, cross-disciplinary environments.

Preferred qualifications

  • Experience with optimization of irregular algorithms, such as graph computations or sparse
  • numerical linear algebra, combining high-level data structure design with low-level SIMD and synchronization optimizations.
  • Familiarity with LLVM/MLIR.
  • RISC-V systems or bare-metal programming, including RISC-V vector and matrix extensions.

We seek smart, curious, self-driven individuals who enjoy creative problem-solving and continuous learning. Even if you don't meet all requirements, we'd love to hear from you if you have the mindset to tackle complex challenges. Majestic Labs is an equal opportunity employer deeply committed to diversity of background and thought. If you are ready to dare greatly, learn from mistakes, engage in vigorous debates, and help create a step-function shift in human technical capability, we want to meet you!

How this job compares

Set against the 36,944 open Software Engineer jobs on Olive Jobs, counted November 20, 2026.

Pay
  • This postingNot listed
  • California median$161–243K/yr6,680 salary ranges
  • California median$48–67/hr122 hourly ranges
Openings
Olive Jobs lists 8,260 open Software Engineer jobs in California and 36,944 across the US. 8% of them nationwide are listed as remote or flexible.
Hiring the most in California
Experience
Software Engineer postings that state a minimum ask for 5 years of experience at the median; the middle half ask for 3 to 7 years (30,715 postings).
Education
10,966 of the 36,944 open Software Engineer jobs (30%) ask for a bachelor's degree or higher.

Pay, requirements and demand for Software Engineer jobs

Counted across the open, public US postings on Olive Jobs on November 20, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.