AI Phone - On-device AI / ML Systems Engineer
Remote · USFull-timePosted todayStill listed today
Most applications go out cold — see where you stand first. No sign-up to start.
You apply on the employer's site, with no Olive account needed.
Watch jobs like this. New remote roles like this one, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
Bjak is building proactive AI applications and devices for everyday conversations, coordination, and workflows. The AI Phone engineer evaluates and optimizes models for on-device execution, integrates them into Android applications and system services, and develops hybrid local/cloud model routing. The role works with mobile hardware acceleration and AI agent engineers to determine which tasks can run locally and which require cloud inference.
Skills & qualifications
Skills
Full job description
About We are reimagining the phone. AI phones need to be proactive, intuitive, intelligent and low cost. This is a mission critical for rest of the world to adopt intelligence. There are over 5 billion people using everyday applications such as email, messaging, notes, tasks, and calendars, yet most are not AI-native. Our mission is to build proactive applications and devices that bring intelligence into daily conversations, coordination and workflows, with minimal prompting.
Responsibilities
-
Evaluate suitable open-weight and commercially available models for on-device execution.
-
Benchmark model performance on target mobile hardware.
-
Integrate models into Android applications and system services.
-
Optimize inference latency, memory consumption and power usage.
-
Evaluate quantization, compression and model distillation techniques.
-
Work with CPU, GPU and NPU acceleration.
-
Evaluate local model capabilities for different workflows.
-
Build hybrid local/cloud model routing mechanisms.
-
Identify which tasks can be handled locally and which require cloud inference.
-
Work with AI agent engineers to integrate local models into the agent runtime.
Requirements
-
Strong ML systems or inference engineering experience.
-
Experience deploying and optimizing models.
-
Strong Python and C++ skills.
-
Understanding of neural network inference.
-
Experience with model quantization and performance optimization.
-
Understanding of hardware constraints and inference benchmarks.
Nice to have
-
Experience with on-device LLMs.
-
Qualcomm QNN, MediaTek NeuroPilot or similar acceleration frameworks.
-
ONNX Runtime, LiteRT, TensorFlow Lite or ExecuTorch.
-
Android NDK.
-
Mobile or edge AI deployment.
-
Multimodal model optimization.
How this job compares
Set against the 616 open AI Systems Engineer jobs on Olive Jobs, counted November 4, 2026.
- Pay
- This postingNot listed
- US median$107–201K/yr601 salary ranges
- Openings
- Olive Jobs lists 616 open AI Systems Engineer jobs across the US. 42% of them nationwide are listed as remote or flexible.
- Hiring the most across the US
- EY496 open
- Oracle52 open
- Capital One27 open
- Experience
- AI Systems Engineer postings that state a minimum ask for 8 years of experience at the median (603 postings).
- Education
- 212 of the 616 open AI Systems Engineer jobs (34%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on November 4, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.