
Software Engineer - Evaluation
Fremont, CAJob$120–200K/yrSeen 2mo agoSeen in employer's feed 3 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near Fremont, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Requirements
Credentials this posting asks for.
Job overview
pony.ai is hiring a Software Engineer - Evaluation. Pony.ai, a leading autonomous mobility company founded in 2016, develops safe autonomous driving technologies across robotaxi, robotruck, and personally owned vehicle units, with a global footprint and over 21 million miles driven, and seeks a Software Engineer to design, implement, and evaluate AI-driven systems and large‑scale data pipelines.
Key focus areas include Design and implement algorithms and evaluation metrics to drive core AI decision‑making., Build scalable data pipelines and toolchains for large‑scale data ingestion, batch processing, and evaluation., and Design system‑level evaluation metrics, testing frameworks, and simulation environments across business components..
Important skills include C/C++, Python, Software Design, Mathematics, Theoretical Computer Science, and Linear Algebra.
Skills & qualifications
Skills
Qualifications
Benefits
Full job description
Founded in 2016 in Silicon Valley, Pony.ai has quickly become a global leader in autonomous mobility and is a pioneer in extending autonomous mobility technologies and services at a rapidly expanding footprint of sites around the world. Operating Robotaxi, Robotruck and Personally Owned Vehicles (POV) business units, Pony.ai is an industry leader in the commercialization of autonomous driving and is committed to developing the safest autonomous driving capabilities on a global scale. Pony.ai’s leading position has been recognized, with CNBC ranking Pony.ai #10 on its CNBC Disruptor list of the 50 most innovative and disruptive tech companies of 2022. In June 2023, Pony.ai was recognized on the XPRIZE and Bessemer Venture Partners inaugural “XB100” 2023 list of the world’s top 100 private deep tech companies, ranking #12 globally. As of August 2023, Pony.ai has accumulated nearly 21 million miles of autonomous driving globally. Pony.ai went public at NASDAQ in November 2024.
Responsibility
-
Design and implement algorithms and evaluation metrics to drive core AI decision-making.
-
Build scalable data pipelines and toolchains for large-scale data ingestion, batch processing, and evaluation.
-
Design system-level evaluation metrics, testing frameworks, and simulation environments across business components.
-
Design and implement high-performance backend services and distributed architectures , capable of handling large-scale real-time event processing.
-
Establish and maintain comprehensive system monitoring, fine-grained observability metrics, and automated alerting frameworks to ensure low latency and reliable production operations.
-
Build and optimize downstream engineering workflows for Large Language Models (LLMs), programmatically steering model reasoning, establishing guardrails, and mitigating hallucinations to ensure reliable outputs.
Requirements
-
Strong programming skills in C/C++, Python, and software design
-
Strong foundation in mathematics and theoretical computer science, such as linear algebra, calculus, graph theory, computational geometry, combinatorial optimization algorithms, stochastic processes, and complexity analysis.
-
Possessing solid engineering discipline, or demonstrating strong interest and potential in building large-scale systems, with the ability to maximize performance while keeping complexity and cost to a minimum.
-
BS/MS or Ph.D in Computer Science or a related field
Compensation and Benefits
Base Salary Range: $120,000 - $200,000 Annually
Compensation may vary outside of this range depending on many factors, including the candidate’s qualifications, skills, competencies, experience, and location. Base pay is one part of the Total Compensation and this role may be eligible for bonuses/incentives and restricted stock units.
Also, we provide the following benefits to eligible employees:
-
Health Care Plan (Medical, Dental & Vision)
-
Retirement Plan (Traditional and Roth 401k)
-
Life Insurance (Basic, Voluntary & AD&D)
-
Paid Time Off (Vacation & Public Holidays)
-
Family Leave (Maternity, Paternity)
-
Short Term & Long Term Disability
-
Free Food & Snacks
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
Senior Software Engineer - ML Tooling and EvaluationGeneral Motors · Sunnyvale, CA (Hybrid) · $145–261K/yrPosted 1w agoPosted 1w ago
Software Engineer, AI Infrastructure - LVM Inference & EvaluationAmbient.ai · Redwood City, CA (Hybrid) · $168–205K/yrPosted 3w agoPosted 3w ago
Senior Software Engineer, Metrics and Evaluation - Autonomous VehiclesNVIDIA · Santa Clara, CA · $184–288K/yrPosted 4 days agoPosted 4 days ago
2027 Summer Intern, MS/PhD, Software Engineer, Simulation Evaluation ML ModelWaymo · Mountain View, CA (Hybrid) · $70/hrPosted 1w agoPosted 1w ago
Senior Software Systems Engineer, Autonomous Vehicles - Metrics & EvaluationGeneral Motors · Sunnyvale, CA (Hybrid) · $153–234K/yrPosted 3w agoPosted 3w ago
You've read the whole posting — now see how you match it.