Ultravox.ai logo

Research Engineer / Scientist, Speech Understanding

Ultravox.ai

Location not statedJobPosted 1y agoStill listed 2 days ago

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this.

At a glance

Compensation
No compensation found
Location
Location not stated
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

Ultravox.ai, a Seattle-based AI startup, seeks a Research Engineer & Scientist to lead foundational multimodal speech understanding research. The role involves developing next‑generation speech‑to‑speech models, building tools for data pipelines, and optimizing deployments, while collaborating closely with researchers, engineers, and product teams.

Skills & qualifications

RequiredNice to have

Skills

Real Time SystemsData AnalysisCollaborationLarge Language ModelsSpeech ModelsMultimodal ModelsPythonPyTorchAI ResearchCommunicationTeamwork

Benefits

Paid Time Off
Medical Insurance
401(k) Match

Full job description

About Fixie We’re a Seattle-based AI startup (with support for working remotely). We’ve raised $17M in seed funding. Our vision is simple: build artificial intelligences that can communicate as naturally as humans. We’re a small team of researchers and engineers with a deep focus in speech and real-time technologies. Our core model, Ultravox, is open-source. We also build a serving stack that’s optimized for very low-latency interactions. The Role As a Research Engineer & Scientist working on foundational multimodal models, you will lead the effort to develop the next-generation speech understanding capabilities for Ultravox, our open-source speech-to-speech model. What you’ll do

  • Lead critical research on speech understanding in both pre-training and post-training stages, addressing core challenges in linguistic and paralinguistic comprehension of human speech.

  • Collaborate with a team of researchers and engineers to develop foundational multimodal models with comprehensive capabilities in speech understanding, speech generation, and full-duplex real-time communication.

  • Develop novel models based on public and proprietary data sources.

  • Build tools to improve our data flywheel and measure model quality.

  • Drive the optimization and deployment of AI models for real-world applications in partnership with engineering and product teams. Things we’re looking for

  • An incredibly strong AI researcher with a track record of contributions to AI research, systems, and products.

  • Experience with large language models, speech models, and multimodal models.

  • Strong experience in Python and, ideally, PyTorch.

  • Ability to roll up your sleeves and get things done.

  • A great communicator and team player. Benefits

  • Generous equity package

  • Unlimited PTO (take time when you need it)

  • Top-of-market salary

  • Great healthcare

  • 401k with match Apply

Similar jobs, posted recently

Open roles like this one, listed in the last 30 days.

You've read the whole posting — now see how you match it.