Josh Orum logo

Staff Applied AI Engineer

Josh Orum

San Francisco, CARemoteFull-timeNo compensation foundPosted 3mo agoVerified open 6 days ago

Most applications go out cold — see where you stand first. No sign-up to start.

At a glance

Compensation
No compensation found
Location
San Francisco, CARemote
Schedule
Full-time
Work Authorization
Not specified

Job overview

Josh Orum is hiring a Staff Applied AI Engineer. Orum is seeking a Staff Applied AI Engineer to lead the design and delivery of AI-powered product features. This role involves building LLM-based systems for coaching insights and real-time recommendations, architecting low-latency and large-scale AI use cases, and defining AI/ML best practices. The engineer will partner with Product and Engineering to identify high-impact AI opportunities and mentor other engineers.

Key focus areas include Lead the design and delivery of AI-powered product features from idea to production, Build LLM-based systems for coaching insights and real-time recommendations during calls, and Architect systems that support low latency and large-scale AI use cases.

Successful candidates bring 7+ Years Software Engineering Experience. Important skills include AI-Powered Product Features Design, LLM-Based Systems Building, Low Latency AI Systems Architecture, Large-Scale AI Use Cases Architecture, AI Best Practices Definition, and ML Best Practices Definition. Preferred (not required): Real-Time Systems, Event-Driven Architecture, Speech, and NLP.

Skills & qualifications

RequiredNice to have

Skills

AI-Powered Product Features DesignLLM-Based Systems BuildingLow Latency AI Systems ArchitectureLarge-Scale AI Use Cases ArchitectureAI Best Practices DefinitionML Best Practices DefinitionAI Best Practices ImplementationML Best Practices ImplementationHigh-Impact AI Opportunities IdentificationScalable Data Pipeline BuildingFeature Pipeline BuildingModel Performance EvaluationModel Performance MonitoringModel Performance Feedback LoopsApplied AI Engineering Practices MentoringShipping AI Systems Into ProductionShipping ML Systems Into ProductionML Pipelines BuildingML Pipelines DeployingLLMsPromptingRAGEmbeddingsAgentsDomain-Specific Models TrainingDomain-Specific Models Fine-TuningSystem DesignScalable AI Systems BuildingReliable AI Systems BuildingLarge-Scale Data SystemsOperating in AmbiguityTechnical Direction DrivingProduct MindsetReal-Time SystemsEvent-Driven ArchitectureSpeechNLPConversational AICustomer-Facing AI Products BuildingBigQueryClickHouse

Qualifications

7+ Years Software Engineering ExperienceStrong Hands-on AI ExperienceStrong Hands-on ML Experience

Full job description

About Orum

Orum ’s AI-powered suite frees salespeople to do what they do best: connect, listen, and sell. Our products gives sales teams everything they need to connect faster, sell smarter, and grow revenue. From intelligent dialing and real-time conversation insights to AI-driven coaching and virtual sales floors, Orum is powering thousands of sales teams to have more meaningful conversations and turn every call into measurable impact. Companies who use Orum connect 5x faster and book millions in new pipeline every month.

We are a team of builders and dreamers creating a future where work feels more meaningful and connected. If you’re excited to change how the world sells, join us. For more information, visit https://www.orum.com/

What You’ll Do

  • Lead the design and delivery of AI-powered product features from idea to production

  • Build LLM-based systems for coaching insights and real-time recommendations during calls

  • Architect systems that support low latency and large-scale AI use cases

  • Define and implement AI and ML best practices across the engineering org

  • Partner with Product and Engineering to identify high-impact AI opportunities

  • Build scalable data and feature pipelines to support AI use cases

  • Establish evaluation, monitoring, and feedback loops to improve model performance

  • Mentor engineers and raise the bar on applied AI engineering practices

What You’ll Work On

  • AI-driven coaching and insights from call transcripts

  • Real-time intelligence during calls, such as next best action and signals

  • Prospect enrichment and intelligent data augmentation

  • Internal AI tools to improve engineering and product velocity

What We’re Looking For

  • 7+ years of software engineering experience with strong hands-on AI and ML experience

  • Proven track record of shipping AI and ML systems into production

  • Experience building and deploying ML pipelines for training, inference, monitoring, and continuous improvement

  • Deep experience with LLMs and modern AI tooling, including prompting, RAG, embeddings, and agents

  • Experience training and fine-tuning models for domain-specific use cases

  • Strong system design skills and ability to build scalable, reliable AI systems

  • Experience working with large-scale data systems such as pipelines, warehouses, or streaming

  • Ability to operate in ambiguity and drive technical direction independently

  • Strong product mindset focused on customer impact

Nice to Have

  • Experience with real-time or event-driven systems

  • Background in speech, NLP, or conversational AI

  • Experience building customer-facing AI products

  • Familiarity with modern data platforms such as BigQuery or ClickHouse

  • Experience building AI systems on top of scalable data platforms

Why This Role Matters

  • You will play a key role in defining our AI strategy and execution

  • Your work will unlock value from our data and enable AI-driven product innovation

  • You will have a broad impact across multiple teams and domains

What Success Looks Like

  • High-impact AI features shipped and adopted by customers

  • Real-time AI capabilities integrated into core product workflows

  • Clear technical direction for applied AI across teams

  • Measurable improvements in product outcomes such as conversion, call quality, and coaching effectiveness

Orum Is An Equal Opportunity Employer

We're committed to continually adding to our diverse team that represents various backgrounds, perspectives, and skills. We do not discriminate based on race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. If you need assistance or accommodation due to a disability, you may contact us at [email protected]. In short, we want you to join in on the ride if you're talented for one of our roles, with no other qualifiers.

You've read the whole posting — now see how you match it.