Yammer logo

Principal Applied Scientist

Yammer

Redmond, WAJobPosted 2 days agoStill listed 2 days ago

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this.

At a glance

Compensation
No compensation found
Location
Redmond, WA
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

The Principal Applied Scientist advances applied AI research into production-ready solutions and builds scalable agentic AI systems. The role focuses on improving planning, memory, grounding, reasoning, and task completion through experimentation, fine-tuning, and modern retrieval and agent architectures. It also includes production evaluation and operations, cross-disciplinary collaboration, and technical leadership. The posting seeks extensive experience applying NLP and LLMs to real-world production problems.

Skills & qualifications

RequiredNice to have

Skills

Generative AIDeep LearningNatural Language ProcessingMultimodal ModelsLarge Language ModelsPrompt EngineeringRetrieval-Augmented GenerationMulti-Step ReasoningChunking StrategiesEmbedding SelectionVector DatabasesIndexing StrategiesSimilarity MetricsRetrieval OptimizationAIOpsMLOpsMonitoringLoggingDebuggingPythonPyTorchTensorFlowModel ServingModel InferenceApplied ExperimentationMetric AnalysisCloud TechnologyParameter-Efficient Fine-TuningLoRAAgentic SystemsFunction CallingPlanningAPI IntegrationTool IntegrationHybrid RetrievalRerankingGroundingCitation StrategiesDrift DetectionAlerting

Qualifications

Bachelor's or Related FieldMaster's or Related FieldDoctorate or Related FieldEquivalent ExperiencePhD in CS, ML, AI, NLP or RelatedMS With Significant Experience8+ Years Related Experience6+ Years Related Experience5+ Years Related Experience10+ Years NLP or LLM ExperienceProduction-Grade LLM ExperienceProduction Operations Experience

Full job description

Advance Applied AI Research to Improve Quality and Reliability Apply deep expertise in Generative AI, deep learning, NLP, and multimodal models to translate cutting-edge research into high-impact, production-ready AI solutions. Design and execute experiments that measurably improve agent planning, memory, grounding, reasoning, and long‑horizon task completion. Perform lightweight fine‑tuning (e.g., LoRA and related techniques) on multimodal and large multimodal language models—to improve entity recognition, reasoning accuracy, and response quality. Implement state‑of‑the‑art approaches using foundation models, advanced prompt engineering, RAG, knowledge graphs, and multi‑agent architectures, complemented by classical ML techniques where appropriate. Build and Ship Scalable Agentic AI Systems Architect and implement end‑to‑end agent workflows that decompose user intent into executable plans, intelligently select and invoke tools, and recover gracefully from errors and edge cases. Design robust multi‑step reasoning and tool‑use strategies, including function calling, code execution, APIs, and secure connectors, with strong safety and reliability guardrails. Build and maintain offline and online evaluation pipelines, including: Collaborate Across Disciplines and Lead Technical Execution Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 8+ years related experience (e.g., statistics, predictive analytics, research) OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 5+ years related experience (e.g., statistics, predictive analytics, research) OR equivalent experience PhD in Computer Science, Machine Learning, AI, NLP, or related field,OR MS with significant experience delivering production‑grade AI systems. 10+ years of hands‑on experience applying NLP, and/or LLMs to real‑world production problems. Strong foundation in Large Language Models (LLMs), Generative AI, deep learning, and modern NLP. Proven experience building production‑grade LLM systems, including prompt engineering, RAG, and multi‑step reasoning pipelines. Solid expertise in chunking strategies and embedding selection, including tradeoffs in retrieval quality, context size, and downstream task performance. Experience designing and operating vector databases, including indexing strategies, similarity metrics, and retrieval optimization. Experience supporting production operations (AIOps/MLOps), including monitoring, logging, quality metrics, and debugging live systems. Proficiency in Python and experience with modern ML frameworks (e.g., PyTorch, TensorFlow) and model serving/inference. Strong applied experimentation skills: defining metrics, analyzing results, and iterating based on data. Ability to collaborate effectively with engineering, product, and business stakeholders. Experience with Cloud technology Stack Experience with parameter‑efficient fine‑tuning techniques (e.g., LoRA) for LLMs or multimodal models. Hands‑on experience building agentic or tool‑augmented LLM systems, including function calling, planners, and API/tool integration. Experience with advanced RAG architectures, such as hybrid retrieval, reranking, grounding, and citation strategies. Strong AIOps depth, including quality drift detection, alerting, rollback, and telemetry‑driven optimization. Experience optimizing systems for latency, reliability, scalability, and cost efficiency at enterprise scale. Prior experience working on mission‑critical or large‑scale enterprise AI systems. Demonstrated mentorship or technical leadership within applied science or engineering teams.

Similar jobs, posted recently

Open roles like this one, listed in the last 30 days.

You've read the whole posting — now see how you match it.