Skip to main content
Beacon AI logo

Staff Software Engineer, Cloud Infrastructure

Beacon AI

San Carlos, CA · HybridFull-time$224–260K/yrPosted 1mo agoStill listed · checked in the last 2 days

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
$224–260K/yr
Location
San Carlos, CAHybrid
Schedule
Full-time
Work Authorization
Work authorization required

Olive focuses on jobs in the United States, including remote roles you can work from there.

Job overview

Beacon AI seeks a Staff Software Engineer, Cloud Infrastructure to lead the design, implementation, and operation of AWS and LLM platforms. The role involves building scalable, reliable, and secure cloud services, managing CI/CD pipelines, and integrating AI-driven workflows, while collaborating closely with product and engineering teams in a hybrid San Carlos environment.

Skills & qualifications

RequiredNice to have

Skills

AWS, nice to haveInfrastructure as Code, nice to haveAWS CDK, nice to haveTerraform, nice to haveGitHub Actions, nice to haveCodeBuild, nice to haveCodePipeline, nice to haveVPC, nice to havePrivateLink, nice to haveIAM, nice to haveKMS, nice to haveSecrets Manager, nice to haveBedrock, nice to haveSageMaker, nice to haveECS, nice to haveEKS, nice to haveLambda, nice to haveBatch, nice to haveLangChain, nice to haveStep Functions, nice to haveAirflow, nice to haveOpenSearch Serverless, nice to haveAurora PostgreSQL, nice to havePgvector, nice to havePinecone, nice to haveS3, nice to haveGlacier, nice to haveAthena, nice to haveGlue, nice to haveLake Formation, nice to haveOpenTelemetry, nice to haveCloudWatch, nice to haveRedis, nice to havePython, nice to haveEventBridge, nice to haveSQS, nice to haveDevOps, nice to haveDevSecOps, nice to haveTriton Inference Server, nice to haveTensorRT‑LLM, nice to have

Benefits

Medical Insurance
Paid Time Off
401(k) Match

Full job description

About Beacon AI We’re a fast-moving team of aviators, engineers, and operators building an AI platform to make flying safer, more efficient, and more capable. Backed by top investors, we’ve secured a dozen Department of Defense contracts and partnered with major airlines to deliver mission-critical systems. We operate without silos or heavy processes. Small, focused teams own what they build, ship quickly, and learn fast, pushing the boundaries of how humans and AI work together in aviation.

Role Overview We are seeking skilled Staff Software Engineers, Cloud Infrastructure to lead the buildout of our AWS foundation and our LLM platform. You will design, implement, and operate services that are scalable, reliable, and secure. The broad scope means focus areas in LLM/ML Infra and IoT infra are strong bonus points. For ML Infra, build the stack that powers retrieval-augmented generation and application workflows built with frameworks like LangChain. Experience with IoT AWS services is a plus. You will work closely with other engineers and product management. The ideal candidate is hands-on, comfortable with ambiguity, and excited to build from first principles.

Key Responsibilities

  • Cloud Infrastructure Setup and Maintenance

  • Design, provision, and maintain AWS infrastructure using IaC tools such as AWS CDK or Terraform.

  • Build CI/CD and testing for apps, infra, and ML pipelines using GitHub Actions, CodeBuild, and CodePipeline.

  • Operate secure networking with VPCs, PrivateLink, and VPC endpoints. Manage IAM, KMS, Secrets Manager, and audit logging.

  • LLM Platform and Runtime

  • Stand up and operate model endpoints using AWS Bedrock and/or SageMaker; evaluate when to use ECS/EKS, Lambda, or Batch for inference jobs.

  • Build and maintain application services that call LLMs through clean APIs, with streaming, batching, and backoff strategies.

  • Implement prompt and tool execution flows with LangChain or similar, including agent tools and function calling.

  • RAG Data Systems and Vector Search

  • Design chunking and embedding pipelines for documents, time series, and multimedia. Orchestrate with Step Functions or Airflow.

  • Operate vector search using OpenSearch Serverless, Aurora PostgreSQL with pgvector, or Pinecone. Tune recall, latency, and cost.

  • Build and maintain knowledge bases and data syncs from S3, Aurora, DynamoDB, and external sources.

  • Evaluation, Observability, and Cost Governance

  • Create offline and online eval harnesses for prompts, retrievers, and chains. Track quality, latency, and regression risk.

  • Instrument model and app telemetry with CloudWatch and OpenTelemetry. Build token usage and cost dashboards with budgets and alerts.

  • Add guardrails, rate limits, fallbacks, and provider routing for resilience.

  • Safety, Privacy, and Compliance

  • Implement PII detection and redaction, access controls, content filters, and human-in-the-loop review where needed.

  • Use Bedrock Guardrails or policy services to enforce safety standards. Maintain audit trails for regulated environments.

  • Data Pipeline Construction

  • Build ingestion and processing pipelines for structured, unstructured, and multimedia data. Ensure integrity, lineage, and cataloging with Glue and Lake Formation.

  • Optimize bulk data movement and storage in S3, Glacier, and tiered storage. Use Athena for ad-hoc analysis.

  • IoT Deployment Management

  • Manage infrastructure that deploys to and communicates with edge devices. Support secure messaging, identity, and over-the-air updates.

  • Analytics and Application Support

  • Partner with product and application teams to integrate retrieval services, embeddings, and LLM chains into user-facing features.

  • Provide expert troubleshooting for cloud and ML services with an emphasis on uptime and performance.

  • Performance Optimization

  • Tune retrieval quality, context window use, and caching with Redis or Bedrock Knowledge Bases.

  • Optimize inference with model selection, quantization where applicable, GPU/CPU instance choices, and autoscaling strategies.

What Will Make You Successful

  • End-to-End Ownership: Drives work from design through production, including on-call and continuous improvement.

  • LLM Systems Experience: Shipped or operated LLM-powered applications in production. Familiar with RAG design, prompt versioning, and chain orchestration using LangChain or similar.

  • AWS Depth: Strong with core AWS services such as VPC, IAM, KMS, CloudWatch, S3, ECS/EKS, Lambda, Step Functions, Bedrock, and SageMaker.

  • Data Engineering Skills: Comfortable building ingestion and transformation pipelines in Python. Familiar with Glue, Athena, and event-driven patterns using EventBridge and SQS.

  • Security Mindset: Applies least privilege, secrets management, network isolation, and compliance practices appropriate to sensitive data.

  • Evaluation and Metrics: Uses quantitative evals, A/B testing, and live metrics to guide improvements.

  • Clear Communication: Explains tradeoffs and aligns partners across product, security, and application engineering.

Bonus Points

  • 9+ years working with serverless or container platforms on AWS.

  • Experience with vector databases, OpenSearch, or pgvector at scale.

  • Hands-on with Bedrock Guardrails, Knowledge Bases, or custom policy engines.

  • Familiarity with GPU workloads, Triton Inference Server, or TensorRT-LLM.

  • Experience with big data tools for large-scale processing and search.

  • Background in aviation data or other safety-critical domains.

  • DevOps or DevSecOps experience automating CI/CD for ML and app services.

Work Location This is a hybrid role based in San Carlos, CA, with 3+ days per week onsite and the option to work remotely on remaining days. Perks & Benefits (Full-Time Employees)

  • Healthcare: 100%* of employee medical premiums covered; 25% for dependents

  • Time Off: 3 weeks PTO plus 13+ paid company holidays

  • 401(k): Offered (no current employer match, but we are committed to enhancing this benefit in the future)

Due to U.S. export control regulations, we can only hire U.S. Persons (U.S. citizens, Green Card holders, lawful permanent residents, or individuals granted asylum or refugee status). We are unable to provide visa sponsorship or support visa transfers. All work must be performed in the United States.

Beacon AI is an equal opportunity employer and does not discriminate based on race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected characteristic. We prohibit harassment or discrimination of any kind in the workplace and comply with all applicable federal, state, and local employment laws.

How this job compares

Set against the 38,274 open Software Engineer jobs on Olive Jobs, counted November 18, 2026.

Pay
  • This posting$224–260K/yr
  • California median$163–243K/yr6,831 salary ranges
  • US median$131–214K/yr31,198 salary ranges

This range's midpoint, $242K, is 18% above the California median midpoint ($205K) — in the top quarter of Software Engineer salary ranges in California.

Openings
Olive Jobs lists 8,409 open Software Engineer jobs in California and 38,274 across the US. 8% of them nationwide are listed as remote or flexible.
Hiring the most in California
Experience
Software Engineer postings that state a minimum ask for 5 years of experience at the median; the middle half ask for 3 to 7 years (31,727 postings).
Education
11,541 of the 38,274 open Software Engineer jobs (30%) ask for a bachelor's degree or higher.

Pay, requirements and demand for Software Engineer jobs

Counted across the open, public US postings on Olive Jobs on November 18, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.