Vinci4D.ai logo

Member of Technical Staff - Foundation Model Architecture & AI Infrastructure

Vinci4D.ai

Palo Alto, CAHybridFull-time$100–220K/yrPosted 6mo agoVerified open 5 days ago

Most applications go out cold — see where you stand first. No sign-up to start.

At a glance

Compensation
$100–220K/yr
Location
Palo Alto, CAHybrid
Schedule
Full-time
Work Authorization
Not specified

Job overview

Vinci4D.ai is hiring a Member of Technical Staff - Foundation Model Architecture & AI Infrastructure. Vinci is building operator intelligence infrastructure that powers hardware programs, and this full‑time role focuses on AI architecture and systems engineering to design transformer variants, scale distributed training, and architect trillion‑scale inference for industrial‑scale deployment.

Key focus areas include Design and refine transformer variants for structured spatial domains, Explore sparse and locality‑aware attention mechanisms, and Build hierarchical attention across multi‑resolution fields.

Successful candidates bring Deep Experience In Large-Scale Foundation Model Architecture, Transformer Variants Sparse Hierarchical Graph-Based, and Distributed Training Systems. Important skills include Large-Scale Foundation Model Architecture, Transformer Variants, Distributed Training Systems, Production ML System Design, Scaling Structured Datasets, and Writing Clean, Maintainable, High-Quality Code.

Skills & qualifications

RequiredNice to have

Skills

Large-Scale Foundation Model ArchitectureTransformer VariantsDistributed Training SystemsProduction ML System DesignScaling Structured DatasetsWriting Clean, Maintainable, High-Quality CodeArchitectural GeneralizationStability Under Nonlinear RegimesCommunication vs Computation TradeoffsDeterministic Distributed ExecutionDesigning Durable Infrastructure SystemsBuilding AI Systems in ProductionStrong Software Engineering FundamentalsClean AbstractionsScalable Code DesignPyTorchDistributed Training EcosystemsStrong CIRegression TestingValidation DisciplineEvolving Core Model Infrastructure

Qualifications

Deep Experience in Large-Scale Foundation Model ArchitectureTransformer Variants Sparse Hierarchical Graph-BasedDistributed Training SystemsProduction ML System DesignScaling Structured DatasetsWriting Clean Maintainable High-Quality CodeStrong Software Engineering FundamentalsClean Abstractions and Scalable Code DesignExperience With Modern ML StacksStrong CI Regression Testing and Validation DisciplineComfort Evolving Core Model Infrastructure

Full job description

Member of Technical Staff - Foundation Model Architecture & AI Infrastructure Vinci | Full-Time | Remote / Hybrid

The Mission At Vinci, we are building the operator intelligence infrastructure that modern hardware programs rely on daily. We have already proven that a single foundation model works out of the box across industries on realistic production workloads.

  • Trained on 45TB+ of structured physics data

  • Running billion-voxel inference in production

  • Deployed inside Tier-1 semiconductor and hardware environments

  • Operating across multiple physical scales and operator regimes

This is not a research prototype. This is production infrastructure. Now we are scaling deployment at industrial magnitude:

  • Increase simulation throughput by two orders of magnitude

  • Move from billion-voxel to trillion-voxel domains

  • Expand operator coverage across nonlinear regimes

  • Support global, multi-entity deployment across Tier-1 ecosystems

Our ambition is not to become a frontier AI lab. Our ambition is to become the default operator intelligence layer that hardware companies run on.

The Operator Frontier Today, our unified model already operates across a subset of partial differential equations in real industrial environments. The next phase is expanding that unified architecture across operators, including:

  • Maxwell’s equations

  • Elasticity

  • Plasticity

  • Navier–Stokes

  • Nonlinear constitutive systems

  • Coupled multiphysics interactions

We are not building separate models per equation. We are evolving a single operator foundation model that generalizes across industries, physical scales, and conditioning regimes - and scales in deployment volume.

What You Will Own This role is about AI architecture and systems engineering - not low-level GPU kernel work. You will help define and scale the core operator intelligence layer.

Evolve the Foundation Architecture

  • Design and refine transformer variants for structured spatial domains

  • Explore sparse and locality-aware attention mechanisms

  • Build hierarchical attention across multi-resolution fields

  • Develop graph-transformer systems for multi-entity interactions

  • Improve modeling depth across nonlinear operator regimes

This is architectural ownership.

Scale Training & Continuous Learning

  • Expand distributed training beyond 45TB-scale datasets

  • Improve generalization across heterogeneous operator distributions

  • Design scalable data and curriculum strategies

  • Maintain reproducibility and determinism across distributed systems

  • Build feedback loops from deployed production environments

The system must grow in capability without fragmenting in design.

Architect Trillion-Scale Inference

Billion-voxel inference runs today. You will help design systems that:

  • Scale to trillion-voxel domains

  • Use sparse and hierarchical computation effectively

  • Balance memory, compute, and communication

  • Maintain production-grade stability and determinism

Throughput and reliability matter equally.

Ship at Industrial Scale

Our models already run inside Tier-1 hardware programs. You will:

  • Ship expanded operator capabilities into production

  • Increase simulations per day by 100×

  • Support global, multi-entity deployment

  • Maintain robustness under diverse industrial workloads

Success is measured by adoption, throughput, and reliability — not leaderboard metrics.

What We’re Looking For Deep experience in:

  • Large-scale foundation model architecture

  • Transformer variants (sparse, hierarchical, graph-based)

  • Distributed training systems

  • Production ML system design

  • Scaling structured datasets

  • Writing clean, maintainable, high-quality code

You think in terms of:

  • Architectural generalization

  • Stability under nonlinear regimes

  • Communication vs computation tradeoffs

  • Deterministic distributed execution

  • Designing systems that become durable infrastructure

You’ve built AI systems that run in production — not just experiments.

Engineering Expectations

  • Strong software engineering fundamentals

  • Clean abstractions and scalable code design

  • Experience with modern ML stacks (e.g., PyTorch and distributed training ecosystems)

  • Strong CI, regression testing, and validation discipline

  • Comfort evolving core model infrastructure

This role is about building infrastructure that lasts.

Why Vinci

  • Single model already deployed across industries

  • 45TB+ structured training data

  • Billion-voxel inference in production

  • Tier-1 customers operating on real hardware workflows

  • High ownership at Series A stage

  • Opportunity to define a foundational abstraction layer early

We are building something that hardware companies will depend on daily. If you want to define and scale the operator intelligence layer that industry runs on — this role was built for you.

You've read the whole posting — now see how you match it.