
AI Infrastructure Engineer
NEW YORK, NYJobSeen 6 days agoSeen in employer's feed 6 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near NEW YORK, NY, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
Fortinet seeks a hands-on AI Infrastructure Engineer to build and operate Linux- and GPU-based infrastructure for AI platforms and performance testing. The role develops benchmarking frameworks, maintains reliable and secure lab and compute environments, and builds internal AI platform services supporting demonstrations, proof-of-concepts, competitive evaluations, and technical sales. It also supports rapid validation of customer requirements and showcases AI solution performance.
Skills & qualifications
Skills
Qualifications
Benefits
Full job description
We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This is a highly hands-on infrastructure, automation, and performance engineering role. You will design and maintain benchmarking frameworks, ensure the reliability and security of lab and compute environments, and develop internal AI platform services that support customer demonstrations, proof-of-concepts, competitive evaluations, and technical sales efforts. Your work will play a key role in helping secure new customer opportunities by enabling rapid validation of customer requirements and showcasing the performance and capabilities of our AI solutions.Key ResponsibilitiesAI Infrastructure & Performance Engineering * Operate, maintain, and enhance automated performance testing services that benchmark throughput, latency, scalability, and resource utilization. * Develop new testing frameworks, automation, and validation methodologies as requirements evolve. * Analyze performance data and recommend improvements to reliability, scalability, and operational efficiency.Server, Hardware & Platform Operations * Deploy, monitor, and optimize Linux servers, GPU clusters, virtualization platforms, and lab hardware. * Support availability and utilization of compute resources for engineering, testing, and AI workloads. * Evaluate and integrate new hardware technologies to improve performance and efficiency.Reliability Engineering & AI Platform Development * Implement monitoring, logging, alerting, failover, and incident response for critical infrastructure. * Develop, deploy, and maintain internal AI server applications and shared compute platforms. * Improve operational efficiency through automation and proactive issue identification; troubleshoot complex system/network/application issues.Laboratory Administration * Support day-to-day lab operations: access control, network administration, resource allocation, and capacity planning. * Contribute to operational standards and best practices for lab governance.Documentation & Knowledge Sharing * Create and maintain technical documentation: benchmarking reports, design notes, and internal runbooks. * Share technical insights and best practices with the broader engineering organization.Required Qualifications (Must-Have) * Hands-on Linux systems administration and infrastructure experience (servers, networking fundamentals, virtualization). * Experience with KVM or containerization (Docker/Kubernetes). * Familiarity with DevOps toolchains (CI/CD, IaC, monitoring/observability stacks). * Strong scripting/automation ability in Python and/or Bash, applied to infrastructure or testing workflows. * Practical experience with GPU-based compute environments or AI/ML infrastructure.Preferred Qualifications * Bachelor's degree in Computer Science, Computer Engineering, or a related field (equivalent experience welcome). * Experience with performance testing, benchmarking, or traffic-generation methodologies. * Exposure to network security concepts and enterprise security technologies. * Experience with Fortinet products (FortiGate, FortiManager, FortiAnalyzer) or similar enterprise security/networking solutions - a plus, not required. * Experience in customer-facing technical work: proof-of-concept support, demos, or technical presentations. * Experience creating technical documentation, white papers, or delivering internal training.Core Competencies * Infrastructure Engineering * AI Platform Development * DevOps & Automation * Performance Testing & Benchmarking * Technical DocumentationFortinet offers employees a variety of benefits, including medical, dental, vision, life and disability insurance, 401(k), 11 paid holidays, vacation time, and sick time as well as a comprehensive leave program. W
How this job compares
Set against the 4,457 open Infrastructure Engineer jobs on Olive Jobs, counted October 27, 2026.
- Pay
- This postingNot listed
- New York median$156–229K/yr212 salary ranges
- US median$48–58/hr108 hourly ranges
- Openings
- Olive Jobs lists 270 open Infrastructure Engineer jobs in New York and 4,457 across the US. 8% of them nationwide are listed as remote or flexible.
- Experience
- Infrastructure Engineer postings that state a minimum ask for 5 years of experience at the median; the middle half ask for 4 to 8 years (3,414 postings).
- Education
- 1,033 of the 4,457 open Infrastructure Engineer jobs (23%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on October 27, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
Agentic AI Infrastructure Engineer II - Core PlatformsAmerican Express · New York, NY (Hybrid) · $89–150K/yr
AI DevOps EngineerMoody's Analytics, Inc. · NEW YORK, NY
Associate EngineerPRESIDIO NETWORKED SOLUTIONS, INC. · NEW YORK, NY
Field Solutions Architect IV, AI Infrastructure, Google CloudGoogle · New York, NY · $233–324K/yr
Operations Engineer, Fleet ReliabilityCoreWeave · Livingston, NJ · $83–110K/yr
You've read the whole posting — now see how you match it.