Skip to main content
Point72 logo

Machine Learning Infrastructure Engineer, Technology

Point72

New York, NYJob$180–300K/yrPosted todayStill listed · checked in the last 2 days

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
$180–300K/yr
Location
New York, NY
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Job overview

The Machine Learning Infrastructure Engineer will design and operate infrastructure for large-scale generative AI and machine learning workloads. The role supports distributed training, inference, and data workflows, and partners with researchers and engineers to improve compute utilization and model performance. It also covers deployment automation, observability, cost management, security, and operational practices across cloud and on-prem environments.

Skills & qualifications

RequiredNice to have

Skills

Distributed Systems, requiredKubernetes, requiredAWS, requiredGoogle Cloud Platform, requiredAzure, requiredMachine Learning Operations, requiredMLflow, requiredRay, requiredAirflow, requiredKubeflow, requiredTerraform, requiredReinforcement Learning, requiredPython, requiredGo, requiredC++, requiredRust, requiredDebugging, requiredPerformance Profiling, requiredPerformance Optimization, requiredGPU Compute, requiredCPU Compute, requiredMonitoring, requiredObservability, requiredCost Optimization, requiredCollaboration, requiredCommunication, requiredSystems Thinking, required

Qualifications

Bachelor's or Master's in Computer Science, Electrical Engineering, or Related Technical Field, required3+ Years Infrastructure Experience, required

Benefits

Medical Insurance
Parental Leave
Tuition Assistance
401(k) Match

Full job description

Machine Learning Infrastructure Engineer

A Career with Point72’s Technology Team

As Point72 reimagines the future of investing, our Technology team is constantly evolving our firm’s IT infrastructure and engineering capabilities, positioning us at the forefront of a rapidly evolving technology landscape. We’re a team of experts who experiment and work to discover new ways to harness open-source solutions, modern cloud architectures, and sophisticated Artificial Intelligence (AI) solutions, while embracing enterprise agile methodologies. Our commitment to building and innovating in the AI space provides the framework intended to drive smarter decision making and enhance how we build and operate our platforms and applications.

As a member of Point72’s Technology team, we encourage and support your professional development from day one—helping you advance your technical skills, contribute innovative ideas, and satisfy your own intellectual curiosity—all while delivering real business impact for our multi-billion-dollar global business.

What you’ll do

  • Design and implement high-performance infrastructure to support large-scale generative AI and machine learning workloads, enabling faster model iteration and real business impact

  • Design and operate distributed systems for model training, hyperparameter tuning, inference, and data preprocessing pipelines to deliver reliable end-to-end machine learning (ML) workflows

  • Collaborate with ML researchers and engineers to produce models, optimizing compute utilization, training throughput, and inference latency

  • Develop and automate deployment, orchestration, and CI/CD pipelines for models and data workflows using container orchestration and infrastructure-as-code (IaC)

  • Implement observability, monitoring, and cost-management strategies for GPU and accelerator compute environments to maintain predictable performance and spend

  • Evaluate, integrate, and benchmark emerging hardware and software technologies across cloud and on-prem environments to improve scalability and throughput

  • Drive security, compliance, and operational runbooks for GenAI infrastructure including access controls, secrets management, and incident response procedures

  • Troubleshoot, profile, and optimize performance across GPU and CPU compute stacks to remove bottlenecks and increase reliability

  • Document architecture, operational practices, and mentor engineers to expand team capability and accelerate adoption of production-ready GenAI infrastructure

What’s required

  • Bachelor's or master's degree in computer science, electrical engineering, or a related technical field

  • 3–7 years of experience building and maintaining scalable compute or machine learning infrastructure systems

  • Deep understanding of distributed systems, container orchestration (Kubernetes), and public cloud platforms such as AWS, Google Cloud Platform, or Azure

  • Hands-on experience with machine learning operations and infrastructure tools such as MLflow, Ray, Airflow, Kubeflow, and Terraform

  • Strong understanding of reinforcement learning concepts and their infrastructure implications

  • Proficiency in Python and systems-level programming in one or more languages such as Go, C++, or Rust

  • Strong debugging, performance profiling, and optimization skills across GPU and CPU compute stacks

  • Experience implementing monitoring, observability, and cost-optimization for GPU/accelerator-based compute environments

  • Excellent collaboration and communication skills with a systems-thinking mindset

  • Commitment to the highest ethical standards

We take care of our people

We invest in our people, their careers, their health, and their well-being. When you work here, we provide:

  • Fully-paid health care benefits

  • Generous parental and family leave policies

  • Mental and physical wellness programs

  • Volunteer opportunities

  • Non-profit matching gift program

  • Support for employee-led affinity groups representing women, minorities and the LGBT+ community

  • Tuition assistance

  • A 401(k) savings program with an employer match and more

ABOUT POINT72:

Point72 is a leading global alternative investment firm led by Steven A. Cohen. Building on more than 30 years of investing experience, Point72 seeks to deliver superior returns for its investors through fundamental and systematic investing strategies across asset classes and geographies. We aim to attract and retain the industry’s brightest talent by cultivating an investor-led culture and committing to our people’s long-term growth. For more information, visit https://point72.com/.

The annual base salary range for this role is $180,000-$300,000 (USD) , which does not include discretionary bonus compensation or our comprehensive benefits package. Actual compensation offered to the successful candidate may vary from posted hiring range based upon geographic location, work experience, education, and/or skill level, among other things.

How this job compares

Set against the 6,313 open Machine Learning Engineer jobs on Olive Jobs, counted November 17, 2026.

Pay
  • This posting$180–300K/yr
  • New York median$169–246K/yr419 salary ranges
  • US median$144–245K/yr5,365 salary ranges

This range's midpoint, $240K, is 13% above the New York median midpoint ($213K) — in the top quarter of Machine Learning Engineer salary ranges in New York.

Openings
Olive Jobs lists 476 open Machine Learning Engineer jobs in New York and 6,313 across the US. 8% of them nationwide are listed as remote or flexible.
Hiring the most in New York
Experience
This posting asks for at least 3 years of experience; Machine Learning Engineer postings that state a minimum ask for 5 years at the median (5,239 postings).
Education
2,179 of the 6,313 open Machine Learning Engineer jobs (35%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on November 17, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.