Research Scientist Intern, On-Device AI Model Optimization (PhD)

Summary:

Reality Labs advances Meta's vision for virtual reality (VR) and augmented reality (AR). Delivering compelling experiences on AR/VR devices requires innovation and co-design across the full technology stack, from algorithms to custom silicon. Our teams push the state of the art in computer vision, speech, virtual assistants, machine learning, mixed reality, graphics, displays, sensors, and human body tracking.We are seeking interns with a background in developing efficient machine learning models for AR/VR applications, including computer vision, speech, sensor fusion, natural language processing (NLP), and multimodal AI. Our team develops high-performing models within tight compute, memory, and power constraints, using optimization techniques such as sparsity, quantization, compression, neural architecture search, and tensor decomposition. Ideal candidates will have practical experience building real-time models that maintain high accuracy under on-device deployment constraints.In this role, you will gain experience across the full stack, from user experiences and algorithms to hardware execution. You will collaborate with domain experts to understand application challenges and develop state-of-the-art neural networks to address them, then partner with software and hardware teams to deploy these solutions on-device.Our internships range from twelve (12) to twenty-four (24) weeks, with start dates throughout the year.

Required Skills:

Research Scientist Intern, On-Device AI Model Optimization (PhD) Responsibilities:

1. Define, plan, and execute cutting-edge deep learning research to advance AR/VR experiences.

2. Develop novel deep learning techniques to achieve state-of-the-art accuracy for large language models (LLMs), multimodal models, and reasoning models within on-device resource and real-time execution constraints.

3. Collaborate with research scientists and software engineers to develop model optimization techniques, such as quantization, compression, and pruning, for vision, speech, user interfaces, and other applications.

4. Partner with software and hardware engineers to develop trade-off curves between model accuracy and runtime requirements, including latency and energy consumption.

5. Clearly communicate experimental results and recommendations to the team and cross-functional partners.

Minimum Qualifications:

Minimum Qualifications:

1. Currently holds or is pursuing a PhD in Computer Science, Electrical Engineering, or a related field

2. Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment

3. Experience developing machine learning solutions

4. Programming experience and experience using deep learning frameworks to prototype ideas

Preferred Qualifications:

Preferred Qualifications:

1. A track record of first-author publications at top-tier machine learning or AI conferences, such as NeurIPS, ICML, ICLR, ACL, AAAI, or similar venues

2. Experience training and running inference with LLMs, multimodal models, or reasoning models

3. Experience with one or more model optimization techniques, such as quantization, pruning, distillation, parameter-efficient fine-tuning (PEFT), or speculative decoding, for cloud or on-device AI deployment

4. Demonstrated research and software engineering experience through internships, coding competitions, or contributions to open-source repositories, such as those hosted on GitHub

Public Compensation:

$7,650/month to $12,667/month + benefits

Industry: Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [email protected].