Research Engineer, Synthetic Data Generation

Summary:

Meta Reality Labs is looking for a lead computer vision engineer to drive synthetic data generation and simulation for our AR/VR products, including the Quest line. This role will contribute to the creation of next-generation AR/VR interaction technologies in a cross-functional team of software, infra, computer vision, machine learning, simulation, and AI image generation engineers. This role will leverage expertise in computer vision, synthetic data, and AI-based image generation to contribute to ML models shipped in Meta AR/VR products. This role collaborates with cross-functional teams on image simulation, core AI, computer graphics, machine vision research, and HW design.The immediate team for this role is composed of Computer Vision, Machine Learning and Software Engineers. We work cross-functionally with teams across multiple disciplines, such as simulation, AR/VR optics, Reality Labs Research, silicon, and sensors, to design and develop novel ML solutions tailored for the requirements and constraints of each particular device.

Required Skills:

Research Engineer, Synthetic Data Generation Responsibilities:

1. Explore, innovate, and leverage novel technologies, from internal and external publications, to improve the realism, diversity, controllability, and generalizability of image synthesis, including techniques to enhance appearance and geometric realism, conditional image generation based on specific conditions or constraints, such as metadata, text-based categories, image masks, or multiple input modalities, and controllable image generation with manipulation of specific attributes like style and appearance

2. Hands-on contribution to synthetic image generation using deep generative models, computer graphics, or physics-based simulation

3. Tech lead for development and launch of CV/ML solutions for generating and synthesizing images used in the training of AR/VR models and system design

4. Drive cross-functional collaborations with partner teams, including but not limited to, Reality Labs Research, simulation, data systems, and Meta Superintelligence Lab

5. Co-own strategic planning, OKR setting, and roadmap generation for synthetic data and other R&D initiatives

6. Contribute to recruitment, mentoring, onboarding, and supporting the professional development of ML engineers/scientists, interns, and contractors

7. Optimize machine learning models for performance, scalability, and maintainability

8. Collaborate with other engineers and data scientists to develop and deploy machine learning solutions

Minimum Qualifications:

Minimum Qualifications:

1. Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

2. PhD in Computer Science or a related field with published projects in the fields of synthetic data generation, machine learning, deep learning, and/or computer vision

3. 5+ years of technical leadership experience driving medium to large-scale cross-functional R&D projects focused on machine learning and computer vision

4. Experience implementing computer vision algorithms and deep learning models in C++ and Python, including hands-on work with 3D geometry, image processing, or sensor fusion

5. Experience in communicating complex technical research to cross-functional audiences through written documents, design reviews, or conference presentations

6. Problem-solving and interpersonal skills and experience to lead technical projects independently

Preferred Qualifications:

Preferred Qualifications:

1. Experience in classical image processing and pose estimation

2. Experience in computer graphics, procedural generation, and avatar rendering

3. Demonstrated track record of peer-reviewed publications in computer vision or machine learning at venues such as CVPR, ICCV, ECCV, NeurIPS, ICLR, or equivalents

4. Work experience in the AR/VR industry

5. Experience in designing data collection protocols and quality control, manifested in solid contributions in constructing high-quality computer vision and machine learning datasets

Public Compensation:

$183,997/year to $257,000/year + bonus + equity + benefits

Industry: Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [email protected].