Intel logo

AI Framework Software Engineer - vLLM

Intel

Shanghai, Shanghai, ChinaFull-timePosted 3w agoStill listed today

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this.

At a glance

Compensation
No compensation found
Location
Shanghai, Shanghai, China
Schedule
Full-time
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Requirements

Credentials this posting asks for.

Bachelor's degree

Job overview

As an AI Frameworks Engineer, you will design, develop, and optimize AI frameworks such as vLLM and PyTorch, implement distributed algorithms, transform computational graphs, profile deep learning models, and collaborate with researchers to integrate advancements, contributing to open‑source projects and enhancing Intel's AI software performance across hardware backends.

Skills & qualifications

RequiredNice to have

Skills

PythonC++vLLMPyTorchDistributed AlgorithmsPerformance OptimizationGPU ArchitectureOpen‑Source Contributions

Qualifications

Master's in Computer Science or Bachelor’s in Computer Science With 2 Years Experience2+ Years Domain Working Experience

Full job description

Job Details:

Job Description: The Role and Impact: As an AI Frameworks Engineer, you will play an integral role in designing and optimizing cutting-edge artificial intelligence software and frameworks. You will contribute to developing distributed algorithms, enhancing deep learning models, and improving AI software performance across diverse hardware backends. By collaborating with researchers and engineers, your work will directly influence Intel's ability to deliver advanced AI solutions, enabling transformative capabilities in the field of artificial intelligence.

Business group: This role is part of Intel's Artificial Intelligence engineering group, a team dedicated to developing innovative AI software solutions and frameworks that enhance performance and efficiency across Intel products. The group focuses on advancing AI technologies and creating impactful solutions that empower customers and drive Intel's leadership in the AI industry.

Key Responsibilities:

  • Design, develop, and optimize AI frameworks such as vLLM and PyTorch for high-performance applications.
  • Implement distributed algorithms, including model/data parallel frameworks and asynchronous data communication in machine learning and deep learning systems.
  • Transform computational graph representations of neural network models and develop machine learning primitives in mathematical libraries.
  • Profile distributed deep learning models to identify bottlenecks and propose performance-enhancing solutions.
  • Collaborate with deep learning researchers to integrate advancements into AI frameworks.
  • Contribute to open-source projects, ensuring compliance with industry standards and delivering impactful innovations.

Qualifications: Minimum Qualifications:

  • Master degree of Computer Science or bachelor degree with at least 2 years of domain working experience.
  • Proficiency in Python and C++ programming languages.
  • Foundational knowledge of AI frameworks such as vLLM, PyTorch and deep learning concepts.
  • Demonstrated ability to debug and optimize software for performance.

Preferred Qualifications:

  • Familiarity with performance optimization technologies and techniques.
  • Experience working with large language models and related inference stacks.
  • Background in contributing to open-source projects or collaborating within open-source ecosystems.
  • Strong problem-solving skills and ability to analyze complex technical challenges.
  • Effective communication skills, including proficiency in written and spoken English.
  • Familiarity with the GPU architecture and concepts is a big plus

Join Intel to explore the forefront of AI innovation, make meaningful contributions to the field, and collaborate with industry leaders to shape the future of artificial intelligence.

Job Type: College Grad

Shift: Shift 1 (China)

Primary Location: PRC, Shanghai

Additional Locations:

Posting Statement: All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance. Position of Trust N/A Work Model for this Role This role will require an on-site presence. * Job posting details (such as work model, location or time type) are subject to change. *

ADDITIONAL INFORMATION: Intel is committed to Responsible Business Alliance (RBA) compliance and ethical hiring practices. We do not charge any fees during our hiring process. Candidates should never be required to pay recruitment fees, medical examination fees, or any other charges as a condition of employment. If you are asked to pay any fees during our hiring process, please report this immediately to your recruiter.

Similar jobs, posted recently

Open roles like this one, listed in the last 30 days.

You've read the whole posting — now see how you match it.