AI Compiler Engineer Full-time

Job Details:

Job Description:
As the AI landscape evolves, the emergence of generative AI has brought the cost of inference into sharp focus, identifying it as a critical bottleneck for innovation and the full utilization of AI capabilities. In the role of Staff AI Compiler Engineer, you’ll be at the forefront of confronting this challenge. By contributing to the development and integration of our state-of-the-art Neural Processing Unit (NPU) compiler within the Windows Machine Learning and DirectML software stack, you will play a central role in offloading cloud inference, thereby revolutionizing the efficiency and scalability of AI applications. With your command of C++ and MLIR, you will not only enhance our NPU and its ecosystem but also redefine the parameters of what’s possible in AI hardware acceleration, paving the way for broader adoption and more sustainable AI innovation.

Key responsibilities:
– Conduct pioneering research and development in algorithms to push the boundaries of AI efficiency, targeting specific improvements in inference cost and performance.
– Implement advanced compilation passes that optimize machine learning models for our NPU, enhancing their performance and reducing latency.
– Collaborate closely with hardware design teams to consult on new generation hardware, ensuring that our NPU designs are optimized for the latest AI workloads and inference demands.
– Lead research and development efforts for performance optimization, particularly focusing on software-to-hardware mapping for AI models.
– Craft and maintain an internal testing framework that sets the bar for industry standards in performance testing.
– Track and report engineering progress with precision, promoting transparency and accountability in every aspect of the project lifecycle.
– Strategically contribute to the engineering roadmap, aligning with the critical business needs
– Maintain a regimen of rigorous code reviews to ensure the highest quality of code.
– Embrace incremental development strategies, breaking down complex projects into manageable tasks.
– Engage in cross-functional collaboration with peer teams for co-engineering, testing, integration, and complex problem-solving.
– Outstanding collaboration and communication abilities.
– Experience in managing complex collaborations across multiple teams and stakeholders.
– Flexibility to adapt to a rapidly changing tech environment.
– Strong commitment to ongoing learning and professional growth.

Qualifications:

You must possess the below minimum qualifications to be initially considered for this position. Preferred qualifications are in addition to the minimum requirements and are considered a plus factor in identifying top candidates.

Minimum Qualifications:

• Bachelor’s degree in computer science, electrical engineering, or a STEM related field with 6+ years of experience in three or more the following:
• Solid background in AI frameworks and compiler construction.
• High proficiency in C++ and MLIR, with a track record of applying these skills in a performance-critical environment.
• Agile project management proficiency, with practical experience in tools like GitHub.
• Experience in performance optimization with an emphasis on cost-effective software/hardware mapping.
• Well-versed in testing frameworks and advanced methodologies.

Preferred Qualifications:

• Master’s degree with 4+ years of experience, OR a PhD with 2+ years of experience in a related discipline.
• Practical experience in Windows driver development.
• In-depth understanding of neural network workloads, with a specialization in AI model optimization for efficient inference.
• Prior involvement with Generative AI integration.

Job Type:
Experienced Hire

Shift:
Shift 1 (United States of America)

Primary Location:
US, California, Folsom

Additional Locations:
US, Oregon, Hillsboro

Business group:
The Client Computing Group (CCG) is responsible for driving business strategy and product development for Intel’s PC products and platforms, spanning form factors such as notebooks, desktops, 2 in 1s, all in ones. Working with our partners across the industry, we intend to deliver purposeful computing experiences that unlock people’s potential – allowing each person use our products to focus, create and connect in ways that matter most to them. As the largest business unit at Intel, CCG is investing more heavily in the PC, ramping its capabilities even more aggressively, and designing the PC experience even more deliberately, including delivering a predictable cadence of leadership products. As a result, we are able to fuel innovation across Intel, providing an important source of IP and scale, as well as help the company deliver on its purpose of enriching the lives of every person on earth.

Posting Statement:
All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.
Position of Trust
N/A

Benefits:

We offer a total compensation package that ranks among the best in the industry. It consists of competitive pay, stock, bonuses, as well as, benefit programs which include health, retirement, and vacation. Find more information about all of our Amazing Benefits here: https://www.intel.com/content/www/us/en/jobs/benefits.html

Annual Salary Range for jobs which could be performed in
US, California:$186,552.00-$279,772.00

Salary range dependent on a number of factors including location and experience.

Work Model for this Role
This role will be eligible for our hybrid work model which allows employees to split their time between working on-site at their assigned Intel site and off-site. In certain circumstances the work model may change to accommodate business needs.