Continual Learning and Deliberate Forgetting in Petascale Generative AI training
Description
The Data Science Institute (DSI) at the University of Technology Sydney (UTS) is a world leader in data science and ethical artificial intelligence and has a strong focus on Industry engagement. The DSI boasts over 200 PhD students and 100 academic staff with award winning researchers in AI
In collaboration with Leonardo.Ai we are advertising an industry PhD program that will tackle research questions at the bleeding edge of GenAI research with an aim to drive forward both foundational research in the field through traditional publication outputs, as well as supercharging the Leonardo.Ai platform. Leonardo.Ai is a world leader in generative AI and is building one of the leading AI laboratories in foundational AI research. Leonardo.Ai has also recently been acquired by Canva and now hosts over 200 million users through the combined platforms. Both Leonardo.Ai and Canva have strong principles in: being a good human being foremost, maximizing impact, moving at speed and owning our goals and winning together.
Project Aims
This PhD project aims to improve the capacity of neural networks to continue to learn new things without loss of performance on previously learned tasks. Additionally, it will be explored both how to prevent and induce model forgetting such that concepts can be removed from models. The student will explore RAG, optimization theory, and finetuning methods among other areas of study. The student will work with petascale training environments to conduct large-scale experiments.
PhD research students will have access to leading edge compute facilities (e.g. H100s), a team of world class research leaders across both UTS, Leonardo and Canva, cutting edge datasets to conduct research, and mentoring and guidance to complete a best-in-class PhD research program.
Eligibility
We are looking for the best of the best! You will be adequately qualified to enter the UTS PhD scheme with Undergraduate / Postgraduate Qualifications in e.g. Computer Science, Data Science, AI, Physics, Mathematics or equivalent.
Candidate Profile
Location
This PhD will be hosted at the University of Technology Sydney and the student will spend significant time at the Leonardo.Ai headquarters, which is located on the waterfront in North Sydney (20 mins train ride from UTS).
Full Domestic Scholarship: Open to Australian citizens who will receive a full scholarship of $37k per year stipend + $10k per year top-up for 3.5 years.
Full International Scholarship: Open to all international applicants with $37k per year stipend, $45k per year international fees and $30k per year top-up for 3.5 years. Student visas will be provided by UTS.
Summary Play a part in building the next revolution of machine learning technology. We’re looking for passionate mid-level and senior...
How to applyRole As a Systems Research Engineer specialized in Machine Learning Systems, you will play a crucial role in researching and...
How to applyWe help the world run better At SAP, we enable you to bring out your best. Our company culture is...
How to applyFundamental AI Research Scientist – FAIR Apply to this job Location pin icon Tel Aviv, Israel • Paris, France •...
How to applyJoin Axon and be a Force for Good. At Axon, we’re on a mission to Protect Life. We’re explorers, pursuing...
How to applyBrookhaven National Laboratory is committed to employee success and we believe that a comprehensive employee benefits program is an important...
How to apply