[ContinualAI Seminars]: "Prompting-based Continual Learning"

[Keiland Cooper]

Hi All,

We're back! 

Join us this Thursday 09-22-2022, 15:30 PM UTC, for the ContinualAI Seminar, where Zifeng Wang (Northeastern University) will present their work:

Title: “Prompting-based Continual Learning”
Link: https://arxiv.org/abs/2204.04799

Abstract: The mainstream paradigm behind continual learning has been to adapt the model parameters to non-stationary data distributions, where catastrophic forgetting is the central challenge. In this talk, we present a new continual learning paradigm – Prompting-based Continual Learning, which learns a tiny set of parameters, called prompts, to properly instruct a pre-trained model to learn tasks arriving sequentially. In our CVPR 22 work, Learning to Prompt (L2P), we design a key-value paired pool of prompts to dynamically instruct the backbone to learn coming tasks. In our ECCV 22 work, DualPrompt, we further improve the design of prompts by decoupling them into complementary “General” and “Expert” prompts to learn task-invariant and task-specific instructions, respectively. Both methods set new state-of-the-art performance on multiple challenging benchmarks, even without buffering examples. We hope that Prompting-based Continual Learning can provide a different perspective for solving frontier challenges in continual learning.


---------------
- YouTube link:
https://www.youtube.com/watch?v=19bylhGhfAw

- Microsoft Teams:
https://bit.ly/clai-seminars

- YouTube recordings of the previous sessions:
https://www.youtube.com/c/ContinualAI
---------------

Feel free to share this email to anyone interested and invite them to subscribe this mailing-list here: https://groups.google.com/g/continualai

Please also contact me if you want to speak at one of the next sessions!

Looking forward to seeing you all there!

All the best,
Keiland Cooper

University of California
ContinualAI Co-founder
http://kwcooper.xyz