Rethinking Experience Replay: A Bag Of Tricks For Continual Learning | Awesome LLM Papers Add your paper to Awesome LLM Papers

Rethinking Experience Replay: A Bag Of Tricks For Continual Learning

Pietro Buzzega, Matteo Boschini, Angelo Porrello, Simone Calderara . 2020 25th International Conference on Pattern Recognition (ICPR) 2021 – 74 citations

[Paper]   Search on Google Scholar   Search on Semantic Scholar
Compositional Generalization Datasets

In Continual Learning, a Neural Network is trained on a stream of data whose distribution shifts over time. Under these assumptions, it is especially challenging to improve on classes appearing later in the stream while remaining accurate on previous ones. This is due to the infamous problem of catastrophic forgetting, which causes a quick performance degradation when the classifier focuses on learning new categories. Recent literature proposed various approaches to tackle this issue, often resorting to very sophisticated techniques. In this work, we show that naive rehearsal can be patched to achieve similar performance. We point out some shortcomings that restrain Experience Replay (ER) and propose five tricks to mitigate them. Experiments show that ER, thus enhanced, displays an accuracy gain of 51.2 and 26.9 percentage points on the CIFAR-10 and CIFAR-100 datasets respectively (memory buffer size 1000). As a result, it surpasses current state-of-the-art rehearsal-based methods.

Similar Work