Part of the Institute of Computer Graphics @ Johannes Kepler University Linz, Austria

What Happens to the Source Domain in Transfer Learning?

What Happens in TL Teaser

Abstract

We investigate the impact of the source domain in supervised transfer learning, focusing on image classification. In particular, we aim to assess to which extent a fine-tuned model can still recognize the classes of the source domain. Furthermore, we want to understand how this ability impacts the target domain. We demonstrate how the retained knowledge about the old classes in a popular foundational model can interfere with the model’s ability to learn and recognize the new classes. This interference can incur significant implications and highlights an inherent shortcoming of supervised transfer learning.


Citation

Amal Alnouri, Bilal Alsallakh
What Happens to the Source Domain in Transfer Learning?
ICLR 2023 Workshop on Mathematical and Empirical Understanding of Foundation Models, 2023.

BibTeX

@article{,
    title = {What Happens to the Source Domain in Transfer Learning?},
    author = {Amal Alnouri and Bilal Alsallakh},
    journal = {ICLR 2023 Workshop on Mathematical and Empirical Understanding of Foundation Models},
    url = {https://openreview.net/forum?id=BsqmRU5hkB},
    year = {2023}
}