Attention Transfer

Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Motivation 大量的論文已經證明Attention在CV、NLP中都發揮着巨大的作用,因爲本文利用Attention做KD,即讓student學習teach
相關文章
相關標籤/搜索