Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer

Attention plays a critical role in human visual experience. Furthermore, it has recently been demonstrated that attention can also play an important role in the context of applying artificial neural networks to a variety of tasks from fields such as computer vision and NLP. In this work we show that... View More