CRelu 激活函數

ICML2016 Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Units 本文在深入分析CNN網絡內部結構，發現在CNN網絡的前幾層學習到的濾波器中存在負相關。 they appear surprisingly opposite to each other,

>>阅读原文<<