attention機制

attention的通用表達式QKV，這篇文章感受講的挺詳細get https://shikanon.com/2019/%E6%9C%BA%E5%99%A8%E5%AD%A6%E4%B9%A0/%E6%B3%A8%E6%84%8F%E5%8A%9B%E6%9C%BA%E5%88%B6%E5%8F%8A%E5%85%B6%E6%84%8F%E4%B9%89/io

>>阅读原文<<