relative position embedding 相關論文和代碼

https://github.com/tensorflow/tensor2tensor/blob/master/tensor2tensor/layers/common_attention.py 論文： Self-Attention with Relative Position Representations MUSIC TRANSFORMER: GENERATING MUSIC WITH LONG

>>阅读原文<<