img资讯

even positions: 8,6,4,2,0 sum to 20.

{ 42, 56, 62, 52, 23, 7, 5, 17 },

。关于这个话题，heLLoword翻译官方下载提供了深入分析

Что думаешь? Оцени!

Fixed/sinusoidal positional encodings are not counted (following the original Transformer paper convention)