https://111qqz.com/en/tags/positional-encoding/Recent content in Positional-Encoding on 111qqz's blogHugo -- gohugo.ioenhust.111qqz@gmail.com (111qqz)hust.111qqz@gmail.com (111qqz)© 2011-2026 111qqzSun, 13 Sep 2026 20:00:00 +0800https://111qqz.com/en/post/%E6%B7%B1%E5%BA%A6%E5%AD%A6%E4%B9%A0/2026-09-13-where-sequence-order-went/Sun, 13 Sep 2026 20:00:00 +0800hust.111qqz@gmail.com (111qqz)https://111qqz.com/en/post/%E6%B7%B1%E5%BA%A6%E5%AD%A6%E4%B9%A0/2026-09-13-where-sequence-order-went/<p>上一篇<a href="https://111qqz.com/en/post/%E6%B7%B1%E5%BA%A6%E5%AD%A6%E4%B9%A0/2026-09-13-rnn-to-self-attention/" >《从 RNN 到 Self-Attention》</a>结尾记账时留了一条：去掉 recurrence 之后，顺序不再天然编码在计算过程里，摊平的 attention 层需要额外把顺序信息补回去，「具体怎么补，下一篇再说」。</p>