Layernorm on 111qqz's bloghttps://111qqz.com/en/tags/layernorm/Recent content in Layernorm on 111qqz's blogHugo -- gohugo.ioenhust.111qqz@gmail.com (111qqz)hust.111qqz@gmail.com (111qqz)© 2011-2026 111qqzSat, 19 Sep 2026 16:00:00 +0800Attention 之后还缺什么：从 Residual Connection 到 Transformer Stackhttps://111qqz.com/en/post/%E6%B7%B1%E5%BA%A6%E5%AD%A6%E4%B9%A0/2026-09-19-transformer-block-residual-stream/Sat, 19 Sep 2026 16:00:00 +0800hust.111qqz@gmail.com (111qqz)https://111qqz.com/en/post/%E6%B7%B1%E5%BA%A6%E5%AD%A6%E4%B9%A0/2026-09-19-transformer-block-residual-stream/<p><a href="https://111qqz.com/en/post/%E6%B7%B1%E5%BA%A6%E5%AD%A6%E4%B9%A0/2026-09-19-multi-head-attention/" >上一篇</a>结尾我写：Multi-Head Attention 仍然只是一个 information routing / read mechanism，一个完整的 Transformer layer 还包含 FFN、residual connection、layer normalization 等组件。</p>