https://111qqz.com/tags/gpu-performance/Recent content in Gpu-Performance on 111qqz的小窝Hugo -- gohugo.iozh-cn© 2015-2026 111qqzSun, 23 Aug 2026 12:45:00 +0800https://111qqz.com/2026/08/flops-to-latency/Sun, 23 Aug 2026 12:45:00 +0800https://111qqz.com/2026/08/flops-to-latency/<h2 class="relative group">起因 <div id="起因" class="anchor"></div> <span class="absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none"> <a class="text-primary-300 dark:text-neutral-700 !no-underline" href="#%e8%b5%b7%e5%9b%a0" aria-label="锚点">#</a> </span> </h2> <p>最近在做 CS336（Language Modeling from Scratch）的 resource accounting 作业，里面要求逐个列出 Transformer forward pass 中所有的 matmul，然后按 \(2MKN\) 计算 FLOPs。</p>