https://111qqz.com/tags/fine-tuning/Recent content in Fine-Tuning on 111qqz的小窝Hugo -- gohugo.iozh-cnhust.111qqz@gmail.com (111qqz)hust.111qqz@gmail.com (111qqz)© 2011-2026 111qqzWed, 11 Nov 2026 22:40:00 +0800https://111qqz.com/2026/11/lora-low-rank-adaptation/Wed, 11 Nov 2026 22:40:00 +0800hust.111qqz@gmail.com (111qqz)https://111qqz.com/2026/11/lora-low-rank-adaptation/<p><a href="https://111qqz.com/2026/11/gaussian-elimination-to-rank-low-rank/" >上一篇</a>从高斯消元推到了低秩分解，最后用 LoRA 举了个例子——\(\Delta W = BA\)。当时想清楚的是数学层面为什么两个小矩阵可以代替一个大矩阵，但 LoRA 本身没有展开。</p>