Canonical-basis realignment for Transformer LLMs: every hidden axis becomes independently measurable and controllabletranslating…

The code essentially gives you a way to rotate a Transformer's internal coordinate system into a canonical basis that aligns with its own weight matrices in a lossless way. By absorbing the normalization gains directly into the adjacent weights and using orthogonal matrices…