Large language models

Per-Matrix Optimality Is Not Enough: Three-Level Optimization for Low-Rank LLM Compression
Per-matrix singular value decomposition (SVD) truncation is Eckart-Young optimal in the whitened Frobenius norm, but errors from …
PDF Cite DOI
Per-Matrix Optimality Is Not Enough: Three-Level Optimization for Low-Rank LLM Compression