Gaussian Equivalence for Self-Attention: Asymptotic Spectral Analysis of Attention Matrix

Presented at (4)

• Gaussian Equivalence for Self-Attention 2026 · workshop · Non-Commutative Probability and Related Topics 2026
• Gaussian equivalence for self-attention: asymptotic spectral analysis of attention matrix 2026 · conference · The China-Japan-Korea Conference on Functional Analysis 2026
• Gaussian Equivalence for Self-Attention: Asymptotic Spectral Analysis of Attention Matrix 2026 · conference · AISTATS2026
• 自己注意のガウス等価性：注意行列の漸近スペクトル解析 2026 · conference · 日本物理学会2026年春季大会

Main topic

• Gaussian equivalence and attention spectra theme · free probability and random matrices

Cited by notes (1)

• AISTATS2026に論文が2本採択されました 2026-01-23

BibTeX

@inproceedings{pmlr-v300-hayase26a,
  title = {Gaussian Equivalence for Self-Attention: Asymptotic Spectral Analysis of Attention Matrix},
  author = {Hayase, Tomohiro and Collins, Benoit and Karakida, Ryo},
  booktitle = {Proceedings of The 29th International Conference on Artificial Intelligence and Statistics},
  year = {2026},
  volume = {300},
  pages = {2512--2520},
  series = {Proceedings of Machine Learning Research},
  publisher = {PMLR},
  url = {https://proceedings.mlr.press/v300/hayase26a.html}
}