← Open in Shiplog

Self-attention spectra

theme free probability and random matrices selected

Spectral and signal-propagation analysis of transformer self-attention layers; Gaussian-equivalence and deviation from Marchenko-Pastur.

Findings (1)

Papers (1)
- Gaussian Equivalence for Self-Attention: Asymptotic Spectral Analysis of Attention Matrix2025· AISTATS

Notes (1)

AISTATS2026に論文が2本採択されました2026-01-23· announcement

Connections

This topic …

usesRandom matrix spectra, Asymptotic freeness

extendsDynamical isometry