← Open in Shiplog

DNN architectures as random-matrix systems

theme machine learning selected

Reading deep architectures (MLP-Mixer, attention, sparse MLPs) through random-matrix and Kronecker-structure lenses to expose implicit regularization.