Orthogonal initialization
Initializing weight matrices as random orthogonal matrices to preserve singular values.
Findings (0)
No findings link this topic yet.
Connections
This topic …
Referenced by
- Dynamical isometry · uses
- Interpretability and training dynamics · uses