Katie Everett
@katie-everett · 1 works
Recent posts by Katie Everett
- Transforming Rank: How Architecture Navigates the Spectral Pathologies of Depth - We investigate how each component of the Transformer feedforward block architecture design determines how much rank survives across depth at initialization. We reinterpret skip connections and… · Paper · arxiv.org