Graph Machine: Towards Better Pretraining via Edges
By Lintai Hou · Paper · cs.LG
We introduce the Graph Machine (GM), an architecture that maintains an $O(n)$-sized state and accesses it through sparse, dynamic routing. Unlike methods with fixed-size states or sparse but static routing, GM preserves $O(n)$ complexity in its sparse layers without restricting t
Tags: Cs.lg