This repository contains implementations of BRL-Attention mechanism for both Language Modeling and Graph Modeling tasks. BRL-Attention introduces compression and regularization functions to enhance standard attention mechanisms through compressive tokens.
ljxw88/Regularizing-Geometric-Bottleneck
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|