News Neurips Best Paper
Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free received a NeurIPS 2025 Best Paper Award! [announcement]
Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free received a NeurIPS 2025 Best Paper Award! [announcement]