works on
long-context memory 1model efficiency 1retrieval-augmented generation 1self-distillation 1transformer depth division 1

From the 1 of 5 linked papers with an AI index.

collaborators
Showing cs.AIShow all

1 paper · 1 filter

cs.AI2025

Attention Schema-based Attention Control (ASAC): A Cognitive-Inspired Approach for Attention Management in Transformers

Krati Saxena, Federico Jurado Ruiz, Guido Manzi +2

Attention mechanisms have become integral in AI, significantly enhancing model performance and scalability by drawing inspiration from human cognition. Concurrently, the Attention…