2 citations · 3 across the 5 of their papers we have counts for
4 papers · 1 filter
Kronecker Product Attention: Memory-Efficient KV Compression via Structured Factorization
Bahareh Nikpour, Hossein Rajabzadeh, Maryam Dialameh +2
Efficient autoregressive generation is increasingly limited by the memory footprint of the key-value (KV) cache, which grows linearly with sequence length, batch size, and model de…
Multitask-Informed Prior for In-Context Learning on Tabular Data: Application to Steel Property Prediction
Dimitrios Sinodinos, Bahareh Nikpour, Jack Yi Wei +5
Accurate prediction of mechanical properties of steel during hot rolling processes, such as Thin Slab Direct Rolling (TSDR), remains challenging due to complex interactions among c…
Memory-Augmented Transformers: A Systematic Review from Neuroscience Principles to Enhanced Model Architectures
Parsa Omidi, Xingshuai Huang, Axel Laborieux +3
Memory is fundamental to intelligence, enabling learning, reasoning, and adaptability across biological and artificial systems. While Transformer architectures excel at sequence mo…
NPC: Neighbors Progressive Competition Algorithm for Classification of Imbalanced Data Sets
Soroush Saryazdi, Bahareh Nikpour, Hossein Nezamabadi-pour
Learning from many real-world datasets is limited by a problem called the class imbalance problem. A dataset is imbalanced when one class (the majority class) has significantly mor…