2 citations · 3 across the 5 of their papers we have counts for
6 papers
Kronecker Product Attention: Memory-Efficient KV Compression via Structured Factorization
Bahareh Nikpour, Hossein Rajabzadeh, Maryam Dialameh +2
Efficient autoregressive generation is increasingly limited by the memory footprint of the key-value (KV) cache, which grows linearly with sequence length, batch size, and model de…
Hierarchical Chain-of-Thought: Enhancing LLM Reasoning Performance and Efficiency
Xingshuai Huang, Derek Li, Bahareh Nikpour +1
Chain-of-Thought (CoT) prompting has significantly improved the reasoning capabilities of large language models (LLMs). However, conventional CoT often relies on unstructured, flat…
Multitask-Informed Prior for In-Context Learning on Tabular Data: Application to Steel Property Prediction
Dimitrios Sinodinos, Bahareh Nikpour, Jack Yi Wei +5
Accurate prediction of mechanical properties of steel during hot rolling processes, such as Thin Slab Direct Rolling (TSDR), remains challenging due to complex interactions among c…
Memory-Augmented Transformers: A Systematic Review from Neuroscience Principles to Enhanced Model Architectures
Parsa Omidi, Xingshuai Huang, Axel Laborieux +3
Memory is fundamental to intelligence, enabling learning, reasoning, and adaptability across biological and artificial systems. While Transformer architectures excel at sequence mo…
Language-Guided Reinforcement Learning for Hard Attention in Few-Shot Learning
Bahareh Nikpour, Narges Armanfard
Attention mechanisms have demonstrated significant potential in enhancing learning models by identifying key portions of input data, particularly in scenarios with limited training…
NPC: Neighbors Progressive Competition Algorithm for Classification of Imbalanced Data Sets
Soroush Saryazdi, Bahareh Nikpour, Hossein Nezamabadi-pour
Learning from many real-world datasets is limited by a problem called the class imbalance problem. A dataset is imbalanced when one class (the majority class) has significantly mor…