5 citations · 5 across the 5 of their papers we have counts for
5 papers
SCOUT: Toward Sub-Quadratic Attention via Segment Compression for Optimized Utility in Transformers
Aref Jafari, Yuhe Fan, Benyamin Jamialahmadi +3
Transformers have demonstrated strong performance across a wide range of sequence modeling tasks, but their quadratic attention complexity limits scalability to long sequences. Lin…
DTRNet: Dynamic Token Routing Network to Reduce Quadratic Costs in Transformers
Aman Sharma, Saeed Najafi, Parsa Farinneya +6
Transformers achieve state-of-the-art results across many tasks, but their uniform application of quadratic self-attention to every token at every layer makes them computationally…
Balcony: A Lightweight Approach to Dynamic Inference of Generative Language Models
Benyamin Jamialahmadi, Parsa Kavehzadeh, Mehdi Rezagholizadeh +5
Deploying large language models (LLMs) in real-world applications is often hindered by strict computational and latency constraints. While dynamic inference offers the flexibility…
Self-Supervised Contrastive BERT Fine-tuning for Fusion-based Reviewed-Item Retrieval
Mohammad Mahdi Abdollah Pour, Parsa Farinneya, Armin Toroghi +6
As natural language interfaces enable users to express increasingly complex natural language queries, there is a parallel explosion of user review content that can allow users to b…
DiffuDetox: A Mixed Diffusion Model for Text Detoxification
Griffin Floto, Mohammad Mahdi Abdollah Pour, Parsa Farinneya +4
Text detoxification is a conditional text generation task aiming to remove offensive content from toxic text. It is highly useful for online forums and social media, where offensiv…