2 papers
cs.LG2025
Memory-Augmented Architecture for Long-Term Context Handling in Large Language Models
Haseeb Ullah Khan Shinwari, Muhammad Usama
Large Language Models face significant challenges in maintaining coherent interactions over extended dialogues due to their limited contextual memory. This limitation often leads t…
cs.LG2025
ARD-LoRA: Dynamic Rank Allocation for Parameter-Efficient Fine-Tuning of Foundation Models with Heterogeneous Adaptation Needs
Haseeb Ullah Khan Shinwari, Muhammad Usama
Conventional Low-Rank Adaptation (LoRA) methods employ a fixed rank, imposing uniform adaptation across transformer layers and attention heads despite their heterogeneous learning…