12 citations · 24 across the 7 of their papers we have counts for
3 papers · 1 filter
zFLoRA: Zero-Latency Fused Low-Rank Adapters
Dhananjaya Gowda, Seoha Song, Harshith Goka +1
Large language models (LLMs) are increasingly deployed with task-specific adapters catering to multiple downstream applications. In such a scenario, the additional compute associat…
BRIDO: Bringing Democratic Order to Abstractive Summarization
Junhyun Lee, Harshith Goka, Hyeonmok Ko
Hallucination refers to the inaccurate, irrelevant, and inconsistent text generated from large language models (LLMs). While the LLMs have shown great promise in a variety of tasks…
Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models
Akhil Kedia, Mohd Abbas Zaidi, Sushil Khyalia +3
In spite of their huge success, transformer models remain difficult to scale in depth. In this work, we develop a unified signal propagation theory and provide formulae that govern…