12 citations · 24 across the 7 of their papers we have counts for
7 papers
FLoRA: Fused forward-backward adapters for parameter efficient fine-tuning and reducing inference-time latencies of LLMs
Dhananjaya Gowda, Seoha Song, Junhyun Lee +1
As the large language models (LLMs) grow in size each day, efficient training and fine-tuning has never been as important as nowadays. This resulted in the great interest in parame…
zFLoRA: Zero-Latency Fused Low-Rank Adapters
Dhananjaya Gowda, Seoha Song, Harshith Goka +1
Large language models (LLMs) are increasingly deployed with task-specific adapters catering to multiple downstream applications. In such a scenario, the additional compute associat…
BRIDO: Bringing Democratic Order to Abstractive Summarization
Junhyun Lee, Harshith Goka, Hyeonmok Ko
Hallucination refers to the inaccurate, irrelevant, and inconsistent text generated from large language models (LLMs). While the LLMs have shown great promise in a variety of tasks…
Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models
Akhil Kedia, Mohd Abbas Zaidi, Sushil Khyalia +3
In spite of their huge success, transformer models remain difficult to scale in depth. In this work, we develop a unified signal propagation theory and provide formulae that govern…
Hole-robust Wireframe Detection
Naejin Kong, Kiwoong Park, Harshith Goka
"Wireframe" is a line segment based representation designed to well capture large-scale visual properties of regular, structural shaped man-made scenes surrounding us. Unlike the w…
Resolution-robust Large Mask Inpainting with Fourier Convolutions
Roman Suvorov, Elizaveta Logacheva, Anton Mashikhin +7
Modern image inpainting systems, despite the significant progress, often struggle with large missing areas, complex geometric structures, and high-resolution images. We find that o…
An Analysis of Frame-skipping in Reinforcement Learning
Shivaram Kalyanakrishnan, Siddharth Aravindan, Vishwajeet Bagdawat +5
In the practice of sequential decision making, agents are often designed to sense state at regular intervals of time steps, , ignoring state information in between sensi…