2 citations · 4 across the 6 of their papers we have counts for
8 papers
FoleyGen: Visually-Guided Audio Generation
Xinhao Mei, Varun Nagaraja, Gael Le Lan +4
Recent advancements in audio generation have been spurred by the evolution of large-scale deep learning models and expansive datasets. However, the task of video-to-audio (V2A) gen…
Stack-and-Delay: a new codebook pattern for music generation
Gael Le Lan, Varun Nagaraja, Ernie Chang +5
In language modeling based music generation, a generated waveform is represented by a sequence of hierarchical token stacks that can be decoded either in an auto-regressive manner…
Enhance audio generation controllability through representation similarity regularization
Yangyang Shi, Gael Le Lan, Varun Nagaraja +6
This paper presents an innovative approach to enhance control over audio generation by emphasizing the alignment between audio and text representations during model training. In th…
Streaming Transformer Transducer Based Speech Recognition Using Non-Causal Convolution
Yangyang Shi, Chunyang Wu, Dilin Wang +9
This paper improves the streaming transformer transducer for speech recognition by using non-causal convolution. Many works apply the causal convolution to improve streaming transf…
Collaborative Training of Acoustic Encoders for Speech Recognition
Varun Nagaraja, Yangyang Shi, Ganesh Venkatesh +3
On-device speech recognition requires training models of different sizes for deploying on devices with various computational budgets. When building such different models, we can be…
Dynamic Encoder Transducer: A Flexible Solution For Trading Off Accuracy For Latency
Yangyang Shi, Varun Nagaraja, Chunyang Wu +9
We propose a dynamic encoder transducer (DET) for on-device speech recognition. One DET model scales to multiple devices with different computation capacities without retraining or…
Modeling Context Between Objects for Referring Expression Understanding
Varun K. Nagaraja, Vlad I. Morariu, Larry S. Davis
Referring expressions usually describe an object using properties of the object and relationships of the object with other objects. We propose a technique that integrates context b…
Searching for Objects using Structure in Indoor Scenes
Varun K. Nagaraja, Vlad I. Morariu, Larry S. Davis
To identify the location of objects of a particular class, a passive computer vision system generally processes all the regions in an image to finally output few regions. However,…