3 papers
cs.LG2026
FunDM: Cheap & Label-Free Decision Models from Frozen Language Models
Ujjawal K. Panchal
Decision models such as Jev score candidate answers or actions. A small decision head trained label-free can recover about 99% of a frozen language model's multiple-choice accuracy…
cs.LG2024
MoIN: Mixture of Introvert Experts to Upcycle an LLM
Ajinkya Tejankar, KL Navaneet, Ujjawal Panchal +2
The goal of this paper is to improve (upcycle) an existing large language model without the prohibitive requirements of continued pre-training of the full-model. The idea is to spl…
cs.CV2022
CoShNet: A Hybrid Complex Valued Neural Network using Shearlets
Manny Ko, Ujjawal K. Panchal, Héctor Andrade-Loarca +1
In a hybrid neural network, the expensive convolutional layers are replaced by a non-trainable fixed transform with a great reduction in parameters. In previous works, good results…