5 citations · 15 across the 5 of their papers we have counts for
4 papers · 1 filter
LORD: Low Rank Decomposition Of Monolingual Code LLMs For One-Shot Compression
Ayush Kaushal, Tejas Vaidhya, Irina Rish
Low Rank Decomposition of matrix - splitting a large matrix into a product of two smaller matrix offers a means for compression that reduces the parameters of a model without spars…
Causal Direction of Data Collection Matters: Implications of Causal and Anticausal Learning for NLP
Zhijing Jin, Julius von Kügelgen, Jingwei Ni +4
The principle of independent causal mechanisms (ICM) states that generative processes of real world data consist of independent modules which do not influence or inform each other.…
Domain specific BERT representation for Named Entity Recognition of lab protocol
Tejas Vaidhya, Ayush Kaushal
Supervised models trained to predict properties from representations have been achieving high accuracy on a variety of tasks. For instance, the BERT family seems to work exceptiona…
Leveraging Event Specific and Chunk Span features to Extract COVID Events from tweets
Ayush Kaushal, Tejas Vaidhya
Twitter has acted as an important source of information during disasters and pandemic, especially during the times of COVID-19. In this paper, we describe our system entry for WNUT…