Showing cs.CLShow all
2 papers · 1 filter
cs.CL2024
Positional Description for Numerical Normalization
Deepanshu Gupta, Javier Latorre
We present a Positional Description Scheme (PDS) tailored for digit sequences, integrating placeholder value information for each digit. Given the structural limitations of subword…
cs.CL2023
EELBERT: Tiny Models through Dynamic Embeddings
Gabrielle Cohn, Rishika Agarwal, Deepanshu Gupta +1
We introduce EELBERT, an approach for compression of transformer-based models (e.g., BERT), with minimal impact on the accuracy of downstream tasks. This is achieved by replacing t…