7 citations · 23 across the 12 of their papers we have counts for
5 papers · 1 filter
Mitigating Bias in Locally Constrained Decoding via Tractable Proposals
Meihua Dang, Linxin Song, Honghua Zhang +3
Generations from large language models often fail to conform to desired constraints such as JSON schema. Existing locally constrained decoding (LCD) approaches enforce constraints…
Where is the signal in tokenization space?
Renato Lui Geh, Honghua Zhang, Kareem Ahmed +2
Large Language Models (LLMs) are typically shipped with tokenizers that deterministically encode text into so-called canonical token sequences, to which the LLMs assign probability…
Adaptable Logical Control for Large Language Models
Honghua Zhang, Po-Nien Kung, Masahiro Yoshida +2
Despite the success of Large Language Models (LLMs) on various tasks following human instructions, controlling model generation at inference time poses a persistent challenge. In t…
Tractable Control for Autoregressive Language Generation
Honghua Zhang, Meihua Dang, Nanyun Peng +1
Despite the success of autoregressive large language models in text generation, it remains a major challenge to generate text that satisfies complex constraints: sampling from the…
On the Paradox of Learning to Reason from Data
Honghua Zhang, Liunian Harold Li, Tao Meng +2
Logical reasoning is needed in a wide range of NLP tasks. Can a BERT model be trained end-to-end to solve logical reasoning problems presented in natural language? We attempt to an…