Showing cs.CLShow all
2 papers · 1 filter
cs.CL2024
End-to-end Planner Training for Language Modeling
Nathan Cornille, Florian Mai, Jingyuan Sun +1
Through end-to-end training to predict the next token, LLMs have become valuable tools for various tasks. Enhancing their core training in language modeling can improve numerous do…
cs.CL2024
Learning to Plan Long-Term for Language Modeling
Florian Mai, Nathan Cornille, Marie-Francine Moens
Modern language models predict the next token in the sequence by considering the past text through a powerful function such as attention. However, language models have no explicit…