29 citations · 52 across the 17 of their papers we have counts for
4 papers · 1 filter
Transformers as Graph-to-Graph Models
James Henderson, Alireza Mohammadshahi, Andrei C. Coman +1
We argue that Transformers are essentially graph-to-graph models, with sequences just being a special case. Attention weights are functionally equivalent to graph edges. Our Graph-…
SQL-PaLM: Improved Large Language Model Adaptation for Text-to-SQL (extended)
Ruoxi Sun, Sercan Ö. Arik, Alex Muzio +8
Text-to-SQL, the process of translating natural language into Structured Query Language (SQL), represents a transformative application of large language models (LLMs), potentially…
Summarization with Precise Length Control
Lesly Miculicich, Yujia Xie, Song Wang +1
Many applications of text generation such as summarization benefit from accurately controlling the text length. Existing approaches on length-controlled summarization either result…
Document Summarization with Text Segmentation
Lesly Miculicich, Benjamin Han
In this paper, we exploit the innate document segment structure for improving the extractive summarization task. We build two text segmentation models and find the most optimal str…