Showing 2024Show all
2 papers · 1 filter
cs.LG2024
Fourier Head: Helping Large Language Models Learn Complex Probability Distributions
Nate Gillman, Daksh Aggarwal, Michael Freeman +2
As the quality of large language models has improved, there has been increased interest in using them to model non-linguistic tokens. For example, the Decision Transformer recasts…
cs.SD2024
Do Music Generation Models Encode Music Theory?
Megan Wei, Michael Freeman, Chris Donahue +1
Music foundation models possess impressive music generation capabilities. When people compose music, they may infuse their understanding of music into their work, by using notes an…