Showing cs.LGShow all
2 papers · 1 filter
cs.LG2024
Limits of Transformer Language Models on Learning to Compose Algorithms
Jonathan Thomm, Giacomo Camposampiero, Aleksandar Terzic +3
We analyze the capabilities of Transformer language models in learning compositional discrete tasks. To this end, we evaluate training LLaMA models and prompting GPT-4 and Gemini o…
cs.LG2024
Terminating Differentiable Tree Experts
Jonathan Thomm, Michael Hersche, Giacomo Camposampiero +3
We advance the recently proposed neuro-symbolic Differentiable Tree Machine, which learns tree operations using a combination of transformers and Tensor Product Representations. We…