5 papers
MemWM: Memory-Augmented Text-Based World Model
Yujun Wang, Tao Zhang, Jinhe Bi +9
World models are increasingly used to support planning in agents by predicting how environment states evolve in response to agent actions. Yet fluent next-state predictions can sti…
From Knowledge to Noise: CTIM-Rover and the Pitfalls of Episodic Memory in Software Engineering Agents
Tobias Lindenbauer, Georg Groh, Hinrich Schütze
We introduce CTIM-Rover, an AI agent for Software Engineering (SE) built on top of AutoCodeRover (Zhang et al., 2024) that extends agentic reasoning frameworks with an episodic mem…
Understanding Gated Neurons in Transformers from Their Input-Output Functionality
Sebastian Gerstner, Hinrich Schütze
Interpretability researchers have attempted to understand MLP neurons of language models based on both the contexts in which they activate and their output weight vectors. They hav…
A Recipe of Parallel Corpora Exploitation for Multilingual Large Language Models
Peiqin Lin, André F. T. Martins, Hinrich Schütze
Recent studies have highlighted the potential of exploiting parallel corpora to enhance multilingual large language models, improving performance in both bilingual tasks, e.g., mac…
Robustness Testing of Multi-Modal Models in Varied Home Environments for Assistive Robots
Lea Hirlimann, Shengqiang Zhang, Hinrich Schütze +1
The development of assistive robotic agents to support household tasks is advancing, yet the underlying models often operate in virtual settings that do not reflect real-world comp…