7 papers · 1 filter
Book your room in the Turing Hotel! A symmetric and distributed Turing Test with multiple AIs and humans
Christian Di Maio, Tommaso Guidi, Luigi Quarantiello +4
In this paper, we report our experience with ``TuringHotel'', a novel extension of the Turing Test based on interactions within mixed communities of Large Language Models (LLMs) an…
State-Space Modeling in Long Sequence Processing: A Survey on Recurrence in the Transformer Era
Matteo Tiezzi, Michele Casoni, Alessandro Betti +2
Effectively learning from sequential data is a longstanding goal of Artificial Intelligence, especially in the case of long sequences. From the dawn of Machine Learning, several re…
Generative System Dynamics in Recurrent Neural Networks
Michele Casoni, Tommaso Guidi, Alessandro Betti +2
In this study, we investigate the continuous time dynamics of Recurrent Neural Networks (RNNs), focusing on systems with nonlinear activation functions. The objective of this work…
A Unified Framework for Neural Computation and Learning Over Time
Stefano Melacci, Alessandro Betti, Michele Casoni +3
This paper proposes Hamiltonian Learning, a novel unified framework for learning with neural networks "over time", i.e., from a possibly infinite stream of data, in an online manne…
Dynamic Decoupling of Placid Terminal Attractor-based Gradient Descent Algorithm
Jinwei Zhao, Marco Gori, Alessandro Betti +4
Gradient descent (GD) and stochastic gradient descent (SGD) have been widely used in a large number of application domains. Therefore, understanding the dynamics of GD and improvin…
On the Resurgence of Recurrent Models for Long Sequences -- Survey and Research Opportunities in the Transformer Era
Matteo Tiezzi, Michele Casoni, Alessandro Betti +3
A longstanding challenge for the Machine Learning community is the one of developing models that are capable of processing and learning from very long sequences of data. The outsta…