activity
20202026
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 626 across the 12 of their papers we have counts for

collaborators

13 papers

cs.AI2026

Is this machine playing?

Nathan Cloos, Antonio Norelli, Daniel Durbin +3

We placed a modern AI coding assistant in an unintended role: as the mind of a body on an unknown digital island. With only a minimal instruction mentioning no specific task, rewar…

cs.AI2025

LLMs can hide text in other text of the same length

Antonio Norelli, Michael Bronstein

A meaningful text can be hidden inside another, completely different yet still coherent and plausible, text of the same length. For example, a tweet containing a harsh political cr…

cs.AI2024

Artificial Scientific Discovery

Antonio Norelli

Rooted in the explosion of deep learning over the past decade, this thesis spans from AlphaGo to ChatGPT to empirically examine the fundamental concepts needed to realize the visio…

cs.LG2024

DyGMamba: Efficiently Modeling Long-Term Temporal Dependency on Continuous-Time Dynamic Graphs with State Space Models

Zifeng Ding, Yifeng Li, Yuan He +5

Learning useful representations for continuous-time dynamic graphs (CTDGs) is challenging, due to the concurrent need to span long node interaction histories and grasp nuanced temp…

cs.CL2024★ 3 cited

Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliance

Kaitlyn Zhou, Jena D. Hwang, Xiang Ren +3

The ability to communicate uncertainty, risk, and limitation is crucial for the safety of large language models. However, current evaluations of these abilities rely on simple cali…

cs.LG2023★ 2 cited

Latent Space Translation via Semantic Alignment

Valentino Maiorca, Luca Moschella, Antonio Norelli +3

While different neural models often exhibit latent spaces that are alike when exposed to semantically related data, this intrinsic similarity is not always immediately discernible.…

cs.LG2023

Bootstrapping Parallel Anchors for Relative Representations

Irene Cannistraci, Luca Moschella, Valentino Maiorca +3

The use of relative representations for latent embeddings has shown potential in enabling latent space communication and zero-shot model stitching across a wide range of applicatio…

cs.LG2022★ 7 cited

ASIF: Coupled Data Turns Unimodal Models to Multimodal Without Training

Antonio Norelli, Marco Fumero, Valentino Maiorca +3

CLIP proved that aligning visual and language spaces is key to solving many vision tasks without explicit training, but required to train image and text encoders from scratch on a…

cs.LG2022★ 7 cited

Relative representations enable zero-shot latent space communication

Luca Moschella, Valentino Maiorca, Marco Fumero +3

Neural networks embed the geometric structure of a data manifold lying in a high-dimensional space into latent representations. Ideally, the distribution of the data points in the…

cs.CL2022★ 565 cited

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448

Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabil…

cs.LG2022

Explanatory Learning: Beyond Empiricism in Neural Networks

Antonio Norelli, Giorgio Mariani, Luca Moschella +4

We introduce Explanatory Learning (EL), a framework to let machines use existing knowledge buried in symbolic sequences -- e.g. explanations written in hieroglyphic -- by autonomou…

cs.LG2021

OLIVAW: Mastering Othello without Human Knowledge, nor a Fortune

Antonio Norelli, Alessandro Panconesi

We introduce OLIVAW, an AI Othello player adopting the design principles of the famous AlphaGo programs. The main motivation behind OLIVAW was to attain exceptional competence in a…

cs.LG2020★ 42 cited

LIMP: Learning Latent Shape Representations with Metric Preservation Priors

Luca Cosmo, Antonio Norelli, Oshri Halimi +2

In this paper, we advocate the adoption of metric preservation as a powerful prior for learning latent representations of deformable 3D shapes. Key to our construction is the intro…