activity
20232026
most citedAttention Is All You Need But You Don't Need All Of It For Inference of Large Language Models

3 citations · 3 across the 2 of their papers we have counts for

collaborators

5 papers

cs.AI2026

Agentic Uncertainty Reveals Agentic Overconfidence

Jean Kaddour, Srijan Patel, Gbètondji Dovonon +3

Can AI agents predict whether they will succeed at a task? We study agentic uncertainty by eliciting success probability estimates before, during, and after task execution. All res…

cs.LG20243 cited

Attention Is All You Need But You Don't Need All Of It For Inference of Large Language Models

Georgy Tyukin, Gbetondji J-S Dovonon, Jean Kaddour +1

The inference demand for LLMs has skyrocketed in recent months, and serving models with low latencies remains challenging due to the quadratic input length complexity of the attent…

cs.CV2024

The State of Computer Vision Research in Africa

Abdul-Hakeem Omotayo, Ashery Mbilinyi, Lukman Ismaila +16

Despite significant efforts to democratize artificial intelligence (AI), computer vision which is a sub-field of AI, still lags in Africa. A significant factor to this, is the limi…

cs.LG2024

Setting the Record Straight on Transformer Oversmoothing

Gbètondji J-S Dovonon, Michael M. Bronstein, Matt J. Kusner

Transformer-based models have recently become wildly successful across a diverse set of domains. At the same time, recent work has shown empirically and theoretically that Transfor…

cs.LG2023

Long-run Behaviour of Multi-fidelity Bayesian Optimisation

Gbetondji J-S Dovonon, Jakob Zeitler

Multi-fidelity Bayesian Optimisation (MFBO) has been shown to generally converge faster than single-fidelity Bayesian Optimisation (SFBO) (Poloczek et al. (2017)). Inspired by rece…