4 papers
Global PIQA: Evaluating Commonsense Reasoning Across 100+ Languages and Cultures
Tyler A. Chang, Catherine Arnett, Abdelrahman Sadallah +377
To date, there exist almost no culturally-specific evaluation benchmarks for large language models (LLMs) that cover a large number of languages and cultures. In this paper, we pre…
Motivating Next-Gen Accelerators with Flexible (N:M) Activation Sparsity via Benchmarking Lightweight Post-Training Sparsification Approaches
Shirin Alanova, Kristina Kazistova, Ekaterina Galaeva +7
The demand for efficient large language model (LLM) inference has intensified the focus on sparsification techniques. While semi-structured (N:M) pruning is well-established for we…
Adversarial Samples Are Not Created Equal
Jennifer Crawford, Amol Khanna, Fred Lu +4
Over the past decade, numerous theories have been proposed to explain the widespread vulnerability of deep neural networks to adversarial evasion attacks. Among these, the theory o…
A Walsh Hadamard Derived Linear Vector Symbolic Architecture
Mohammad Mahmudul Alam, Alexander Oberle, Edward Raff +3
Vector Symbolic Architectures (VSAs) are one approach to developing Neuro-symbolic AI, where two vectors in are `bound' together to produce a new vector in the same…