16 papers · 1 filter
Beyond Heavy Log Curation: Perplexity-Based APT Detection via Unsupervised, Context-Augmented Language Models
Shoya Otsu, Kei Suzuki, Toshiaki Koike-Akino +2
Advanced Persistent Threats (APTs) remain difficult to detect because only a small fraction of events in large-scale logs are attack-related, and investigation is expensive and har…
EinSort: Sorting is All We Need for Tensorizing LLM
Toshiaki Koike-Akino, Jing Liu, Ye Wang
Tensor networks provide efficient representations for compressing large neural networks. By carefully designing shapes and topologies, they can significantly reduce memory and comp…
Mastering the Minority: An Uncertainty-guided Multi-Expert Framework for Challenging-tailed Sequence Learning
Ye Wang, Zixuan Wu, Lifeng Shen +4
Imbalanced data distribution remains a critical challenge in sequential learning, leading models to easily recognize frequent categories while failing to detect minority classes ad…
Amplification Effects in Test-Time Reinforcement Learning: Safety and Reasoning Vulnerabilities
Vanshaj Khattar, Md Rafi ur Rashid, Moumita Choudhury +4
Test-time training (TTT) has recently emerged as a promising method to improve the reasoning abilities of large language models (LLMs), in which the model directly learns from test…
Directional Embedding Smoothing for Robust Vision Language Models
Ye Wang, Jing Liu, Toshiaki Koike-Akino
The safety and reliability of vision-language models (VLMs) are a crucial part of deploying trustworthy agentic AI systems. However, VLMs remain vulnerable to jailbreaking attacks…
AWP: Activation-Aware Weight Pruning and Quantization with Projected Gradient Descent
Jing Liu, Toshiaki Koike-Akino, Ye Wang +2
To address the enormous size of Large Language Models (LLMs), model compression methods, such as quantization and pruning, are often deployed, especially on edge devices. In this w…