4 papers · 1 filter
MemDefrag: Latent Memory Defragmentation for Large Language Models
Ruiyi Yan, Zhuoyuan Mao, Yiwen Guo
Latent memory, which stores past knowledge fragments as per-layer hidden states, has emerged as a promising paradigm (e.g., MemoryLLM and M+) for long-term memory in large language…
Anchored Sliding Window: Toward Robust and Imperceptible Linguistic Steganography
Ruiyi Yan, Shiao Meng, Yugo Murawaki
Linguistic steganography based on language models typically assumes that steganographic texts are transmitted without alteration, making them fragile to even minor modifications. W…
Efficient Provably Secure Linguistic Steganography via Range Coding
Ruiyi Yan, Yugo Murawaki
Linguistic steganography involves embedding secret messages within seemingly innocuous texts to enable covert communication. Provable security, which is a long-standing goal and ke…
Addressing Tokenization Inconsistency in Steganography and Watermarking Based on Large Language Models
Ruiyi Yan, Yugo Murawaki
Large language models have significantly enhanced the capacities and efficiency of text generation. On the one hand, they have improved the quality of text-based steganography. On…