NoEsis: Differentially Private Knowledge Transfer in Modular LLM Adaptation

Rob Romijnders, Stefanos Laskaridis, Ali Shahin Shamsabadi +1

Large Language Models (LLM) are typically trained on vast amounts of data from various sources. Even when designed modularly (e.g., Mixture-of-Experts), LLMs can leak privacy on th…