5 citations · 6 across the 3 of their papers we have counts for
3 papers
Understanding Catastrophic Forgetting In LoRA via Mean-Field Attention Dynamics
Hugo Koubbi, Louis Hernandez, Matthieu Boussard
Low-Rank Adaptation (LoRA) is the dominant parameter-efficient fine-tuning method due to its favorable compute-performance trade-off, yet it suffers from catastrophic forgetting. W…
Practical considerations on using private sampling for synthetic data
Clément Pierquin, Bastien Zimmermann, Matthieu Boussard
Artificial intelligence and data access are already mainstream. One of the main challenges when designing an artificial intelligence or disclosing content from a database is preser…
Information gain ratio correction: Improving prediction with more balanced decision tree splits
Antonin Leroux, Matthieu Boussard, Remi Dès
Decision trees algorithms use a gain function to select the best split during the tree's induction. This function is crucial to obtain trees with high predictive accuracy. Some gai…