ZOIF: Zeroth-Order Influence Function Estimation for LLM Data Selection Using Only Forward Passes

Lisong He, Yunxuan Jiang, Haishan Ye +1

Influence functions enable principled data selection for large language models (e.g., identifying influential training samples for model editing, debugging, or efficient fine-tunin…