Fifth Meeting

July 20, 2024 • Yijun Pan, Jin Huang

LLM Data Selection Influence Function Counterfactual Prediction

Yijun Pan and Jin Huang.

Xia, Mengzhou, Sadhika Malladi, Suchin Gururangan, Sanjeev Arora, and Danqi Chen. “Less: Selecting influential data for targeted instruction tuning.” arXiv preprint arXiv:2402.04333 (2024).
Liu, Zikang, Kun Zhou, Wayne Xin Zhao, Dawei Gao, Yaliang Li, and Ji-Rong Wen. “Less is More: Data Value Estimation for Visual Instruction Tuning.” arXiv preprint arXiv:2403.09559 (2024).
Yu, Zichun, Spandan Das, and Chenyan Xiong. “MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models.” arXiv preprint arXiv:2406.06046 (2024).