Showing cs.AIShow all
2 papers · 1 filter
cs.AI2024
Measuring Sample Importance in Data Pruning for Language Models based on Information Entropy
Minsang Kim, Seungjun Baek
Compute-efficient training of language models has become an important issue. We consider data pruning for data-efficient training of LLMs. In this work, we consider a data pruning…
cs.AI2024★ 5 cited
Hierarchical Position Embedding of Graphs with Landmarks and Clustering for Link Prediction
Minsang Kim, Seungjun Baek
Learning positional information of nodes in a graph is important for link prediction tasks. We propose a representation of positional information using representative nodes called…