2 papers
cs.LG2024
LMD3: Language Model Data Density Dependence
John Kirchenbauer, Garrett Honke, Gowthami Somepalli +5
We develop a methodology for analyzing language model task performance at the individual example level based on training data density estimation. Experiments with paraphrasing as a…
cs.CL2024
LawInstruct: A Resource for Studying Language Model Adaptation to the Legal Domain
Joel Niklaus, Lucia Zheng, Arya D. McCarthy +7
Instruction tuning is an important step in making language models useful for direct user interaction. However, the legal domain is underrepresented in typical instruction datasets…