8 papers
Beyond Facts: Benchmarking Distributional Reading Comprehension in Large Language Models
Pei-Fu Guo, Ya-An Tsai, Chun-Chia Hsu +6
While most reading comprehension benchmarks for LLMs focus on factual information that can be answered by localizing specific textual evidence, many real-world tasks require unders…
LiveCLKTBench: Towards Reliable Evaluation of Cross-Lingual Knowledge Transfer in Multilingual LLMs
Pei-Fu Guo, Yun-Da Tsai, Chun-Chia Hsu +6
Evaluating cross-lingual knowledge transfer in large language models is challenging, as correct answers in a target language may arise either from genuine transfer or from prior ex…
An Efficient Algorithm for Thresholding Monte Carlo Tree Search
Shoma Nameki, Atsuyoshi Nakamura, Junpei Komiyama +1
We introduce the Thresholding Monte Carlo Tree Search problem, in which, given a tree and a threshold , a player must answer whether the root node value of $\math…
Training LLMs Beyond Next Token Prediction -- Filling the Mutual Information Gap
Chun-Hao Yang, Bo-Han Feng, Tzu-Yuan Lai +3
Optimizing training performance in large language models (LLMs) remains an essential challenge, particularly in improving model performance while maintaining computational costs. T…
Multimodal Chip Physical Design Engineer Assistant
Yun-Da Tsai, Chang-Yu Chao, Liang-Yeh Shen +7
Modern chip physical design relies heavily on Electronic Design Automation (EDA) tools, which often struggle to provide interpretable feedback or actionable guidance for improving…
Uncertainty Profiles for LLMs: Uncertainty Source Decomposition and Adaptive Model-Metric Selection
Pei-Fu Guo, Yun-Da Tsai, Shou-De Lin
Large language models (LLMs) often generate fluent but factually incorrect outputs, known as hallucinations, which undermine their reliability in real-world applications. While unc…