4 citations · 4 across the 4 of their papers we have counts for
4 papers
Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat
Pilsung Kang
Question-order effects in human survey data have been reported to approximately satisfy the QQ (quantum question) equality, a parameter-free prediction of the standard projective q…
Same Answer, Different Confidence: Protocol Sensitivity in LLM Confidence Calibration
Hankyeol Kim, Pilsung Kang
Large language models (LLM) can state their confidence in an answer (verbalized confidence), or the confidence can be read from the probability of the answer's tokens (token confid…
Technical Report of NICE Challenge at CVPR 2024: Caption Re-ranking Evaluation Using Ensembled CLIP and Consensus Scores
Kiyoon Jeong, Woojun Lee, Woongchan Nam +2
This report presents the ECO (Ensembled Clip score and cOnsensus score) pipeline from team DSBA LAB, which is a new framework used to evaluate and rank captions for a given image.…
Which is better? Exploring Prompting Strategy For LLM-based Metrics
Joonghoon Kim, Saeran Park, Kiyoon Jeong +4
This paper describes the DSBA submissions to the Prompting Large Language Models as Explainable Metrics shared task, where systems were submitted to two tracks: small and large sum…