4 papers
LGMT: Logic-Grounded Metamorphic Testing for Evaluating the Reasoning Reliability of LLMs
Zenghui Zhou, Man Li, Xiaoke Fang +3
Large Language Models (LLMs) achieve strong performance on logical reasoning benchmarks, yet their reliability remains uncertain. Existing evaluations rely on static benchmarks, wh…
Bidirectional Empowerment of Metamorphic Testing and Large Language Models: A Systematic Survey
Zheng Zheng, Zenghui Zhou, Yinwang Xu +2
Large language models (LLMs) have introduced substantial challenges to software quality assurance due to their generative, probabilistic, and open-ended nature, which intensifies t…
PSALM: applying Proportional SAmpLing strategy in Metamorphic testing
Zenghui Zhou, Pak-Lok Poon, Zheng Zheng +1
Metamorphic testing (MT) alleviates the oracle problem by checking metamorphic relations (MRs) across multiple test executions. The fault detection effectiveness of MT is influence…
Code Comments for Quantum Software Development Kits: An Empirical Study on Qiskit
Zenghui Zhou, Yuechen Li, Yi Cai +4
Quantum computing is gaining attention from academia and industry. With the quantum Software Development Kits (SDKs), programmers can develop quantum software to explore the power…