4 papers
SciCodePile: A 128GB Corpus and Executable Benchmark for Challenging Scientific Code Generation
Weifeng Sun, Ye Fan, Yuchen Chen +6
Large language models (LLMs) excel at general-purpose code generation, yet how well they handle scientific code remains an open question. Existing datasets and benchmarks are limit…
The Cognitive Circuit Breaker: A Systems Engineering Framework for Intrinsic AI Reliability
Jonathan Pan
As Large Language Models (LLMs) are increasingly deployed in mission-critical software systems, detecting hallucinations and ``faked truthfulness'' has become a paramount engineeri…
Multi-Trait Subspace Steering to Reveal the Dark Side of Human-AI Interaction
Xin Wei Chia, Swee Liang Wong, Jonathan Pan
Recent incidents have highlighted alarming cases where human-AI interactions led to negative psychological outcomes, including mental health crises and even user harm. As LLMs serv…
Prompt Inject Detection with Generative Explanation as an Investigative Tool
Jonathan Pan, Swee Liang Wong, Yidi Yuan +1
Large Language Models (LLMs) are vulnerable to adversarial prompt based injects. These injects could jailbreak or exploit vulnerabilities within these models with explicit prompt r…