1 citations · 1 across the 5 of their papers we have counts for
7 papers
Will the Judge Flip? Predicting Position-Sensitive LLM Judgments from Residual Stream Activations
Hashmath Shaik, Gnaneswar Villuri, Alex Doboli
The order in which candidate responses are presented can change an LLM judge's verdict. Detecting such a position flip ordinarily requires judging each pair in both orders, which d…
The First Token Is Not the Verdict: Hidden Costs of Reading LLM Judges Without Generating
Gnaneswar Villuri, Hashmath Shaik, Alex Doboli
Reading an LLM judge's verdict from the logits of its first generated token is cheap, requires no generation, and is exactly what constrained decoding and likelihood-scoring evalua…
When Do Internal Probes Beat Reading the Answer? Miscalibrated Readouts and Behavior-Concealed Knowledge in Language Models
Gnaneswar Villuri, Hashmath Shaik, Alex Doboli
A 0.6B language model, asked to verify 1,200 logical conclusions (half valid, half corrupted by a single semantic edit), answers YES every time. Judged by behavior it discriminates…
Dynamic Adaptation of the LLM Context for Generating Routines with Coupled Semantics
Gnaneswar Villuri, Hashmath Shaik, Alex Doboli
LLM-based code generation fails when correctness depends on execution-dependent coupling: the meaning of one routine is defined by the runtime behavior of another, a relationship t…
An Overview and Discussion on Using Large Language Models for Implementation Generation of Solutions to Open-Ended Problems
Hashmath Shaik, Alex Doboli
Large Language Models offer new opportunities to devise automated implementation generation methods that can tackle problem solving activities beyond traditional methods, which req…
An Overview and Discussion of the Suitability of Existing Speech Datasets to Train Machine Learning Models for Collective Problem Solving
Gnaneswar Villuri, Alex Doboli
This report characterized the suitability of existing datasets for devising new Machine Learning models, decision making methods, and analysis algorithms to improve Collaborative P…
A Large Language Model-based Computational Approach to Improve Identity-Related Write-Ups
Alex Doboli
Creating written products is essential to modern life, including writings about one's identity and personal experiences. However, writing is often a difficult activity that require…