17 citations · 36 across the 13 of their papers we have counts for
13 papers
DFAH-Bench: What Agreement Leaves Unmeasured in Financial Agents
Raffi Khatchadourian
When a financial agent repeats its decision, how much does that tell us about the actions behind it? DFAH-Bench examines this question through replay experiments, a controlled test…
Forecasting Future Language: Context Design for Mention Markets
Sumin Kim, Jihoon Kwon, Yoon Kim +9
Mention markets, a type of prediction market in which contracts resolve based on whether a specified keyword is mentioned during a future public event, require accurate probabilist…
Replayable Financial Agents: A Determinism-Faithfulness Assurance Harness for Tool-Using LLM Agents
Raffi Khatchadourian
Replaying a financial agent requires specifying the conditions of a rerun, preserving its execution record, and deciding which parts of its behavior to compare. We introduce the De…
An Empirical Framework for Evaluating Semantic Preservation Using Hugging Face
Nan Jia, Anita Raja, Raffi Khatchadourian
As machine learning (ML) becomes an integral part of high-autonomy systems, it is critical to ensure the trustworthiness of learning-enabled software systems (LESS). Yet, the nonde…
LLM Output Drift: Cross-Provider Validation & Mitigation for Financial Workflows
Raffi Khatchadourian, Rolando Franco
Financial institutions deploy Large Language Models (LLMs) for reconciliations, regulatory reporting, and client communications, but nondeterministic outputs (output drift) undermi…
Speculative Automated Refactoring of Imperative Deep Learning Programs to Graph Execution
Raffi Khatchadourian, Tatiana Castro Vélez, Mehdi Bagherzadeh +2
Efficiency is essential to support ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code -- s…
Towards Safe Automated Refactoring of Imperative Deep Learning Programs to Graph Execution
Raffi Khatchadourian, Tatiana Castro Vélez, Mehdi Bagherzadeh +2
Efficiency is essential to support responsiveness w.r.t. ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execut…
QuerTCI: A Tool Integrating GitHub Issue Querying with Comment Classification
Ye Paing, Tatiana Castro Vélez, Raffi Khatchadourian
Empirical Software Engineering (ESE) researchers study (open-source) project issues and the comments and threads within to discover -- among others -- challenges developers face wh…
Challenges in Migrating Imperative Deep Learning Programs to Graph Execution: An Empirical Study
Tatiana Castro Vélez, Raffi Khatchadourian, Mehdi Bagherzadeh +1
Efficiency is essential to support responsiveness w.r.t. ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execut…
A Tool for Rejuvenating Feature Logging Levels via Git Histories and Degree of Interest
Yiming Tang, Allan Spektor, Raffi Khatchadourian +1
Logging is a significant programming practice. Due to the highly transactional nature of modern software applications, massive amount of logs are generated every day, which may ove…
Interests, Difficulties, Sentiments, and Tool Usages of Concurrency Developers: A Large-Scale Study on Stack Overflow
Mehdi Bagherzadeh, Syed Ahmed, Srilakshmi Sripathi +1
Context: Software developers are increasingly facing the challenges of writing code that is not only concurrent but also correct. Objective: To help these developers, it is necessa…
Automated Evolution of Feature Logging Statement Levels Using Git Histories and Degree of Interest
Yiming Tang, Allan Spektor, Raffi Khatchadourian +1
Logging -- used for system events and security breaches to describe more informational yet essential aspects of software features -- is pervasive. Given the high transactionality o…
Proactive Empirical Assessment of New Language Feature Adoption via Automated Refactoring: The Case of Java 8 Default Methods
Raffi Khatchadourian, Hidehiko Masuhara
Programming languages and platforms improve over time, sometimes resulting in new language features that offer many benefits. However, despite these benefits, developers may not al…