12 citations · 15 across the 14 of their papers we have counts for
5 papers · 1 filter
CryptoBench: A Dynamic Benchmark for Expert-Level Evaluation of LLM Agents in Cryptocurrency
Jiacheng Guo, Suozhi Huang, Zixin Yao +16
This paper introduces CryptoBench, the first expert-curated, dynamic benchmark designed to rigorously evaluate the real-world capabilities of Large Language Model (LLM) agents in t…
Estimating the Error of Large Language Models at Pairwise Text Comparison
Tianyi Li
We measure LLMs' output error at pairwise text comparison, noting the probability of error in their preferences. Our method does not rely on the ground truth and supports two scena…
A Multi-Task Evaluation of LLMs' Processing of Academic Text Input
Tianyi Li, Yu Qin, Olivia R. Liu Sheng
How much large language models (LLMs) can aid scientific discovery, notably in assisting academic peer review, is in heated debate. Between a literature digest and a human-comparab…
A Survey on Diffusion Language Models
Tianyi Li, Mingda Chen, Bowei Guo +1
Diffusion Language Models (DLMs) are rapidly emerging as a powerful and promising alternative to the dominant autoregressive (AR) paradigm. By generating tokens in parallel through…
User-Centered Design with AI in the Loop: A Case Study of Rapid User Interface Prototyping with "Vibe Coding"
Tianyi Li, Tanay Maheshwari, Alex Voelker
We present a case study of using generative user interfaces, or ``vibe coding,'' a method leveraging large language models (LLMs) for generating code via natural language prompts,…