14 citations · 14 across the 3 of their papers we have counts for
3 papers
From Queries to Criteria: Understanding How Astronomers Evaluate LLMs
Alina Hyk, Kiera McCormick, Mian Zhong +7
There is growing interest in leveraging LLMs to aid in astronomy and other scientific research, but benchmarks for LLM evaluation in general have not kept pace with the increasingl…
pathfinder: A Semantic Framework for Literature Review and Knowledge Discovery in Astronomy
Kartheik G. Iyer, Mikaeel Yunus, Charles O'Neill +27
The exponential growth of astronomical literature poses significant challenges for researchers navigating and synthesizing general insights or even domain-specific knowledge. We pr…
Designing an Evaluation Framework for Large Language Models in Astronomy Research
John F. Wu, Alina Hyk, Kiera McCormick +15
Large Language Models (LLMs) are shifting how scientific research is done. It is imperative to understand how researchers interact with these models and how scientific sub-communit…