9 citations · 9 across the 9 of their papers we have counts for
9 papers
STaD: Scaffolded Task Design for Identifying Compositional Skill Gaps in LLMs
Sungeun An, Swanand Ravindra Kadhe, Shailja Thakur +2
Benchmarks are often used as a standard to understand LLM capabilities in different domains. However, aggregate benchmark scores provide limited insight into compositional skill ga…
Learning Ecology with VERA Using Conceptual Models and Simulations
Spencer Rugaber, Scott Bunin, Andrew Hornback +2
Conceptual modeling has been an important part of constructionist educational practices for many years, particularly in STEM (Science, Technology, Engineering and Mathematics) disc…
Using Analytics on Student Created Data to Content Validate Pedagogical Tools
John Kos, Kenneth Eaton, Sareen Zhang +4
Conceptual and simulation models can function as useful pedagogical tools, however it is important to categorize different outcomes when evaluating them in order to more meaningful…
Conducting A/B Experiments with a Scalable Architecture
Andrew Hornback, Sungeun An, Scott Bunin +3
A/B experiments are commonly used in research to compare the effects of changing one or more variables in two different experimental groups - a control group and a treatment group.…
Contextualizing Large-Scale Domain Knowledge for Conceptual Modeling and Simulation
Sungeun An, Spencer Rugaber, Jennifer Hammock +1
We present an interactive modeling tool, VERA, that scaffolds the acquisition of domain knowledge involved in conceptual modeling and agent-based simulations. We describe the knowl…
Cognitive Assistance for Inquiry-Based Modeling
Sungeun An, Robert Bates, Spencer Rugaber +3
Inquiry-based modeling is essential to scientific practice. However, modeling is difficult for novice scientists in part due to limited domain-specific knowledge and quantitative s…
Understanding Self-Directed Learning in an Online Laboratory
Sungeun An, Spencer Rugaber, Jennifer Hammock +1
We described a study on the use of an online laboratory for self-directed learning by constructing and simulating conceptual models of ecological systems. In this study, we could o…
Explanation as Question Answering based on Design Knowledge
Ashok Goel, Vrinda Nandan, Eric Gregori +2
Explanation of an AI agent requires knowledge of its design and operation. An open question is how to identify, access and use this design knowledge for generating explanations. Ma…
Using VERA to explain the impact of social distancing on the spread of COVID-19
William Broniec, Sungeun An, Spencer Rugaber +1
COVID-19 continues to spread across the country and around the world. Current strategies for managing the spread of COVID-19 include social distancing. We present VERA, an interact…