544 citations · 561 across the 16 of their papers we have counts for
Showing cs.CLShow all
3 papers · 1 filter
cs.CL2025
Thematic and Task-Based Categorization of K-12 GenAI Usages with Hierarchical Topic Modeling
Johannes Schneider, Béatrice S. Hasler, Michaela Varrone +4
We analyze anonymous interaction data of minors in class-rooms spanning several months, schools, and subjects employing a novel, simple topic modeling approach. Specifically, we ca…
cs.CL2024
Improving Next Tokens via Second-to-Last Predictions with Generate and Refine
Johannes Schneider
Autoregressive language models like GPT aim to predict next tokens, while autoencoding models such as BERT are trained on tasks such as predicting masked tokens. We train a decoder…
cs.CL2024
Topic Modeling with Fine-tuning LLMs and Bag of Sentences
Johannes Schneider
Large language models (LLMs) are increasingly used for topic modeling, outperforming classical topic models such as LDA. Commonly, pre-trained LLM encoders such as BERT are used ou…