649 citations · 689 across the 9 of their papers we have counts for
4 papers · 1 filter
How Language Models Organize and Structure Moral Knowledge
Orion Reblitz-Richardson
How do large language models (LLMs) organize moral knowledge? Models detect moral content broadly, but detection is a low bar. We ask whether they go further, distinguishing moral…
Output Dilution: Redundant but Fragile Representations in MoE Models
Orion Reblitz-Richardson
Mixture-of-Experts (MoE) models appear to encode moral content as robustly as dense models, yet prove far more fragile in their encoding. In OLMoE-1B-7B, linear probes recover mora…
When Probing Accuracy Saturates, Fragility Resolves: A Complementary Metric for LLM Pre-Training Analysis
Orion Reblitz-Richardson
Standard linear probing declares a property "encoded" when a classifier on hidden states achieves high accuracy. The protocol works well on a snapshot but breaks across pre-trainin…
ExecuTorch -- A Unified PyTorch Solution to Run AI Models On-Device
Mergen Nachin, Digant Desai, Sicheng Stephen Jia +36
Local execution of AI on edge devices is important for low latency and offline operation. However, deploying models on diverse hardware remains fragmented, often requiring model co…