2 papers
cs.CL2024
Routing in Sparsely-gated Language Models responds to Context
Stefan Arnold, Marian Fietta, Dilara Yesilbas
Language Models (LMs) recently incorporate mixture-of-experts layers consisting of a router and a collection of experts to scale up their parameter count given a fixed computationa…
cs.DL2024
Documentation Practices of Artificial Intelligence
Stefan Arnold, Dilara Yesilbas, Rene Gröbner +3
Artificial Intelligence (AI) faces persistent challenges in terms of transparency and accountability, which requires rigorous documentation. Through a literature review on document…