64 citations · 64 across the 7 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
math.OC2024
Criteria and Bias of Parameterized Linear Regression under Edge of Stability Regime
Peiyuan Zhang, Amin Karbasi
Classical optimization theory requires a small step-size for gradient-based methods to converge. Nevertheless, recent findings challenge the traditional idea by empirically demonst…
cs.CV2024
Temporal Reasoning Transfer from Text to Video
Lei Li, Yuanxin Liu, Linli Yao +6
Video Large Language Models (Video LLMs) have shown promising capabilities in video comprehension, yet they struggle with tracking temporal changes and reasoning about temporal rel…
cs.CL2024★ 64 cited
TinyLlama: An Open-Source Small Language Model
Peiyuan Zhang, Guangtao Zeng, Tianduo Wang +1
We present TinyLlama, a compact 1.1B language model pretrained on around 1 trillion tokens for approximately 3 epochs. Building on the architecture and tokenizer of Llama 2, TinyLl…