155 citations · 379 across the 24 of their papers we have counts for
4 papers · 1 filter
Alignment at Pre-training! Towards Native Alignment for Arabic LLMs
Juhao Liang, Zhenyang Cai, Jianqing Zhu +9
The alignment of large language models (LLMs) is critical for developing effective and safe language models. Traditional approaches focus on aligning models during the instruction…
Second Language (Arabic) Acquisition of LLMs via Progressive Vocabulary Expansion
Jianqing Zhu, Huang Huang, Zhihang Lin +18
This paper addresses the critical need for democratizing large language models (LLM) in the Arab world, a region that has seen slower progress in developing models comparable to st…
Expressivity and Approximation Properties of Deep Neural Networks with ReLU Activation
Juncai He, Tong Mao, Jinchao Xu
In this paper, we investigate the expressivity and approximation properties of deep neural networks employing the ReLU activation function for . Although deep ReLU ne…
Deep Neural Networks and Finite Elements of Any Order on Arbitrary Dimensions
Juncai He, Jinchao Xu
In this study, we establish that deep neural networks employing ReLU and ReLU activation functions can effectively represent Lagrange finite element functions of any order on v…