2 papers
cs.LG2025
Transformer learns the cross-task prior and regularization for in-context learning
Fei Lu, Yue Yu
Transformers have shown a remarkable ability for in-context learning (ICL), making predictions based on contextual examples. However, while theoretical analyses have explored this…
cs.CL2024
FinTeamExperts: Role Specialized MOEs For Financial Analysis
Yue Yu, Prayag Tiwari
Large Language Models (LLMs), such as ChatGPT, Phi3 and Llama-3, are leading a significant leap in AI, as they can generalize knowledge from their training to new tasks without fin…