24 citations · 29 across the 11 of their papers we have counts for
Showing 2023Show all
3 papers · 1 filter
cs.CL2023★ 1 cited
Exploring the Relationship between In-Context Learning and Instruction Tuning
Hanyu Duan, Yixuan Tang, Yi Yang +2
In-Context Learning (ICL) and Instruction Tuning (IT) are two primary paradigms of adopting Large Language Models (LLMs) to downstream applications. However, they are significantly…
cs.CL2023
Bias A-head? Analyzing Bias in Transformer-Based Language Model Attention Heads
Yi Yang, Hanyu Duan, Ahmed Abbasi +2
Transformer-based pretrained large language models (PLM) such as BERT and GPT have achieved remarkable success in NLP tasks. However, PLMs are prone to encoding stereotypical biase…
q-fin.GN2023★ 24 cited
InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuning
Yi Yang, Yixuan Tang, Kar Yan Tam
We present a new financial domain large language model, InvestLM, tuned on LLaMA-65B (Touvron et al., 2023), using a carefully curated instruction dataset related to financial inve…