14 citations · 15 across the 4 of their papers we have counts for
4 papers
Optimization Dynamics Imprint Semantic Specificity in Contrastive Embedding Norms
Ziwei Su, Junyu Ren, Victor Veitch
Contrastive embedding models trained with scale-invariant losses are typically paired with distance metrics like cosine similarity, effectively ignoring embedding magnitudes. Howev…
Time-Aware Feature Selection: Adaptive Temporal Masking for Stable Sparse Autoencoder Training
T. Ed Li, Junyu Ren
Understanding the internal representations of large language models is crucial for ensuring their reliability and safety, with sparse autoencoders (SAEs) emerging as a promising in…
Pre-Training and Prompting for Few-Shot Node Classification on Text-Attributed Graphs
Huanjing Zhao, Beining Yang, Yukuo Cen +6
The text-attributed graph (TAG) is one kind of important real-world graph-structured data with each node associated with raw texts. For TAGs, traditional few-shot node classificati…
Spatio-Temporal Graph Convolutional Network Combined Large Language Model: A Deep Learning Framework for Bike Demand Forecasting
Peisen Li, Yizhe Pang, Junyu Ren
This study presents a new deep learning framework, combining Spatio-Temporal Graph Convolutional Network (STGCN) with a Large Language Model (LLM), for bike demand forecasting. Add…