9 citations · 23 across the 21 of their papers we have counts for
12 papers · 1 filter
Hyperbolic Deep Learning for Foundation Models: A Survey
Neil He, Hiren Madhu, Ngoc Bui +2
Foundation models pre-trained on massive datasets, including large language models (LLMs), vision-language models (VLMs), and large multimodal models, have demonstrated remarkable…
Discrete Tokenization for Multimodal LLMs: A Comprehensive Survey
Jindong Li, Yali Fu, Jiahong Liu +5
The rapid advancement of large language models (LLMs) has intensified the need for effective mechanisms to transform continuous multimodal data into discrete representations suitab…
Learning Along the Arrow of Time: Hyperbolic Geometry for Backward-Compatible Representation Learning
Ngoc Bui, Menglin Yang, Runjin Chen +5
Backward compatible representation learning enables updated models to integrate seamlessly with existing ones, avoiding to reprocess stored data. Despite recent advances, existing…
Towards Non-Euclidean Foundation Models: Advancing AI Beyond Euclidean Frameworks
Menglin Yang, Yifei Zhang, Jialin Chen +2
In the era of foundation models and Large Language Models (LLMs), Euclidean space is the de facto geometric setting of our machine learning architectures. However, recent literatur…
HMamba: Hyperbolic Mamba for Sequential Recommendation
Qianru Zhang, Honggang Wen, Wei Yuan +4
Sequential recommendation systems have become a cornerstone of personalized services, adept at modeling the temporal evolution of user preferences by capturing dynamic interaction…
HELM: Hyperbolic Large Language Models via Mixture-of-Curvature Experts
Neil He, Rishabh Anand, Hiren Madhu +5
Large language models (LLMs) have shown great success in text modeling tasks across domains. However, natural language exhibits inherent semantic hierarchies and nuanced geometric…
HyperCore: The Core Framework for Building Hyperbolic Foundation Models with Comprehensive Modules
Neil He, Menglin Yang, Rex Ying
Hyperbolic neural networks have emerged as a powerful tool for modeling hierarchical data across diverse modalities. Recent studies show that token distributions in foundation mode…
Position: Beyond Euclidean -- Foundation Models Should Embrace Non-Euclidean Geometries
Neil He, Jiahong Liu, Buze Zhang +6
In the era of foundation models and Large Language Models (LLMs), Euclidean space has been the de facto geometric setting for machine learning architectures. However, recent litera…
Hierarchical Graph Topic Modeling with Topic Tree-based Transformer
Delvin Ce Zhang, Menglin Yang, Xiaobao Wu +2
Textual documents are commonly connected in a hierarchical graph structure where a central document links to others with an exponentially growing connectivity. Though Hyperbolic Gr…
A Survey of Personalized Large Language Models: Progress and Future Directions
Jiahong Liu, Zexuan Qiu, Zhongyang Li +7
Large Language Models (LLMs) excel in handling general knowledge tasks, yet they struggle with user-specific personalization, such as understanding individual emotions, writing sty…
Lorentzian Residual Neural Networks
Neil He, Menglin Yang, Rex Ying
Hyperbolic neural networks have emerged as a powerful tool for modeling hierarchical data structures prevalent in real-world datasets. Notably, residual connections, which facilita…
Low-Rank Adaptation for Foundation Models: A Comprehensive Review
Menglin Yang, Jialin Chen, Jinkai Tao +9
The rapid advancement of foundation modelslarge-scale neural networks trained on diverse, extensive datasetshas revolutionized artificial intelligence, enabling unprecedented advan…