5 papers · 1 filter
TeRA: Vector-based Random Tensor Network for High-Rank Adaptation of Large Language Models
Yuxuan Gu, Wuyang Zhou, Giorgos Iacovides +1
Parameter-Efficient Fine-Tuning (PEFT) methods, such as Low-Rank Adaptation (LoRA), have significantly reduced the number of trainable parameters needed in fine-tuning large langua…
FinDPO: Financial Sentiment Analysis for Algorithmic Trading through Preference Optimization of LLMs
Giorgos Iacovides, Wuyang Zhou, Danilo Mandic
Opinions expressed in online finance-related textual data are having an increasingly profound impact on trading decisions and market movements. This trend highlights the vital role…
Understanding the Rank of Tensor Networks via an Intuitive Example-Driven Approach
Wuyang Zhou, Giorgos Iacovides, Kriton Konstantinidis +2
Tensor Network (TN) decompositions have emerged as an indispensable tool in Big Data analytics owing to their ability to provide compact low-rank representations, thus alleviating…
Domain-Aware Tensor Network Structure Search
Giorgos Iacovides, Wuyang Zhou, Chao Li +2
Tensor networks (TNs) provide efficient representations of high-dimensional data, yet identification of the optimal TN structures, the so called tensor network structure search (TN…
TensorLLM: Tensorising Multi-Head Attention for Enhanced Reasoning and Compression in LLMs
Yuxuan Gu, Wuyang Zhou, Giorgos Iacovides +1
The reasoning abilities of Large Language Models (LLMs) can be improved by structurally denoising their weights, yet existing techniques primarily focus on denoising the feed-forwa…