1 citations · 1 across the 4 of their papers we have counts for
Showing cs.CLShow all
3 papers · 1 filter
cs.CL2026
BERT-JEPA: Reorganizing CLS Embeddings for Language-Invariant Semantics
Taj Gillin, Adam Lalani, Kenneth Zhang +1
Joint Embedding Predictive Architectures (JEPA) are a novel self supervised training technique that have shown recent promise across domains. We introduce BERT-JEPA (BEPA), a train…
cs.CL2025
Dual Decomposition of Weights and Singular Value Low Rank Adaptation
Jialong Han, Si Zhang, Ke Zhang
Parameter-Efficient Fine-Tuning (PEFT) has emerged as a critical paradigm for adapting Large Language Models (LLMs) to downstream tasks, among which Low-rank Adaptation (LoRA) repr…
cs.CL2025
OSoRA: Output-Dimension and Singular-Value Initialized Low-Rank Adaptation
Jialong Han, Si Zhang, Ke Zhang
Fine-tuning Large Language Models (LLMs) has become increasingly challenging due to their massive scale and associated computational costs. Parameter-Efficient Fine-Tuning (PEFT) m…