3 citations · 5 across the 7 of their papers we have counts for
8 papers
Cross-Tokenizer LLM Distillation through a Byte-Level Interface
Avyav Kumar Singh, Yen-Chen Wu, Alexandru Cioba +2
Cross-tokenizer distillation (CTD), the transfer of knowledge from a teacher to a student language model when the two use different tokenizers, remains a largely unsolved problem.…
Reinforcement Learning Using known Invariances
Alexandru Cioba, Aya Kayal, Laura Toni +2
In many real-world reinforcement learning (RL) problems, the environment exhibits inherent symmetries that can be exploited to improve learning efficiency. This paper develops a th…
Exact, Tractable Gauss-Newton Optimization in Deep Reversible Architectures Reveal Poor Generalization
Davide Buffelli, Jamie McGowan, Wangkun Xu +4
Second-order optimization has been shown to accelerate the training of deep neural networks in many applications, often yielding faster progress per iteration on the training loss…
Sample-efficient Bayesian Optimisation Using Known Invariances
Theodore Brown, Alexandru Cioba, Ilija Bogunovic
Bayesian optimisation (BO) is a powerful framework for global optimisation of costly functions, using predictions from Gaussian process models (GPs). In this work, we apply BO to f…
Flexible Multiple-Objective Reinforcement Learning for Chip Placement
Fu-Chieh Chang, Yu-Wei Tseng, Ya-Wen Yu +11
Recently, successful applications of reinforcement learning to chip placement have emerged. Pretrained models are necessary to improve efficiency and effectiveness. Currently, the…
How to distribute data across tasks for meta-learning?
Alexandru Cioba, Michael Bromberg, Qian Wang +5
Meta-learning models transfer the knowledge acquired from previous tasks to quickly learn new ones. They are trained on benchmarks with a fixed number of data points per task. This…
Efficient attention guided 5G power amplifier digital predistortion
Alexandru Cioba, Alvin Chua, Da-shan Shiu +2
We investigate neural network (NN) assisted techniques for compensating the non-linear behaviour and the memory effect of a 5G PA through digital predistortion (DPD). Traditionally…
Unknotted Reeb orbits and nicely embedded holomorphic curves
Alexandru Cioba, Chris Wendl
We exhibit a distinctly low-dimensional dynamical obstruction to the existence of Liouville cobordisms: for any contact 3-manifold admitting an exact symplectic cobordism to the ti…