14 citations · 44 across the 14 of their papers we have counts for
16 papers
Align Then Reason: A Multimodal Lip-Sync Judge for Dubbing
Rui Liu, Bhavin Jawade, Haoqi Li +4
Dubbing quality control requires a reference-free judge that can determine whether a candidate text line matches a speaker's visible articulation in both content and timing, using…
TQLite: Multi-LLM Jury Guided Distillation for Real-time MQM Translation Quality Evaluation
Bhavin Jawade, Cameron R. Wolfe
Large language models (LLMs) have demonstrated impressive performance in MQM-based translation quality (TQ) evaluation, and recent advances in large reasoning models (LRMs) promise…
Better Schedules for Low Precision Training of Deep Neural Networks
Cameron R. Wolfe, Anastasios Kyrillidis
Low precision training can significantly reduce the computational overhead of training deep neural networks (DNNs). Though many such techniques exist, cyclic precision training (CP…
Cold Start Streaming Learning for Deep Networks
Cameron R. Wolfe, Anastasios Kyrillidis
The ability to dynamically adapt neural networks to newly-available data without performance deterioration would revolutionize deep learning applications. Streaming learning (i.e.,…
PipeGCN: Efficient Full-Graph Training of Graph Convolutional Networks with Pipelined Feature Communication
Cheng Wan, Youjie Li, Cameron R. Wolfe +3
Graph Convolutional Networks (GCNs) is the state-of-the-art method for learning graph-structured data, and training large-scale GCNs requires distributed training across multiple a…
i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery
Cameron R. Wolfe, Anastasios Kyrillidis
We propose a novel, structured pruning algorithm for neural networks -- the iterative, Sparse Structured Pruning algorithm, dubbed as i-SpaSP. Inspired by ideas from sparse signal…
How much pre-training is enough to discover a good subnetwork?
Cameron R. Wolfe, Fangshuo Liao, Qihan Wang +2
Neural network pruning is useful for discovering efficient, high-performing subnetworks within pre-trained, dense network architectures. More often than not, it involves a three-st…
Exceeding the Limits of Visual-Linguistic Multi-Task Learning
Cameron R. Wolfe, Keld T. Lundgaard
By leveraging large amounts of product data collected across hundreds of live e-commerce websites, we construct 1000 unique classification tasks that share similarly-structured inp…
REX: Revisiting Budgeted Training with an Improved Schedule
John Chen, Cameron Wolfe, Anastasios Kyrillidis
Deep learning practitioners often operate on a computational and monetary budget. Thus, it is critical to design optimization algorithms that perform well under any budget. The lin…
Momentum-inspired Low-Rank Coordinate Descent for Diagonally Constrained SDPs
Junhyung Lyle Kim, JA Lara Benitez, Mohammad Taha Toghani +3
We present a novel, practical, and provable approach for solving diagonally constrained semi-definite programming (SDP) problems at scale using accelerated non-convex programming.…
ResIST: Layer-Wise Decomposition of ResNets for Distributed Training
Chen Dun, Cameron R. Wolfe, Christopher M. Jermaine +1
We propose ResIST, a novel distributed training protocol for Residual Networks (ResNets). ResIST randomly decomposes a global ResNet into several shallow sub-ResNets that are train…
GIST: Distributed Training for Large-Scale Graph Convolutional Networks
Cameron R. Wolfe, Jingkang Yang, Arindam Chowdhury +4
The graph convolutional network (GCN) is a go-to solution for machine learning on graphs, but its training is notoriously difficult to scale both in terms of graph size and the num…
E-Stitchup: Data Augmentation for Pre-Trained Embeddings
Cameron R. Wolfe, Keld T. Lundgaard
In this work, we propose data augmentation methods for embeddings from pre-trained deep learning models that take a weighted combination of a pair of input embeddings, as inspired…
Demon: Improved Neural Network Training with Momentum Decay
John Chen, Cameron Wolfe, Zhao Li +1
Momentum is a widely used technique for gradient-based optimizers in deep learning. In this paper, we propose a decaying momentum (\textsc{Demon}) rule. We conduct the first large-…
Distributed Learning of Deep Neural Networks using Independent Subnet Training
Binhang Yuan, Cameron R. Wolfe, Chen Dun +3
Distributed machine learning (ML) can bring more computational resources to bear than single-machine learning, thus enabling reductions in training time. Distributed learning parti…
Functional Generative Design of Mechanisms with Recurrent Neural Networks and Novelty Search
Cameron R. Wolfe, Cem C. Tutum, Risto Miikkulainen
Consumer-grade 3D printers have made it easier to fabricate aesthetic objects and static assemblies, opening the door to automated design of such objects. However, while static des…