37 citations · 67 across the 8 of their papers we have counts for
8 papers
QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs
Saleh Ashkboos, Amirkeivan Mohtashami, Maximilian L. Croci +6
We introduce QuaRot, a new Quantization scheme based on Rotations, which is able to quantize LLMs end-to-end, including all weights, activations, and KV cache in 4 bits. QuaRot rot…
HMD-NeMo: Online 3D Avatar Motion Generation From Sparse Observations
Sadegh Aliakbarian, Fatemeh Saleh, David Collier +2
Generating both plausible and accurate full body avatar motion is the key to the quality of immersive experiences in mixed reality scenarios. Head-Mounted Devices (HMDs) typically…
FLAG: Flow-based 3D Avatar Generation from Sparse Observations
Sadegh Aliakbarian, Pashmina Cameron, Federica Bogo +2
To represent people in mixed reality applications for collaboration and communication, we need to generate realistic and faithful avatar poses. However, the signal streams that can…
Contextual HyperNetworks for Novel Feature Adaptation
Angus Lamb, Evgeny Saveliev, Yingzhen Li +7
While deep learning has obtained state-of-the-art results in many applications, the adaptation of neural network architectures to incorporate new output features remains a challeng…
Results and Insights from Diagnostic Questions: The NeurIPS 2020 Education Challenge
Zichao Wang, Angus Lamb, Evgeny Saveliev +9
This competition concerns educational diagnostic questions, which are pedagogically effective, multiple-choice questions (MCQs) whose distractors embody misconceptions. With a larg…
Learning to Extend Molecular Scaffolds with Structural Motifs
Krzysztof Maziarz, Henry Jackson-Flux, Pashmina Cameron +5
Recent advancements in deep learning-based modeling of molecules promise to accelerate in silico drug discovery. A plethora of generative models is available, building molecules ei…
Towards Compliant Data Management Systems for Healthcare ML
Goutham Ramakrishnan, Aditya Nori, Hannah Murfet +1
The increasing popularity of machine learning approaches and the rising awareness of data protection and data privacy presents an opportunity to build truly secure and trustworthy…
Instructions and Guide for Diagnostic Questions: The NeurIPS 2020 Education Challenge
Zichao Wang, Angus Lamb, Evgeny Saveliev +9
Digital technologies are becoming increasingly prevalent in education, enabling personalized, high quality education resources to be accessible by students across the world. Import…