most citedLAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmark

40 citations · 61 across the 10 of their papers we have counts for

collaborators

10 papers

cs.CV2023

Autoregressive Omni-Aware Outpainting for Open-Vocabulary 360-Degree Image Generation

Zhuqiang Lu, Kun Hu, Chaoyue Wang +2

A 360-degree (omni-directional) image provides an all-encompassing spherical view of a scene. Recently, there has been an increasing interest in synthesising 360-degree images from…

cs.CV2023

Terrain Diffusion Network: Climatic-Aware Terrain Generation with Geological Sketch Guidance

Zexin Hu, Kun Hu, Clinton Mo +2

Sketch-based terrain generation seeks to create realistic landscapes for virtual environments in various applications such as computer games, animation and virtual reality. Recentl…

cs.SD2023★ 11 cited

Robust Audio Anti-Spoofing with Fusion-Reconstruction Learning on Multi-Order Spectrograms

Penghui Wen, Kun Hu, Wenxi Yue +3

Robust audio anti-spoofing has been increasingly challenging due to the recent advancements on deepfake techniques. While spectrograms have demonstrated their capability for anti-s…

cs.CV2023★ 4 cited

SurgicalSAM: Efficient Class Promptable Surgical Instrument Segmentation

Wenxi Yue, Jing Zhang, Kun Hu +3

The Segment Anything Model (SAM) is a powerful foundation model that has revolutionised image segmentation. To apply SAM to surgical instrument segmentation, a common approach is t…

cs.CL2023

Efficient and Interpretable Compressive Text Summarisation with Unsupervised Dual-Agent Reinforcement Learning

Peggy Tang, Junbin Gao, Lei Zhang +1

Recently, compressive text summarisation offers a balance between the conciseness issue of extractive summarisation and the factual hallucination issue of abstractive summarisation…

cs.CV2023★ 40 cited

LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmark

Zhenfei Yin, Jiong Wang, Jianjian Cao +9

Large language models have emerged as a promising approach towards achieving general-purpose AI agents. The thriving open-source LLM community has greatly accelerated the developme…

cs.CV2023★ 1 cited

Continuous Intermediate Token Learning with Implicit Motion Manifold for Keyframe Based Motion Interpolation

Clinton Ansun Mo, Kun Hu, Chengjiang Long +1

Deriving sophisticated 3D motions from sparse keyframes is a particularly challenging problem, due to continuity and exceptionally skeletal precision. The action features are often…

cs.CV2023★ 1 cited

Robust Knowledge Adaptation for Federated Unsupervised Person ReID

Jianfeng Weng, Kun Hu, Tingting Yao +2

Person Re-identification (ReID) has been extensively studied in recent years due to the increasing demand in public security. However, collecting and dealing with sensitive persona…

cs.CV2022★ 3 cited

TLDW: Extreme Multimodal Summarisation of News Videos

Peggy Tang, Kun Hu, Lei Zhang +2

Multimodal summarisation with multimodal output is drawing increasing attention due to the rapid growth of multimedia data. While several methods have been proposed to summarise vi…

cs.CV2022★ 1 cited

Skin Lesion Recognition with Class-Hierarchy Regularized Hyperbolic Embeddings

Zhen Yu, Toan Nguyen, Yaniv Gal +7

In practice, many medical datasets have an underlying taxonomy defined over the disease label space. However, existing classification algorithms for medical diagnoses often assume…