activity
20172023
most citedA Survey on Multimodal Large Language Models

736 citations · 1.2k across the 23 of their papers we have counts for

collaborators

24 papers

cs.HC2023★ 1 cited

Comparing Spatial Navigation and Human Environment Interaction in Virtual Reality vs. Identical Real Environments across the Adult Lifespan

Saleh Kalantari, Bill Tong Xu, Armin Mostafavi +2

Virtual reality (VR) is increasingly being used as a research platform for investigating human responses to environmental variables. While VR provides tremendous advantages in term…

cs.HC2023

Visual Flow-based Programming Plugin for Brain Computer Interface in Computer-Aided Design

Tong Bill Xu, Saleh Kalantari

Over the last half century, the main application of Brain Computer Interfaces, BCIs has been controlling wheelchairs and neural prostheses or generating text or commands for people…

cs.HC2023★ 2 cited

Assessing the Effects of Illuminance and Correlated Color Temperature on Emotional Responses and Lighting Preferences Using Virtual Reality

Armin Mostafavi, Tong Bill Xu, Saleh Kalantari

This paper presents a novel approach to assessing human lighting adjustment behavior and preference in diverse lighting conditions through the evaluation of emotional feedback and…

cs.CV2023

A Solution to CVPR'2023 AQTC Challenge: Video Alignment for Multi-Step Inference

Chao Zhang, Shiwei Wu, Sirui Zhao +2

Affordance-centric Question-driven Task Completion (AQTC) for Egocentric Assistant introduces a groundbreaking scenario. In this scenario, through learning instructional videos, AI…

cs.LG2023★ 1 cited

Multi-Temporal Relationship Inference in Urban Areas

Shuangli Li, Jingbo Zhou, Ji Liu +3

Finding multiple temporal relationships among locations can benefit a bunch of urban applications, such as dynamic offline advertising and smart public transport planning. While so…

cs.CV2023★ 736 cited

A Survey on Multimodal Large Language Models

Shukang Yin, Chaoyou Fu, Sirui Zhao +4

Recently, Multimodal Large Language Model (MLLM) represented by GPT-4V has been a new rising research hotspot, which uses powerful Large Language Models (LLMs) as a brain to perfor…

cs.MM2023

Social Context-aware GCN for Video Character Search via Scene-prior Enhancement

Wenjun Peng, Weidong He, Derong Xu +3

With the increasing demand for intelligent services of online video platforms, video character search task has attracted wide attention to support downstream applications like fine…

quant-ph2023★ 74 cited

Quantum Neural Network for Quantum Neural Computing

Min-Gang Zhou, Zhi-Ping Liu, Hua-Lei Yin +3

Neural networks have achieved impressive breakthroughs in both industry and academia. How to effectively develop neural networks on quantum computing devices is a challenging open…

cs.CV2023★ 2 cited

AU-aware graph convolutional network for Macro- and Micro-expression spotting

Shukang Yin, Shiwei Wu, Tong Xu +3

Automatic Micro-Expression (ME) spotting in long videos is a crucial step in ME analysis but also a challenging task due to the short duration and low intensity of MEs. When solvin…

cs.CL2023★ 3 cited

Federated Nearest Neighbor Machine Translation

Yichao Du, Zhirui Zhang, Bingzhe Wu +3

To protect user privacy and meet legal regulations, federated learning (FL) is attracting significant attention. Training neural machine translation (NMT) models with traditional F…

cs.LG2022★ 2 cited

A Contextual Master-Slave Framework on Urban Region Graph for Urban Village Detection

Congxi Xiao, Jingbo Zhou, Jizhou Huang +4

Urban villages (UVs) refer to the underdeveloped informal settlement falling behind the rapid urbanization in a city. Since there are high levels of social inequality and social ri…

cs.HC2022★ 1 cited

Using Immersive Virtual Reality to Enhance Social Interaction among Older Adults: A Multi-site Study

Saleh Kalantari, Tong Bill Xu, Armin Mostafavi +4

Research examining older adults interactions with Virtual Reality (VR) and the impact of social VR experiences on outcomes such as social engagement has been limited, especially am…

cs.HC2022★ 1 cited

Designing Virtual Environments for Social Engagement in Older Adults

Tong Bill Xu, Armin Mostafavi, Benjamin Kim +4

Virtual reality (VR) is increasingly used as a platform for social interaction, including as a means for older adults to maintain engagement. However, there has been limited resear…

cs.CV2022

Winning the CVPR'2022 AQTC Challenge: A Two-stage Function-centric Approach

Shiwei Wu, Weidong He, Tong Xu +2

Affordance-centric Question-driven Task Completion for Egocentric Assistant(AQTC) is a novel task which helps AI assistant learn from instructional videos and scripts and guide the…

stat.AP2022

Efficient Inference of Spatially-varying Gaussian Markov Random Fields with Applications in Gene Regulatory Networks

Visweswaran Ravikumar, Tong Xu, Wajd N. Al-Holou +2

In this paper, we study the problem of inferring spatially-varying Gaussian Markov random fields (SV-GMRF) where the goal is to learn a network of sparse, context-specific GMRFs re…

cs.HC2022

Using a Nature-based Virtual Reality Environment for Improving Mood States and Cognitive Engagement in Older Adults: A Mixed-method Feasibility Study

Saleh Kalantari, Tong Bill Xu, Armin Mostafavi +4

Engaging with natural environments and representations of nature has been shown to improve mood states and reduce cognitive decline in older adults. The current study evaluated the…

cs.CL2021★ 5 cited

VIRT: Improving Representation-based Models for Text Matching through Virtual Interaction

Dan Li, Yang Yang, Hongyin Tang +4

With the booming of pre-trained transformers, representation-based models based on Siamese transformer encoders have become mainstream techniques for efficient text matching. Howev…

q-bio.QM2021★ 2 cited

Structure-aware Interactive Graph Neural Networks for the Prediction of Protein-Ligand Binding Affinity

Shuangli Li, Jingbo Zhou, Tong Xu +6

Drug discovery often relies on the successful prediction of protein-ligand binding affinity. Recent advances have shown great promise in applying graph neural networks (GNNs) for b…

cs.CV2019

Is Heuristic Sampling Necessary in Training Deep Object Detectors?

Joya Chen, Dong Liu, Tong Xu +3

To train accurate deep object detectors under the extreme foreground-background imbalance, heuristic sampling methods are always necessary, which either re-sample a subset of all t…

cs.CL2019★ 7 cited

Chinese Embedding via Stroke and Glyph Information: A Dual-channel View

Hanqing Tao, Shiwei Tong, Tong Xu +2

Recent studies have consistently given positive hints that morphology is helpful in enriching word embeddings. In this paper, we argue that Chinese word embeddings can be substanti…

cs.SI2019★ 133 cited

MCNE: An End-to-End Framework for Learning Multiple Conditional Network Representations of Social Network

Hao Wang, Tong Xu, Qi Liu +5

Recently, the Network Representation Learning (NRL) techniques, which represent graph structure via low-dimension vectors to support social-oriented application, have attracted wid…

cs.AI2018★ 155 cited

Enhancing Person-Job Fit for Talent Recruitment: An Ability-aware Neural Network Approach

Chuan Qin, Hengshu Zhu, Tong Xu +4

The wide spread use of online recruitment services has led to information explosion in the job market. As a result, the recruiters have to seek the intelligent ways for Person Job…

eess.SY2017★ 1 cited

A Response-Function-Based Coordination Method for Transmission-Distribution-Coupled AC OPF

Zhengshuo Li, Qinglai Guo, Hongbin Sun +2

With distributed generation highly integrated into the grid, the transmission-distribution-coupled AC OPF (TDOPF) becomes increasingly important. This paper proposes a response-fun…

cs.CY2017★ 33 cited

Measuring the Popularity of Job Skills in Recruitment Market: A Multi-Criteria Approach

Tong Xu, Hengshu Zhu, Chen Zhu +2

To cope with the accelerating pace of technological changes, talents are urged to add and refresh their skills for staying in active and gainful employment. This raises a natural q…