566 citations · 716 across the 21 of their papers we have counts for
21 papers
MolXPT: Wrapping Molecules with Text for Generative Pre-training
Zequn Liu, Wei Zhang, Yingce Xia +5
Generative pre-trained Transformer (GPT) has demonstrates its great success in natural language processing and related techniques have been adapted into molecular modeling. Conside…
De Novo Molecular Generation via Connection-aware Motif Mining
Zijie Geng, Shufang Xie, Yingce Xia +6
De novo molecular generation is an essential task for science discovery. Recently, fragment-based deep generative models have attracted much research attention due to their flexibi…
Incorporating Pre-training Paradigm for Antibody Sequence-Structure Co-design
Kaiyuan Gao, Lijun Wu, Jinhua Zhu +8
Antibodies are versatile proteins that can bind to pathogens and provide effective protection for human body. Recently, deep learning-based computational antibody design has attrac…
Tailoring Molecules for Protein Pockets: a Transformer-based Generative Solution for Structured-based Drug Design
Kehan Wu, Yingce Xia, Yang Fan +7
Structure-based drug design is drawing growing attentions in computer-aided drug discovery. Compared with the virtual screening approach where a pre-defined library of compounds ar…
Unified 2D and 3D Pre-Training of Molecular Representations
Jinhua Zhu, Yingce Xia, Lijun Wu +5
Molecular representation learning has attracted much attention recently. A molecule can be viewed as a 2D graph with nodes/atoms connected by edges/bonds, and can also be represent…
SSM-DTA: Breaking the Barriers of Data Scarcity in Drug-Target Affinity Prediction
Qizhi Pei, Lijun Wu, Jinhua Zhu +6
Accurate prediction of Drug-Target Affinity (DTA) is of vital importance in early-stage drug discovery, facilitating the identification of drugs that can effectively interact with…
A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyond
Yisheng Xiao, Lijun Wu, Junliang Guo +4
Non-autoregressive (NAR) generation, which is first proposed in neural machine translation (NMT) to speed up inference, has attracted much attention in both machine learning and na…
Dynamic Relation Discovery and Utilization in Multi-Entity Time Series Forecasting
Lin Huang, Lijun Wu, Jia Zhang +2
Time series forecasting plays a key role in a variety of domains. In a lot of real-world scenarios, there exist multiple forecasting entities (e.g. power station in the solar syste…
AF: Adaptive Focus Framework for Aerial Imagery Segmentation
Lin Huang, Qiyuan Dong, Lijun Wu +3
As a specific semantic segmentation task, aerial imagery segmentation has been widely employed in high spatial resolution (HSR) remote sensing images understanding. Besides common…
Incorporating NODE with Pre-trained Neural Differential Operator for Learning Dynamics
Shiqi Gong, Qi Meng, Yue Wang +4
Learning dynamics governed by differential equations is crucial for predicting and controlling the systems in science and engineering. Neural Ordinary Differential Equation (NODE),…
UniDrop: A Simple yet Effective Technique to Improve Transformer without Extra Cost
Zhen Wu, Lijun Wu, Qi Meng +5
Transformer architecture achieves great success in abundant natural language processing tasks. The over-parameterization of the Transformer model has motivated plenty of works to a…
IOT: Instance-wise Layer Reordering for Transformer Structures
Jinhua Zhu, Lijun Wu, Yingce Xia +5
With sequentially stacked self-attention, (optional) encoder-decoder attention, and feed-forward layers, Transformer achieves big success in natural language processing (NLP), and…
ADD: Augmented Disentanglement Distillation Framework for Improving Stock Trend Forecasting
Hongshun Tang, Lijun Wu, Weiqing Liu +1
Stock trend forecasting has become a popular research direction that attracts widespread attention in the financial field. Though deep learning methods have achieved promising resu…
Learning to Reweight with Deep Interactions
Yang Fan, Yingce Xia, Lijun Wu +5
Recently, the concept of teaching has been introduced into machine learning, in which a teacher model is used to guide the training of a student model (which will be used in real t…
Microsoft Research Asia's Systems for WMT19
Yingce Xia, Xu Tan, Fei Tian +11
We Microsoft Research Asia made submissions to 11 language directions in the WMT19 news translation tasks. We won the first place for 8 of the 11 directions and the second place fo…
Efficient Bidirectional Neural Machine Translation
Xu Tan, Yingce Xia, Lijun Wu +1
The encoder-decoder based neural machine translation usually generates a target sequence token by token from left to right. Due to error propagation, the tokens in the right side o…
Learning to Teach with Dynamic Loss Functions
Lijun Wu, Fei Tian, Yingce Xia +4
Teaching is critical to human society: it is with teaching that prospective students are educated and human civilization can be inherited and advanced. A good teacher not only prov…
Beyond Error Propagation in Neural Machine Translation: Characteristics of Language Also Matter
Lijun Wu, Xu Tan, Di He +4
Neural machine translation usually adopts autoregressive models and suffers from exposure bias as well as the consequent error propagation problem. Many previous works have discuss…
A Study of Reinforcement Learning for Neural Machine Translation
Lijun Wu, Fei Tian, Tao Qin +2
Recent studies have shown that reinforcement learning (RL) is an effective approach for improving the performance of neural machine translation (NMT) system. However, due to its in…
Entire solutions of certain type of non-linear differential-difference equations
Li-Hao Wu, Ran-Ran Zhang, Zhi-Bo Huang
The existence of sufficiently many finite order meromorphic solutions of a differential equation, or difference equation, or differential-difference equation, appears to be a good…
Achieving Human Parity on Automatic Chinese to English News Translation
Hany Hassan, Anthony Aue, Chang Chen +21
Machine translation has made rapid advances in recent years. Millions of people are using it today in online translation systems and mobile applications in order to communicate acr…