13 papers
Seeing, Maintaining, and Learning: The Evolution of Multimodal Agent Memory
Minghao Guo, Qingyue Jiao, Xiujin Liu +77
Multimodal models and agents have emerged to enable AI systems to learn from and interact with the real world more like humans by integrating information across multiple modalities…
Sensitivity or Criterion? Measuring and Moving When Language Models Act
Sixun Dong, Yebowen Hu, Ming Yin +3
Before an agent acts, it must decide whether action is warranted. A single accuracy cannot distinguish failure to recognize a warranted action from reluctance to act. Signal-detect…
To Think or Not To Think, That is The Question for Large Reasoning Models in Theory of Mind Tasks
Nanxu Gong, Haotian Li, Sixun Dong +3
Theory of Mind (ToM) assesses whether models can infer hidden mental states such as beliefs, desires, and intentions, which is essential for natural social interaction. Although re…
Teaching Time Series to See and Speak: Forecasting with Aligned Visual and Textual Perspectives
Sixun Dong, Wei Fan, Teresa Wu +1
Time series forecasting traditionally relies on unimodal numerical inputs, which often struggle to capture high-level semantic patterns due to their dense and unstructured nature.…
LLM-ML Teaming: Integrated Symbolic Decoding and Gradient Search for Valid and Stable Generative Feature Transformation
Xinyuan Wang, Haoyue Bai, Nanxu Gong +4
Feature transformation enhances data representation by deriving new features from the original data. Generative AI offers potential for this task, but faces challenges in stable ge…
Efficient Post-Training Refinement of Latent Reasoning in Large Language Models
Xinyuan Wang, Dongjie Wang, Wangyang Ying +5
Reasoning is a key component of language understanding in Large Language Models. While Chain-of-Thought prompting enhances performance via explicit intermediate steps, it suffers f…
Brownian Bridge Augmented Surrogate Simulation and Injection Planning for Geological CO Storage
Haoyue Bai, Guodong Chen, Wangyang Ying +7
Geological CO2 storage (GCS) involves injecting captured CO2 into deep subsurface formations to support climate goals. The effective management of GCS relies on adaptive injection…
Bridging the Domain Gap in Equation Distillation with Reinforcement Feedback
Wangyang Ying, Haoyue Bai, Nanxu Gong +4
The data-to-equation (Data2Eqn) task aims to discover interpretable mathematical equations that map observed values to labels, offering physical insights and broad applicability ac…
Sculpting Features from Noise: Reward-Guided Hierarchical Diffusion for Task-Optimal Feature Transformation
Nanxu Gong, Zijun Li, Sixun Dong +4
Feature Transformation (FT) crafts new features from original ones via mathematical operations to enhance dataset expressiveness for downstream models. However, existing FT methods…
Agentic Feature Augmentation: Unifying Selection and Generation with Teaming, Planning, and Memories
Nanxu Gong, Sixun Dong, Haoyue Bai +3
As a widely-used and practical tool, feature engineering transforms raw data into discriminative features to advance AI model performance. However, existing methods usually apply f…
Unsupervised Feature Transformation via In-context Generation, Generator-critic LLM Agents, and Duet-play Teaming
Nanxu Gong, Xinyuan Wang, Wangyang Ying +4
Feature transformation involves generating a new set of features from the original dataset to enhance the data's utility. In certain domains like material performance screening, di…
A Survey on Data-Centric AI: Tabular Learning from Reinforcement Learning and Generative AI Perspective
Wangyang Ying, Cong Wei, Nanxu Gong +7
Tabular data is one of the most widely used data formats across various domains such as bioinformatics, healthcare, and marketing. As artificial intelligence moves towards a data-c…
Towards Data-Centric AI: A Comprehensive Survey of Traditional, Reinforcement, and Generative Approaches for Tabular Data Transformation
Dongjie Wang, Yanyong Huang, Wangyang Ying +11
Tabular data is one of the most widely used formats across industries, driving critical applications in areas such as finance, healthcare, and marketing. In the era of data-centric…