Distribution-Guided Auto-Encoder for User Multimodal Interest Cross Fusion

Abstract

Traditional recommendation methods rely on correlating the embedding vectors of item IDs to capture implicit collaborative filtering signals to model the user's interest in the target item. Consequently, traditional ID-based methods often encounter data sparsity problems stemming from the sparse nature of ID features. To alleviate the problem of item ID sparsity, recommendation models incorporate multimodal item information to enhance recommendation accuracy. However, existing multimodal recommendation methods typically employ early fusion approaches, which focus primarily on combining text and image features, while neglecting the contextual influence of user behavior sequences. This oversight prevents dynamic adaptation of multimodal interest representations based on behavioral patterns, consequently restricting the model's capacity to effectively capture user multimodal interests. Therefore, this paper proposes the Distribution-Guided Multimodal-Interest Auto-Encoder (DMAE), which achieves the cross fusion of user multimodal interest at the behavioral level.Ultimately, extensive experiments demonstrate the superiority of DMAE.

Accepted by CIKM 2025, 11 pages, 4 figures, 4 tables

References in corpus (12)

• Facial Expression Analysis under Partial Occlusion: A Survey
• xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems
• AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networks
• Contrastive Learning for Representation Degeneration Problem in Sequential Recommendation
• Practice on Long Sequential User Behavior Modeling for Click-Through Rate Prediction
• EVA-02: A Visual Representation for Neon Genesis
• Optimized Cost per Click in Taobao Display Advertising
• An Embedding Learning Framework for Numerical Features in CTR Prediction
• Deep Spatio-Temporal Neural Networks for Click-Through Rate Prediction
• Enhancing CTR Prediction with Context-Aware Feature Representation Learning
• Deep Interest Highlight Network for Click-Through Rate Prediction in Trigger-Induced Recommendation
• Disentangling ID and Modality Effects for Session-based Recommendation