Aditya Gaydhani, Guangyue Xu, Dhanush Kamath, Ankit Singh, Alex Fengjie Li
原文摘要
Large-scale e-commerce search and recommendation systems rely on multiple specialized retrieval channels to surface diverse products, each optimized for a distinct objective. A key challenge is merging candidates from these heterogeneous channels into a single ranked list under strict latency constraints while optimizing business KPIs such as user conversion. Static rank-fusion methods such as Reciprocal Rank Fusion (RRF) and Weighted Interleaving use the same fusion behavior across queries, limiting their ability to adapt to context or model interactions among channel signals. We reformulate multi-channel fusion as a channel-aware learning-to-rank problem and propose a unified ranking model trained on a scalar, funnel-weighted graded-relevance label that combines clicks, add-to-carts, and purchases. The model incorporates channel-specific scores together with recent aggregate query-item behavior to capture near-term population demand. The evaluated channel set combines conventional relevance retrieval with query-conditioned, recommendation-oriented channels emphasizing newness, trending demand, regional relevance, and seasonality. A randomized online experiment shows a 2.85% increase in user conversion over the deployed weighted-interleaving control. The model achieves a p95 reranking-stage latency below 50 ms and has been deployed on Target.com.
E-commerce customers make purchase decisions by jointly considering product text and visual information, yet most industrial retrieval systems rely almost exclusively on textual signals. Deployed at scale on CPU-based nearest-neighbor infrastructure, these systems leave substantial visual evidence untapped. In this work, we study unified text-image fusion for two-tower retrieval models at a large-scale e-commerce platform, training on 20M query-item pairs. We demonstrate that domain-specific fine-tuning and modality-specific query alignment between user queries and both product text and image modalities are crucial for effective multimodal retrieval. Building on these insights, we propose a mixture-of-modality-experts fusion architecture with a bilinear interaction network to capture cross-modal complementary information. Our model achieves up to 4.86% improvement in nDCG@1 for desirability and 2.36% for relevance over a strong text-only baseline, while preserving the pre-computable item embedding design required for production deployment.