← 研踪 PaperTrailarXiv:2611.01343 · v1
MoEDDI: Semantic Mixtures of Experts for Long Tailed Drug Drug Interaction Prediction
首次提交 2026-11-01 07:19
版本更新 2026-11-01 07:19
雷达观测 2026-11-04 23:43
摘要
Descriptor-based drug--drug interaction (DDI) models typically apply a single global predictor despite heterogeneous physicochemical evidence and severely long-tailed labels. We introduce \textbf{MoEDDI (Mixture-of-Experts for Drug--Drug Interaction prediction)}, a chemically organized mixture-of-experts that routes overlapping descriptor families using low-dimensional statistics and combines their sparse top-$2$ mixture with a global T-DDI pathway through a residual logit correction. The residual parameterization can exactly preserve a supplied T-DDI checkpoint at initialization, although the evaluated models are trained from scratch. Across complete test partitions with 178, 86, and 92 classes, MoEDDI improves macro-F1 over reproduced seed-2026 T-DDI baselines from 0.8284 to 0.8485, 0.4729 to 0.6536, and 0.1807 to 0.4671. On the 3,780-feature corpus, the lowest-support group (89 classes with fewer than 50 test examples) shows the largest mean classwise gain (+3.30 F1 points). Calibration improves on one corpus but worsens on two. These single-seed results support semantic conditional specialization while motivating matched ablations and distribution-shift evaluation.
观测到的版本
相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。
v1 · 2026-11-01 07:19 · 最新观测版本
MoEDDI: Semantic Mixtures of Experts for Long Tailed Drug Drug Interaction Prediction
Descriptor-based drug--drug interaction (DDI) models typically apply a single global predictor despite heterogeneous physicochemical evidence and severely long-tailed labels. We introduce \textbf{MoEDDI (Mixture-of-Experts for Drug--Drug Interaction prediction)}, a chemically organized mixture-of-experts that routes overlapping descriptor families using low-dimensional statistics and combines their sparse top-$2$ mixture with a global T-DDI pathway through a residual logit correction. The residual parameterization can exactly preserve a supplied T-DDI checkpoint at initialization, although the evaluated models are trained from scratch. Across complete test partitions with 178, 86, and 92 classes, MoEDDI improves macro-F1 over reproduced seed-2026 T-DDI baselines from 0.8284 to 0.8485, 0.4729 to 0.6536, and 0.1807 to 0.4671. On the 3,780-feature corpus, the lowest-support group (89 classes with fewer than 50 test examples) shows the largest mean classwise gain (+3.30 F1 points). Calibration improves on one corpus but worsens on two. These single-seed results support semantic conditional specialization while motivating matched ablations and distribution-shift evaluation.
查看此版本解读 →查看此版本原文 ↗