← 研踪 PaperTrailarXiv:2412.12227 · v2
Embedded Decomposed Transformer for explainable multivariate time series forecasting
首次提交 2024-12-16 19:13
版本更新 2026-11-09 17:07
雷达观测 2026-11-10 15:22
摘要
Time series forecasting is an important problem with diverse real-world applications. This paper introduces the Embedded Decomposed Transformer (EDformer) for multivariate time series forecasting. EDformer decomposes the input signal into seasonal and trend components using two complementary strategies: time-domain Average Pooling (AP) based on moving-average smoothing and Frequency-Aware (FA) decomposition based on low-pass filtering in the Fourier domain. The reconstructed multivariate seasonal component is embedded across inverted dimensions, after which attention captures cross-variate correlations and a feed-forward network learns nonlinear representations for each variable. The trend component is forecast through projection and combined with the seasonal prediction to produce the final forecast. We evaluate both decomposition variants on several real-world datasets, showing that EDformer achieves competitive performance, while their relative effectiveness varies across datasets, experimental settings, and temporal characteristics. We further conduct an ablation study isolating the contribution of decomposition, inverted embedding, and the frequency cutoff ratio; a hyperparameter sensitivity analysis over learning rate and batch size; and a statistical significance analysis using Friedman and Wilcoxon signed-rank tests to substantiate the reported performance differences. Finally, model explainability techniques are explored to improve interpretability and provide insights into the features and time steps influencing the forecasting results.
期刊信息:Computers and Electrical Engineering, 2026
观测到的版本
相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。
v2 · 2026-11-09 17:07 · 最新观测版本
Embedded Decomposed Transformer for explainable multivariate time series forecasting
Time series forecasting is an important problem with diverse real-world applications. This paper introduces the Embedded Decomposed Transformer (EDformer) for multivariate time series forecasting. EDformer decomposes the input signal into seasonal and trend components using two complementary strategies: time-domain Average Pooling (AP) based on moving-average smoothing and Frequency-Aware (FA) decomposition based on low-pass filtering in the Fourier domain. The reconstructed multivariate seasonal component is embedded across inverted dimensions, after which attention captures cross-variate correlations and a feed-forward network learns nonlinear representations for each variable. The trend component is forecast through projection and combined with the seasonal prediction to produce the final forecast. We evaluate both decomposition variants on several real-world datasets, showing that EDformer achieves competitive performance, while their relative effectiveness varies across datasets, experimental settings, and temporal characteristics. We further conduct an ablation study isolating the contribution of decomposition, inverted embedding, and the frequency cutoff ratio; a hyperparameter sensitivity analysis over learning rate and batch size; and a statistical significance analysis using Friedman and Wilcoxon signed-rank tests to substantiate the reported performance differences. Finally, model explainability techniques are explored to improve interpretability and provide insights into the features and time steps influencing the forecasting results.
查看此版本解读 →查看此版本原文 ↗