Augur: An Online Learning-based Hardware Data Prefetcher using Reservoir Computing
Satvik Maurya, David Trilla, Swamit Tannu, Alper Buyuktosunoglu
原文摘要
Machine-learning-based hardware prefetchers can learn complex access patterns, but practical deployment demands online adaptation, low-latency inference, and modest hardware cost. We present Augur, a hardware delta prefetcher based on next-generation reservoir computing (NGRC) that meets all three requirements. Augur formulates delta prediction as a history-based regression problem. It constructs a fixed-size reservoir from hashed delta features over a short context window and predicts the next delta using a single dot product. The model is updated online via one-step SGD and requires no offline pre-training, no per-benchmark tuning, and no floating-point arithmetic. Replacing the integer multiplications traditionally used to generate nonlinear reservoir features with bitwise AND operations removes all feature-generation multipliers with no loss in performance. Because Augur regresses a continuous delta, it needs no action set chosen offline for a fixed set of workloads. Augur pairs the reservoir with a simple Markov-based delta predictor for simple delta patterns, and with a selective issuance policy that filters and throttles wasteful prefetches; this policy accounts for about 40% of Augur's advantage and also improves Pythia. Evaluated on 169 traces spanning GAP, Ligra, PARSEC, SPEC CPU 2006, SPEC CPU 2017, and AI workloads, Augur outperforms the state-of-the-art ML-based delta prefetcher by 2.9%, 4.5%, and 5.3% in geomean speedup on 1-, 4-, and 8-core systems, respectively, while achieving ~2x higher prefetch accuracy and 37.8 percentage points fewer overpredictions. Augur is practical to implement at 33 KB storage, 0.32 sq. mm area, and 32.7 mW in 12 nm.
cs.AR