NL-SME: Enhancing Multi-Step Gradient Inversion through Adaptive Two-State Matching
Li Xia, Jing Yu, Zheng Liu, Sili Huang, Wei Tang, Xuan Liu
原文摘要
Federated learning (FL) enables collaborative model training among multiple clients without directly sharing their raw data.However, gradient inversion attacks can exploit the model updates exchanged during training to reconstruct clients' private data.With multiple local training steps, an observed update combines gradients evaluated at changing model states and potentially different mini-batches, while intermediate states remain hidden. Restricting gradient evaluation to a single state on the segment between the initial and final models can exclude states that better fit the accumulated update.We consider reconstruction from an individual client's endpoint models, assuming that the training labels are known.We propose NL-SME, a regularized two-state gradient surrogate for matching multi-step client updates without replaying local training.The surrogate adapts its evaluation center, regularizes its displacement, and averages raw parameter gradients at two shared symmetric states.We evaluate NL-SME against existing gradient inversion methods on FEMNIST and CIFAR-100 with varying numbers of local training steps.The results show improved reconstruction quality, highlighting the privacy risks of sharing individual client updates after multiple local steps.
cs.LG · cs.CR