TY - JOUR
T1 - Privacy-Preserving Federated Learning Framework Based on Chained Secure Multiparty Computing
AU - Li, Yong
AU - Zhou, Yipeng
AU - Jolfaei, Alireza
AU - Yu, Dongjin
AU - Xu, Gaochao
AU - Zheng, Xi
PY - 2021/4/15
Y1 - 2021/4/15
N2 - Federated learning (FL) is a promising new technology in the field of IoT intelligence. However, exchanging model-related data in FL may leak the sensitive information of participants. To address this problem, we propose a novel privacy-preserving FL framework based on an innovative chained secure multiparty computing technique, named chain-PPFL. Our scheme mainly leverages two mechanisms: 1) single-masking mechanism that protects information exchanged between participants and 2) chained-communication mechanism that enables masked information to be transferred between participants with a serial chain frame. We conduct extensive simulation-based experiments using two public data sets (MNIST and CIFAR-100) by comparing both training accuracy and leak defence with other state-of-the-art schemes. We set two data sample distributions (IID and NonIID) and three training models (CNN, MLP, and L-BFGS) in our experiments. The experimental results demonstrate that the chain-PPFL scheme can achieve practical privacy preservation (equivalent to differential privacy with ϵ approaching zero) for FL with some cost of communication and without impairing the accuracy and convergence speed of the training model.
AB - Federated learning (FL) is a promising new technology in the field of IoT intelligence. However, exchanging model-related data in FL may leak the sensitive information of participants. To address this problem, we propose a novel privacy-preserving FL framework based on an innovative chained secure multiparty computing technique, named chain-PPFL. Our scheme mainly leverages two mechanisms: 1) single-masking mechanism that protects information exchanged between participants and 2) chained-communication mechanism that enables masked information to be transferred between participants with a serial chain frame. We conduct extensive simulation-based experiments using two public data sets (MNIST and CIFAR-100) by comparing both training accuracy and leak defence with other state-of-the-art schemes. We set two data sample distributions (IID and NonIID) and three training models (CNN, MLP, and L-BFGS) in our experiments. The experimental results demonstrate that the chain-PPFL scheme can achieve practical privacy preservation (equivalent to differential privacy with ϵ approaching zero) for FL with some cost of communication and without impairing the accuracy and convergence speed of the training model.
KW - FedAVG algorithm
KW - federated learning (FL)
KW - privacy preservation
KW - secure multiparty computing (SMC)
UR - http://www.scopus.com/inward/record.url?scp=85104078952&partnerID=8YFLogxK
UR - http://purl.org/au-research/grants/ARC/LP190100676
U2 - 10.1109/JIOT.2020.3022911
DO - 10.1109/JIOT.2020.3022911
M3 - Article
AN - SCOPUS:85104078952
VL - 8
SP - 6178
EP - 6186
JO - IEEE Internet of Things Journal
JF - IEEE Internet of Things Journal
SN - 2327-4662
IS - 8
ER -