Journal of Beijing University of Posts and Telecommunications

  • EI核心期刊

Journal of Beijing University of Posts and Telecommunications ›› 2023, Vol. 46 ›› Issue (1): 12-18.

Previous Articles     Next Articles

A Personalized Federated Learning Algorithm Based on Meta-Learning and Knowledge Distillation

  

  • Received:2021-12-29 Revised:2022-02-12 Online:2023-02-28 Published:2023-02-22

Abstract: In federated learning (FL),the distribution of data in clients is always heterogeneous,which makes the unified model trained in FL unable to meet the demand of each client. To combat this issue, a personalized federated learning algorithm with meta learning and knowledge distillation is proposed,in which the knowledge distillation and meta-learning with FL and incorporating the personalization are combined into the training of FL. In each global iteration,the global model(teacher model) update itself according to the feedback from the local model ( student model) during the knowledge distillation. Therefore,each client can obtain a better personalized model. Simulation results show that compared with the existing personalized algorithms, the proposed algorithm can achieve a better compromise between global accuracy and personalization accuracy while improving the personalization accuracy.

Key words: federated learning , meta-learning , knowledge distillation , personalization

CLC Number: