Authored by researchers and practitioners who build cutting-edge federated learning applications to solve real-world problems, this book covers the spectrum of federated learning technology from concepts and application scenarios to advanced algorithms and finally system implementation in three parts. It provides a comprehensive review and summary of federated learning technology, as well as presenting numerous novel federated learning algorithms which no other books have summarized. The work also references the most recent papers, articles and reviews from the past several years to keep pace with the academic and industrial state of the art of federated learning.
The first part lays a foundational understanding of federated learning by going through its definition and characteristics, and also possible application scenarios and related privacy protection technologies. The second part elaborates on some of the federated learning algorithms innovated by JD Technology which encompass both vertical and horizontal scenarios, including vertical federated tree models, linear regression, kernel learning, asynchronous methods, deep learning, homomorphic encryption, and reinforcement learning. The third and final part shifts in scope to federated learning systems — namely JD Technology's own FedLearn system — by discussing its design and implementation using gRPC, in addition to specific performance optimization techniques plus integration with blockchain technology.
This book will serve as a great reference for readers who are experienced in federated learning algorithms, building privacy-preserving machine learning applications or solving real-world problems with privacy-restricted scenarios.
Sample Chapter(s)
Preface
Chapter 1: Introduction to Federated Learning
Contents:
- Federated Learning Knowledge:
- Introduction to Federated Learning
- Federated Learning Application Scenarios
- Common Privacy Protection Technologies
- Federated Learning Algorithms:
- Tree-Based Models in Vertical Federated Learning
- Vertical Federated Linear Regression Algorithm
- Vertically Federated Kernel Learning
- Asynchronous Vertical Federated Learning Algorithm
- Secure Bilevel Asynchronous Vertical Federated Learning with Backward Updating
- Vertical Federated Deep Learning Algorithms
- Faster Secure Data Mining Framework via Homomorphic Encryption
- Horizontal Federated Learning Algorithms
- Mixed Federated Learning Algorithms
- Federated Reinforcement Learning
- Federated Learning Systems:
- Detailed Exploration of the FedLearn Federated Learning System
- Application of gRPC in FedLearn
- Performance Optimization Practices in Real-World Scenarios
- Federated Learning Based on Blockchain
Readership: Advanced undergraduate and graduate students, researchers and practitioners with somewhat knowledge about machine learning, distributed system and privacy preserving technologies. This book will serve as a greate reference for readers who has experiences of federated learning algorithms, building privacy preserving machine learning applications or solving real-world problems with privacy-restricted scenarios.
Liefeng BO is the Vice President of JD Technology and the Head of the Silicon Valley R&D Department. He served as committee member of several top artificial intelligence conferences, including NeurIPS, CVPR, ICCV, ECCV, AAAI, and SDM. He has published more than 80 papers in top international conferences and journals, with his papers being cited 10,186 times and having an H-index of 44. His doctoral dissertation was awarded the National Excellent Doctoral Dissertation Award, and his paper on RGB-D object recognition won the Best Computer Vision Paper Award at the prestigious academic conference ICRA.
Heng HUANG is AIMBE Fellow, an international academic leader in the fields of big data, machine learning, and artificial intelligence. He is a Distinguished Lifetime Professor in the Department of Electrical and Computer Engineering at the University of Pittsburgh. As a conference program chair or member of the chairing committee, he has organized more than 20 international academic conferences. He has published over 220 articles in top international conferences and journals, with his articles being cited more than 18,000 times. As a project leader, he has led more than 20 internationally leading scientific research projects.
Songxiang GU is a Direct at JD Technology. He received PhD in Computer Science and conducted in-depth research on large-scale parallel systems. He has served as a senior machine learning and statistical scientist at the U.S. FDA, where he developed an evaluation system for radiographic medical imaging equipment. He subsequently joined WalmartLabs and LinkedIn, where he was responsible for the architectural design of machine learning platforms. In 2018, he joined JD Technology and has since led multiple teams in developing intelligent customer service, knowledge graphs, and federated learning systems.
Yanqing CHEN is a Director at JD Technology. He receives PhD in Computer Science at Stony Brook Univerisity. He is a pioneer and conducts in-depth research in the field of federated learning. He designs and developes multiple novel federated learning algorithms, publishes multiple papers regarding algorithms, optimizations and evaluations under privacy-preserving conditions.