Evaluating data distribution strategies in federated learning: A trade-off analysis between privacy and performance for IoT security

White, Jonathan; Legg, Phil

Abstract

Federated learning is an effective approach for training a global machine learning model. It uses locally acquired data without having to share local data with the centralised server. This method provides a machine learning model beneficial for all parties. It ensures that individual parties do not compromise their privacy or disclose sensitive or personal data. From a cyber security perspective, machine learning with federated learning can highlight intrusions or anomalous activity on a device, without the individual device owner having to reveal characteristics of their own personal usage that would then breach their own privacy. In this paper, we conduct an exploratory investigation into two public datasets, Edge-IIoTset, and CICIoT2023, and we highlight the strengths and limitations of these datasets as currently presented. We then conduct further experimentation on the CICIoT2023 dataset, that previously has only been used for developing centralised learning models. We investigate machine learning performance under various distributions of the data across a set of federated clients, including stratified, leave-one-out, one-class, and half-benign strategies. Specifically, we examine whether a comparable model can be developed using federated learning, and how little data is required by each client to maintain privacy whilst also offering comparable performance against a centralised model.

Citation

White, J., & Legg, P. (in press). Evaluating data distribution strategies in federated learning: A trade-off analysis between privacy and performance for IoT security.

• Conference Name: 9th International Conference on Cyber Security and Privacy
• Conference Location: Cardiff, UK
• Start Date: Dec 11, 2023
• End Date: Dec 12, 2023
• Acceptance Date: Nov 6, 2023
• Deposit Date: Dec 15, 2023
• Publisher: Springer
• Public URL: https://uwe-repository.worktribe.com/output/11517808