Evaluating data distribution strategies in federated learning: A trade-off analysis between privacy and performance for IoT security

White, Jonathan; Legg, Phil

Abstract

Federated learning is an effective approach for training a global machine learning model. It uses locally acquired data without having to share local data with the centralised server. This method provides a machine learning model beneficial for all parties. It ensures that individual parties do not compromise their privacy or disclose sensitive or personal data. From a cyber security perspective, machine learning with federated learning can highlight intrusions or anomalous activity on a device, without the individual device owner having to reveal characteristics of their own personal usage that would then breach their own privacy. In this paper, we conduct an exploratory investigation into two public datasets, Edge-IIoTset, and CICIoT2023, and we highlight the strengths and limitations of these datasets as currently presented. We then conduct further experimentation on the CICIoT2023 dataset, that previously has only been used for developing centralised learning models. We investigate machine learning performance under various distributions of the data across a set of federated clients, including stratified, leave-one-out, one-class, and half-benign strategies. Specifically, we examine whether a comparable model can be developed using federated learning, and how little data is required by each client to maintain privacy whilst also offering comparable performance against a centralised model.

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 9th International Conference on Cyber Security and Privacy
• Start Date: Dec 11, 2023
• End Date: Dec 12, 2023
• Acceptance Date: Nov 6, 2023
• Online Publication Date: Sep 18, 2024
• Publication Date: Sep 18, 2024
• Deposit Date: Dec 15, 2023
• Publicly Available Date: Sep 19, 2025
• Publisher: Springer
• Pages: 17-37
• Series Title: Lecture Notes in Networks and Systems
• Series Number: 1032
• Series ISSN: 2367-3389
• Book Title: AI Applications in Cyber Security and Communication Networks: Proceedings of Ninth International Conference on Cyber Security, Privacy in Communication Networks (ICCS 2023)
• ISBN: 9789819739721
• DOI: https://doi.org/10.1007/978-981-97-3973-8_2
• Public URL: https://uwe-repository.worktribe.com/output/11517808