Haixia Liu
Examining neural networks through architectural variation analysis for image classification
Liu, Haixia; Brailsford, Tim; Bull, Larry; Goulding, James; Smith, Gavin
Authors
Tim Brailsford Tim.Brailsford@uwe.ac.uk
Professor of Computer Science
Lawrence Bull Larry.Bull@uwe.ac.uk
School Director (Research & Enterprise) and Professor
James Goulding
Gavin Smith
Abstract
This paper presents a method for examining neural networks in image classification through architectural variation analysis. Small-scale experiments generate initial insights, and the configurations are further tested on entire datasets. The newly proposed sampling strategy, which focuses on heavily confused samples to identify instance hardness, offers researchers a way to explore novel methods with reduced computational costs. Image pre-processing operations are crucial in the image classification pipeline. Applying image sharpening prior to other standard pre-processing techniques was found to yield improved results. The choice and order of layers significantly impact model performance. We propose three layer-level operations: Plug and Play (PaP), Leave One Layer Out (LOLO), and Select and Reorder (SaRe). The results indicate that convolutional (Conv2D) and batch normalization (BN) layers are significant in image classification tasks, but this is dependent upon the context of the images. Performing BN before Conv2D can improve the model's predictive capability. This study provides valuable insights into optimizing deep learning models, with potential avenues for future research, including explainable AI (XAI).
Presentation Conference Type | Conference Paper (published) |
---|---|
Conference Name | International Conference on Information Science and Systems (ICISS 2024) |
Start Date | Aug 14, 2024 |
End Date | Aug 16, 2024 |
Acceptance Date | Jun 18, 2024 |
Deposit Date | Aug 16, 2024 |
Peer Reviewed | Peer Reviewed |
Keywords | Architectural Variation Analysis; Explainable AI; Layer Selection; Layer Ordering; Deep Learning Optimization; Neural Networks; LOLO |
Public URL | https://uwe-repository.worktribe.com/output/12791966 |
This file is under embargo due to copyright reasons.
Contact Haixia.Liu@uwe.ac.uk to request a copy for personal use.
You might also like
Towards computation of novel ideas from corpora of scientific text
(2015)
Presentation / Conference Contribution
A generalised dropout mechanism for distributed systems
(2022)
Journal Article
A method for finding implicating rules based on the genetic algorithm
(2007)
Presentation / Conference Contribution
Downloadable Citations
About UWE Bristol Research Repository
Administrator e-mail: repository@uwe.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search