TCS learning classifier system controller on a real robot

Hurst, Jacob; Bull, Larry; Melhuish, Chris

Abstract

To date there have been few implementation of Holland’s Learning Classifier System (LCS) on real robots. The paper introduces a Temporal Classifier System (TCS), an LCS derived from Wilson’s ZCS. Traditional LCS have the ability to generalise over the state action-space of a reinforcement learning problem using evolutionary techniques. In TCS this generalisation ability can also be used to determine the state divisions in the state space considered by the LCS. TCS also implements components from Semi-Mark-Decision Process (SMDP) theory to weight the influence of time on the reward functions of the LCS. A simple light-seeking task on a real robot platform using TCS is presented which demonstrates desirable adaptive characteristics for the use of LCS on real robots.

• Presentation Conference Type: Conference Paper (published)
• Conference Name: International Conference on Parallel Problem Solving from Nature
• Publication Date: Jan 1, 2002
• Journal: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
• Print ISSN: 0302-9743
• Publisher: Springer Verlag
• Peer Reviewed: Not Peer Reviewed
• Volume: 2439
• Pages: 588-597
• Series Title: Lecture Notes in Computer Science
• Series Number: 2439
• ISBN: 3540441395
• DOI: https://doi.org/10.1007/3-540-45712-7_57
• Keywords: computation by abstract devices, algorithm analysis and problem complexity, processor architectures, artificial intelligence, programming techniques, evolutionary biology
• Public URL: https://uwe-repository.worktribe.com/output/1083145
• Publisher URL: http://dx.doi.org/10.1007/3-540-45712-7_57