A Biologically Constrained Cerebellar Model with Reinforcement Learning for Robotic Limb Control

Type of content
Journal Article
Thesis discipline
Degree name
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Journal Title
Journal ISSN
Volume Title
Language
Date
2020
Authors
Liu , Rong
Zhang, Qi
Chen , Yaru
Wang , Jiaxing
Yang, Le
Abstract

The cerebellum is known to be critical for accurate adaptive control and motor learning. It has long been recognized that the cerebellum acts as a supervised learning machine. However, recent evidence shows that cerebellum is integral to reinforcement learning. This paper proposes a biologically plausible cerebellar model with reinforcement learning based on the cerebellar neural circuitry to eliminate the need for explicit teacher signals. The learning capacity of cerebellar reinforcement learning is first demonstrated by constructing a simulated cerebellar neural network agent and a detailed model of the human arm and muscle system in the Emergent virtual environment. Next, the cerebellar model is incorporated in both a simulated arm and a Geomagic Touch device to further verify the effectiveness of the cerebellar model in reaching tasks. Results from these experiments indicate that the cerebellar simulation is capable of driving the 'arm plant' to arrive at the target positions accurately. Moreover, by examining the effect of the number of basic units, we find the results are consistent with previous findings that the central nervous system may recruit the muscle synergies to realize motor control. The study described here prompts several hypotheses about the relationship between motor control and learning and may be useful in the development of general-purpose motor learning systems for machines.

Description
Citation
Liu R, Zhang Q, Chen Y, Wang J, Yang L (2020). A Biologically Constrained Cerebellar Model with Reinforcement Learning for Robotic Limb Control. IEEE Access. 8. 222199-222210.
Keywords
Cerebellum, cerebellar model, reinforcement learning, robotic limb control
Ngā upoko tukutuku/Māori subject headings
ANZSRC fields of research
32 - Biomedical and clinical sciences::3209 - Neurosciences::320903 - Central nervous system
40 - Engineering::4003 - Biomedical engineering::400309 - Neural engineering
Rights
All rights reserved unless otherwise stated