Kernel Temporal Differences for Neural Decoding
Joint Authors
Bae, Jihye
Sanchez Giraldo, Luis G.
Pohlmeyer, Eric A.
Francis, Joseph T.
Sanchez, Justin C.
Príncipe, José C.
Source
Computational Intelligence and Neuroscience
Issue
Vol. 2015, Issue 2015 (31 Dec. 2015), pp.1-17, 17 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2015-03-17
Country of Publication
Egypt
No. of Pages
17
Main Subjects
Abstract EN
We study the feasibility and capability of the kernel temporal difference (KTD)(λ) algorithm for neural decoding.
KTD(λ) is an online, kernel-based learning algorithm, which has been introduced to estimate value functions in reinforcement learning.
This algorithm combines kernel-based representations with the temporal difference approach to learning.
One of our key observations is that by using strictly positive definite kernels, algorithm’s convergence can be guaranteed for policy evaluation.
The algorithm’s nonlinear functional approximation capabilities are shown in both simulations of policy evaluation and neural decoding problems (policy improvement).
KTD can handle high-dimensional neural states containing spatial-temporal information at a reasonable computational complexity allowing real-time applications.
When the algorithm seeks a proper mapping between a monkey’s neural states and desired positions of a computer cursor or a robot arm, in both open-loop and closed-loop experiments, it can effectively learn the neural state to action mapping.
Finally, a visualization of the coadaptation process between the decoder and the subject shows the algorithm’s capabilities in reinforcement learning brain machine interfaces.
American Psychological Association (APA)
Bae, Jihye& Sanchez Giraldo, Luis G.& Pohlmeyer, Eric A.& Francis, Joseph T.& Sanchez, Justin C.& Príncipe, José C.. 2015. Kernel Temporal Differences for Neural Decoding. Computational Intelligence and Neuroscience،Vol. 2015, no. 2015, pp.1-17.
https://search.emarefa.net/detail/BIM-1057705
Modern Language Association (MLA)
Bae, Jihye…[et al.]. Kernel Temporal Differences for Neural Decoding. Computational Intelligence and Neuroscience No. 2015 (2015), pp.1-17.
https://search.emarefa.net/detail/BIM-1057705
American Medical Association (AMA)
Bae, Jihye& Sanchez Giraldo, Luis G.& Pohlmeyer, Eric A.& Francis, Joseph T.& Sanchez, Justin C.& Príncipe, José C.. Kernel Temporal Differences for Neural Decoding. Computational Intelligence and Neuroscience. 2015. Vol. 2015, no. 2015, pp.1-17.
https://search.emarefa.net/detail/BIM-1057705
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1057705