Development of a multimodal brain-neural interface to control a exoskeletal-neuroprosthesis hybrid robotic system for the upper limb · Brain2motion · DPI2011-27022-C02-01 & DPI2011-27022-C02-02
Exoskeletal robots (ERs) are person-oriented robots that supplement the function of a limb or replace it completely. A possible alternative to ERs are Motor Neuro-Prostheses (MNP) based on Functional Electrical Stimulation (FES). Both ERs and MNPs are technologies that seek to restore or substitute motor function. MNPs constitute an approach to restoring function by means of artificially controlling human muscles or muscle nerves with FES. ERs use volitional commands for controlling the application of controlled forces to drive paralyzed or weak limbs.
The main goal of BRAIN2MOTION project is to develop a new hybrid ER-MNP for the upper limb interfaced to the users by means of non-invasive multimodal brain-neural computer interfaces (BNCIs). The robotic hybrid system will combine a light and kinematically compatible ER, and a textile-based surface MNP. In this combined ER-MNP, hardware and control strategies will be developed to combine the action of the ER and MNP while preserving motor latent capabilities of the user. A spontaneous non- invasive EEG-based Brain-Computer Interface (BCI) and an electrooculography (EOG) interface will compose the multimodal BNCI. The BCI will differentiate more than three mental tasks. This will be achieved incorporating new adaptive classifiers into the BCI. Learning strategies will be developed in order to improve the performance and versatility of the BCI. Control strategies combining EEG and EOG signals will be developed to control the ER-MNP.
The hybrid ER-MNP controlled by the BNCI will be used to perform reaching and grasping operations. The system will be validated with patients suffering from neurological conditions leading to severe motor disorders, in particular cerebrovascular accident (CVA).
UMH Subproject
Title: Development of a multimodal brain-neural interface to control a exoskeletal-neuroprosthesis hybrid robotic system for the upper limb
Reference: DPI2011-27022-C02-01
CSIC Subproject
Title: Development of a new exoskeletal – neuroprosthesis hybrid robotic system for the upper limb
Reference: DPI2011-27022-C02-02
Journals
A. Úbeda, E. Iáñez, J.M. Azorín, J.M. Sabater, E. Fernández, «Classification Method for BCIs Based on the Correlation of EEG Maps», Neurocomputing, November 2012 (ONLINE)
A. Úbeda, E. Iáñez, J.M. Azorín, C. Pérez-Vidal, «Endogenous brain-machine interface based on the correlation of EEG map», Computer Methods and Programs in Biomedicine, February 2013 (ONLINE)
E. Hortal, A. Úbeda, E. Iáñez and J.M. Azorín, “Control of a 2 DoF Robot Using a Brain-Machine Interface”, Computer Methods and Programs in Biomedicine Special Issues, 116(2): 169-176, September 2014 (ONLINE)
International Conferences
A. Úbeda, J.M. Azorín, Nicolás García, J.M. Sabater, Carlos Pérez, «Brain-Machine Interface Based On EEG Mapping to Control an Assistive Robotic Arm», BIOROB 2012, Rome, Italy, 24-27 June
L.D. Lledó, J.M. Cano, A. Úbeda, E. Iáñez, J.M. Azorín, «Neuro-Fuzzy Classifier to Recognize Mental Tasks in a BCI», BIOROB 2012, Rome, Italy, 24-27 June
A. Úbeda, E. Iáñez, J. Badesa, R. Morales, J.M. Climent, J.M. Azorín, «Control Strategies of an Assistive Roboto Using a Brain-Machine Interfaces», IEEE/RSJ International Conference on Intelligent Robots and Systems 2012, Algarve, Portugal, October 7-12
J. López, A. Úbeda, E. Iáñez, J.M. Climent, J.M. Azorín, «Online Error Potential Detection to Assist Movement Intention Decoding in Stroke Patients», International Conference on Neurorehabilitation 2012, Toledo, Spain, November 14-16
E. Hortal, A. Úbeda, E. Iáñez, D. Tornero, J.M. Azorín, «Decoding Upper Limb Movement Velocity for Stroke Rehabilitation», International Conference on Neurorehabilitation 2012, Toledo, Spain, November 14-16
E. Iáñez, A. Úbeda, E. Hortal, J.M. Azorín, «Mental Tasks Selection Method for a SVM-Based BCI System», IEEE International Systems Conference 2013, Orlando, USA, April 15-18
A. Úbeda, E. Iáñez, E. Hortal, J.M. Azorín, «Linear Decoding of 2D Hand Movements for Target Selection Tasks Using a Non-Invasive BCI System», IEEE International Systems Conference 2013, Orlando, USA, April 15-18ç
E. Hortal, A. Úbeda, E. Iáñez, D. Planelles, J. M. Azorín, «Selection of the Best Classifier for Differenciating Mental Tasks in a Brain-Machine Interface», IFESS 2013, San Sebastián, Spain, 6-8 June
E. Hortal, E. Iáñez, A. Úbeda, J.M. Azorín, E. Fernández, «Training Study Approaches for a SVM-based BCI: Adaptation to the Model vs Adaptation to the User», IWINAC 2013, Mallorca, Spain, 10-14 June
E. Iáñez, A. Úbeda, E. Hortal, J.M. Azorín, E. Fernández, «Empirical Analysis of the Integration of a BCI and an EOG Interface to Control a Robot Arm», IWINAC 2013, Mallorca, Spain, 10-14 June
D. Planelles, E. Hortal, E. Iáñez, A. Costa and J.M. Azorín. “Processing EEG Signals to Detect Intention of Upper Limb Movement”. Replace, Repair, Restore, Relieve – Bridging Clinical and Engineering Solutions in Neurorehabilitation, Proceedings of the 2nd International Conference on NeuroRehabilitation, Aalborg, Denmark. Vol. 7, pages: 655-664. ISSN: 2195-3562. ISBN: 978-3-319-08071-0. 24-26 June 2014.
A. Úbeda, D. Planelles, E. Hortal, F. Resquín, A.D. Koutsou, J.M. Azorín and J.L. Pons. “A Brain-Machine Interface Architecture to Control an Upper Limb Rehabilitation Exoskeleton”. Replace, Repair, Restore, Relieve – Bridging Clinical and Engineering Solutions in Neurorehabilitation, Proceedings of the 2nd International Conference on NeuroRehabilitation, Aalborg, Denmark. Vol. 7, pages: 795-804. ISSN: 2195-3562. ISBN: 978-3-319-08071-0. 24-26 June 2014.
E. Hortal, D. Planelles, A. Úbeda, A. Costa and J.M. Azorín, ”Brain-Machine Interface System to Differentiate between Five Mental Tasks”, 8th Annual IEEE International Systems Conference, Otawa, Canada. Pages: 172-175. ISBN: 978-1-4799-2087-7. March 31-April 3, 2014.
National Conferences
E. Hortal, A. Úbeda, E. Iáñez, A. Rodríguez, J.M. Azorín, «Detección de la Intención del Movimiento del Brazo Mediante Señales EEG», 4º Simposio CEA Bioingeniería 2012 – Redes REDINBIO y RETADIM, pp. 35-41, ISBN: 978-84-695-3541-7
A. Úbeda, E. Iáñez, J.M. Azorín, «Interfaz Multimodal Basada en la Combinación de Información Ocular, Cerebral y Háptica para el Control de una Interfaz Gráfica 3D», XXXIII Jornadas de Automática 2012, Vigo, España, 5-7 Septiembre
J. López, A. Úbeda, E. Iáñez, J.M. Azorín, N. García, «Clasificador de Potenciales de Error Orientado a la Detección de Intención de Movimiento», XXXIII Jornadas de Automática 2012, Vigo, España, 5-7 Septiembre
J. López, A. Úbeda, D. Planelles, J. M. Azorín, J. Gimeno, J.A. Flores, «Clasificación de Señales de Potencial de Error a través de una Interfaz Gráfica con Realimentación de Fuerzas», XXXIV Jornadas de Automática 2013, Terrasa, España, 4-6 Septiembre
E. Hortal, D. Planelles, A. Úbeda, A.D. Koutsou, F. Resquín, J.M. Azorín and J.L. Pons. “Arquitectura de una Interfaz Cerebro-Máquina para el control de un exoesqueleto robot de miembro superior”. Cognitive Area Networks, proceedings of 6º Simposio CEA Bioingeniería, Granada, Spain. Vol. 1, pages: 13-18. ISSN: 2341-4243. 12-13 June, 2014.
Brain2Motion in Press
«Pacientes con hemiplegia prueban un robot para mover el brazo con la mente»
- Las Provincias 13 July 2014
- La Verdad 13 July 2014
«El Hospital General de Alicante prueba un brazo robótico»
- Diario Información 14 July 2014
«Pacientes del Hospital de Alicante prueban un brazo robótico para mover con la mente»
- El Periodic 14 July 2014
«Ayuda robótica para volver a mover los brazos»
- EsTuSanidad.com 14 July 2014
«Prueban una interfaz que permitiría mover con la mente un brazo robótico»
- La Vanguardia 14 July 2014
- ABC 14 July 2014
«El Hospital General de Alicante prueba un brazo robótico en personas que han perdido el movimiento por accidentes»
- Europa Press 14 July 2014
«Diseñan un robot controlado por la actividad cerebral de las personas»
- La Verdad 21 September 2013
BEST PAPER AWARD– 1st PLACE – 2013 IEEE International Systems Conference 15-18 April Orlando, Fl, USA For the paper: «Mental Tasks Selection Method for a SVM-Based BCI System»
«El Primer Brazo Robótico para Mover con la Mente»
- La Verdad 26 November 2012
- Las Provincias 26 November 2012