1. ZHAW digitalcollection
  2. School of Engineering
  3. Publikationen
  4. Publikationen School of Engineering
Please use this identifier to cite or link to this item: https://doi.org/10.21256/zhaw-30277
Full metadata record
DC FieldValueLanguage
dc.contributor.authorIwane, Fumiaki-
dc.contributor.authorPorssut, Thibault-
dc.contributor.authorBlanke, Olaf-
dc.contributor.authorChavarriaga, Ricardo-
dc.contributor.authorMillan, Jose Del R.-
dc.contributor.authorHerbelin, Bruno-
dc.contributor.authorBoulic, Ronan-
dc.date.accessioned2024-03-16T09:49:26Z-
dc.date.available2024-03-16T09:49:26Z-
dc.date.issued2024-02-22-
dc.identifier.issn1741-2552de_CH
dc.identifier.issn1741-2560de_CH
dc.identifier.urihttps://digitalcollection.zhaw.ch/handle/11475/30277-
dc.description.abstractObjective. A key challenge of virtual reality (VR) applications is to maintain a reliable human-avatar mapping. Users may lose the sense of controlling (sense of agency), owning (sense of body ownership), or being located (sense of self-location) inside the virtual body when they perceive erroneous interaction, i.e. Break-in-embodiment (BiE). However, the way to detect such an inadequate event is currently limited to questionnaires or spontaneous reports from users. The ability to implicitly detect BiE in real-time enables us to adjust human-avatar mapping without interruption. Approach. We propose and empirically demonstrate a novel Brain Computer Interface (BCI) approach that monitors the occurrence of BiE based on the users' brain oscillatory activity in real-time to adjust the human-avatar mapping in VR. We collected EEG data of 37 participants while they performed reaching movements with their avatar with different magnitude of distortion. Main results. Our BCI approach seamlessly predicts occurrence of BiE in varying magnitude of erroneous interaction. The mapping has been customized by BCI-reinforcement learning (RL) closed-loop system to prevent BiE from occurring. Furthermore, a non-personalized BCI decoder generalizes to new users, enabling "Plug-and-Play" ErrP-based non-invasive BCI. The proposed VR system allows customization of human-avatar mapping without personalized BCI decoders or spontaneous reports. Significance. We anticipate that our newly developed VR-BCI can be useful to maintain an engaging avatar-based interaction and a compelling immersive experience while detecting when users notice a problem and seamlessly correcting it.de_CH
dc.language.isoende_CH
dc.publisherIOP Publishingde_CH
dc.relation.ispartofJournal of Neural Engineeringde_CH
dc.rightshttps://creativecommons.org/licenses/by/4.0/de_CH
dc.subjectBrain computer interfacede_CH
dc.subjectBreak-in-embodimentde_CH
dc.subjectEEGde_CH
dc.subjectError related potentialde_CH
dc.subjectReinforcement learningde_CH
dc.subjectVirtual realityde_CH
dc.subject.ddc006: Spezielle Computerverfahrende_CH
dc.titleCustomizing the human-avatar mapping based on EEG error related potentials during avatar-based interactionde_CH
dc.typeBeitrag in wissenschaftlicher Zeitschriftde_CH
dcterms.typeTextde_CH
zhaw.departementSchool of Engineeringde_CH
zhaw.organisationalunitCentre for Artificial Intelligence (CAI)de_CH
dc.identifier.doi10.1088/1741-2552/ad2c02de_CH
dc.identifier.doi10.21256/zhaw-30277-
dc.identifier.pmid38386506de_CH
zhaw.funding.euNode_CH
zhaw.issue2de_CH
zhaw.originated.zhawYesde_CH
zhaw.pages.start026016de_CH
zhaw.publication.statuspublishedVersionde_CH
zhaw.volume21de_CH
zhaw.publication.reviewPeer review (Publikation)de_CH
zhaw.funding.snf178790de_CH
zhaw.webfeedDatalabde_CH
zhaw.webfeedResponsible Artificial Intelligence Innovationde_CH
zhaw.author.additionalNode_CH
zhaw.display.portraitYesde_CH
Appears in collections:Publikationen School of Engineering

Files in This Item:
File Description SizeFormat 
2024_Iwane-etal_Customizing-human-avatar-mapping-EEG-error-potentials.pdf1.97 MBAdobe PDFThumbnail
View/Open
Show simple item record
Iwane, F., Porssut, T., Blanke, O., Chavarriaga, R., Millan, J. D. R., Herbelin, B., & Boulic, R. (2024). Customizing the human-avatar mapping based on EEG error related potentials during avatar-based interaction. Journal of Neural Engineering, 21(2), 26016. https://doi.org/10.1088/1741-2552/ad2c02
Iwane, F. et al. (2024) ‘Customizing the human-avatar mapping based on EEG error related potentials during avatar-based interaction’, Journal of Neural Engineering, 21(2), p. 026016. Available at: https://doi.org/10.1088/1741-2552/ad2c02.
F. Iwane et al., “Customizing the human-avatar mapping based on EEG error related potentials during avatar-based interaction,” Journal of Neural Engineering, vol. 21, no. 2, p. 026016, Feb. 2024, doi: 10.1088/1741-2552/ad2c02.
IWANE, Fumiaki, Thibault PORSSUT, Olaf BLANKE, Ricardo CHAVARRIAGA, Jose Del R. MILLAN, Bruno HERBELIN und Ronan BOULIC, 2024. Customizing the human-avatar mapping based on EEG error related potentials during avatar-based interaction. Journal of Neural Engineering. 22 Februar 2024. Bd. 21, Nr. 2, S. 026016. DOI 10.1088/1741-2552/ad2c02
Iwane, Fumiaki, Thibault Porssut, Olaf Blanke, Ricardo Chavarriaga, Jose Del R. Millan, Bruno Herbelin, and Ronan Boulic. 2024. “Customizing the Human-Avatar Mapping Based on EEG Error Related Potentials during Avatar-Based Interaction.” Journal of Neural Engineering 21 (2): 26016. https://doi.org/10.1088/1741-2552/ad2c02.
Iwane, Fumiaki, et al. “Customizing the Human-Avatar Mapping Based on EEG Error Related Potentials during Avatar-Based Interaction.” Journal of Neural Engineering, vol. 21, no. 2, Feb. 2024, p. 26016, https://doi.org/10.1088/1741-2552/ad2c02.


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.