The effect of augmented reality applications on brain oscillations has been tested.

The difference between the Real and AR readings in 3 domains was analyzed by EEG.

The results show that emotion classification success is higher with AR reading.

The AR application, one of the Metaverse components, meets the usability parameters.

As a result of stimulating the basic human senses, emotional states occur in humans. Of these senses, the visual sense is the most basic human sense. This sense perceives visual stimuli and elicits emotional states. Augmented Reality (AR) applications also work with these visual stimuli. This study investigates how AR systems, which are among immersive environments, are effective in distinguishing the emotional states of students in book reading activities, with the support of Electroencephalography (EEG). The BOOKAR dataset obtained within the scope of this study is among the first AR-supported datasets in emotion recognition using physiological signals with immersive methods. To reveal the emotional states of the readers, texts that stimulate emotional states such as disgusting, happy, neutral, and 2-dimensional pictures are presented within these texts. In the AR-based reading section, the 3-dimensional models of these 2-dimensional pictures and the rig-processed conditions of these models are presented as a stimulus to the reader. The results show that AR-based reading has a significant discriminatory effect, especially on the valence-arousal emotional states of readers, and achieves higher classification performance than real reading. The results also show that the proposed method is good at classifying emotional states from EEG signals with accuracy scores close to 100%. It has been observed that the designed AR application also meets the usability characteristics. The proposed emotion recognition method in AR applications has significant potential for integration into various Metaverse-based applications.

Data availability

The BOOKAR data used to support the findings of this study are currently under embargo. The dataset will be published at https://eegdatasets.erzurum.edu.tr and dataset requests will be considered by the corresponding author within the scope of the license agreement. The dataset is made publicly available after six months.

This research was funded by the Scientific and Technological Research Council of Turkey (1919B012000977).

View full text