Mixed Reality (MR) is becoming an integral part of many context-aware industrial applications. In maintenance and remote support operations, the individual steps of computer-supported (cooperative) work can be defined and presented to human operators through MR headsets. Tracking of eye movements can provide valuable insights into a user’s decision-making and interaction processes. Thus, our overarching […]

We explore the extent to which empathetic reactions are elicited when subjects view 3D motion-capture driven avatar faces compared to viewing human faces. Through a remote study, we captured subjects’ facial reactions when viewing avatar and humans faces, and elicited self reported feedback regarding empathy. Avatar faces varied by gender and realism. Results show no […]

Current image/video acquisition and analysis techniques allow for not only the identification and classification of objects in a scene but also more sophisticated processing. For example, there are video cameras today able to capture micro facial expressions, namely, facial expressions that occur in a fraction of a second. Such micro expressions can provide useful information […]

Acute sleep deprivation is a common workplace and lifestyle hazard known to affect physiological and cognitive performance. Previous research emphasizes the effect that sleep deprivation has on cognitive performance and often correlates changes in physiological parameters to measured performance. One potential problem with this approach is that there is some ambiguity about the true physiological […]

Eye tracking is a promising technology offering objective metrics quantifying visual attention in various application fields. The employment in people with specific learning disabilities (SLDs), who reportedly manifest long-term functional social, emotional, and behavioral difficulties, provided well understandings of their visual attention, detecting cognitive processing mechanisms regarding specific SLD patterns. This study focuses on investigating […]

Electrodermal activity (EDA) is considered to be an effective metric for measuring changes in the arousal level of people. In this paper, the phasic component of EDA data from players is analyzed in relation to their reported experience from a standardized questionnaire, when interacting with a couple of virtual reality games that featured two different […]

The aim is to develop an intelligent automatic facial expression recognition and emotion analysis (AFEREA) algorithm that, first, characterizes the time-based raw signals of biosensors in quantitative indicators of the emotional state of the individuals participating in an experiment and, second, compares the emotional reactions across them in terms of intensity and duration. The proposed […]

This explorative study aims to examine if electrodermal activity (EDA) and heart rate (HR) are appropriate measures for identifying and monitoring academic emotions during learning in computer-based learning environments (CBLEs). Understanding learners’ emotions while using CBLEs, allows improving the design of CBLEs. Therefore, we collected EDA, HR, and self-report data from 32 participants to measure […]

This study uses a multimodal data analysis approach to provide a more continuous and objective insight into how students’ engagement unfolds and impacts learning achievements. In this study, 61 nursing students’ learning processes with a virtual reality (VR)-based simulation were captured by psycho-physiological data streams of facial expression, eye-tracking, and electrodermal activity (EDA) sensors, as well […]

This study aimed to evaluate the influence of origin information on Pinot Noir wine labels using eye-tracking and its associations with purchase intent, and hedonic and subconscious emotional responses. Two studies were carried out on untrained university staff and students aged 20–60 years old. Study 1 was conducted to assess consumers’ (n = 55; 55% males, […]