The advanced technology of eye-tracking enables us to analyse healthcare professionals’ (HCPs) gaze behaviours. Gaze analysis has great potential to capture HCPs’ non-technical skills, especially situational awareness (SA).1 The SA framework has three levels. Level 1 involves perceiving an event, level 2 understanding what is being perceived importantly and level 3 being able to make predictions. How to […]

A positive working environment is fundamental for reducing employee turnover, and increasing engagement and productivity. Technologies such as wearable sensors and video analysis of facial expressions can be used to objectively measure the emotional responses of employees in real-time in the workplace. The study aims were to perform a preliminary investigation into the validities of […]

Advertisement repetition is known to enhance recall and awareness towards a certain stimulus. However, overexposure is also recognized to negatively impact user experience (UX). Little is understood on how many repetitions are required to achieve a tolerable balance between user experience and advertising. Likewise, the number of displayed advertisements versus seen advertisements is also unclear. […]

Human communication is multimodal in nature; it is through multiple modalities, i.e., language, voice, and facial expressions, that opinions and emotions are expressed. Data in this domain exhibits complex multi-relational and temporal interactions. Learning from this data is a fundamentally challenging research problem. In this paper, we propose Multimodal Temporal Graph Attention Networks (MTGAT). MTGAT […]

Diminished visual monitoring of faces and activities of others is an early feature of autism spectrum disorder (ASD). It is uncertain whether deficits in activity monitoring, identified using a homogeneous set of stimuli, persist throughout the lifespan in ASD, and thus, whether they could serve as a biological indicator (“biomarker”) of ASD. We investigated differences […]

In the time of climate change, as heat waves become a more regular occurrence, indoor thermal comfort is an important factor in day to day life. Due to such circumstances, many researchers have focused their studies on finding an effective solution that will not only enable thermal comfort, but also increase satisfaction within the indoor […]

In the time of climate change, as heat waves become a more regular occurrence, indoor thermal comfort is an important factor in day to day life. Due to such circumstances, many researchers have focused their studies on finding an effective solution that will not only enable thermal comfort, but also increase satisfaction within the indoor […]

Drawing on cognitive load theory, congruence research, and dual processing models, the purpose of this study is to determine the effectiveness of online advertising in social media. To this end, three separate studies were conducted. First, using eye-tracking and electroencephalography, we examine the differences, based on whether or not an ad is embedded, in subjects’ […]

Monitoring human emotions through wearable systems has become an important area of research. Electrodermal activity (EDA) has proven to be a good indicator of emotional arousal, and numerous works have focused on using EDA data to predict emotional states. However, to successfully integrate EDA data into real-time wearable emotion recognition systems, several challenges of practical […]

Despite the recent achievements made in the multi-modal emotion recognition task, two problems still exist and have not been well investigated: 1) the relationship between different emotion categories are not utilized, which leads to sub-optimal performance; and 2) current models fail to cope well with low-resource emotions, especially for unseen emotions. In this paper, we […]