Keywords: Mixed Reality, Engineering Design, Human-Centered Design, Human-Computer Interaction, Socio-Technical System, Human-AI Collaboration, Trust in AI

Ongoing Projects

Investigation of Multimodal Interaction in Augmented Reality

Recruitment Ended

We investigate the impact of multimodal interaction methods on stress level and task efficiency in Augmented Reality, using Microsoft’s HoloLens 2. The research wants to indicate the potential avalibality of multimodal interaction control in AR and provide designers with guidelines to tailor interactions within diverse AR environments. [Poster]

Design of empathetic chatbot for better trust and engagement

Recruitment Ended

We design virtual agents that deliver empathetic responses within the context of academic advising and investigate how agent behavior and user emotional states influence user engagement and trust. The findings enable more trustworthy and empathetic agents that potentially increase user retention and accordingly, make education and counseling more accessible.

A real-time framework to provide emotion-congruent responses in human-AI interactions

Recruitment Ended

We design and develop a framework that utilizes both sentiment analysis and facial recognition to track user emotional states in real-time in the interaction between users and a virtual agent. The framework enables the agent to provide customizable and emotion-congruent responses when emotion acknowledgment is important, for example, in mental counseling.

Wearable data integrity detection and causation for effective human interaction

Recruitment Ended

We investigate how human preference and security behavior impact data integrity and cyber risk for telehealth when using wearable devices under nextG networks. The proposed framework strengthens other existing methods for assessing cyber risks by accounting for human behavior. The output of this research will allow security engineers to monitor the telehealth system in real-time and protect user confidentiality and data integrity more efficiently.