Emotion Detection on User Front-Facing App Interfaces for Enhanced Schedule Optimization: A Machine Learning Approach

A comparison of two ways to read a user’s emotional state, from heart-rate signals and from everyday computer activity, so that calendar apps can adapt to stress and mood.

Authors
Feiting Yang (University of Toronto), Antoine Moevus (DIRO, Université de Montréal), Steve Lévesque (ÉTS)
Venue
IEEE IISA 2025, Mytilene, Greece
Year
2025
Pages
1–8
Keywords
Machine Learning, Deep Learning, UI/UX, HCI, Calendar Optimization, Computer Activity, Emotion Detection
Status
Published

Overview

Human-computer interaction increasingly includes emotion recognition. This paper, written with Feiting Yang and Antoine Moevus, looks at bringing emotion detection into calendar applications so that the interface can react to a user’s emotional state and stress level, with the aim of improving both productivity and engagement.

Approach

We evaluate two complementary approaches on real-world datasets:

  • a biometric approach, where heart rate extracted from ECG signals feeds LSTM and GRU networks that predict valence, arousal and dominance
  • a behavioral approach, where several machine learning models classify emotions from fine-grained computer activity such as mouse movements, clicks and keystroke patterns

Findings

Both approaches work, but the computer-activity approach proved more consistent and more accurate, especially for mouse interactions, which reached about 90% accuracy. In the biometric approach, GRU networks outperformed LSTM models, with valence prediction reaching 84.38% accuracy.

Publication details

Presented at the International Conference on Information, Intelligence, Systems & Applications (IISA 2025), held July 10–12, 2025, in Mytilene, on the island of Lesvos, Greece, and published by IEEE. A preprint has been available on arXiv since June 2025.

← Research

Emotion Detection on User Front-Facing App Interfaces for Enhanced Schedule Optimization: A Machine Learning Approach

A comparison of two ways to read a user’s emotional state, from heart-rate signals and from everyday computer activity, so that calendar apps can adapt to stress and mood.

Authors
Feiting Yang (University of Toronto), Antoine Moevus (DIRO, Université de Montréal), Steve Lévesque (ÉTS)
Venue
IEEE IISA 2025, Mytilene, Greece
Year
2025
Pages
1–8
Keywords
Machine Learning, Deep Learning, UI/UX, HCI, Calendar Optimization, Computer Activity, Emotion Detection
Status
Published

Overview

Human-computer interaction increasingly includes emotion recognition. This paper, written with Feiting Yang and Antoine Moevus, looks at bringing emotion detection into calendar applications so that the interface can react to a user’s emotional state and stress level, with the aim of improving both productivity and engagement.

Approach

We evaluate two complementary approaches on real-world datasets:

  • a biometric approach, where heart rate extracted from ECG signals feeds LSTM and GRU networks that predict valence, arousal and dominance
  • a behavioral approach, where several machine learning models classify emotions from fine-grained computer activity such as mouse movements, clicks and keystroke patterns

Findings

Both approaches work, but the computer-activity approach proved more consistent and more accurate, especially for mouse interactions, which reached about 90% accuracy. In the biometric approach, GRU networks outperformed LSTM models, with valence prediction reaching 84.38% accuracy.

Publication details

Presented at the International Conference on Information, Intelligence, Systems & Applications (IISA 2025), held July 10–12, 2025, in Mytilene, on the island of Lesvos, Greece, and published by IEEE. A preprint has been available on arXiv since June 2025.

Up Next ·

Teaching

Teaching

© 2026 Steve Lévesque. All rights reserved.

Back to top

Up Next

Teaching

© 2026 Steve Lévesque. All rights reserved.