The Spectrum project reimagines assistive technology to empower individuals with emotional recognition challenges, particularly those with Asperger’s syndrome. Inspired by the storytelling in To the Moon and societal needs for inclusivity, the project integrates advanced emotion recognition capabilities to foster deeper human connections.

Introduction

Role

Product Designer

3D Modeler

Product Designer

3D Modeler

Duration

Aug - Dec 2024

Skills

Product Design, User Research, 3D module

River, a character in To the Moon, embodies the challenges faced by individuals with Asperger's syndrome, such as difficulty in expressing emotions and interpreting social cues. This inspired us to create a device that uses advanced technologies—facial recognition, voice analysis, and contextual data—to provide real-time emotional feedback.

Society's growing emphasis on mental health and inclusivity further motivated us to develop a tool that bridges communication gaps while preserving individuality.

River, a character in To the Moon, embodies the challenges faced by individuals with Asperger's syndrome, such as difficulty in expressing emotions and interpreting social cues. This inspired us to create a device that uses advanced technologies—facial recognition, voice analysis, and contextual data—to provide real-time emotional feedback.

Society's growing emphasis on mental health and inclusivity further motivated us to develop a tool that bridges communication gaps while preserving individuality.

Context & Inspiration

Research Insights

Key Findings

Emotional Recognition Challenges
Individuals with Asperger’s struggle with recognizing both basic and complex emotions, significantly impacting social interactions.
Assistive Technology Effectiveness
Existing tools like Mind Reading software show potential in improving emotion recognition but lack real-time and multimodal capabilities.
Market Limitations
Products like Tobii Dynavox and SHORE focus on symbolic communication or basic emotions, failing to address nuanced emotional states or integrate contextual understanding.

Design Implications

Combine facial, vocal, and contextual cues for comprehensive emotional analysis.
Integrate gamified learning modules to enhance engagement.
Ensure real-time feedback to support dynamic social interactions.

Key Findings

Emotional Recognition Challenges
Individuals with Asperger’s struggle with recognizing both basic and complex emotions, significantly impacting social interactions.
Assistive Technology Effectiveness
Existing tools like Mind Reading software show potential in improving emotion recognition but lack real-time and multimodal capabilities.
Market Limitations
Products like Tobii Dynavox and SHORE focus on symbolic communication or basic emotions, failing to address nuanced emotional states or integrate contextual understanding.

Design Implications

Combine facial, vocal, and contextual cues for comprehensive emotional analysis.
Integrate gamified learning modules to enhance engagement.
Ensure real-time feedback to support dynamic social interactions.

Final Design

Design Process

Needs Analysis

Memory Retrieval: Store past interaction data for contextual insights.
Real-Time Feedback: Analyze emotions and deliver audio or visual cues.
Emotion Display: Use wearable displays for self-expression.
Environment Recognition: Detect and interpret social atmospheres.

Initial Concept

We envisioned a lightweight, wearable device integrating:

Headphones with EEG receivers for brainwave interpretation.
Chest-Mounted Display for visual feedback.
Cameras & Sensors for real-time data collection.

Needs Analysis

Memory Retrieval: Store past interaction data for contextual insights.
Real-Time Feedback: Analyze emotions and deliver audio or visual cues.
Emotion Display: Use wearable displays for self-expression.
Environment Recognition: Detect and interpret social atmospheres.

Initial Concept

We envisioned a lightweight, wearable device integrating:

Headphones with EEG receivers for brainwave interpretation.
Chest-Mounted Display for visual feedback.
Cameras & Sensors for real-time data collection.

Product Name: Spectrum
The device combines functionality and aesthetics to support neurodiverse users in their daily lives.