Evaluating User Experience and Data Quality in Gamified Data Collection for Appearance-Based Gaze Estimation

Overview

• This paper evaluates the user experience and data quality of a gamified data collection system for appearance-based gaze estimation.
• The system was designed to collect large-scale gaze data from users in a fun and engaging way.
• The researchers assessed factors like user enjoyment, task completion, and the accuracy of the collected gaze data.

Plain English Explanation

The researchers developed an interactive system that allows people to play a game while also collecting data about how they look at things on a screen. The goal was to make the data collection process more enjoyable and engaging for users, rather than having them do a boring task.

To evaluate this system, the researchers looked at a few key factors:

• User Experience: How much did people enjoy using the system? Did they find it fun and engaging?
• Task Completion: Were people able to successfully complete the game tasks?
• Data Quality: How accurate was the gaze data collected through the system?

By examining these aspects, the researchers could assess whether their gamified approach was effective at gathering high-quality gaze data from users in an enjoyable way.

Technical Explanation

The researchers developed a web-based, gamified system for collecting appearance-based gaze estimation data. Users played a game where they had to follow targets on the screen with their gaze. The system used the device's webcam to track the user's gaze in real-time and provide feedback on their performance.

To evaluate this system, the researchers conducted a user study with 48 participants. They collected data on user enjoyment, task completion rates, and the accuracy of the gaze estimation. The accuracy was assessed by comparing the system's estimates to ground truth gaze data obtained through a high-precision eye tracker.

The results showed that users generally found the system to be enjoyable and were able to successfully complete the game tasks. The gaze estimation accuracy was also reasonably good, though not as precise as the dedicated eye tracker. The researchers identified areas for improvement, such as enhancing the visual feedback and adjusting the task difficulty to maintain user engagement.

Critical Analysis

The researchers acknowledge some limitations of their study. The sample size was relatively small, and the participants were predominantly young and tech-savvy. It's unclear how well the results would generalize to a more diverse population.

Additionally, the researchers did not explore the long-term effects of using the gamified system. It's possible that user enjoyment and engagement could decrease over extended use, which could impact data quality. Further research is needed to investigate these longitudinal effects.

Another potential issue is the privacy implications of using a webcam-based system to collect gaze data. While the researchers mention that the data was anonymized, there may be concerns about the security and use of this sensitive information. Exploring privacy-preserving gaze tracking approaches could be an important area for future work.

Conclusion

The researchers have demonstrated a promising approach to making gaze data collection more engaging and enjoyable for users through gamification. The results suggest that this method can yield reasonably accurate gaze data while maintaining high user satisfaction.

However, further research is needed to address the limitations of the current study and explore the long-term viability and privacy implications of this type of gaze-aware system. Continued advancements in this area could lead to more effective and user-friendly tools for studying human visual attention and behavior.