iBall: Augmenting Basketball Videos with Gaze-moderated Embedded Visualizations
2303.03476
0
0
🔄
Abstract
We present iBall, a basketball video-watching system that leverages gaze-moderated embedded visualizations to facilitate game understanding and engagement of casual fans. Video broadcasting and online video platforms make watching basketball games increasingly accessible. Yet, for new or casual fans, watching basketball videos is often confusing due to their limited basketball knowledge and the lack of accessible, on-demand information to resolve their confusion. To assist casual fans in watching basketball videos, we compared the game-watching behaviors of casual and die-hard fans in a formative study and developed iBall based on the fndings. iBall embeds visualizations into basketball videos using a computer vision pipeline, and automatically adapts the visualizations based on the game context and users' gaze, helping casual fans appreciate basketball games without being overwhelmed. We confrmed the usefulness, usability, and engagement of iBall in a study with 16 casual fans, and further collected feedback from 8 die-hard fans.
Create account to get full access
Overview
- Presents iBall, a basketball video-watching system that uses gaze-moderated embedded visualizations to help casual fans better understand and engage with the game
- Addresses the challenge faced by new or casual fans who find watching basketball videos confusing due to their limited basketball knowledge and lack of accessible information
- Developed based on a formative study comparing the game-watching behaviors of casual and die-hard fans
Plain English Explanation
iBall is a system that aims to make it easier for casual basketball fans to understand and enjoy watching basketball videos. Watching basketball can be confusing for people who don't know much about the sport, as there's a lot of complex information happening on the court that casual fans might not fully understand.
iBall addresses this by embedding helpful visualizations directly into the basketball videos. These visualizations are automatically adapted based on the game context and the viewer's gaze (where they're looking on the screen). This allows casual fans to get additional information and explanations about what's happening, without feeling overwhelmed.
The researchers developed iBall after studying how casual and die-hard fans behave when watching basketball videos. They used this insight to design a system that provides the right amount of information to help casual fans appreciate the game without getting lost in the details.
Technical Explanation
The researchers conducted a formative study to compare the game-watching behaviors of casual and die-hard basketball fans. Based on the findings, they developed iBall, a system that embeds visualizations into basketball videos using computer vision techniques. These visualizations are automatically adapted based on the game context and the user's gaze, which is tracked using eye-tracking technology.
The iBall system is designed to help casual fans better understand and engage with basketball videos without feeling overwhelmed. By providing contextual information and explanations through the embedded visualizations, iBall aims to bridge the knowledge gap between casual and die-hard fans.
The researchers evaluated iBall in a study with 16 casual fans, who reported finding the system useful, usable, and engaging. They also collected feedback from 8 die-hard fans to understand how the system could be further improved.
Critical Analysis
The iBall system presents a promising approach to enhancing the basketball viewing experience for casual fans. By leveraging gaze-moderated visualizations, the system addresses a real challenge faced by new or infrequent viewers of the sport.
However, the paper does not provide much detail on the specific computer vision techniques used to embed the visualizations or the algorithms behind the gaze-based adaptation. More information on these technical aspects would be helpful to fully assess the system's capabilities and potential limitations.
Additionally, the evaluation was conducted with a relatively small number of participants, and the researchers did not compare iBall's performance to alternative approaches, such as VISCommentator or SportHesia. Broader testing and comparative analysis could further establish the system's effectiveness and identify areas for improvement.
Conclusion
The iBall system presents a novel approach to enhancing the basketball viewing experience for casual fans. By leveraging gaze-moderated embedded visualizations, the system helps bridge the knowledge gap between casual and die-hard fans, allowing a wider audience to better understand and engage with the sport.
While the research shows promising results, further exploration of the technical details and more extensive evaluation could help refine the system and explore its potential applications in other sports such as those explored in Video2Game or SportAnalysis VR. Overall, iBall demonstrates the value of using AI-powered visualizations to make complex sports more accessible and engaging for a broader audience.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
Augmenting Sports Videos with VisCommentator
Chen Zhu-Tian, Shuainan Ye, Xiangtong Chu, Haijun Xia, Hui Zhang, Huamin Qu, Yingcai Wu
0
0
Visualizing data in sports videos is gaining traction in sports analytics, given its ability to communicate insights and explicate player strategies engagingly. However, augmenting sports videos with such data visualizations is challenging, especially for sports analysts, as it requires considerable expertise in video editing. To ease the creation process, we present a design space that characterizes augmented sports videos at an element-level (what the constituents are) and clip-level (how those constituents are organized). We do so by systematically reviewing 233 examples of augmented sports videos collected from TV channels, teams, and leagues. The design space guides selection of data insights and visualizations for various purposes. Informed by the design space and close collaboration with domain experts, we design VisCommentator, a fast prototyping tool, to eases the creation of augmented table tennis videos by leveraging machine learning-based data extractors and design space-based visualization recommendations. With VisCommentator, sports analysts can create an augmented video by selecting the data to visualize instead of manually drawing the graphical marks. Our system can be generalized to other racket sports (e.g., tennis, badminton) once the underlying datasets and models are available. A user study with seven domain experts shows high satisfaction with our system, confirms that the participants can reproduce augmented sports videos in a short period, and provides insightful implications into future improvements and opportunities.
5/14/2024
🌿
Sporthesia: Augmenting Sports Videos Using Natural Language
Chen Zhu-Tian, Qisen Yang, Xiao Xie, Johanna Beyer, Haijun Xia, Yingcai Wu, Hanspeter Pfister
0
0
Augmented sports videos, which combine visualizations and video effects to present data in actual scenes, can communicate insights engagingly and thus have been increasingly popular for sports enthusiasts around the world. Yet, creating augmented sports videos remains a challenging task, requiring considerable time and video editing skills. On the other hand, sports insights are often communicated using natural language, such as in commentaries, oral presentations, and articles, but usually lack visual cues. Thus, this work aims to facilitate the creation of augmented sports videos by enabling analysts to directly create visualizations embedded in videos using insights expressed in natural language. To achieve this goal, we propose a three-step approach - 1) detecting visualizable entities in the text, 2) mapping these entities into visualizations, and 3) scheduling these visualizations to play with the video - and analyzed 155 sports video clips and the accompanying commentaries for accomplishing these steps. Informed by our analysis, we have designed and implemented Sporthesia, a proof-of-concept system that takes racket-based sports videos and textual commentaries as the input and outputs augmented videos. We demonstrate Sporthesia's applicability in two exemplar scenarios, i.e., authoring augmented sports videos using text and augmenting historical sports videos based on auditory comments. A technical evaluation shows that Sporthesia achieves high accuracy (F1-score of 0.9) in detecting visualizable entities in the text. An expert evaluation with eight sports analysts suggests high utility, effectiveness, and satisfaction with our language-driven authoring method and provides insights for future improvement and opportunities.
5/14/2024
Sports Analysis and VR Viewing System Based on Player Tracking and Pose Estimation with Multimodal and Multiview Sensors
Wenxuan Guo, Zhiyu Pan, Ziheng Xi, Alapati Tuerxun, Jianjiang Feng, Jie Zhou
0
0
Sports analysis and viewing play a pivotal role in the current sports domain, offering significant value not only to coaches and athletes but also to fans and the media. In recent years, the rapid development of virtual reality (VR) and augmented reality (AR) technologies have introduced a new platform for watching games. Visualization of sports competitions in VR/AR represents a revolutionary technology, providing audiences with a novel immersive viewing experience. However, there is still a lack of related research in this area. In this work, we present for the first time a comprehensive system for sports competition analysis and real-time visualization on VR/AR platforms. First, we utilize multiview LiDARs and cameras to collect multimodal game data. Subsequently, we propose a framework for multi-player tracking and pose estimation based on a limited amount of supervised data, which extracts precise player positions and movements from point clouds and images. Moreover, we perform avatar modeling of players to obtain their 3D models. Ultimately, using these 3D player data, we conduct competition analysis and real-time visualization on VR/AR. Extensive quantitative experiments demonstrate the accuracy and robustness of our multi-player tracking and pose estimation framework. The visualization results showcase the immense potential of our sports visualization system on the domain of watching games on VR/AR devices. The multimodal competition dataset we collected and all related code will be released soon.
5/3/2024
Video2Game: Real-time, Interactive, Realistic and Browser-Compatible Environment from a Single Video
Hongchi Xia, Zhi-Hao Lin, Wei-Chiu Ma, Shenlong Wang
0
0
Creating high-quality and interactive virtual environments, such as games and simulators, often involves complex and costly manual modeling processes. In this paper, we present Video2Game, a novel approach that automatically converts videos of real-world scenes into realistic and interactive game environments. At the heart of our system are three core components:(i) a neural radiance fields (NeRF) module that effectively captures the geometry and visual appearance of the scene; (ii) a mesh module that distills the knowledge from NeRF for faster rendering; and (iii) a physics module that models the interactions and physical dynamics among the objects. By following the carefully designed pipeline, one can construct an interactable and actionable digital replica of the real world. We benchmark our system on both indoor and large-scale outdoor scenes. We show that we can not only produce highly-realistic renderings in real-time, but also build interactive games on top.
4/16/2024