Conditional Quantile Estimation for Uncertain Watch Time in Short-Video Recommendation
0
Sign in to get full access
Overview
- This paper focuses on the problem of uncertain watch time prediction in short-video recommendation systems.
- It proposes a conditional quantile estimation approach to model the distribution of watch time, rather than just predicting the mean watch time.
- This allows the system to better capture the uncertainty in user engagement and make more robust recommendations.
Plain English Explanation
When you browse short videos online, recommendation systems try to predict how long you'll watch each video. However, user engagement can be quite uncertain - sometimes you might watch a video for just a few seconds, while other times you could watch it for several minutes.
The researchers behind this paper argue that simply predicting the average watch time isn't enough. Instead, they propose a method that models the entire distribution of possible watch times for each video. This allows the recommendation system to better understand the uncertainty in user behavior and make more reliable recommendations.
For example, the system might predict that there's a 20% chance you'll watch a video for less than 30 seconds, a 50% chance you'll watch it for 1-2 minutes, and a 30% chance you'll watch it for over 2 minutes. Armed with this more nuanced understanding of potential watch times, the recommendation system can make better decisions about which videos to show you.
Technical Explanation
The key innovation in this paper is the use of conditional quantile estimation to model the uncertain watch time distribution, rather than just predicting the mean watch time.
The authors first extract various features about the video and user that might influence watch time, such as video length, user demographics, and past engagement history. They then train a quantile regression model to estimate the conditional quantiles of the watch time distribution given these features.
This allows the system to make uncertainty-aware predictions about the full range of possible watch times, rather than just a point estimate. The researchers show that this leads to more reliable video recommendations that better match user preferences and engagement.
Critical Analysis
The paper makes a compelling case for the benefits of modeling uncertain watch time distributions in short-video recommendation. However, a potential limitation is that the proposed approach relies on extensive feature engineering to capture all the relevant factors influencing user engagement.
An interesting direction for future research could be to explore online learning or meta-learning techniques that could adaptively update the quantile estimation model as new user interaction data becomes available.
Additionally, the paper does not discuss potential privacy or fairness concerns that may arise from using detailed user features to model watch time distributions. Further work is needed to ensure such recommendation systems are designed with ethical considerations in mind.
Conclusion
This paper presents a novel approach to modeling uncertain user engagement in short-video recommendation systems. By using conditional quantile estimation to predict the full distribution of watch times, rather than just the mean, the system can make more reliable and personalized recommendations.
While the proposed method shows promising results, there are opportunities to further improve the adaptability and ethical considerations of this type of recommendation system. Overall, the research contributes important insights into the value of uncertainty-aware prediction for enhancing the user experience in online video platforms.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Conditional Quantile Estimation for Uncertain Watch Time in Short-Video Recommendation
Chengzhi Lin, Shuchang Liu, Chuyuan Wang, Yongqi Liu
Accurately predicting watch time is crucial for optimizing recommendations and user experience in short video platforms. However, existing methods that estimate a single average watch time often fail to capture the inherent uncertainty and diversity in user engagement patterns. In this paper, we propose the Conditional Quantile Estimation (CQE) framework to model the entire conditional distribution of watch time. Using quantile regression, CQE characterizes the complex watch-time distribution for each user-video pair, providing a flexible and comprehensive approach to understanding user behavior. We further design multiple strategies to combine the quantile estimates, adapting to different recommendation scenarios and user preferences. Extensive offline experiments and online A/B tests demonstrate the superiority of CQE in watch time prediction and user engagement modeling. In particular, the online deployment of CQE in KuaiShow has led to significant improvements in key evaluation metrics, including active days, active users, engagement duration, and video view counts. These results highlight the practical impact of our proposed approach in enhancing the user experience and overall performance of the short video recommendation system. The code will be released after publication.
Read more8/1/2024
0
Counteracting Duration Bias in Video Recommendation via Counterfactual Watch Time
Haiyuan Zhao, Guohao Cai, Jieming Zhu, Zhenhua Dong, Jun Xu, Ji-Rong Wen
In video recommendation, an ongoing effort is to satisfy users' personalized information needs by leveraging their logged watch time. However, watch time prediction suffers from duration bias, hindering its ability to reflect users' interests accurately. Existing label-correction approaches attempt to uncover user interests through grouping and normalizing observed watch time according to video duration. Although effective to some extent, we found that these approaches regard completely played records (i.e., a user watches the entire video) as equally high interest, which deviates from what we observed on real datasets: users have varied explicit feedback proportion when completely playing videos. In this paper, we introduce the counterfactual watch time(CWT), the potential watch time a user would spend on the video if its duration is sufficiently long. Analysis shows that the duration bias is caused by the truncation of CWT due to the video duration limitation, which usually occurs on those completely played records. Besides, a Counterfactual Watch Model (CWM) is proposed, revealing that CWT equals the time users get the maximum benefit from video recommender systems. Moreover, a cost-based transform function is defined to transform the CWT into the estimation of user interest, and the model can be learned by optimizing a counterfactual likelihood function defined over observed user watch times. Extensive experiments on three real video recommendation datasets and online A/B testing demonstrated that CWM effectively enhanced video recommendation accuracy and counteracted the duration bias.
Read more6/14/2024
0
SWaT: Statistical Modeling of Video Watch Time through User Behavior Analysis
Shentao Yang, Haichuan Yang, Linna Du, Adithya Ganesh, Bo Peng, Boying Liu, Serena Li, Ji Liu
The significance of estimating video watch time has been highlighted by the rising importance of (short) video recommendation, which has become a core product of mainstream social media platforms. Modeling video watch time, however, has been challenged by the complexity of user-video interaction, such as different user behavior modes in watching the recommended videos and varying watching probabilities over the video horizon. Despite the importance and challenges, existing literature on modeling video watch time mostly focuses on relatively black-box mechanical enhancement of the classical regression/classification losses, without factoring in user behavior in a principled manner. In this paper, we for the first time take on a user-centric perspective to model video watch time, from which we propose a white-box statistical framework that directly translates various user behavior assumptions in watching (short) videos into statistical watch time models. These behavior assumptions are portrayed by our domain knowledge on users' behavior modes in video watching. We further employ bucketization to cope with user's non-stationary watching probability over the video horizon, which additionally helps to respect the constraint of video length and facilitate the practical compatibility between the continuous regression event of watch time and other binary classification events. We test our models extensively on two public datasets, a large-scale offline industrial dataset, and an online A/B test on a short video platform with hundreds of millions of daily-active users. On all experiments, our models perform competitively against strong relevant baselines, demonstrating the efficacy of our user-centric perspective and proposed framework.
Read more8/16/2024
0
Adaptive Uncertainty Quantification for Trajectory Prediction Under Distributional Shift
Huiqun Huang, Sihong He, Fei Miao
Trajectory prediction models that can infer both finite future trajectories and their associated uncertainties of the target vehicles in an online setting (e.g., real-world application scenarios) is crucial for ensuring the safe and robust navigation and path planning of autonomous vehicle motion. However, the majority of existing trajectory prediction models have neither considered reducing the uncertainty as one objective during the training stage nor provided reliable uncertainty quantification during inference stage under potential distribution shift. Therefore, in this paper, we propose the Conformal Uncertainty Quantification under Distribution Shift framework, CUQDS, to quantify the uncertainty of the predicted trajectories of existing trajectory prediction models under potential data distribution shift, while considering improving the prediction accuracy of the models and reducing the estimated uncertainty during the training stage. Specifically, CUQDS includes 1) a learning-based Gaussian process regression module that models the output distribution of the base model (any existing trajectory prediction or time series forecasting neural networks) and reduces the estimated uncertainty by additional loss term, and 2) a statistical-based Conformal P control module to calibrate the estimated uncertainty from the Gaussian process regression module in an online setting under potential distribution shift between training and testing data.
Read more6/19/2024