Social Media Use is Predictable from App Sequences: Using LSTM and Transformer Neural Networks to Model Habitual Behavior

Read original: arXiv:2404.16066 - Published 6/26/2024 by Heinrich Peters, Joseph B. Bayer, Sandra C. Matz, Yikun Chi, Sumer S. Vaid, Gabriella M. Harari
Total Score

0

🧠

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper introduces a novel approach to studying social media habits by predicting sequential smartphone user behaviors.
  • Rather than relying on self-reported data or simple behavioral frequency measures, the researchers examine the predictability of social media use within and between individuals.
  • The study leverages Long Short-Term Memory (LSTM) and transformer neural networks to model patterns in user behavior.

Plain English Explanation

The researchers wanted to understand how people use social media on their smartphones in a more detailed way than previous studies. Instead of just asking people how often they use social media or tracking how much time they spend on it, the researchers looked at the sequences of actions people take on their phones.

By using advanced machine learning techniques like LSTMs and transformers, the researchers were able to predict people's social media use patterns. They found that social media use is quite predictable, both at the individual level and across all the study participants.

Interestingly, the researchers discovered that how predictable someone's social media use is doesn't necessarily correlate with how much they use social media overall. This suggests their approach is capturing a distinct aspect of smartphone habits beyond just frequency of use.

Technical Explanation

The researchers developed several different modeling approaches to predict social media use:

  1. Global models: Training a single model on data pooled from all participants
  2. Idiographic person-specific models: Training individual models for each participant
  3. Fine-tuned global models: Starting with the global model and further training it on each participant's data

Surprisingly, the global models performed just as well as the person-specific models, indicating they were able to capture a variety of individual behavioral patterns. The researchers also found that the predictability of an individual's social media use was not strongly related to their overall frequency of smartphone or social media use.

Critical Analysis

A strength of this research is the use of sequential behavioral data and advanced neural network models to gain insights beyond what self-report or simple frequency measures can provide. This aligns with calls in the literature to move beyond usage metrics and explore the dynamics of social interaction.

However, the paper does not delve into potential privacy concerns around modeling individual smartphone behaviors in such detail. There are also open questions about how generalizable these findings are, as the study was conducted with a relatively small, homogeneous sample.

Additionally, the researchers do not provide much theoretical grounding or interpretation for why some individuals' social media use is more predictable than others. Further probing of these large-scale behavioral models could yield valuable insights.

Conclusion

This paper presents a novel approach to studying social media habits that goes beyond simple usage metrics. By modeling the sequential nature of smartphone behaviors, the researchers were able to uncover predictable patterns both within and between individuals.

The finding that global models can capture individual differences suggests these techniques may be useful for understanding player behaviors in other domains as well. Overall, this research highlights the potential of advanced machine learning to shed new light on technology-mediated human behaviors.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🧠

Total Score

0

Social Media Use is Predictable from App Sequences: Using LSTM and Transformer Neural Networks to Model Habitual Behavior

Heinrich Peters, Joseph B. Bayer, Sandra C. Matz, Yikun Chi, Sumer S. Vaid, Gabriella M. Harari

The present paper introduces a novel approach to studying social media habits through predictive modeling of sequential smartphone user behaviors. While much of the literature on media and technology habits has relied on self-report questionnaires and simple behavioral frequency measures, we examine an important yet understudied aspect of media and technology habits: their embeddedness in repetitive behavioral sequences. Leveraging Long Short-Term Memory (LSTM) and transformer neural networks, we show that (i) social media use is predictable at the within and between-person level and that (ii) there are robust individual differences in the predictability of social media use. We examine the performance of several modeling approaches, including (i) global models trained on the pooled data from all participants, (ii) idiographic person-specific models, and (iii) global models fine-tuned on person-specific data. Neither person-specific modeling nor fine-tuning on person-specific data substantially outperformed the global models, indicating that the global models were able to represent a variety of idiosyncratic behavioral patterns. Additionally, our analyses reveal that the person-level predictability of social media use is not substantially related to the frequency of smartphone use in general or the frequency of social media use, indicating that our approach captures an aspect of habits that is distinct from behavioral frequency. Implications for habit modeling and theoretical development are discussed.

Read more

6/26/2024

🔮

Total Score

0

Context-Aware Prediction of User Engagement on Online Social Platforms

Heinrich Peters, Yozen Liu, Francesco Barbieri, Raiyan Abdul Baten, Sandra C. Matz, Maarten W. Bos

The success of online social platforms hinges on their ability to predict and understand user behavior at scale. Here, we present data suggesting that context-aware modeling approaches may offer a holistic yet lightweight and potentially privacy-preserving representation of user engagement on online social platforms. Leveraging deep LSTM neural networks to analyze more than 100 million Snapchat sessions from almost 80.000 users, we demonstrate that patterns of active and passive use are predictable from past behavior (R2=0.345) and that the integration of context features substantially improves predictive performance compared to the behavioral baseline model (R2=0.522). Features related to smartphone connectivity status, location, temporal context, and weather were found to capture non-redundant variance in user engagement relative to features derived from histories of in-app behaviors. Further, we show that a large proportion of variance can be accounted for with minimal behavioral histories if momentary context is considered (R2=0.442). These results indicate the potential of context-aware approaches for making models more efficient and privacy-preserving by reducing the need for long data histories. Finally, we employ model explainability techniques to glean preliminary insights into the underlying behavioral mechanisms. Our findings are consistent with the notion of context-contingent, habit-driven patterns of active and passive use, underscoring the value of contextualized representations of user behavior for predicting user engagement on social platforms.

Read more

6/17/2024

EVOLVE: Predicting User Evolution and Network Dynamics in Social Media Using Fine-Tuned GPT-like Model
Total Score

0

EVOLVE: Predicting User Evolution and Network Dynamics in Social Media Using Fine-Tuned GPT-like Model

Ismail Hossain, Md Jahangir Alam, Sai Puppala, Sajedul Talukder

Social media platforms are extensively used for sharing personal emotions, daily activities, and various life events, keeping people updated with the latest happenings. From the moment a user creates an account, they continually expand their network of friends or followers, freely interacting with others by posting, commenting, and sharing content. Over time, user behavior evolves based on demographic attributes and the networks they establish. In this research, we propose a predictive method to understand how a user evolves on social media throughout their life and to forecast the next stage of their evolution. We fine-tune a GPT-like decoder-only model (we named it E-GPT: Evolution-GPT) to predict the future stages of a user's evolution in online social media. We evaluate the performance of these models and demonstrate how user attributes influence changes within their network by predicting future connections and shifts in user activities on social media, which also addresses other social media challenges such as recommendation systems.

Read more

7/16/2024

Limits to Predicting Online Speech Using Large Language Models
Total Score

0

Limits to Predicting Online Speech Using Large Language Models

Mina Remeli, Moritz Hardt, Robert C. Williamson

We study the predictability of online speech on social media, and whether predictability improves with information outside a user's own posts. Recent work suggests that the predictive information contained in posts written by a user's peers can surpass that of the user's own posts. Motivated by the success of large language models, we empirically test this hypothesis. We define unpredictability as a measure of the model's uncertainty, i.e., its negative log-likelihood on future tokens given context. As the basis of our study, we collect a corpus of 6.25M posts from more than five thousand X (previously Twitter) users and their peers. Across three large language models ranging in size from 1 billion to 70 billion parameters, we find that predicting a user's posts from their peers' posts performs poorly. Moreover, the value of the user's own posts for prediction is consistently higher than that of their peers'. Across the board, we find that the predictability of social media posts remains low, comparable to predicting financial news without context. We extend our investigation with a detailed analysis about the causes of unpredictability and the robustness of our findings. Specifically, we observe that a significant amount of predictive uncertainty comes from hashtags and @-mentions. Moreover, our results replicate if instead of prompting the model with additional context, we finetune on additional context.

Read more

7/19/2024