The Web unpacked: a quantitative analysis of global Web usage

Overview

• This paper presents a comprehensive analysis of global web usage patterns based on data from SimilarWeb, a leading source for estimating web traffic.
• The researchers leveraged a dataset of over 250,000 websites to estimate total web traffic and investigate its distribution among domains and industry sectors.
• The analysis focuses on the characteristics of the top 116 domains, which comprise an estimated one-third of all web traffic.

Plain English Explanation

This paper takes an in-depth look at how people use the web around the world. The researchers used data from SimilarWeb, a company that tracks web traffic, to analyze the browsing habits of millions of internet users.

They looked at over 250,000 websites and estimated the total amount of web traffic, as well as how that traffic is spread out across different websites and industries. The researchers paid special attention to the 116 most popular websites, which together account for about one-third of all web traffic.

They examined various aspects of these top websites, such as the types of content they host, whether users need to log in to access them, if they have a physical presence in the real world, and who owns them. The analysis revealed some interesting patterns:

[Concentration of traffic] A small number of websites capture the majority of web traffic, indicating a significant concentration of usage. [Top traffic drivers] The websites that attract the most traffic tend to be search engines, news and media sites, social networks, streaming platforms, and adult content sites. [Platform dominance] Much of the web traffic goes to large platforms and websites owned by companies in the United States. [Business models] Most of the top websites are free to use and supported by business models that don't involve charging users directly, such as advertising.

Technical Explanation

The researchers leveraged a comprehensive dataset from SimilarWeb comprising over 250,000 websites to conduct their analysis. They estimated the total web traffic and investigated its distribution across different domains and industry sectors.

The core focus of the paper was a detailed examination of the top 116 domains, which were found to account for approximately one-third of all web traffic. The researchers analyzed various attributes of these high-traffic websites, including:

• Content sources and types: The researchers categorized the websites based on the primary content or services they provide, such as search engines, news and media, social networks, streaming platforms, and adult content.
• Access requirements: Some websites require users to log in or create an account, while others are freely accessible.
• Offline presence: The analysis also considered whether the websites had a physical, offline component to their operations.
• Ownership features: The researchers investigated the ownership structures of the top websites, looking at factors like the country of origin and whether they were owned by for-profit or non-profit entities.

The key findings of the analysis reveal a significant concentration of web traffic, with a small number of top websites capturing the majority of visits. Search engines, news and media, social networks, streaming, and adult content were identified as the primary drivers of web traffic. The data also suggests a dominance of large platforms and USA-owned websites in terms of overall traffic.

Interestingly, the researchers found that much of the traffic goes to for-profit but mostly free-of-charge websites, highlighting the prevalence of business models that do not rely on paywalls or direct user fees.

Critical Analysis

The paper provides a comprehensive and insightful analysis of global web usage patterns, leveraging a robust dataset from SimilarWeb. However, there are a few potential limitations and areas for further research that could be considered:

[Geographical representation] While the dataset encompasses a large number of websites, it may not fully represent the web usage patterns in all regions of the world, particularly in developing countries where internet access and usage patterns may differ significantly.

[Dynamic nature of the web] The web is a constantly evolving ecosystem, and the analysis in this paper reflects a snapshot in time. Longitudinal studies, such as those found in Improved Methodology for Longitudinal Web Analytics Using Common and Curious Rhythms: Temporal Regularities in Wikipedia Consumption, could provide valuable insights into how web usage patterns change over time.

[User-level analysis] The current analysis is focused on aggregate, domain-level data. Incorporating user-level data, as explored in The Political Economy of Link-Based Web Search, could shed light on individual browsing behaviors and preferences.

[Assessing causality] While the paper identifies various trends and correlations, it would be valuable to investigate the underlying causal mechanisms that drive the observed web usage patterns, possibly through studies like Through the Lens of Google Crux: Dissecting Web Browsing.

Overall, this paper offers a comprehensive and insightful snapshot of global web usage patterns, setting the stage for further research to deepen our understanding of this complex and dynamic ecosystem.

Conclusion

This paper presents a detailed analysis of global web usage patterns, leveraging a large dataset from SimilarWeb to uncover key insights about how people interact with the internet. The researchers found a significant concentration of web traffic, with a small number of top websites capturing the majority of visits. Search engines, news and media, social networks, streaming platforms, and adult content were identified as the primary attractors of web traffic, which was also highly concentrated on large platforms and USA-owned websites.

Importantly, the analysis revealed that much of the web traffic goes to for-profit but mostly free-of-charge websites, highlighting the dominance of business models that do not rely on paywalls or direct user fees. These findings have important implications for understanding the dynamics of the web and the role of various content providers and platforms in shaping online behavior and user experiences.

While the paper offers a comprehensive snapshot of global web usage, further research is needed to address potential limitations, such as geographical representation and the dynamic nature of the web. Incorporating user-level data and investigating causal mechanisms could also deepen our understanding of these complex patterns.