Metadata Integration for Spam Reviews Detection on Vietnamese E-commerce Websites

Overview

• Researchers developed a dataset called ViSpamReviews v2 that includes metadata of reviews to help classify spam reviews on Vietnamese e-commerce websites.
• They proposed a novel approach to integrate both textual and categorical attributes into the classification model.
• Experiments showed that the product category feature was effective when combined with deep neural network (DNN) models, while text features performed well on both DNN models.
• The PhoBERT model achieved state-of-the-art performance when combined with product description features generated from the SPhoBert model.

Plain English Explanation

Detecting spam reviews on e-commerce websites is an important problem, as these fake reviews can mislead consumers. In this work, the researchers created a new dataset called ViSpamReviews v2 that includes not only the text of the reviews, but also additional information like the product category.

The researchers then developed a new approach that combines both the text of the reviews and the additional metadata, like the product category, to improve the accuracy of spam review detection. They found that the product category information was particularly helpful when used with deep neural network models, while the text features performed well on their own.

The best-performing model was the PhoBERT model, which is a type of language model that has been trained on a large amount of Vietnamese text. When the PhoBERT model was combined with additional features generated from another model called SPhoBert, it was able to achieve the highest accuracy in detecting spam reviews on Vietnamese e-commerce websites.

Overall, this research shows how incorporating additional metadata, like product information, can help improve the accuracy of detecting spam and fake reviews online, which is an important problem for maintaining trust in e-commerce platforms.

Technical Explanation

The researchers introduced a new dataset called ViSpamReviews v2 that includes metadata of reviews, such as the product category, in addition to the review text. This was done to provide supplementary attributes to help classify spam reviews more accurately.

They proposed a novel approach that integrates both textual and categorical attributes into the classification model. In their experiments, they found that the product category feature was effective when combined with deep neural network (DNN) models, while text features performed well on both DNN models and the PhoBERT model.

The PhoBERT model, which is a BERT-based language model trained on Vietnamese text, achieved the highest accuracy when combined with product description features generated from the SPhoBert model (a combination of PhoBERT and SentenceBERT). Using the macro-averaged F1 score, the task of classifying spam reviews achieved 87.22% (an increase of 1.64% compared to the baseline), while the task of identifying the type of spam reviews achieved an accuracy of 73.49% (an increase of 1.93% compared to the baseline).

Critical Analysis

The researchers acknowledged that their dataset, ViSpamReviews v2, is focused on reviews from Vietnamese e-commerce websites, which may limit the generalizability of their findings to other languages and contexts. Additionally, they noted that the dataset is imbalanced, with more genuine reviews than spam reviews, which could affect the model's performance.

While the researchers showed that incorporating metadata, such as product category, can improve spam review detection, it's unclear how well this approach would scale to larger and more diverse review datasets. There may be other types of metadata or contextual information that could be even more useful for this task.

Furthermore, the researchers did not provide much insight into the types of spam reviews that their models were able to detect more effectively with the additional metadata. A more detailed analysis of the model's strengths and weaknesses would be helpful for understanding the practical implications of this research.

Overall, this work represents a promising step towards improving the detection of spam and fake reviews on e-commerce platforms, but further research is needed to fully understand the broader applicability and limitations of this approach.

Conclusion

This research introduces a new dataset, ViSpamReviews v2, and a novel approach for using both textual and categorical attributes to improve the detection of spam reviews on Vietnamese e-commerce websites. The key findings show that incorporating metadata, such as product category, can enhance the performance of deep learning models for this task.

The state-of-the-art results achieved by the PhoBERT model, when combined with features generated from the SPhoBert model, highlight the potential of leveraging pre-trained language models and supplementary data sources to tackle the problem of spam and fake reviews.

While the dataset and findings are specific to the Vietnamese market, this work demonstrates the value of considering additional context and metadata in AI-powered review analysis systems. As e-commerce continues to grow, addressing the challenge of spam reviews will be increasingly important for maintaining trust and transparency in online marketplaces.