Style Based Clustering of Visual Artworks

Read original: arXiv:2409.08245 - Published 9/14/2024 by Abhishek Dangeti, Pavan Gajula, Vivek Srivastava, Vikram Jamwal
Total Score

0

Style Based Clustering of Visual Artworks

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • The research paper explores a technique for clustering visual artworks based on their artistic style.
  • It examines how to group paintings, sculptures, and other visual art pieces into coherent style-based clusters.
  • The goal is to develop a system that can automatically organize large art collections according to the underlying artistic styles.

Plain English Explanation

The paper presents a method for grouping visual artworks based on their artistic styles. This could be useful for managing and navigating large art collections, as it allows artwork to be organized in a way that reflects the visual similarities between pieces rather than just their subject matter or artist.

The approach involves using machine learning techniques to analyze the visual features of artworks and determine which ones share a common artistic style. This could help identify trends and patterns in how artists approach their craft, as well as discover new connections between seemingly disparate works.

Overall, the goal is to develop a system that can automatically organize and browse large art collections in a more intuitive and meaningful way, based on the underlying artistic styles rather than just superficial characteristics.

Technical Explanation

The paper proposes a framework for clustering visual artworks based on their stylistic features. The key steps are:

  1. Extracting visual features from artworks using a deep learning model trained on a large dataset of art images.
  2. Applying dimensionality reduction techniques to compress the high-dimensional feature vectors into a more compact representation.
  3. Using a clustering algorithm to group the artworks into coherent style-based clusters.

The authors experimented with different feature extraction models and clustering algorithms, and evaluated the performance on several art datasets. They found that their approach was able to identify meaningful style-based groupings that aligned with expert human judgments.

Critical Analysis

The paper provides a solid technical foundation for style-based clustering of visual artworks, but there are a few limitations worth noting:

Overall, the research represents an important step towards better understanding and organizing the diverse world of visual arts, and could inspire further work in this direction.

Conclusion

This paper presents a novel approach for clustering visual artworks based on their artistic styles, rather than just their subject matter or creator. By leveraging deep learning and dimensionality reduction techniques, the method can identify meaningful style-based groupings that align with expert human judgments.

While the current implementation has some limitations, the research lays the groundwork for more sophisticated art organization and browsing systems that could help people discover new artistic connections and trends in large art collections. This could have significant implications for art education, curation, and appreciation.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Style Based Clustering of Visual Artworks
Total Score

0

Style Based Clustering of Visual Artworks

Abhishek Dangeti, Pavan Gajula, Vivek Srivastava, Vikram Jamwal

Clustering artworks based on style has many potential real-world applications like art recommendations, style-based search and retrieval, and the study of artistic style evolution in an artwork corpus. However, clustering artworks based on style is largely an unaddressed problem. A few present methods for clustering artworks principally rely on generic image feature representations derived from deep neural networks and do not specifically deal with the artistic style. In this paper, we introduce and deliberate over the notion of style-based clustering of visual artworks. Our main objective is to explore neural feature representations and architectures that can be used for style-based clustering and observe their impact and effectiveness. We develop different methods and assess their relative efficacy for style-based clustering through qualitative and quantitative analysis by applying them to four artwork corpora and four curated synthetically styled datasets. Our analysis provides some key novel insights on architectures, feature representations, and evaluation methods suitable for style-based clustering.

Read more

9/14/2024

🧪

Total Score

0

FedStyle: Style-Based Federated Learning Crowdsourcing Framework for Art Commissions

Changjuan Ran, Yeting Guo, Fang Liu, Shenglan Cui, Yunfan Ye

The unique artistic style is crucial to artists' occupational competitiveness, yet prevailing Art Commission Platforms rarely support style-based retrieval. Meanwhile, the fast-growing generative AI techniques aggravate artists' concerns about releasing personal artworks to public platforms. To achieve artistic style-based retrieval without exposing personal artworks, we propose FedStyle, a style-based federated learning crowdsourcing framework. It allows artists to train local style models and share model parameters rather than artworks for collaboration. However, most artists possess a unique artistic style, resulting in severe model drift among them. FedStyle addresses such extreme data heterogeneity by having artists learn their abstract style representations and align with the server, rather than merely aggregating model parameters lacking semantics. Besides, we introduce contrastive learning to meticulously construct the style representation space, pulling artworks with similar styles closer and keeping different ones apart in the embedding space. Extensive experiments on the proposed datasets demonstrate the superiority of FedStyle.

Read more

4/26/2024

Deep Ensemble Art Style Recognition
Total Score

0

Deep Ensemble Art Style Recognition

Orfeas Menis-Mastromichalakis, Natasa Sofou, Giorgos Stamou

The massive digitization of artworks during the last decades created the need for categorization, analysis, and management of huge amounts of data related to abstract concepts, highlighting a challenging problem in the field of computer science. The rapid progress of artificial intelligence and neural networks has provided tools and technologies that seem worthy of the challenge. Recognition of various art features in artworks has gained attention in the deep learning society. In this paper, we are concerned with the problem of art style recognition using deep networks. We compare the performance of 8 different deep architectures (VGG16, VGG19, ResNet50, ResNet152, Inception-V3, DenseNet121, DenseNet201 and Inception-ResNet-V2), on two different art datasets, including 3 architectures that have never been used on this task before, leading to state-of-the-art performance. We study the effect of data preprocessing prior to applying a deep learning model. We introduce a stacking ensemble method combining the results of first-stage classifiers through a meta-classifier, with the innovation of a versatile approach based on multiple models that extract and recognize different characteristics of the input, creating a more consistent model compared to existing works and achieving state-of-the-art accuracy on the largest art dataset available (WikiArt - 68,55%). We also discuss the impact of the data and art styles themselves on the performance of our models forming a manifold perspective on the problem.

Read more

5/21/2024

Diversity and stylization of the contemporary user-generated visual arts in the complexity-entropy plane
Total Score

0

Diversity and stylization of the contemporary user-generated visual arts in the complexity-entropy plane

Seunghwan Kim, Byunghwee Lee, Wonjae Lee

The advent of computational and numerical methods in recent times has provided new avenues for analyzing art historiographical narratives and tracing the evolution of art styles therein. Here, we investigate an evolutionary process underpinning the emergence and stylization of contemporary user-generated visual art styles using the complexity-entropy (C-H) plane, which quantifies local structures in paintings. Informatizing 149,780 images curated in DeviantArt and Behance platforms from 2010 to 2020, we analyze the relationship between local information of the C-H space and multi-level image features generated by a deep neural network and a feature extraction algorithm. The results reveal significant statistical relationships between the C-H information of visual artistic styles and the dissimilarities of the multi-level image features over time within groups of artworks. By disclosing a particular C-H region where the diversity of image representations is noticeably manifested, our analyses reveal an empirical condition of emerging styles that are both novel in the C-H plane and characterized by greater stylistic diversity. Our research shows that visual art analyses combined with physics-inspired methodologies and machine learning, can provide macroscopic insights into quantitatively mapping relevant characteristics of an evolutionary process underpinning the creative stylization of uncharted visual arts of given groups and time.

Read more

8/22/2024