ClustML: A Measure of Cluster Pattern Complexity in Scatterplots Learnt from Human-labeled Groupings

Overview

• Researchers propose a new visual quality measure (VQM) called ClustML to automatically assess the perceptual complexity of grouping patterns in scatterplots.
• ClustML encodes scatterplots using a Gaussian Mixture Model and classifies the grouping patterns based on previously collected human judgments.
• The model improves upon existing VQMs by better estimating human judgments on two-Gaussian cluster patterns and providing higher accuracy when ranking general cluster patterns.
• The researchers use ClustML to analyze kinship data for genome-wide association studies, where experts rely on visual analysis of large sets of scatterplots.
• The benchmark datasets and new VQM are made available for practical use and further improvements.

Plain English Explanation

Visualizations like scatterplots are often used by analysts to explore and understand complex data. However, interpreting the visual grouping patterns in these plots can be challenging. ClustML: An Automatic Visual Quality Measure for Scatterplots proposes a new tool to help with this task.

The researchers trained ClustML on previous human judgments of scatterplot patterns. This allowed the model to learn how people perceive the "complexity" of different grouping patterns. Now, ClustML can look at a new scatterplot and automatically estimate how visually complex the grouping patterns are, just like a human expert would.

This is useful for analysts who work with large datasets that generate many scatterplots, like in genome-wide association studies. Instead of manually reviewing each plot, they can use ClustML to quickly identify the most interesting or complex patterns that deserve closer inspection. The researchers showed that ClustML outperforms existing tools at this task.

By making ClustML publicly available, the researchers hope it will become a practical tool to support data analysis and visualization. It could also inspire further research into modeling human perception of visual patterns.

Technical Explanation

ClustML: An Automatic Visual Quality Measure for Scatterplots proposes a new visual quality measure (VQM) to automatically assess the perceptual complexity of grouping patterns in scatterplots.

The model encodes scatterplots in the parametric space of a Gaussian Mixture Model (GMM), which captures the underlying cluster structure. It then uses a classifier trained on previously collected human judgments to estimate the perceived complexity of the grouping patterns.

Specifically, the number of initial mixture components and the final number of combined groups are used as features to train the complexity classifier. This approach improves upon existing VQMs in two key ways:

1. It better estimates human judgments on scatterplots with two-Gaussian cluster patterns, which prior models struggled with.
2. It provides higher accuracy when ranking the general cluster patterns present in scatterplots.

The researchers demonstrate the utility of ClustML by applying it to analyze kinship data for genome-wide association studies. In this domain, experts rely heavily on visual analysis of large sets of scatterplots, making an automated VQM like ClustML a valuable tool.

The benchmark datasets and the new ClustML VQM are made publicly available to support practical use and further research into modeling human perception of visual patterns. This builds on prior work on interpreting visual clusters in dimensionality reduction, enhancing dimension-reduced scatter plots, and clustering distinguishability criteria.

Critical Analysis

The paper presents a compelling approach to automatically assessing the perceptual complexity of scatterplot grouping patterns. The use of human judgment data to train the complexity classifier is a key strength, as it allows the model to better align with how people actually perceive these visual patterns.

However, the authors acknowledge that the current version of ClustML has some limitations. For example, it may struggle with scatterplots that have irregular or overlapping cluster shapes, beyond the Gaussian patterns it was trained on. Approaches that consider multi-view clustering or characterize the imprecision of cluster boundaries could potentially address these issues in future work.

Additionally, while the researchers demonstrate the utility of ClustML for genome-wide association studies, its broader applicability to other visualization domains remains to be explored. Further validation and testing on a wider range of scatterplot use cases would help strengthen the generalizability of the approach.

Overall, ClustML represents an important step forward in developing automated tools to support human interpretation of complex visual patterns. As the authors note, continued research in this area has the potential to significantly enhance data analysis and visualization capabilities across many fields.

Conclusion

ClustML: An Automatic Visual Quality Measure for Scatterplots introduces a new visual quality measure that can automatically assess the perceptual complexity of grouping patterns in scatterplots.

By encoding scatterplots using a Gaussian Mixture Model and training a classifier on human judgment data, ClustML provides a way to quantify the visual "complexity" of cluster structures. This tool can help analysts more efficiently explore and understand large collections of scatterplots, as demonstrated in the genome-wide association study use case.

The availability of the benchmark datasets and the ClustML model itself opens up opportunities for further research and practical applications in data visualization and analysis. As the field continues to explore how to better model and interpret human perception of visual patterns, tools like ClustML could become invaluable for supporting experts in various domains.