Progressive Feature Learning for Realistic Cloth-Changing Gait Recognition

Read original: arXiv:2207.11720 - Published 4/23/2024 by Xuqian Ren, Saihui Hou, Chunshui Cao, Xu Liu, Yongzhen Huang
Total Score

0

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Gait recognition is a technique used for crime prevention and social security, as it can identify individuals from a distance by their walking patterns.
  • Existing datasets and methods have difficulty with the common real-world challenge of people changing their clothes, which can significantly impact gait recognition accuracy.
  • The paper proposes a new problem formulation and benchmarks to address this "cloth-changing" challenge, as well as a novel framework called Progressive Feature Learning to improve performance.

Plain English Explanation

Gait recognition is a way to identify people based on how they walk. This can be really useful for security and crime prevention, since it allows you to figure out who someone is from a distance. However, the paper explains that existing methods struggle with a common real-world issue - when people change their clothes. This can make it much harder to accurately recognize someone's gait.

To address this, the researchers formulate a new problem called "Realistic Cloth-Changing Gait Recognition" and create two new benchmark datasets to test it. They also propose a new framework called "Progressive Feature Learning" that can be used with existing AI models to improve their performance, especially when people are changing their clothes.

The key idea is to extract features in a stepwise manner - first focusing on recognizing people across different viewing angles, and then adding the ability to handle changes in clothing. This helps the model learn robust features that work well even when someone's outfit is different.

Technical Explanation

The paper formulates a new problem called "Realistic Cloth-Changing Gait Recognition" (RCC-GR) to address the limitations of existing gait recognition datasets and methods. They construct two new benchmarks, CASIA-BN-RCC and OUMVLP-RCC, that simulate the real-world challenge of people changing their clothes.

The researchers then propose a framework called Progressive Feature Learning to improve gait recognition performance, especially in cloth-changing conditions. Their approach extracts features in a stepwise manner - first learning to recognize people across different viewing angles, and then learning to handle changes in clothing on top of that.

Specifically, the framework includes two key components: Progressive Mapping and Progressive Uncertainty. Progressive Mapping learns cross-view features first, which helps counter the uneven distribution in the training data caused by the adverse effects of the cross-cloth data. Progressive Uncertainty then extracts cross-cloth features building on the cross-view features.

Experiments on the new benchmarks show that this Progressive Feature Learning framework can effectively boost recognition performance, particularly in challenging cloth-changing scenarios that existing methods struggle with.

Critical Analysis

The paper makes a valuable contribution by identifying and addressing a key practical limitation of current gait recognition systems - their inability to handle changes in clothing. The proposed RCC-GR problem formulation and benchmarks provide a useful framework for evaluating real-world performance.

However, the paper does not discuss potential privacy or ethical concerns around the use of gait recognition technology, such as its potential for surveillance and identification without consent. There may also be challenges in generalizing the proposed approach to work with different sensor modalities like LiDAR.

Overall, the technical contributions are strong, but the paper would benefit from a more well-rounded discussion of the broader implications and limitations of this line of research.

Conclusion

This paper tackles an important practical challenge in gait recognition - the ability to accurately identify individuals even when their clothing changes. By formulating a new "Realistic Cloth-Changing Gait Recognition" problem and proposing a novel Progressive Feature Learning framework, the researchers demonstrate significant improvements in recognition performance on challenging real-world scenarios.

While the technical advancements are compelling, the broader societal impact and ethical considerations of this technology should be explored further. Nonetheless, this work represents an important step forward in making gait recognition more robust and applicable for real-world crime prevention and security applications.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Total Score

0

Progressive Feature Learning for Realistic Cloth-Changing Gait Recognition

Xuqian Ren, Saihui Hou, Chunshui Cao, Xu Liu, Yongzhen Huang

Gait recognition is instrumental in crime prevention and social security, for it can be conducted at a long distance to figure out the identity of persons. However, existing datasets and methods cannot satisfactorily deal with the most challenging cloth-changing problem in practice. Specifically, the practical gait models are usually trained on automatically labeled data, in which the sequences' views and cloth conditions of each person have some restrictions. To be concrete, the cross-view sub-dataset only has normal walking condition without cloth-changing, while the cross-cloth sub-dataset has cloth-changing sequences but only in front views. As a result, the cloth-changing accuracy cannot meet practical requirements. In this work, we formulate the problem as Realistic Cloth-Changing Gait Recognition (abbreviated as RCC-GR) and we construct two benchmarks: CASIA-BN-RCC and OUMVLP-RCC, to simulate the above setting. Furthermore, we propose a new framework called Progressive Feature Learning that can be applied with off-the-shelf backbones to improve their performance in RCC-GR. Specifically, in our framework, we design Progressive Mapping and Progressive Uncertainty to extract cross-view features and then extract cross-cloth features on the basis. In this way, the feature from the cross-view sub-dataset can first dominate the feature space and relieve the uneven distribution caused by the adverse effect from the cross-cloth sub-dataset. The experiments on our benchmarks show that our framework can effectively improve recognition performance, especially in the cloth-changing conditions.

Read more

4/23/2024

🎲

Total Score

0

Features Reconstruction Disentanglement Cloth-Changing Person Re-Identification

Zhihao Chen, Yiyuan Ge, Qing Yue

Cloth-changing person re-identification (CC-ReID) aims to retrieve specific pedestrians in a cloth-changing scenario. Its main challenge is to disentangle the clothing-related and clothing-unrelated features. Most existing approaches force the model to learn clothing-unrelated features by changing the color of the clothes. However, due to the lack of ground truth, these methods inevitably introduce noise, which destroys the discriminative features and leads to an uncontrollable disentanglement process. In this paper, we propose a new person re-identification network called features reconstruction disentanglement ReID (FRD-ReID), which can controllably decouple the clothing-unrelated and clothing-related features. Specifically, we first introduce the human parsing mask as the ground truth of the reconstruction process. At the same time, we propose the far away attention (FAA) mechanism and the person contour attention (PCA) mechanism for clothing-unrelated features and pedestrian contour features to improve the feature reconstruction efficiency. In the testing phase, we directly discard the clothing-related features for inference,which leads to a controllable disentanglement process. We conducted extensive experiments on the PRCC, LTCC, and Vc-Clothes datasets and demonstrated that our method outperforms existing state-of-the-art methods.

Read more

7/16/2024

🤷

Total Score

0

Unsupervised Gait Recognition with Selective Fusion

Xuqian Ren, Shaopeng Yang, Saihui Hou, Chunshui Cao, Xu Liu, Yongzhen Huang

Previous gait recognition methods primarily trained on labeled datasets, which require painful labeling effort. However, using a pre-trained model on a new dataset without fine-tuning can lead to significant performance degradation. So to make the pre-trained gait recognition model able to be fine-tuned on unlabeled datasets, we propose a new task: Unsupervised Gait Recognition (UGR). We introduce a new cluster-based baseline to solve UGR with cluster-level contrastive learning. But we further find more challenges this task meets. First, sequences of the same person in different clothes tend to cluster separately due to the significant appearance changes. Second, sequences taken from 0{deg} and 180{deg} views lack walking postures and do not cluster with sequences taken from other views. To address these challenges, we propose a Selective Fusion method, which includes Selective Cluster Fusion (SCF) and Selective Sample Fusion (SSF). With SCF, we merge matched clusters of the same person wearing different clothes by updating the cluster-level memory bank with a multi-cluster update strategy. And in SSF, we merge sequences taken from front/back views gradually with curriculum learning. Extensive experiments show the effectiveness of our method in improving the rank-1 accuracy in walking with different coats condition and front/back views conditions.

Read more

4/23/2024

📉

Total Score

0

Exploring Fine-Grained Representation and Recomposition for Cloth-Changing Person Re-Identification

Qizao Wang, Xuelin Qian, Bin Li, Xiangyang Xue, Yanwei Fu

Cloth-changing person Re-IDentification (Re-ID) is a particularly challenging task, suffering from two limitations of inferior discriminative features and limited training samples. Existing methods mainly leverage auxiliary information to facilitate identity-relevant feature learning, including soft-biometrics features of shapes or gaits, and additional labels of clothing. However, this information may be unavailable in real-world applications. In this paper, we propose a novel FIne-grained Representation and Recomposition (FIRe$^{2}$) framework to tackle both limitations without any auxiliary annotation or data. Specifically, we first design a Fine-grained Feature Mining (FFM) module to separately cluster images of each person. Images with similar so-called fine-grained attributes (e.g., clothes and viewpoints) are encouraged to cluster together. An attribute-aware classification loss is introduced to perform fine-grained learning based on cluster labels, which are not shared among different people, promoting the model to learn identity-relevant features. Furthermore, to take full advantage of fine-grained attributes, we present a Fine-grained Attribute Recomposition (FAR) module by recomposing image features with different attributes in the latent space. It significantly enhances robust feature learning. Extensive experiments demonstrate that FIRe$^{2}$ can achieve state-of-the-art performance on five widely-used cloth-changing person Re-ID benchmarks. The code is available at https://github.com/QizaoWang/FIRe-CCReID.

Read more

6/21/2024