The 8th AI City Challenge

Read original: arXiv:2404.09432 - Published 4/16/2024 by Shuo Wang, David C. Anastasiu, Zheng Tang, Ming-Ching Chang, Yue Yao, Liang Zheng, Mohammed Shaiqur Rahman, Meenakshi S. Arya, Anuj Sharma, Pranamesh Chakraborty and 14 others
Total Score

0

The 8th AI City Challenge

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • The 8th AI City Challenge is a research competition focused on developing advanced AI systems for smart city applications.
  • The challenge covers a range of tasks, including multi-target, multi-camera (MTMC) person tracking, vehicle re-identification, and traffic flow prediction.
  • Participants are provided with large-scale datasets to train and evaluate their AI models.
  • The goal is to push the boundaries of what's possible with AI in the context of building smarter, more efficient, and safer cities.

Plain English Explanation

The 8th AI City Challenge is a research competition that asks teams to develop advanced AI systems to help make cities smarter and more efficient. The challenge covers a variety of tasks related to city infrastructure and transportation, like tracking people as they move between different surveillance cameras, identifying vehicles, and predicting traffic patterns.

Participants are given large datasets of information about cities, like video footage and sensor data, that they can use to train their AI models. The goal is to push the boundaries of what's possible with AI - to create systems that can monitor a city in real-time, understand what's happening, and make intelligent decisions to improve things like transportation, public safety, and resource efficiency.

This kind of technology could one day help cities run more smoothly, with less traffic congestion, better coordinated emergency response, and more efficient use of things like electricity and water. The 8th AI City Challenge is an opportunity for researchers to showcase the latest advancements in AI and how they can be applied to make our urban environments smarter and more livable.

Technical Explanation

The 8th AI City Challenge focuses on several key tasks related to building intelligent systems for smart cities. One of the main challenges is multi-target, multi-camera (MTMC) person tracking, which involves accurately following the movements of individual people as they move between different surveillance cameras across a city.

Another key task is vehicle re-identification, where AI models must be able to associate images of the same vehicle captured by different cameras. This could be useful for monitoring traffic patterns, detecting stolen vehicles, and more.

The challenge also includes a traffic flow prediction task, where participants must develop models that can forecast future traffic conditions based on historical data and real-time sensor information. This could enable more efficient traffic management and route planning.

Participants are provided with large-scale datasets, including video footage, GPS data, and other sensor information, that they can use to train and evaluate their AI models. The goal is to push the state-of-the-art in areas like computer vision, sensor fusion, and predictive analytics to create intelligent systems that can truly transform how cities operate.

Critical Analysis

The 8th AI City Challenge tackles important problems in the field of smart city development, but there are some potential limitations and areas for further research.

One key challenge is the need for robust driver attention tracking and analysis to complement the vehicle re-identification and traffic flow prediction tasks. Understanding driver behavior and attention levels could lead to more accurate predictions and enhance safety.

Additionally, the datasets provided, while large-scale, may not fully capture the diversity and complexity of real-world urban environments. Further research is needed to develop AI systems that can generalize and adapt to different city contexts.

Another area for improvement is the integration of these AI-powered systems into existing city infrastructure and operations. Careful consideration must be given to issues of data privacy, cybersecurity, and ethical AI deployment to ensure these technologies are used responsibly and for the benefit of all citizens.

Overall, the 8th AI City Challenge represents an important step forward in applying advanced AI to the challenges of building smarter, more efficient, and more livable cities. Continued research and collaboration between academia, industry, and city governments will be crucial to realizing the full potential of these technologies.

Conclusion

The 8th AI City Challenge is a research competition that aims to push the boundaries of what's possible with AI in the context of smart city development. By tackling tasks like multi-target, multi-camera person tracking, vehicle re-identification, and traffic flow prediction, the challenge is encouraging the creation of intelligent systems that can monitor, understand, and optimize urban environments.

The large-scale datasets and focus on real-world applications make this challenge an important driver of progress in fields like computer vision, sensor fusion, and predictive analytics. While there are some limitations and areas for further research, the 8th AI City Challenge represents a significant step forward in the quest to build smarter, more efficient, and more livable cities through the power of AI.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

The 8th AI City Challenge
Total Score

0

The 8th AI City Challenge

Shuo Wang, David C. Anastasiu, Zheng Tang, Ming-Ching Chang, Yue Yao, Liang Zheng, Mohammed Shaiqur Rahman, Meenakshi S. Arya, Anuj Sharma, Pranamesh Chakraborty, Sanjita Prajapati, Quan Kong, Norimasa Kobori, Munkhjargal Gochoo, Munkh-Erdene Otgonbold, Fady Alnajjar, Ganzorig Batnasan, Ping-Yang Chen, Jun-Wei Hsieh, Xunlei Wu, Sameer Satish Pusegaonkar, Yizhou Wang, Sujit Biswas, Rama Chellappa

The eighth AI City Challenge highlighted the convergence of computer vision and artificial intelligence in areas like retail, warehouse settings, and Intelligent Traffic Systems (ITS), presenting significant research opportunities. The 2024 edition featured five tracks, attracting unprecedented interest from 726 teams in 47 countries and regions. Track 1 dealt with multi-target multi-camera (MTMC) people tracking, highlighting significant enhancements in camera count, character number, 3D annotation, and camera matrices, alongside new rules for 3D tracking and online tracking algorithm encouragement. Track 2 introduced dense video captioning for traffic safety, focusing on pedestrian accidents using multi-camera feeds to improve insights for insurance and prevention. Track 3 required teams to classify driver actions in a naturalistic driving analysis. Track 4 explored fish-eye camera analytics using the FishEye8K dataset. Track 5 focused on motorcycle helmet rule violation detection. The challenge utilized two leaderboards to showcase methods, with participants setting new benchmarks, some surpassing existing state-of-the-art achievements.

Read more

4/16/2024

🗣️

Total Score

0

NTIRE 2024 Quality Assessment of AI-Generated Content Challenge

Xiaohong Liu, Xiongkuo Min, Guangtao Zhai, Chunyi Li, Tengchuan Kou, Wei Sun, Haoning Wu, Yixuan Gao, Yuqin Cao, Zicheng Zhang, Xiele Wu, Radu Timofte, Fei Peng, Huiyuan Fu, Anlong Ming, Chuanming Wang, Huadong Ma, Shuai He, Zifei Dou, Shu Chen, Huacong Zhang, Haiyi Xie, Chengwei Wang, Baoying Chen, Jishen Zeng, Jianquan Yang, Weigang Wang, Xi Fang, Xiaoxin Lv, Jun Yan, Tianwu Zhi, Yabin Zhang, Yaohui Li, Yang Li, Jingwen Xu, Jianzhao Liu, Yiting Liao, Junlin Li, Zihao Yu, Yiting Lu, Xin Li, Hossein Motamednia, S. Farhad Hosseini-Benvidi, Fengbin Guan, Ahmad Mahmoudi-Aznaveh, Azadeh Mansouri, Ganzorig Gankhuyag, Kihwan Yoon, Yifang Xu, Haotian Fan, Fangyuan Kong, Shiling Zhao, Weifeng Dong, Haibing Yin, Li Zhu, Zhiling Wang, Bingchen Huang, Avinab Saha, Sandeep Mishra, Shashank Gupta, Rajesh Sureddi, Oindrila Saha, Luigi Celona, Simone Bianco, Paolo Napoletano, Raimondo Schettini, Junfeng Yang, Jing Fu, Wei Zhang, Wenzhi Cao, Limei Liu, Han Peng, Weijun Yuan, Zhan Li, Yihang Cheng, Yifan Deng, Haohui Li, Bowen Qu, Yao Li, Shuqing Luo, Shunzhou Wang, Wei Gao, Zihao Lu, Marcos V. Conde, Xinrui Wang, Zhibo Chen, Ruling Liao, Yan Ye, Qiulin Wang, Bing Li, Zhaokun Zhou, Miao Geng, Rui Chen, Xin Tao, Xiaoyu Liang, Shangkun Sun, Xingyuan Ma, Jiaze Li, Mengduo Yang, Haoran Xu, Jie Zhou, Shiding Zhu, Bohan Yu, Pengfei Chen, Xinrui Xu, Jiabin Shen, Zhichao Duan, Erfan Asadi, Jiahe Liu, Qi Yan, Youran Qu, Xiaohui Zeng, Lele Wang, Renjie Liao

This paper reports on the NTIRE 2024 Quality Assessment of AI-Generated Content Challenge, which will be held in conjunction with the New Trends in Image Restoration and Enhancement Workshop (NTIRE) at CVPR 2024. This challenge is to address a major challenge in the field of image and video processing, namely, Image Quality Assessment (IQA) and Video Quality Assessment (VQA) for AI-Generated Content (AIGC). The challenge is divided into the image track and the video track. The image track uses the AIGIQA-20K, which contains 20,000 AI-Generated Images (AIGIs) generated by 15 popular generative models. The image track has a total of 318 registered participants. A total of 1,646 submissions are received in the development phase, and 221 submissions are received in the test phase. Finally, 16 participating teams submitted their models and fact sheets. The video track uses the T2VQA-DB, which contains 10,000 AI-Generated Videos (AIGVs) generated by 9 popular Text-to-Video (T2V) models. A total of 196 participants have registered in the video track. A total of 991 submissions are received in the development phase, and 185 submissions are received in the test phase. Finally, 12 participating teams submitted their models and fact sheets. Some methods have achieved better results than baseline methods, and the winning methods in both tracks have demonstrated superior prediction performance on AIGC.

Read more

5/8/2024

📶

Total Score

0

From Lab to Field: Real-World Evaluation of an AI-Driven Smart Video Solution to Enhance Community Safety

Shanle Yao, Babak Rahimi Ardabili, Armin Danesh Pazho, Ghazal Alinezhad Noghre, Christopher Neff, Lauren Bourque, Hamed Tabkhi

This article adopts and evaluates an AI-enabled Smart Video Solution (SVS) designed to enhance safety in the real world. The system integrates with existing infrastructure camera networks, leveraging recent advancements in AI for easy adoption. Prioritizing privacy and ethical standards, pose based data is used for downstream AI tasks such as anomaly detection. Cloud-based infrastructure and mobile app are deployed, enabling real-time alerts within communities. The SVS employs innovative data representation and visualization techniques, such as the Occupancy Indicator, Statistical Anomaly Detection, Bird's Eye View, and Heatmaps, to understand pedestrian behaviors and enhance public safety. Evaluation of the SVS demonstrates its capacity to convert complex computer vision outputs into actionable insights for stakeholders, community partners, law enforcement, urban planners, and social scientists. This article presents a comprehensive real-world deployment and evaluation of the SVS, implemented in a community college environment across 16 cameras. The system integrates AI-driven visual processing, supported by statistical analysis, database management, cloud communication, and user notifications. Additionally, the article evaluates the end-to-end latency from the moment an AI algorithm detects anomalous behavior in real-time at the camera level to the time stakeholders receive a notification. The results demonstrate the system's robustness, effectively managing 16 CCTV cameras with a consistent throughput of 16.5 frames per second (FPS) over a 21-hour period and an average end-to-end latency of 26.76 seconds between anomaly detection and alert issuance.

Read more

9/5/2024

📈

Total Score

0

City-Scale Multi-Camera Vehicle Tracking System with Improved Self-Supervised Camera Link Model

Yuqiang Lin, Sam Lockyer, Adrian Evans, Markus Zarbock, Nic Zhang

Multi-Target Multi-Camera Tracking (MTMCT) has broad applications and forms the basis for numerous future city-wide systems (e.g. traffic management, crash detection, etc.). However, the challenge of matching vehicle trajectories across different cameras based solely on feature extraction poses significant difficulties. This article introduces an innovative multi-camera vehicle tracking system that utilizes a self-supervised camera link model. In contrast to related works that rely on manual spatial-temporal annotations, our model automatically extracts crucial multi-camera relationships for vehicle matching. The camera link is established through a pre-matching process that evaluates feature similarities, pair numbers, and time variance for high-quality tracks. This process calculates the probability of spatial linkage for all camera combinations, selecting the highest scoring pairs to create camera links. Our approach significantly improves deployment times by eliminating the need for human annotation, offering substantial improvements in efficiency and cost-effectiveness when it comes to real-world application. This pairing process supports cross camera matching by setting spatial-temporal constraints, reducing the searching space for potential vehicle matches. According to our experimental results, the proposed method achieves a new state-of-the-art among automatic camera-link based methods in CityFlow V2 benchmarks with 61.07% IDF1 Score.

Read more

7/10/2024