Logo image
Human vs. Machine Minds: Ego-Centric Action Recognition Compared
Conference proceeding

Human vs. Machine Minds: Ego-Centric Action Recognition Compared

Sadegh Rahmaniboldaji, Filip Rybansky, Quoc Vuong, Frank Guerin and Andrew Gilbert
IEEE Computer Society Conference on Computer Vision and Pattern Recognition workshops, pp.2943-2953
10/06/2025–14/06/2025
11/06/2025

Abstract

action recognition Artificial intelligence Computational modeling Conferences Context modeling deep learning ego-centric Feature extraction human vision Reliability Resilience Videos Visualization Computer Vision Pattern Recognition Psychology
Humans reliably surpass the performance of the most advanced AI models in action recognition, especially in realworld scenarios with low resolution, occlusions, and visual clutter. These models are somewhat similar to humans in using architecture that allows hierarchical feature extraction. However, they prioritise different features, leading to notable differences in their recognition. This study investigated these differences by introducing Epic ReduAct 1 1 The dataset is available at: https://github.com/SadeghRahmaniB/EpicReduAct, a dataset derived from Epic-Kitchens-100. It consists of Easy and Hard ego-centric videos across various action classes. Critically, our dataset incorporates the concepts of Minimal Recognisable Configuration (MIRC) and sub-MIRC derived by progressively reducing the spatial content of the action videos across multiple stages. This enables a controlled evaluation of recognition difficulty for humans and AI models. This study examines the fundamental differences between human and AI recognition processes. While humans, unlike AI models, demonstrate proficiency in recognising hard videos, they experience a sharp decline in recognition ability as visual information is reduced, ultimately reaching a threshold beyond which recognition is no longer possible. In contrast, the AI models examined in this study appeared to exhibit greater resilience within this specific context, with recognition confidence decreasing gradually or, in some cases, even increasing at later reduction stages. These findings suggest that the limitations observed in human recognition do not directly translate to AI models, highlighting the distinct nature of their processing mechanisms.
pdf
HumanvsMachineMindsPaper8.07 MBDownloadView
Author's Accepted Manuscript Embargo until publication date CC BY V4.0

Metrics

515 File views/ downloads
75 Record Views

Details

Logo image

Usage Policy