This work presents a comparative evaluation of markerless upper-limb motion tracking methods, namely, Medi-aPipe (monocular), Fusion (multi-view fusion of MediaPipe out-puts), and Triangulation (3D reconstruction via calibrated multi-view geometry), against a marker-based ground truth acquired with OptiTrack. The objective is to assess the feasibility and accuracy of these approaches in reconstructing 3D joint positions during human motion imitation tasks. Data were collected using RGB-D cameras and compared with OptiTrack data after time-based synchronization. This study uses only RGB data. Four representative gestures, Drinking, Eating with a utensil, Closing a zipper, and Touching the nose, were analyzed. The evaluation focuses on the positional error of the shoulder, elbow, and wrist joints, using RMSE as the primary metric. Preliminary results indicate that triangulation achieves the highest spatial accuracy when MediaPipe detections are consistent across views, but its performance degrades rapidly under occlusions or missing key-points. In contrast, MediaPipe and multi-view fusion offer greater robustness in such conditions, maintaining functional accuracy even when visibility is compromised. These findings inform the design of adaptable, markerless motion capture pipelines suitable for different human-robot interaction scenarios.

Markerless Upper Limb Motion Tracking: A Comparative Evaluation of Multi-View Approaches / Bajrami, A., Beraldo, G., Palpacelli, M.C., Heikkila, T., Cortelessa, G.. - (2025), pp. 818-823. (4th IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering, MetroXRAINE 2025 ita 2025) [10.1109/MetroXRAINE66377.2025.11340428].

Markerless Upper Limb Motion Tracking: A Comparative Evaluation of Multi-View Approaches

Bajrami A.;Palpacelli M. C.;
2025-01-01

Abstract

This work presents a comparative evaluation of markerless upper-limb motion tracking methods, namely, Medi-aPipe (monocular), Fusion (multi-view fusion of MediaPipe out-puts), and Triangulation (3D reconstruction via calibrated multi-view geometry), against a marker-based ground truth acquired with OptiTrack. The objective is to assess the feasibility and accuracy of these approaches in reconstructing 3D joint positions during human motion imitation tasks. Data were collected using RGB-D cameras and compared with OptiTrack data after time-based synchronization. This study uses only RGB data. Four representative gestures, Drinking, Eating with a utensil, Closing a zipper, and Touching the nose, were analyzed. The evaluation focuses on the positional error of the shoulder, elbow, and wrist joints, using RMSE as the primary metric. Preliminary results indicate that triangulation achieves the highest spatial accuracy when MediaPipe detections are consistent across views, but its performance degrades rapidly under occlusions or missing key-points. In contrast, MediaPipe and multi-view fusion offer greater robustness in such conditions, maintaining functional accuracy even when visibility is compromised. These findings inform the design of adaptable, markerless motion capture pipelines suitable for different human-robot interaction scenarios.
2025
  
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11566/367383
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? ND
social impact