In this paper, a vision system for safety applications in human-robot collaboration is presented. The system is based on two Time-Of-Flight (TOF) cameras for 3D acquisition. The point clouds are registered in a common reference system, and human and robot recognition are then implemented. Human recognition is performed using a customized version of the Histogram of Oriented Gradient (HOG) algorithm. Robot recognition is achieved using a procedure based on the Kanade-Lucas-Tomasi (KLT) algorithm. Two safety strategies have been developed. The first one is based on the definition of suitable comfort zones of both the operator and the robot; the second implements virtual barriers between the operator and the robot. The vision system has been characterized in terms of (i) human and robot recognition performance, (ii) correctness of the detection of safety situations and (iii) evaluation of the time delays in the detection. The results show that the human operator is robustly recognized provided that he moves frontally with respect to the TOF cameras and the robot is always recognized. The safety situations are always identified correctly with an average time delay of 0.86 0.63 s (k=1).

Development and Characterization of a Safety System for Robotic Cells Based on Multiple Time of Flight (TOF) Cameras and Point Cloud Analysis

Pasinetti, Simone
;
Nuzzi, Cristina;Lancini, Matteo;Sansoni, Giovanna;Docchio, Franco;
2018-01-01

Abstract

In this paper, a vision system for safety applications in human-robot collaboration is presented. The system is based on two Time-Of-Flight (TOF) cameras for 3D acquisition. The point clouds are registered in a common reference system, and human and robot recognition are then implemented. Human recognition is performed using a customized version of the Histogram of Oriented Gradient (HOG) algorithm. Robot recognition is achieved using a procedure based on the Kanade-Lucas-Tomasi (KLT) algorithm. Two safety strategies have been developed. The first one is based on the definition of suitable comfort zones of both the operator and the robot; the second implements virtual barriers between the operator and the robot. The vision system has been characterized in terms of (i) human and robot recognition performance, (ii) correctness of the detection of safety situations and (iii) evaluation of the time delays in the detection. The results show that the human operator is robustly recognized provided that he moves frontally with respect to the TOF cameras and the robot is always recognized. The safety situations are always identified correctly with an average time delay of 0.86 0.63 s (k=1).
2018
9781538624975
File in questo prodotto:
File Dimensione Formato  
08439037.pdf

solo utenti autorizzati

Tipologia: Full Text
Licenza: DRM non definito
Dimensione 5.09 MB
Formato Adobe PDF
5.09 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11379/510660
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 12
  • ???jsp.display-item.citation.isi??? 1
social impact