Experimental network performance evaluation for human-robot interaction collision detection using cameras

Detalhes bibliográficos
Autor(a) principal: Oliveira Filho, Assis T. de
Data de Publicação: 2022
Outros Autores: Barbosa, Gibson, Rodrigues, Iago Richard, Cani, Carolina, Kelner, Judith, Sadok, Djamel, Souza, Ricardo
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Research, Society and Development
Texto Completo: https://rsdjournal.org/index.php/rsd/article/view/30543
Resumo: A practical solution to human-robot collision detection using devices commonly found in workplaces, such as 2D cameras, requires thorough planning and evaluation of network restrictions that may deny timely access to and process important context data collected by IoT devices. In this study, we evaluate the behavior of the AMQP and MQTT application protocols for camera image transmission. We examine the packet overhead for each protocol when streaming video signals. Also, we evaluate the impact of transmission delay on the total decision time starting from the moment the camera captures an image to the moment it is decided if there is a robot-human collision or not. Finally, we also evaluated an open-source platform to emulate wireless Mininet-wifi, seeking to understand the level of influence it would have on the results. The results show that transmission overhead represents as much as 80% of the total decision time and that the AMQP protocol takes around 5% less transmission time than MQTT. The results also show that the use of hardware accelerators such as a GPU increases by 37 times the number of detections. We found that the size of the image to be transmitted and wireless communications did not influence the results for our scenario. In addition, we also noticed that the use of emulation through Mininet-wifi does not negatively influence the behavior of the experiments.
id UNIFEI_3fab63c0a91040a89e9f55af65757938
oai_identifier_str oai:ojs.pkp.sfu.ca:article/30543
network_acronym_str UNIFEI
network_name_str Research, Society and Development
repository_id_str
spelling Experimental network performance evaluation for human-robot interaction collision detection using camerasEvaluación experimental del rendimiento de la red para la detección de colisiones entre humanos y robots mediante cámarasAvaliação experimental de desempenho de rede para detecção de colisão de interação humano-robô usando câmerasAMQPMQTTInteracción entre humanos y robotsComunicación de RedEnseñanza.AMQPMQTTInteração Humano RobôComunicação de RedeEnsino.AMQPMQTTNetwork communicationHuman Robot InteractionTeaching.A practical solution to human-robot collision detection using devices commonly found in workplaces, such as 2D cameras, requires thorough planning and evaluation of network restrictions that may deny timely access to and process important context data collected by IoT devices. In this study, we evaluate the behavior of the AMQP and MQTT application protocols for camera image transmission. We examine the packet overhead for each protocol when streaming video signals. Also, we evaluate the impact of transmission delay on the total decision time starting from the moment the camera captures an image to the moment it is decided if there is a robot-human collision or not. Finally, we also evaluated an open-source platform to emulate wireless Mininet-wifi, seeking to understand the level of influence it would have on the results. The results show that transmission overhead represents as much as 80% of the total decision time and that the AMQP protocol takes around 5% less transmission time than MQTT. The results also show that the use of hardware accelerators such as a GPU increases by 37 times the number of detections. We found that the size of the image to be transmitted and wireless communications did not influence the results for our scenario. In addition, we also noticed that the use of emulation through Mininet-wifi does not negatively influence the behavior of the experiments.Una solución práctica para la detección de colisiones entre humanos y robots utilizando dispositivos que se encuentran comúnmente en los lugares de trabajo, como cámaras 2D, requiere una planificación y evaluación exhaustivas de las restricciones de la red que pueden negar el acceso oportuno y procesar datos de contexto importantes recopilados por dispositivos IoT. En este estudio, evaluamos el comportamiento de los protocolos de aplicación AMQP y MQTT para transmitir imágenes de cámara. Examinamos la sobrecarga del paquete para cada protocolo al transmitir señales de video. Además, evaluamos el impacto del retraso de la transmisión en el tiempo de decisión total desde el momento en que la cámara captura una imagen hasta el momento en que decide si hay o no una colisión robot-humano. Finalmente, también evaluamos una plataforma de código abierto para emular Mininet-wifi inalámbrico, buscando comprender el nivel de influencia que tendría en los resultados. Los resultados muestran que la sobrecarga de transmisión representa hasta el 80 % del tiempo total de decisión y que el protocolo AMQP requiere aproximadamente un 5 % menos de tiempo de transmisión que MQTT. Los resultados también muestran que el uso de aceleradores de hardware, como una GPU, aumenta 37 veces el número de detecciones. Descubrimos que el tamaño de la imagen a transmitir y las comunicaciones inalámbricas no influyeron en los resultados de nuestro escenario. Además, también notamos que el uso de la emulación a través de Mininet-wifi no influye negativamente en el comportamiento de los experimentos.Uma solução prática para detecção de colisão humano-robô usando dispositivos comumente encontrados em locais de trabalho, como câmeras 2D, requer planejamento e avaliação completos das restrições de rede que podem negar acesso oportuno e processar dados de contexto importantes coletados por dispositivos IoT. Neste estudo, avaliamos o comportamento dos protocolos de aplicação AMQP e MQTT para transmissão de imagens de câmeras. Examinamos a sobrecarga de pacotes para cada protocolo ao transmitir sinais de vídeo. Além disso, avaliamos o impacto do atraso de transmissão no tempo total de decisão desde o momento em que a câmera captura uma imagem até o momento em que é decidido se há ou não uma colisão robô-humano. Por fim, também avaliamos uma plataforma de código aberto para emular Mininet-wifi sem fio, buscando entender o nível de influência que ela teria nos resultados. Os resultados mostram que a sobrecarga de transmissão representa até 80% do tempo total de decisão e que o protocolo AMQP leva cerca de 5% menos tempo de transmissão que o MQTT. Os resultados também mostram que o uso de aceleradores de hardware, como uma GPU, aumenta em 37 vezes o número de detecções. Descobrimos que o tamanho da imagem a ser transmitida e as comunicações sem fio não influenciaram os resultados para nosso cenário. Além disso, notamos também que o uso de emulação através do Mininet-wifi não influencia negativamente no comportamento dos experimentos.Research, Society and Development2022-06-17info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionapplication/pdfhttps://rsdjournal.org/index.php/rsd/article/view/3054310.33448/rsd-v11i8.30543Research, Society and Development; Vol. 11 No. 8; e8811830543Research, Society and Development; Vol. 11 Núm. 8; e8811830543Research, Society and Development; v. 11 n. 8; e88118305432525-3409reponame:Research, Society and Developmentinstname:Universidade Federal de Itajubá (UNIFEI)instacron:UNIFEIenghttps://rsdjournal.org/index.php/rsd/article/view/30543/26456Copyright (c) 2022 Assis T. de Oliveira Filho; Gibson Barbosa; Iago Richard Rodrigues; Carolina Cani; Judith Kelner; Djamel Sadok; Ricardo Souzahttps://creativecommons.org/licenses/by/4.0info:eu-repo/semantics/openAccessOliveira Filho, Assis T. de Barbosa, GibsonRodrigues, Iago Richard Cani, CarolinaKelner, JudithSadok, DjamelSouza, Ricardo2022-07-01T13:34:06Zoai:ojs.pkp.sfu.ca:article/30543Revistahttps://rsdjournal.org/index.php/rsd/indexPUBhttps://rsdjournal.org/index.php/rsd/oairsd.articles@gmail.com2525-34092525-3409opendoar:2024-01-17T09:47:15.678088Research, Society and Development - Universidade Federal de Itajubá (UNIFEI)false
dc.title.none.fl_str_mv Experimental network performance evaluation for human-robot interaction collision detection using cameras
Evaluación experimental del rendimiento de la red para la detección de colisiones entre humanos y robots mediante cámaras
Avaliação experimental de desempenho de rede para detecção de colisão de interação humano-robô usando câmeras
title Experimental network performance evaluation for human-robot interaction collision detection using cameras
spellingShingle Experimental network performance evaluation for human-robot interaction collision detection using cameras
Oliveira Filho, Assis T. de
AMQP
MQTT
Interacción entre humanos y robots
Comunicación de Red
Enseñanza.
AMQP
MQTT
Interação Humano Robô
Comunicação de Rede
Ensino.
AMQP
MQTT
Network communication
Human Robot Interaction
Teaching.
title_short Experimental network performance evaluation for human-robot interaction collision detection using cameras
title_full Experimental network performance evaluation for human-robot interaction collision detection using cameras
title_fullStr Experimental network performance evaluation for human-robot interaction collision detection using cameras
title_full_unstemmed Experimental network performance evaluation for human-robot interaction collision detection using cameras
title_sort Experimental network performance evaluation for human-robot interaction collision detection using cameras
author Oliveira Filho, Assis T. de
author_facet Oliveira Filho, Assis T. de
Barbosa, Gibson
Rodrigues, Iago Richard
Cani, Carolina
Kelner, Judith
Sadok, Djamel
Souza, Ricardo
author_role author
author2 Barbosa, Gibson
Rodrigues, Iago Richard
Cani, Carolina
Kelner, Judith
Sadok, Djamel
Souza, Ricardo
author2_role author
author
author
author
author
author
dc.contributor.author.fl_str_mv Oliveira Filho, Assis T. de
Barbosa, Gibson
Rodrigues, Iago Richard
Cani, Carolina
Kelner, Judith
Sadok, Djamel
Souza, Ricardo
dc.subject.por.fl_str_mv AMQP
MQTT
Interacción entre humanos y robots
Comunicación de Red
Enseñanza.
AMQP
MQTT
Interação Humano Robô
Comunicação de Rede
Ensino.
AMQP
MQTT
Network communication
Human Robot Interaction
Teaching.
topic AMQP
MQTT
Interacción entre humanos y robots
Comunicación de Red
Enseñanza.
AMQP
MQTT
Interação Humano Robô
Comunicação de Rede
Ensino.
AMQP
MQTT
Network communication
Human Robot Interaction
Teaching.
description A practical solution to human-robot collision detection using devices commonly found in workplaces, such as 2D cameras, requires thorough planning and evaluation of network restrictions that may deny timely access to and process important context data collected by IoT devices. In this study, we evaluate the behavior of the AMQP and MQTT application protocols for camera image transmission. We examine the packet overhead for each protocol when streaming video signals. Also, we evaluate the impact of transmission delay on the total decision time starting from the moment the camera captures an image to the moment it is decided if there is a robot-human collision or not. Finally, we also evaluated an open-source platform to emulate wireless Mininet-wifi, seeking to understand the level of influence it would have on the results. The results show that transmission overhead represents as much as 80% of the total decision time and that the AMQP protocol takes around 5% less transmission time than MQTT. The results also show that the use of hardware accelerators such as a GPU increases by 37 times the number of detections. We found that the size of the image to be transmitted and wireless communications did not influence the results for our scenario. In addition, we also noticed that the use of emulation through Mininet-wifi does not negatively influence the behavior of the experiments.
publishDate 2022
dc.date.none.fl_str_mv 2022-06-17
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://rsdjournal.org/index.php/rsd/article/view/30543
10.33448/rsd-v11i8.30543
url https://rsdjournal.org/index.php/rsd/article/view/30543
identifier_str_mv 10.33448/rsd-v11i8.30543
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv https://rsdjournal.org/index.php/rsd/article/view/30543/26456
dc.rights.driver.fl_str_mv https://creativecommons.org/licenses/by/4.0
info:eu-repo/semantics/openAccess
rights_invalid_str_mv https://creativecommons.org/licenses/by/4.0
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Research, Society and Development
publisher.none.fl_str_mv Research, Society and Development
dc.source.none.fl_str_mv Research, Society and Development; Vol. 11 No. 8; e8811830543
Research, Society and Development; Vol. 11 Núm. 8; e8811830543
Research, Society and Development; v. 11 n. 8; e8811830543
2525-3409
reponame:Research, Society and Development
instname:Universidade Federal de Itajubá (UNIFEI)
instacron:UNIFEI
instname_str Universidade Federal de Itajubá (UNIFEI)
instacron_str UNIFEI
institution UNIFEI
reponame_str Research, Society and Development
collection Research, Society and Development
repository.name.fl_str_mv Research, Society and Development - Universidade Federal de Itajubá (UNIFEI)
repository.mail.fl_str_mv rsd.articles@gmail.com
_version_ 1797052767301271552