SoccerKicks: A Dataset of 3D dead ball kicks reference movements for humanoid robots

Detalhes bibliográficos
Autor(a) principal: Lessa, Nayari Marie [UNESP]
Data de Publicação: 2021
Outros Autores: Colombini, Esther Luna [UNESP], Da Silva Simoes, Alexandre
Tipo de documento: Artigo de conferência
Idioma: eng
Título da fonte: Repositório Institucional da UNESP
Texto Completo: http://dx.doi.org/10.1109/SMC52423.2021.9658787
http://hdl.handle.net/11449/223430
Resumo: The possibility of robots imitating reference movements performed by experts recently emerged in the Machine Learning context. Based on Deep Reinforcement Learning (DRL), this process focuses on observing a reference movement policy and its adaptation to a robot with a similar body scheme. In the humanoid robots domain, the massive availability of videos on the internet holds the potential to provide reference movements for virtually any task performed by humans. However, 3D pose estimation algorithms based on videos are currently subject to failure due to several practical situations (poor image framing, low video quality, joints occlusions and mismatch, and so on) and typically require applying a complex methodology. This paper presents SoccerKicks, a new dataset that provides 3D reference movements of humans performing dead ball kicks (penalty and foul) obtained from reference videos suitable for use in the robotics soccer domain. In this work we describe: i) the methodology adopted for the videos selection; ii) the algorithms chosen to perform the 2D and 3D pose estimation based on the videos; iii) the evaluation of the algorithms performance; iv) the annotation on these videos and the reference movements provided. Our dataset is publicly available at https://github.com/larocs/SoccerKicks.
id UNSP_5081fcd030181eaf48ce9df12f727542
oai_identifier_str oai:repositorio.unesp.br:11449/223430
network_acronym_str UNSP
network_name_str Repositório Institucional da UNESP
repository_id_str 2946
spelling SoccerKicks: A Dataset of 3D dead ball kicks reference movements for humanoid robotsHumanoid robotsImitation LearningPose EstimationThe possibility of robots imitating reference movements performed by experts recently emerged in the Machine Learning context. Based on Deep Reinforcement Learning (DRL), this process focuses on observing a reference movement policy and its adaptation to a robot with a similar body scheme. In the humanoid robots domain, the massive availability of videos on the internet holds the potential to provide reference movements for virtually any task performed by humans. However, 3D pose estimation algorithms based on videos are currently subject to failure due to several practical situations (poor image framing, low video quality, joints occlusions and mismatch, and so on) and typically require applying a complex methodology. This paper presents SoccerKicks, a new dataset that provides 3D reference movements of humans performing dead ball kicks (penalty and foul) obtained from reference videos suitable for use in the robotics soccer domain. In this work we describe: i) the methodology adopted for the videos selection; ii) the algorithms chosen to perform the 2D and 3D pose estimation based on the videos; iii) the evaluation of the algorithms performance; iv) the annotation on these videos and the reference movements provided. Our dataset is publicly available at https://github.com/larocs/SoccerKicks.São Paulo State University (UNESP) Campus Sorocaba Institute of Science and Technology (ICT)University of Campinas (Unicamp) Institute of Computing (IC), São PauloSão Paulo State University (UNESP) Campus Sorocaba Institute of Science and Technology (ICT)Universidade Estadual Paulista (UNESP)Universidade Estadual de Campinas (UNICAMP)Lessa, Nayari Marie [UNESP]Colombini, Esther Luna [UNESP]Da Silva Simoes, Alexandre2022-04-28T19:50:40Z2022-04-28T19:50:40Z2021-01-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/conferenceObject3472-3478http://dx.doi.org/10.1109/SMC52423.2021.9658787Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics, p. 3472-3478.1062-922Xhttp://hdl.handle.net/11449/22343010.1109/SMC52423.2021.96587872-s2.0-85124277795Scopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengConference Proceedings - IEEE International Conference on Systems, Man and Cyberneticsinfo:eu-repo/semantics/openAccess2022-04-28T19:50:40Zoai:repositorio.unesp.br:11449/223430Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T17:43:21.587100Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false
dc.title.none.fl_str_mv SoccerKicks: A Dataset of 3D dead ball kicks reference movements for humanoid robots
title SoccerKicks: A Dataset of 3D dead ball kicks reference movements for humanoid robots
spellingShingle SoccerKicks: A Dataset of 3D dead ball kicks reference movements for humanoid robots
Lessa, Nayari Marie [UNESP]
Humanoid robots
Imitation Learning
Pose Estimation
title_short SoccerKicks: A Dataset of 3D dead ball kicks reference movements for humanoid robots
title_full SoccerKicks: A Dataset of 3D dead ball kicks reference movements for humanoid robots
title_fullStr SoccerKicks: A Dataset of 3D dead ball kicks reference movements for humanoid robots
title_full_unstemmed SoccerKicks: A Dataset of 3D dead ball kicks reference movements for humanoid robots
title_sort SoccerKicks: A Dataset of 3D dead ball kicks reference movements for humanoid robots
author Lessa, Nayari Marie [UNESP]
author_facet Lessa, Nayari Marie [UNESP]
Colombini, Esther Luna [UNESP]
Da Silva Simoes, Alexandre
author_role author
author2 Colombini, Esther Luna [UNESP]
Da Silva Simoes, Alexandre
author2_role author
author
dc.contributor.none.fl_str_mv Universidade Estadual Paulista (UNESP)
Universidade Estadual de Campinas (UNICAMP)
dc.contributor.author.fl_str_mv Lessa, Nayari Marie [UNESP]
Colombini, Esther Luna [UNESP]
Da Silva Simoes, Alexandre
dc.subject.por.fl_str_mv Humanoid robots
Imitation Learning
Pose Estimation
topic Humanoid robots
Imitation Learning
Pose Estimation
description The possibility of robots imitating reference movements performed by experts recently emerged in the Machine Learning context. Based on Deep Reinforcement Learning (DRL), this process focuses on observing a reference movement policy and its adaptation to a robot with a similar body scheme. In the humanoid robots domain, the massive availability of videos on the internet holds the potential to provide reference movements for virtually any task performed by humans. However, 3D pose estimation algorithms based on videos are currently subject to failure due to several practical situations (poor image framing, low video quality, joints occlusions and mismatch, and so on) and typically require applying a complex methodology. This paper presents SoccerKicks, a new dataset that provides 3D reference movements of humans performing dead ball kicks (penalty and foul) obtained from reference videos suitable for use in the robotics soccer domain. In this work we describe: i) the methodology adopted for the videos selection; ii) the algorithms chosen to perform the 2D and 3D pose estimation based on the videos; iii) the evaluation of the algorithms performance; iv) the annotation on these videos and the reference movements provided. Our dataset is publicly available at https://github.com/larocs/SoccerKicks.
publishDate 2021
dc.date.none.fl_str_mv 2021-01-01
2022-04-28T19:50:40Z
2022-04-28T19:50:40Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/conferenceObject
format conferenceObject
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://dx.doi.org/10.1109/SMC52423.2021.9658787
Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics, p. 3472-3478.
1062-922X
http://hdl.handle.net/11449/223430
10.1109/SMC52423.2021.9658787
2-s2.0-85124277795
url http://dx.doi.org/10.1109/SMC52423.2021.9658787
http://hdl.handle.net/11449/223430
identifier_str_mv Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics, p. 3472-3478.
1062-922X
10.1109/SMC52423.2021.9658787
2-s2.0-85124277795
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv 3472-3478
dc.source.none.fl_str_mv Scopus
reponame:Repositório Institucional da UNESP
instname:Universidade Estadual Paulista (UNESP)
instacron:UNESP
instname_str Universidade Estadual Paulista (UNESP)
instacron_str UNESP
institution UNESP
reponame_str Repositório Institucional da UNESP
collection Repositório Institucional da UNESP
repository.name.fl_str_mv Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)
repository.mail.fl_str_mv
_version_ 1808128850677202944