Computer vision based path following for autonomous unammed aerial systems in unburied pipeline onshore inspection

Detalhes bibliográficos
Autor(a) principal: Silva, Yago M.R. da
Data de Publicação: 2022
Outros Autores: Andrade, Fabio A.A., Sousa, Lucas C., Castro, Gabriel G.R., Dias, João T., Berger, Guido, Lima, José, Pinto, Milena F.
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10198/27154
Resumo: Unmanned Aerial Systems (UAS) are becoming more attractive in diverse applications due to their efficiency in performing tasks with a reduced time execution, covering a larger area, and lowering human risks at harmful tasks. In the context of Oil & Gas (O&G), the scenario is even more attractive for the application of UAS for inspection activities due to the large extension of these facilities and the operational risks involved in the processes. Many authors proposed solutions to detect gas leaks regarding the onshore unburied pipeline structures. However, only a few addressed the navigation and tracking problem for the autonomous navigation of UAS over these structures. Most proposed solutions rely on traditional computer vision strategies for tracking. As a drawback, depending on lighting conditions, the obtained path line may be inaccurate, making a strategy to force the UAS to continue on the path necessary. Therefore, this research describes the potential of an autonomous UAS based on image processing technique and Convolutional Neural Network (CNN) strategy to navigate appropriately in complex unburied pipeline networks contributing to the monitoring procedure of the Oil & Gas Industry structures. A CNN is used to detect the pipe, while image processing techniques such as Canny edge detection and Hough Transform are used to detect the pipe line reference, which is used by a line following algorithm to guide the UAS along the pipe. The framework is assessed by a PX4 flight controller Software-in-The-Loop (SITL) simulations performed with the Robot Operating System (ROS) along with the Gazebo platform to simulate the proposed operational environment and verify the approach’s functionality as a proof of concept. Real tests were also conducted. The results showed that the solution is robust and feasible to deploy in this proposed task, achieving 72% of mean average precision on detecting different types of pipes and 0.0111 m of mean squared error on the path following with a drone 2 m away from a tube.
id RCAP_4cb95517878dd8d82aeef45324548d1a
oai_identifier_str oai:bibliotecadigital.ipb.pt:10198/27154
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Computer vision based path following for autonomous unammed aerial systems in unburied pipeline onshore inspectionAutomatic inspectionPipe inspectionUnmanned aerial systemComputer visionUnmanned Aerial Systems (UAS) are becoming more attractive in diverse applications due to their efficiency in performing tasks with a reduced time execution, covering a larger area, and lowering human risks at harmful tasks. In the context of Oil & Gas (O&G), the scenario is even more attractive for the application of UAS for inspection activities due to the large extension of these facilities and the operational risks involved in the processes. Many authors proposed solutions to detect gas leaks regarding the onshore unburied pipeline structures. However, only a few addressed the navigation and tracking problem for the autonomous navigation of UAS over these structures. Most proposed solutions rely on traditional computer vision strategies for tracking. As a drawback, depending on lighting conditions, the obtained path line may be inaccurate, making a strategy to force the UAS to continue on the path necessary. Therefore, this research describes the potential of an autonomous UAS based on image processing technique and Convolutional Neural Network (CNN) strategy to navigate appropriately in complex unburied pipeline networks contributing to the monitoring procedure of the Oil & Gas Industry structures. A CNN is used to detect the pipe, while image processing techniques such as Canny edge detection and Hough Transform are used to detect the pipe line reference, which is used by a line following algorithm to guide the UAS along the pipe. The framework is assessed by a PX4 flight controller Software-in-The-Loop (SITL) simulations performed with the Robot Operating System (ROS) along with the Gazebo platform to simulate the proposed operational environment and verify the approach’s functionality as a proof of concept. Real tests were also conducted. The results showed that the solution is robust and feasible to deploy in this proposed task, achieving 72% of mean average precision on detecting different types of pipes and 0.0111 m of mean squared error on the path following with a drone 2 m away from a tube.The authors would like to thank the following Brazilian Agencies CEFET-RJ, CAPES, CNPq, and FAPERJ. In addition, the authors also want to thank the Research Centre in Digitalization and Intelligent Robotics (CeDRI), IPB, Laboratório para a Sustentabilidade e Tecnologia em Regiões de Montanha (SusTEC), IPB, Portugal, and INESC Technology and Science, Porto, Portugal.MDPIBiblioteca Digital do IPBSilva, Yago M.R. daAndrade, Fabio A.A.Sousa, Lucas C.Castro, Gabriel G.R.Dias, João T.Berger, GuidoLima, JoséPinto, Milena F.2023-02-23T16:22:47Z20222022-01-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10198/27154engSilva, Yago M.R. da; Andrade, Fabio A.A.; Sousa, Lucas; Castro, Gabriel G.R. de; Dias, João T.; Berger, Guido; Lima, José; Pinto, Milena F. (2022). Computer vision based path following for autonomous unammed aerial systems in unburied pipeline onshore inspection. Drones. 6:12, p. 410 -10.3390/drones6120410info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-11-21T11:00:18Zoai:bibliotecadigital.ipb.pt:10198/27154Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T23:17:30.650894Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Computer vision based path following for autonomous unammed aerial systems in unburied pipeline onshore inspection
title Computer vision based path following for autonomous unammed aerial systems in unburied pipeline onshore inspection
spellingShingle Computer vision based path following for autonomous unammed aerial systems in unburied pipeline onshore inspection
Silva, Yago M.R. da
Automatic inspection
Pipe inspection
Unmanned aerial system
Computer vision
title_short Computer vision based path following for autonomous unammed aerial systems in unburied pipeline onshore inspection
title_full Computer vision based path following for autonomous unammed aerial systems in unburied pipeline onshore inspection
title_fullStr Computer vision based path following for autonomous unammed aerial systems in unburied pipeline onshore inspection
title_full_unstemmed Computer vision based path following for autonomous unammed aerial systems in unburied pipeline onshore inspection
title_sort Computer vision based path following for autonomous unammed aerial systems in unburied pipeline onshore inspection
author Silva, Yago M.R. da
author_facet Silva, Yago M.R. da
Andrade, Fabio A.A.
Sousa, Lucas C.
Castro, Gabriel G.R.
Dias, João T.
Berger, Guido
Lima, José
Pinto, Milena F.
author_role author
author2 Andrade, Fabio A.A.
Sousa, Lucas C.
Castro, Gabriel G.R.
Dias, João T.
Berger, Guido
Lima, José
Pinto, Milena F.
author2_role author
author
author
author
author
author
author
dc.contributor.none.fl_str_mv Biblioteca Digital do IPB
dc.contributor.author.fl_str_mv Silva, Yago M.R. da
Andrade, Fabio A.A.
Sousa, Lucas C.
Castro, Gabriel G.R.
Dias, João T.
Berger, Guido
Lima, José
Pinto, Milena F.
dc.subject.por.fl_str_mv Automatic inspection
Pipe inspection
Unmanned aerial system
Computer vision
topic Automatic inspection
Pipe inspection
Unmanned aerial system
Computer vision
description Unmanned Aerial Systems (UAS) are becoming more attractive in diverse applications due to their efficiency in performing tasks with a reduced time execution, covering a larger area, and lowering human risks at harmful tasks. In the context of Oil & Gas (O&G), the scenario is even more attractive for the application of UAS for inspection activities due to the large extension of these facilities and the operational risks involved in the processes. Many authors proposed solutions to detect gas leaks regarding the onshore unburied pipeline structures. However, only a few addressed the navigation and tracking problem for the autonomous navigation of UAS over these structures. Most proposed solutions rely on traditional computer vision strategies for tracking. As a drawback, depending on lighting conditions, the obtained path line may be inaccurate, making a strategy to force the UAS to continue on the path necessary. Therefore, this research describes the potential of an autonomous UAS based on image processing technique and Convolutional Neural Network (CNN) strategy to navigate appropriately in complex unburied pipeline networks contributing to the monitoring procedure of the Oil & Gas Industry structures. A CNN is used to detect the pipe, while image processing techniques such as Canny edge detection and Hough Transform are used to detect the pipe line reference, which is used by a line following algorithm to guide the UAS along the pipe. The framework is assessed by a PX4 flight controller Software-in-The-Loop (SITL) simulations performed with the Robot Operating System (ROS) along with the Gazebo platform to simulate the proposed operational environment and verify the approach’s functionality as a proof of concept. Real tests were also conducted. The results showed that the solution is robust and feasible to deploy in this proposed task, achieving 72% of mean average precision on detecting different types of pipes and 0.0111 m of mean squared error on the path following with a drone 2 m away from a tube.
publishDate 2022
dc.date.none.fl_str_mv 2022
2022-01-01T00:00:00Z
2023-02-23T16:22:47Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10198/27154
url http://hdl.handle.net/10198/27154
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Silva, Yago M.R. da; Andrade, Fabio A.A.; Sousa, Lucas; Castro, Gabriel G.R. de; Dias, João T.; Berger, Guido; Lima, José; Pinto, Milena F. (2022). Computer vision based path following for autonomous unammed aerial systems in unburied pipeline onshore inspection. Drones. 6:12, p. 410 -
10.3390/drones6120410
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv MDPI
publisher.none.fl_str_mv MDPI
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799135464896069632