Detection and tracking of chickens in low-light images using YOLO network and Kalman filter

Detalhes bibliográficos
Autor(a) principal: Siriani, Allan Lincoln Rodrigues [UNESP]
Data de Publicação: 2022
Outros Autores: Kodaira, Vanessa, Mehdizadeh, Saman Abdanan, de Alencar Nääs, Irenilza, de Moura, Daniella Jorge, Pereira, Danilo Florentino [UNESP]
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Institucional da UNESP
Texto Completo: http://dx.doi.org/10.1007/s00521-022-07664-w
http://hdl.handle.net/11449/242209
Resumo: Continuous monitoring of chickens’ movement on-farm is a challenge. The present study aimed to associate the modified YOLO v4 model with a bird tracking algorithm based on a Kalman filter to identify a chicken’s movement using low-resolution video. The videos were captured in grayscale using a top-view camera with a low resolution of 702 × 480 pixels, preventing the application of usual image processing techniques. We used YOLO to extract the characteristics of the image and classification automatically. A dataset with images of tagged chickens was used to detect chickens, being 1000 frames tagged in different videos. The generated model was applied in a video that returned the bounding box of the location of the chicken in the frame. With the limits of the box, the centroid was calculated and exported in a CSV file for tracking processing. The Kalman filter was implemented to track chickens in low light intensity. Results indicated that YOLO presented a 99.9% accuracy in detecting chickens in low-quality videos. Using the Kalman filter, the algorithm tracks the chickens and gives them a particular identification number until they leave the compartment. Furthermore, each moving chicken is located in different colors along with the maps below the image, making chicken detection more convenient. The tracking results of chickens show that the proposed method can correctly handle the new entry and exit moving targets in crowded conditions.
id UNSP_6d3528e79a86e5a31202e41d496ae45e
oai_identifier_str oai:repositorio.unesp.br:11449/242209
network_acronym_str UNSP
network_name_str Repositório Institucional da UNESP
repository_id_str 2946
spelling Detection and tracking of chickens in low-light images using YOLO network and Kalman filterConvolutional neural networkDeep learningPrecision livestock farmingYOLO v4Continuous monitoring of chickens’ movement on-farm is a challenge. The present study aimed to associate the modified YOLO v4 model with a bird tracking algorithm based on a Kalman filter to identify a chicken’s movement using low-resolution video. The videos were captured in grayscale using a top-view camera with a low resolution of 702 × 480 pixels, preventing the application of usual image processing techniques. We used YOLO to extract the characteristics of the image and classification automatically. A dataset with images of tagged chickens was used to detect chickens, being 1000 frames tagged in different videos. The generated model was applied in a video that returned the bounding box of the location of the chicken in the frame. With the limits of the box, the centroid was calculated and exported in a CSV file for tracking processing. The Kalman filter was implemented to track chickens in low light intensity. Results indicated that YOLO presented a 99.9% accuracy in detecting chickens in low-quality videos. Using the Kalman filter, the algorithm tracks the chickens and gives them a particular identification number until they leave the compartment. Furthermore, each moving chicken is located in different colors along with the maps below the image, making chicken detection more convenient. The tracking results of chickens show that the proposed method can correctly handle the new entry and exit moving targets in crowded conditions.Graduate Program in Agribusiness and Development School of Sciences and Engineering São Paulo State University, SPGraduate Program in Agricultural Engineering School of Agricultural Engineering State University of Campinas, SPDepartment of Mechanics of Biosystems Engineering Faculty of Agricultural Engineering Agricultural Sciences and Natural Resources University of KhuzestanGraduate Program in Production Engineering Universidade Paulista, SPSchool of Agricultural Engineering Campinas State University, SPDepartment of Management Development and Technology School of Sciences and Engineering São Paulo State University, SPGraduate Program in Agribusiness and Development School of Sciences and Engineering São Paulo State University, SPDepartment of Management Development and Technology School of Sciences and Engineering São Paulo State University, SPUniversidade Estadual Paulista (UNESP)Universidade Estadual de Campinas (UNICAMP)Agricultural Sciences and Natural Resources University of KhuzestanUniversidade PaulistaSiriani, Allan Lincoln Rodrigues [UNESP]Kodaira, VanessaMehdizadeh, Saman Abdanande Alencar Nääs, Irenilzade Moura, Daniella JorgePereira, Danilo Florentino [UNESP]2023-03-02T11:51:27Z2023-03-02T11:51:27Z2022-01-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articlehttp://dx.doi.org/10.1007/s00521-022-07664-wNeural Computing and Applications.1433-30580941-0643http://hdl.handle.net/11449/24220910.1007/s00521-022-07664-w2-s2.0-85136810255Scopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengNeural Computing and Applicationsinfo:eu-repo/semantics/openAccess2024-06-10T14:49:01Zoai:repositorio.unesp.br:11449/242209Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T15:04:11.502570Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false
dc.title.none.fl_str_mv Detection and tracking of chickens in low-light images using YOLO network and Kalman filter
title Detection and tracking of chickens in low-light images using YOLO network and Kalman filter
spellingShingle Detection and tracking of chickens in low-light images using YOLO network and Kalman filter
Siriani, Allan Lincoln Rodrigues [UNESP]
Convolutional neural network
Deep learning
Precision livestock farming
YOLO v4
title_short Detection and tracking of chickens in low-light images using YOLO network and Kalman filter
title_full Detection and tracking of chickens in low-light images using YOLO network and Kalman filter
title_fullStr Detection and tracking of chickens in low-light images using YOLO network and Kalman filter
title_full_unstemmed Detection and tracking of chickens in low-light images using YOLO network and Kalman filter
title_sort Detection and tracking of chickens in low-light images using YOLO network and Kalman filter
author Siriani, Allan Lincoln Rodrigues [UNESP]
author_facet Siriani, Allan Lincoln Rodrigues [UNESP]
Kodaira, Vanessa
Mehdizadeh, Saman Abdanan
de Alencar Nääs, Irenilza
de Moura, Daniella Jorge
Pereira, Danilo Florentino [UNESP]
author_role author
author2 Kodaira, Vanessa
Mehdizadeh, Saman Abdanan
de Alencar Nääs, Irenilza
de Moura, Daniella Jorge
Pereira, Danilo Florentino [UNESP]
author2_role author
author
author
author
author
dc.contributor.none.fl_str_mv Universidade Estadual Paulista (UNESP)
Universidade Estadual de Campinas (UNICAMP)
Agricultural Sciences and Natural Resources University of Khuzestan
Universidade Paulista
dc.contributor.author.fl_str_mv Siriani, Allan Lincoln Rodrigues [UNESP]
Kodaira, Vanessa
Mehdizadeh, Saman Abdanan
de Alencar Nääs, Irenilza
de Moura, Daniella Jorge
Pereira, Danilo Florentino [UNESP]
dc.subject.por.fl_str_mv Convolutional neural network
Deep learning
Precision livestock farming
YOLO v4
topic Convolutional neural network
Deep learning
Precision livestock farming
YOLO v4
description Continuous monitoring of chickens’ movement on-farm is a challenge. The present study aimed to associate the modified YOLO v4 model with a bird tracking algorithm based on a Kalman filter to identify a chicken’s movement using low-resolution video. The videos were captured in grayscale using a top-view camera with a low resolution of 702 × 480 pixels, preventing the application of usual image processing techniques. We used YOLO to extract the characteristics of the image and classification automatically. A dataset with images of tagged chickens was used to detect chickens, being 1000 frames tagged in different videos. The generated model was applied in a video that returned the bounding box of the location of the chicken in the frame. With the limits of the box, the centroid was calculated and exported in a CSV file for tracking processing. The Kalman filter was implemented to track chickens in low light intensity. Results indicated that YOLO presented a 99.9% accuracy in detecting chickens in low-quality videos. Using the Kalman filter, the algorithm tracks the chickens and gives them a particular identification number until they leave the compartment. Furthermore, each moving chicken is located in different colors along with the maps below the image, making chicken detection more convenient. The tracking results of chickens show that the proposed method can correctly handle the new entry and exit moving targets in crowded conditions.
publishDate 2022
dc.date.none.fl_str_mv 2022-01-01
2023-03-02T11:51:27Z
2023-03-02T11:51:27Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://dx.doi.org/10.1007/s00521-022-07664-w
Neural Computing and Applications.
1433-3058
0941-0643
http://hdl.handle.net/11449/242209
10.1007/s00521-022-07664-w
2-s2.0-85136810255
url http://dx.doi.org/10.1007/s00521-022-07664-w
http://hdl.handle.net/11449/242209
identifier_str_mv Neural Computing and Applications.
1433-3058
0941-0643
10.1007/s00521-022-07664-w
2-s2.0-85136810255
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Neural Computing and Applications
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.source.none.fl_str_mv Scopus
reponame:Repositório Institucional da UNESP
instname:Universidade Estadual Paulista (UNESP)
instacron:UNESP
instname_str Universidade Estadual Paulista (UNESP)
instacron_str UNESP
institution UNESP
reponame_str Repositório Institucional da UNESP
collection Repositório Institucional da UNESP
repository.name.fl_str_mv Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)
repository.mail.fl_str_mv
_version_ 1808128453750292480