Development and evaluation of a recommendation system to suggest medical items for inpatients in Hospital da Luz Lisboa

Detalhes bibliográficos
Autor(a) principal: Cabral, Miguel Alexandre Garcia
Data de Publicação: 2022
Tipo de documento: Dissertação
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10773/37347
Resumo: The internet advances have led to an increase of data and information availability. This overload of information tends to compromise the capacity to manage and filter the available data. In the health domain, the increasing digitalization in healthcare led to a substantial rise of the recorded data. Various recommendation systems (RS) have been developed to help healthcare professionals integrate all information and make efficient and effective decisions. Here, a preliminary RS based on collaborative filtering is proposed to reduce the time that healthcare professionals spend in registering medical items consumed during patients’ hospitalization. For that purpose, the RS was built to perform suggestions of the medical items and respective quantities needed in the first day of hospitalization of a patient. Data regarding the diagnostics, surgical procedures and medical item records associated to surgeries of inpatients during a period of one year in Hospital da Luz Lisboa was filtered, restructured, and analysed (N = 5088 surgeries) for the construction of the RS. A 75-25% split of the data was considered with a 4-fold cross-validation procedure applied on the train set to tune the hyperparameters settings for the algorithm. The RS was then tested and evaluated regarding its overall performance in terms of accuracy, classification performance, and coverage. The same measures were applied to assess the quality of the recommendations for each medical specialty of the hospital. Furthermore, the trust of healthcare professionals in the RS was also assessed. A moderate overall performance was achieved (precision = 0.608, recall = 0.729, F1-Measure = 0.663, RMSE = 6.901) and the quality of the algorithm’s recommendations varied between medical specialties. Additionally, the algorithm presented higher values of precision, recall and F1-Measure in the predictions of the most frequently registered medical items in the test set, which corresponded to approximately 85% of the consumptions in the first day of hospitalization. Regarding the coverage of the RS, approximately 80% of the medical items used in the test set were never recommended by the algorithm, corresponding to only 5.57% of the consumptions. Lastly, although in the point of view of hospital’s nurses there is some trust in the RS results, several suggestions were given for further improvements of the algorithm. Despite the limitations of the RS, the observed results represent a starting point for the development of a tool that can support healthcare professionals of Hospital da Luz Lisboa in registering medical items needed during inpatients’ hospitalization.
id RCAP_5cc77f0be1241ae0e3a9077e66dd55ed
oai_identifier_str oai:ria.ua.pt:10773/37347
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Development and evaluation of a recommendation system to suggest medical items for inpatients in Hospital da Luz LisboaRecommendation systemsCollaborative filteringHealth domainMedical itemsInpatientsThe internet advances have led to an increase of data and information availability. This overload of information tends to compromise the capacity to manage and filter the available data. In the health domain, the increasing digitalization in healthcare led to a substantial rise of the recorded data. Various recommendation systems (RS) have been developed to help healthcare professionals integrate all information and make efficient and effective decisions. Here, a preliminary RS based on collaborative filtering is proposed to reduce the time that healthcare professionals spend in registering medical items consumed during patients’ hospitalization. For that purpose, the RS was built to perform suggestions of the medical items and respective quantities needed in the first day of hospitalization of a patient. Data regarding the diagnostics, surgical procedures and medical item records associated to surgeries of inpatients during a period of one year in Hospital da Luz Lisboa was filtered, restructured, and analysed (N = 5088 surgeries) for the construction of the RS. A 75-25% split of the data was considered with a 4-fold cross-validation procedure applied on the train set to tune the hyperparameters settings for the algorithm. The RS was then tested and evaluated regarding its overall performance in terms of accuracy, classification performance, and coverage. The same measures were applied to assess the quality of the recommendations for each medical specialty of the hospital. Furthermore, the trust of healthcare professionals in the RS was also assessed. A moderate overall performance was achieved (precision = 0.608, recall = 0.729, F1-Measure = 0.663, RMSE = 6.901) and the quality of the algorithm’s recommendations varied between medical specialties. Additionally, the algorithm presented higher values of precision, recall and F1-Measure in the predictions of the most frequently registered medical items in the test set, which corresponded to approximately 85% of the consumptions in the first day of hospitalization. Regarding the coverage of the RS, approximately 80% of the medical items used in the test set were never recommended by the algorithm, corresponding to only 5.57% of the consumptions. Lastly, although in the point of view of hospital’s nurses there is some trust in the RS results, several suggestions were given for further improvements of the algorithm. Despite the limitations of the RS, the observed results represent a starting point for the development of a tool that can support healthcare professionals of Hospital da Luz Lisboa in registering medical items needed during inpatients’ hospitalization.Os avanços da internet têm aumentado a quantidade de informação disponível, pelo que o seu excesso tende a dificultar a capacidade de gestão e filtragem da mesma. Este fenómeno pode ser observado no domínio da saúde onde a digitalização dos serviços médicos levou a um aumento substancial dos dados registados nos hospitais. Com o intuito de ajudar os profissionais de saúde a integrar toda a informação e, assim, realizarem decisões eficientes e efetivas, vários sistemas de recomendação (SR) foram desenvolvidos. Neste projeto, propõe-se um SR preliminar baseado em filtragem colaborativa para reduzir o tempo despendido pelos profissionais de saúde do Hospital da Luz Lisboa no registo de artigos médicos consumidos durante o período de internamento de doentes. Para isso, o SR foi desenvolvido de modo a formular recomendações relativamente aos artigos médicos e respetivas quantidades necessárias para o primeiro dia de internamento de um doente. A construção do SR teve por base os diagnósticos, procedimentos cirúrgicos e registos de consumos de artigos médicos associados a propostas cirúrgicas de doentes que foram internados no período de um ano no Hospital da Luz Lisboa. O conjunto de dados foi filtrado, reestruturado e analisado (N = 5088 propostas cirúrgicas), para posteriormente ser dividido em conjuntos de treino e de teste (75-25%). Foi aplicada uma 4-fold cross-validation sobre o conjunto de treino para a afinação dos hiperparâmetros do algoritmo, sendo o SR foi testado e avaliado relativamente às suas recomendações a nível global e em cada especialidade médica do hospital em termos de accuracy, classification performance e coverage. Foi igualmente avaliado o grau de confiança no SR por parte dos profissionais de saúde do hospital. O SR apresentou uma performance global razoável (precisão = 0.608, sensibilidade = 0.729, F1 = 0.663, RMSE = 6.901) e demonstrou diferentes níveis de qualidade de recomendações dependendo da especialidade médica. Os melhores valores de precisão, sensibilidade e F1 foram observados nas previsões dos artigos médicos mais frequentemente registados, que correspondem a cerca de 85% dos consumos feitos no primeiro dia de internamento dos doentes do conjunto de teste. O algoritmo nunca sugeriu aproximadamente 80% dos artigos médicos utilizados no conjunto de teste, no entanto, estes apenas correspondiam 5.57% dos consumos totais. Por fim, e embora do ponto de vista dos enfermeiros do hospital haja alguma confiança nos resultados do SR, foram dadas sugestões para futuros ajustes do algoritmo. Não obstante as limitações do SR, os resultados obtidos representam um ponto de partida para o desenvolvimento de uma ferramenta de apoio aos profissionais de saúde do Hospital da Luz nos registos dos artigos médicos necessários durante o internamento de doentes.2023-04-26T13:30:22Z2022-11-10T00:00:00Z2022-11-10info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfhttp://hdl.handle.net/10773/37347engCabral, Miguel Alexandre Garciainfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-02-22T12:11:37Zoai:ria.ua.pt:10773/37347Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-20T03:07:46.852989Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Development and evaluation of a recommendation system to suggest medical items for inpatients in Hospital da Luz Lisboa
title Development and evaluation of a recommendation system to suggest medical items for inpatients in Hospital da Luz Lisboa
spellingShingle Development and evaluation of a recommendation system to suggest medical items for inpatients in Hospital da Luz Lisboa
Cabral, Miguel Alexandre Garcia
Recommendation systems
Collaborative filtering
Health domain
Medical items
Inpatients
title_short Development and evaluation of a recommendation system to suggest medical items for inpatients in Hospital da Luz Lisboa
title_full Development and evaluation of a recommendation system to suggest medical items for inpatients in Hospital da Luz Lisboa
title_fullStr Development and evaluation of a recommendation system to suggest medical items for inpatients in Hospital da Luz Lisboa
title_full_unstemmed Development and evaluation of a recommendation system to suggest medical items for inpatients in Hospital da Luz Lisboa
title_sort Development and evaluation of a recommendation system to suggest medical items for inpatients in Hospital da Luz Lisboa
author Cabral, Miguel Alexandre Garcia
author_facet Cabral, Miguel Alexandre Garcia
author_role author
dc.contributor.author.fl_str_mv Cabral, Miguel Alexandre Garcia
dc.subject.por.fl_str_mv Recommendation systems
Collaborative filtering
Health domain
Medical items
Inpatients
topic Recommendation systems
Collaborative filtering
Health domain
Medical items
Inpatients
description The internet advances have led to an increase of data and information availability. This overload of information tends to compromise the capacity to manage and filter the available data. In the health domain, the increasing digitalization in healthcare led to a substantial rise of the recorded data. Various recommendation systems (RS) have been developed to help healthcare professionals integrate all information and make efficient and effective decisions. Here, a preliminary RS based on collaborative filtering is proposed to reduce the time that healthcare professionals spend in registering medical items consumed during patients’ hospitalization. For that purpose, the RS was built to perform suggestions of the medical items and respective quantities needed in the first day of hospitalization of a patient. Data regarding the diagnostics, surgical procedures and medical item records associated to surgeries of inpatients during a period of one year in Hospital da Luz Lisboa was filtered, restructured, and analysed (N = 5088 surgeries) for the construction of the RS. A 75-25% split of the data was considered with a 4-fold cross-validation procedure applied on the train set to tune the hyperparameters settings for the algorithm. The RS was then tested and evaluated regarding its overall performance in terms of accuracy, classification performance, and coverage. The same measures were applied to assess the quality of the recommendations for each medical specialty of the hospital. Furthermore, the trust of healthcare professionals in the RS was also assessed. A moderate overall performance was achieved (precision = 0.608, recall = 0.729, F1-Measure = 0.663, RMSE = 6.901) and the quality of the algorithm’s recommendations varied between medical specialties. Additionally, the algorithm presented higher values of precision, recall and F1-Measure in the predictions of the most frequently registered medical items in the test set, which corresponded to approximately 85% of the consumptions in the first day of hospitalization. Regarding the coverage of the RS, approximately 80% of the medical items used in the test set were never recommended by the algorithm, corresponding to only 5.57% of the consumptions. Lastly, although in the point of view of hospital’s nurses there is some trust in the RS results, several suggestions were given for further improvements of the algorithm. Despite the limitations of the RS, the observed results represent a starting point for the development of a tool that can support healthcare professionals of Hospital da Luz Lisboa in registering medical items needed during inpatients’ hospitalization.
publishDate 2022
dc.date.none.fl_str_mv 2022-11-10T00:00:00Z
2022-11-10
2023-04-26T13:30:22Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10773/37347
url http://hdl.handle.net/10773/37347
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799137731789455360