Enhanced teleoperation interfaces for multi-second latency conditions: System design and evaluation

Detalhes bibliográficos
Autor(a) principal: Luz, R.
Data de Publicação: 2023
Outros Autores: Silva, J. L., Ventura, R.
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10071/28145
Resumo: Adding human cognitive skills to planetary exploration through remote teleoperation can lead to more effective and valuable scientific data acquisition. Still, even small amounts of latency can significantly affect real-time operations, often leading to compromised robot safety, goal overshoot, and high levels of human mental fatigue and cognitive workload. Thus, novel operational strategies are necessary to cope with these effects. This paper proposes three augmented teleoperation interfaces that allow the user to operate a robot subject to 3 seconds of latency: (1) Avatar-Aided Interface (AAI), a semi-autonomous approach based on a virtual element; (2) Predictive Interface (PI), an approach with direct control and predictive elements; and (3) Hybrid Interface (HI), where the operator can easily switch between PI and AAI. We conducted a systematic within-subject experiment to evaluate the proposed interfaces in a realistic virtual environment with frequent traction losses. The user study compared AAI and PI to a Control Interface (CI), which did not display any augmented elements. The main results of this comparison showed that: (1) AAI led to a significant reduction in workload and a significant increase in usability and robot safety; (2) the use of the PI caused a significant increase in path length, indicating that operators overshoot their goals more often with this approach; (3) PI and AAI had lower reported effort; and (4) AAI is more flexible and effortless than PI and CI. Finally, the presented results show the need to consider uncertainty (e.g., traction loss) in future interface design.
id RCAP_a0fc758c89f838557e96c347f15e1ea2
oai_identifier_str oai:repositorio.iscte-iul.pt:10071/28145
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Enhanced teleoperation interfaces for multi-second latency conditions: System design and evaluationTime-delayed teleoperationAugmented interfacesPredictive displaysSemi-autonomous navigationTraction lossesPlanetary explorationAdding human cognitive skills to planetary exploration through remote teleoperation can lead to more effective and valuable scientific data acquisition. Still, even small amounts of latency can significantly affect real-time operations, often leading to compromised robot safety, goal overshoot, and high levels of human mental fatigue and cognitive workload. Thus, novel operational strategies are necessary to cope with these effects. This paper proposes three augmented teleoperation interfaces that allow the user to operate a robot subject to 3 seconds of latency: (1) Avatar-Aided Interface (AAI), a semi-autonomous approach based on a virtual element; (2) Predictive Interface (PI), an approach with direct control and predictive elements; and (3) Hybrid Interface (HI), where the operator can easily switch between PI and AAI. We conducted a systematic within-subject experiment to evaluate the proposed interfaces in a realistic virtual environment with frequent traction losses. The user study compared AAI and PI to a Control Interface (CI), which did not display any augmented elements. The main results of this comparison showed that: (1) AAI led to a significant reduction in workload and a significant increase in usability and robot safety; (2) the use of the PI caused a significant increase in path length, indicating that operators overshoot their goals more often with this approach; (3) PI and AAI had lower reported effort; and (4) AAI is more flexible and effortless than PI and CI. Finally, the presented results show the need to consider uncertainty (e.g., traction loss) in future interface design.IEEE2023-03-02T16:16:37Z2023-01-01T00:00:00Z20232023-03-02T16:15:49Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10071/28145eng2169-353610.1109/ACCESS.2023.3240307Luz, R.Silva, J. L.Ventura, R.info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-11-09T17:41:00Zoai:repositorio.iscte-iul.pt:10071/28145Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T22:19:01.222565Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Enhanced teleoperation interfaces for multi-second latency conditions: System design and evaluation
title Enhanced teleoperation interfaces for multi-second latency conditions: System design and evaluation
spellingShingle Enhanced teleoperation interfaces for multi-second latency conditions: System design and evaluation
Luz, R.
Time-delayed teleoperation
Augmented interfaces
Predictive displays
Semi-autonomous navigation
Traction losses
Planetary exploration
title_short Enhanced teleoperation interfaces for multi-second latency conditions: System design and evaluation
title_full Enhanced teleoperation interfaces for multi-second latency conditions: System design and evaluation
title_fullStr Enhanced teleoperation interfaces for multi-second latency conditions: System design and evaluation
title_full_unstemmed Enhanced teleoperation interfaces for multi-second latency conditions: System design and evaluation
title_sort Enhanced teleoperation interfaces for multi-second latency conditions: System design and evaluation
author Luz, R.
author_facet Luz, R.
Silva, J. L.
Ventura, R.
author_role author
author2 Silva, J. L.
Ventura, R.
author2_role author
author
dc.contributor.author.fl_str_mv Luz, R.
Silva, J. L.
Ventura, R.
dc.subject.por.fl_str_mv Time-delayed teleoperation
Augmented interfaces
Predictive displays
Semi-autonomous navigation
Traction losses
Planetary exploration
topic Time-delayed teleoperation
Augmented interfaces
Predictive displays
Semi-autonomous navigation
Traction losses
Planetary exploration
description Adding human cognitive skills to planetary exploration through remote teleoperation can lead to more effective and valuable scientific data acquisition. Still, even small amounts of latency can significantly affect real-time operations, often leading to compromised robot safety, goal overshoot, and high levels of human mental fatigue and cognitive workload. Thus, novel operational strategies are necessary to cope with these effects. This paper proposes three augmented teleoperation interfaces that allow the user to operate a robot subject to 3 seconds of latency: (1) Avatar-Aided Interface (AAI), a semi-autonomous approach based on a virtual element; (2) Predictive Interface (PI), an approach with direct control and predictive elements; and (3) Hybrid Interface (HI), where the operator can easily switch between PI and AAI. We conducted a systematic within-subject experiment to evaluate the proposed interfaces in a realistic virtual environment with frequent traction losses. The user study compared AAI and PI to a Control Interface (CI), which did not display any augmented elements. The main results of this comparison showed that: (1) AAI led to a significant reduction in workload and a significant increase in usability and robot safety; (2) the use of the PI caused a significant increase in path length, indicating that operators overshoot their goals more often with this approach; (3) PI and AAI had lower reported effort; and (4) AAI is more flexible and effortless than PI and CI. Finally, the presented results show the need to consider uncertainty (e.g., traction loss) in future interface design.
publishDate 2023
dc.date.none.fl_str_mv 2023-03-02T16:16:37Z
2023-01-01T00:00:00Z
2023
2023-03-02T16:15:49Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10071/28145
url http://hdl.handle.net/10071/28145
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv 2169-3536
10.1109/ACCESS.2023.3240307
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv IEEE
publisher.none.fl_str_mv IEEE
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799134749724246016