An Iowa Gambling Task-based experiment applied to robots: A Study on Long-term Decision Making

Detalhes bibliográficos
Autor(a) principal: Berto, Leticia M.
Data de Publicação: 2021
Outros Autores: Costa, Paula D. P., Simoes, Alexandre S. [UNESP], Gudwin, Ricardo R., Colombini, Esther L.
Tipo de documento: Artigo de conferência
Idioma: eng
Título da fonte: Repositório Institucional da UNESP
Texto Completo: http://dx.doi.org/10.1109/ICDL49984.2021.9515632
http://hdl.handle.net/11449/222377
Resumo: Designing a robot's decision-making process is challenging because it is still not completely understood even in humans. However, it is a fundamental process in the search for autonomous agents. When making decisions, we consider the short and long-term consequences of our actions, but some impairments prevent some people from seeing in the long run. Using as an inspiration an experiment carried out with humans in which decision-making is evaluated under the uncertainty of premises and results, rewards, and punishments, we created an equivalent robotics experiment. To model our agent's state, we use a set of drives. Our agent's goal is to reduce the distance between its homeostasis state and its needs. We trained a simulated robot with reinforcement learning, showing that long-term assessment agents can survive longer while satisfying other needs.
id UNSP_34d81cab7d42967b204d50a67a61008b
oai_identifier_str oai:repositorio.unesp.br:11449/222377
network_acronym_str UNSP
network_name_str Repositório Institucional da UNESP
repository_id_str 2946
spelling An Iowa Gambling Task-based experiment applied to robots: A Study on Long-term Decision MakingAction selection and planningExploration and PlayIntrinsic MotivationModels of emotions and internal statesDesigning a robot's decision-making process is challenging because it is still not completely understood even in humans. However, it is a fundamental process in the search for autonomous agents. When making decisions, we consider the short and long-term consequences of our actions, but some impairments prevent some people from seeing in the long run. Using as an inspiration an experiment carried out with humans in which decision-making is evaluated under the uncertainty of premises and results, rewards, and punishments, we created an equivalent robotics experiment. To model our agent's state, we use a set of drives. Our agent's goal is to reduce the distance between its homeostasis state and its needs. We trained a simulated robot with reinforcement learning, showing that long-term assessment agents can survive longer while satisfying other needs.Lab. of Robotics and Cognitive Systems-UNICAMPDCA-FEEC-UNICAMPUNESP Dept. of Control and Automation EngineeringUNESP Dept. of Control and Automation EngineeringUniversidade Estadual de Campinas (UNICAMP)Universidade Estadual Paulista (UNESP)Berto, Leticia M.Costa, Paula D. P.Simoes, Alexandre S. [UNESP]Gudwin, Ricardo R.Colombini, Esther L.2022-04-28T19:44:18Z2022-04-28T19:44:18Z2021-08-23info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/conferenceObjecthttp://dx.doi.org/10.1109/ICDL49984.2021.9515632IEEE International Conference on Development and Learning, ICDL 2021.http://hdl.handle.net/11449/22237710.1109/ICDL49984.2021.95156322-s2.0-85114558776Scopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengIEEE International Conference on Development and Learning, ICDL 2021info:eu-repo/semantics/openAccess2022-04-28T19:44:18Zoai:repositorio.unesp.br:11449/222377Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T23:51:50.334902Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false
dc.title.none.fl_str_mv An Iowa Gambling Task-based experiment applied to robots: A Study on Long-term Decision Making
title An Iowa Gambling Task-based experiment applied to robots: A Study on Long-term Decision Making
spellingShingle An Iowa Gambling Task-based experiment applied to robots: A Study on Long-term Decision Making
Berto, Leticia M.
Action selection and planning
Exploration and Play
Intrinsic Motivation
Models of emotions and internal states
title_short An Iowa Gambling Task-based experiment applied to robots: A Study on Long-term Decision Making
title_full An Iowa Gambling Task-based experiment applied to robots: A Study on Long-term Decision Making
title_fullStr An Iowa Gambling Task-based experiment applied to robots: A Study on Long-term Decision Making
title_full_unstemmed An Iowa Gambling Task-based experiment applied to robots: A Study on Long-term Decision Making
title_sort An Iowa Gambling Task-based experiment applied to robots: A Study on Long-term Decision Making
author Berto, Leticia M.
author_facet Berto, Leticia M.
Costa, Paula D. P.
Simoes, Alexandre S. [UNESP]
Gudwin, Ricardo R.
Colombini, Esther L.
author_role author
author2 Costa, Paula D. P.
Simoes, Alexandre S. [UNESP]
Gudwin, Ricardo R.
Colombini, Esther L.
author2_role author
author
author
author
dc.contributor.none.fl_str_mv Universidade Estadual de Campinas (UNICAMP)
Universidade Estadual Paulista (UNESP)
dc.contributor.author.fl_str_mv Berto, Leticia M.
Costa, Paula D. P.
Simoes, Alexandre S. [UNESP]
Gudwin, Ricardo R.
Colombini, Esther L.
dc.subject.por.fl_str_mv Action selection and planning
Exploration and Play
Intrinsic Motivation
Models of emotions and internal states
topic Action selection and planning
Exploration and Play
Intrinsic Motivation
Models of emotions and internal states
description Designing a robot's decision-making process is challenging because it is still not completely understood even in humans. However, it is a fundamental process in the search for autonomous agents. When making decisions, we consider the short and long-term consequences of our actions, but some impairments prevent some people from seeing in the long run. Using as an inspiration an experiment carried out with humans in which decision-making is evaluated under the uncertainty of premises and results, rewards, and punishments, we created an equivalent robotics experiment. To model our agent's state, we use a set of drives. Our agent's goal is to reduce the distance between its homeostasis state and its needs. We trained a simulated robot with reinforcement learning, showing that long-term assessment agents can survive longer while satisfying other needs.
publishDate 2021
dc.date.none.fl_str_mv 2021-08-23
2022-04-28T19:44:18Z
2022-04-28T19:44:18Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/conferenceObject
format conferenceObject
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://dx.doi.org/10.1109/ICDL49984.2021.9515632
IEEE International Conference on Development and Learning, ICDL 2021.
http://hdl.handle.net/11449/222377
10.1109/ICDL49984.2021.9515632
2-s2.0-85114558776
url http://dx.doi.org/10.1109/ICDL49984.2021.9515632
http://hdl.handle.net/11449/222377
identifier_str_mv IEEE International Conference on Development and Learning, ICDL 2021.
10.1109/ICDL49984.2021.9515632
2-s2.0-85114558776
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv IEEE International Conference on Development and Learning, ICDL 2021
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.source.none.fl_str_mv Scopus
reponame:Repositório Institucional da UNESP
instname:Universidade Estadual Paulista (UNESP)
instacron:UNESP
instname_str Universidade Estadual Paulista (UNESP)
instacron_str UNESP
institution UNESP
reponame_str Repositório Institucional da UNESP
collection Repositório Institucional da UNESP
repository.name.fl_str_mv Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)
repository.mail.fl_str_mv
_version_ 1808129559381409792