Teaching and learning Calculus with ChatGPT: benefits and limitations

Detalhes bibliográficos
Autor(a) principal: Cruz, J. P.
Data de Publicação: 2023
Outros Autores: Oliveira, M. P., Cação, Isabel
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10773/39899
Resumo: The use of Artificial Intelligence (AI) in education is growing as AI-based technologies become more and more developed and there are free versions available online for any user. Large Language Models (LLMs)-statistical models that predict the next token from the previous ones using a large amount of data-have already demonstrated their usefulness as conversational agents in multiple domains, including education. The question-and-answer dialogue ChatGPT (Chat Generative Pre-Trained Transformer) is one of the most popular LLMs that has been released. It has access to a massive amount of data that enables a wide range of linguistic relationships providing understandable contextualized natural language. Therefore, it shows apparently admirable capacities for educational purposes (in fact, it was noticed worldwide that it could pass the United States Medical Licensing Exam and scored highly on the Psychology Today Verbal-Linguistic Intelligence IQ Test). Facing this new reality, how should academia act? Is ChatGPT a threat or an opportunity? Several newspaper articles and scientific papers were devoted to this topic, concluding that, in general, ChatGPT can be beneficial if integrated into the teaching-learning process, as long as the student is aware of its limitations. In fact, it has been reported that ChatGPT often provides biased and even, in some cases, incorrect information, so the students must have this awareness and should take the results with a critical mind. This is particularly relevant in Mathematics, where ChatGPT has shown several weaknesses and failures. In this paper, we conduct an experiment on Symbolic Integration and consequent computation of areas of a geometric figure, as these are common topics of Calculus for both Mathematics and Engineering students of the first year. Our results enforce previous conclusions about the failure of ChatGPT and the necessity of suitable guidance when it is used for exercise-solving purposes. When integrated in the classroom, it could be an interesting and motivational tool for learning and teaching, as it can promote fruitful discussions between peers and student-teacher, fomenting critical thinking.
id RCAP_44031ff1801efff508f377cf8ab7cbe0
oai_identifier_str oai:ria.ua.pt:10773/39899
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Teaching and learning Calculus with ChatGPT: benefits and limitationsMathematicsChatGPTCalculusEducationThe use of Artificial Intelligence (AI) in education is growing as AI-based technologies become more and more developed and there are free versions available online for any user. Large Language Models (LLMs)-statistical models that predict the next token from the previous ones using a large amount of data-have already demonstrated their usefulness as conversational agents in multiple domains, including education. The question-and-answer dialogue ChatGPT (Chat Generative Pre-Trained Transformer) is one of the most popular LLMs that has been released. It has access to a massive amount of data that enables a wide range of linguistic relationships providing understandable contextualized natural language. Therefore, it shows apparently admirable capacities for educational purposes (in fact, it was noticed worldwide that it could pass the United States Medical Licensing Exam and scored highly on the Psychology Today Verbal-Linguistic Intelligence IQ Test). Facing this new reality, how should academia act? Is ChatGPT a threat or an opportunity? Several newspaper articles and scientific papers were devoted to this topic, concluding that, in general, ChatGPT can be beneficial if integrated into the teaching-learning process, as long as the student is aware of its limitations. In fact, it has been reported that ChatGPT often provides biased and even, in some cases, incorrect information, so the students must have this awareness and should take the results with a critical mind. This is particularly relevant in Mathematics, where ChatGPT has shown several weaknesses and failures. In this paper, we conduct an experiment on Symbolic Integration and consequent computation of areas of a geometric figure, as these are common topics of Calculus for both Mathematics and Engineering students of the first year. Our results enforce previous conclusions about the failure of ChatGPT and the necessity of suitable guidance when it is used for exercise-solving purposes. When integrated in the classroom, it could be an interesting and motivational tool for learning and teaching, as it can promote fruitful discussions between peers and student-teacher, fomenting critical thinking.IATED2023-12-22T11:05:02Z2023-11-13T00:00:00Z2023-11-13book partinfo:eu-repo/semantics/publishedVersionapplication/pdfhttp://hdl.handle.net/10773/39899eng978-84-09-55942-810.21125/iceri.2023Cruz, J. P.Oliveira, M. P.Cação, Isabelinfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-05-06T04:50:17Zoai:ria.ua.pt:10773/39899Portal AgregadorONGhttps://www.rcaap.pt/oai/openairemluisa.alvim@gmail.comopendoar:71602024-05-06T04:50:17Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Teaching and learning Calculus with ChatGPT: benefits and limitations
title Teaching and learning Calculus with ChatGPT: benefits and limitations
spellingShingle Teaching and learning Calculus with ChatGPT: benefits and limitations
Cruz, J. P.
Mathematics
ChatGPT
Calculus
Education
title_short Teaching and learning Calculus with ChatGPT: benefits and limitations
title_full Teaching and learning Calculus with ChatGPT: benefits and limitations
title_fullStr Teaching and learning Calculus with ChatGPT: benefits and limitations
title_full_unstemmed Teaching and learning Calculus with ChatGPT: benefits and limitations
title_sort Teaching and learning Calculus with ChatGPT: benefits and limitations
author Cruz, J. P.
author_facet Cruz, J. P.
Oliveira, M. P.
Cação, Isabel
author_role author
author2 Oliveira, M. P.
Cação, Isabel
author2_role author
author
dc.contributor.author.fl_str_mv Cruz, J. P.
Oliveira, M. P.
Cação, Isabel
dc.subject.por.fl_str_mv Mathematics
ChatGPT
Calculus
Education
topic Mathematics
ChatGPT
Calculus
Education
description The use of Artificial Intelligence (AI) in education is growing as AI-based technologies become more and more developed and there are free versions available online for any user. Large Language Models (LLMs)-statistical models that predict the next token from the previous ones using a large amount of data-have already demonstrated their usefulness as conversational agents in multiple domains, including education. The question-and-answer dialogue ChatGPT (Chat Generative Pre-Trained Transformer) is one of the most popular LLMs that has been released. It has access to a massive amount of data that enables a wide range of linguistic relationships providing understandable contextualized natural language. Therefore, it shows apparently admirable capacities for educational purposes (in fact, it was noticed worldwide that it could pass the United States Medical Licensing Exam and scored highly on the Psychology Today Verbal-Linguistic Intelligence IQ Test). Facing this new reality, how should academia act? Is ChatGPT a threat or an opportunity? Several newspaper articles and scientific papers were devoted to this topic, concluding that, in general, ChatGPT can be beneficial if integrated into the teaching-learning process, as long as the student is aware of its limitations. In fact, it has been reported that ChatGPT often provides biased and even, in some cases, incorrect information, so the students must have this awareness and should take the results with a critical mind. This is particularly relevant in Mathematics, where ChatGPT has shown several weaknesses and failures. In this paper, we conduct an experiment on Symbolic Integration and consequent computation of areas of a geometric figure, as these are common topics of Calculus for both Mathematics and Engineering students of the first year. Our results enforce previous conclusions about the failure of ChatGPT and the necessity of suitable guidance when it is used for exercise-solving purposes. When integrated in the classroom, it could be an interesting and motivational tool for learning and teaching, as it can promote fruitful discussions between peers and student-teacher, fomenting critical thinking.
publishDate 2023
dc.date.none.fl_str_mv 2023-12-22T11:05:02Z
2023-11-13T00:00:00Z
2023-11-13
dc.type.driver.fl_str_mv book part
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10773/39899
url http://hdl.handle.net/10773/39899
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv 978-84-09-55942-8
10.21125/iceri.2023
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv IATED
publisher.none.fl_str_mv IATED
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv mluisa.alvim@gmail.com
_version_ 1817543878841991168