UNDERSTANDING GENERATIVE ARTIFICIAL INTELLIGENCE FROM THE LANGUAGE PERSPECTIVE

Detalhes bibliográficos
Autor(a) principal: Duque-Pereira, Ives da Silva
Data de Publicação: 2023
Outros Autores: Moura, Sergio Arruda de
Tipo de documento: preprint
Idioma: por
Título da fonte: SciELO Preprints
Texto Completo: https://preprints.scielo.org/index.php/scielo/preprint/view/7077
Resumo: This article explores text generation through Generative Artificial Intelligence (Gen AI), focusing on the interactions between AI and Language. The research aims to elucidate the underlying mechanisms of text-to-text generation tools, such as ChatGPT, placing it within the broad field of AI, an interdisciplinary area that counts Linguistics as one of its pillars. The investigative journey spans from the theoretical foundations of AI, traversing fields like Natural Language Processing, Machine Learning, Deep Learning, and the revolutionary Transformer Architecture. The study emphasizes Distributed Semantics as the enabler for the emergence of Large Language Models. Highlighting the confluence of technology with natural language, the paper outlines the capabilities, limitations, and challenges of these models, especially in generating textual content from input commands, known as "prompts". In this context, our primary goal is to understand the fundamentals and workings of Generative AI and its intersections with Language, enabling the use of tools geared towards text-to-text generation, like ChatGPT.
id SCI-1_09b724849430d9624c0627991c1c6701
oai_identifier_str oai:ops.preprints.scielo.org:preprint/7077
network_acronym_str SCI-1
network_name_str SciELO Preprints
repository_id_str
spelling UNDERSTANDING GENERATIVE ARTIFICIAL INTELLIGENCE FROM THE LANGUAGE PERSPECTIVECOMPREENDENDO A INTELIGÊNCIA ARTIFICIAL GENERATIVA NA PERSPECTIVA DA LÍNGUAInteligência Artificial GenerativalínguaLingüísticaChatGPTGenerative Artificial IntelligenceLanguageLinguisticsChatGPTThis article explores text generation through Generative Artificial Intelligence (Gen AI), focusing on the interactions between AI and Language. The research aims to elucidate the underlying mechanisms of text-to-text generation tools, such as ChatGPT, placing it within the broad field of AI, an interdisciplinary area that counts Linguistics as one of its pillars. The investigative journey spans from the theoretical foundations of AI, traversing fields like Natural Language Processing, Machine Learning, Deep Learning, and the revolutionary Transformer Architecture. The study emphasizes Distributed Semantics as the enabler for the emergence of Large Language Models. Highlighting the confluence of technology with natural language, the paper outlines the capabilities, limitations, and challenges of these models, especially in generating textual content from input commands, known as "prompts". In this context, our primary goal is to understand the fundamentals and workings of Generative AI and its intersections with Language, enabling the use of tools geared towards text-to-text generation, like ChatGPT.Este artículo explora la generación de texto a través de la Inteligencia Artificial Generativa (IA Gen), centrándose en las interacciones entre la IA y el Lenguaje. La investigación busca esclarecer los mecanismos subyacentes de herramientas de generación de texto-a-texto, como el ChatGPT, contextualizándolo dentro del amplio campo de la IA, una área interdisciplinaria que tiene como uno de sus pilares la Lingüística. El recorrido investigativo abarca desde los fundamentos teóricos de la IA, pasando por campos como el Procesamiento del Lenguaje Natural, Aprendizaje Automático, Aprendizaje Profundo y la revolucionaria Arquitectura de Transformers. El estudio se centra en la Semántica Distribucional como facilitadora del surgimiento de los Grandes Modelos de Lenguaje. Al destacar la confluencia de la tecnología con el lenguaje natural, el trabajo señala las capacidades, limitaciones y desafíos de estos modelos, especialmente en la generación de contenido textual a partir de comandos de entrada, conocidos como "prompts". En este contexto, nuestro principal objetivo es comprender los fundamentos y funcionamiento de la IA Generativa y las intersecciones con el Lenguaje, que permite la utilización de herramientas orientadas a la generación de texto-a-texto, como el ChatGPT.Este artigo explora a geração de texto através da Inteligência Artificial Generativa (IA Gen), com foco nas interações entre a IA e a Língua. A pesquisa visa elucidar os mecanismos subjacentes de ferramentas de geração texto-para-texto, como o ChatGPT, contextualizando-o dentro do amplo campo da IA, uma área interdisciplinar que têm como um de seus pilares a Linguística. A jornada investigativa abrange desde os fundamentos teóricos da IA, passando por campos como Processamento da Língua Natural, Aprendizado de Máquina, Aprendizado Profundo e a revolucionária Arquitetura de Transformers. O estudo presta atenção na Semântica Distribucional como possibilitadora do surgimento dos Grandes Modelos de Linguagem. Ao destacar a confluência da tecnologia com a língua natural, o trabalho aponta as capacidades, limitações e desafios desses modelos, especialmente na geração de conteúdo textual a partir de comandos de entrada, conhecidos como "prompts". Neste contexto, nosso principal objetivo é compreender os fundamentos e funcionamento da IA Generativa e as interseções com a Língua, que possibilita a utilização de ferramentas voltadas à geração texto-para-texto, como o ChatGPT.SciELO PreprintsSciELO PreprintsSciELO Preprints2023-10-06info:eu-repo/semantics/preprintinfo:eu-repo/semantics/publishedVersionapplication/pdfhttps://preprints.scielo.org/index.php/scielo/preprint/view/707710.1590/SciELOPreprints.7077porhttps://preprints.scielo.org/index.php/scielo/article/view/7077/13284Copyright (c) 2023 Ives da Silva Duque-Pereira, Sergio Arruda de Mourahttps://creativecommons.org/licenses/by/4.0info:eu-repo/semantics/openAccessDuque-Pereira, Ives da SilvaMoura, Sergio Arruda dereponame:SciELO Preprintsinstname:Scientific Electronic Library Online (SCIELO)instacron:SCI2023-09-25T01:15:34Zoai:ops.preprints.scielo.org:preprint/7077Servidor de preprintshttps://preprints.scielo.org/index.php/scieloONGhttps://preprints.scielo.org/index.php/scielo/oaiscielo.submission@scielo.orgopendoar:2023-09-25T01:15:34SciELO Preprints - Scientific Electronic Library Online (SCIELO)false
dc.title.none.fl_str_mv UNDERSTANDING GENERATIVE ARTIFICIAL INTELLIGENCE FROM THE LANGUAGE PERSPECTIVE
COMPREENDENDO A INTELIGÊNCIA ARTIFICIAL GENERATIVA NA PERSPECTIVA DA LÍNGUA
title UNDERSTANDING GENERATIVE ARTIFICIAL INTELLIGENCE FROM THE LANGUAGE PERSPECTIVE
spellingShingle UNDERSTANDING GENERATIVE ARTIFICIAL INTELLIGENCE FROM THE LANGUAGE PERSPECTIVE
Duque-Pereira, Ives da Silva
Inteligência Artificial Generativa
língua
Lingüística
ChatGPT
Generative Artificial Intelligence
Language
Linguistics
ChatGPT
title_short UNDERSTANDING GENERATIVE ARTIFICIAL INTELLIGENCE FROM THE LANGUAGE PERSPECTIVE
title_full UNDERSTANDING GENERATIVE ARTIFICIAL INTELLIGENCE FROM THE LANGUAGE PERSPECTIVE
title_fullStr UNDERSTANDING GENERATIVE ARTIFICIAL INTELLIGENCE FROM THE LANGUAGE PERSPECTIVE
title_full_unstemmed UNDERSTANDING GENERATIVE ARTIFICIAL INTELLIGENCE FROM THE LANGUAGE PERSPECTIVE
title_sort UNDERSTANDING GENERATIVE ARTIFICIAL INTELLIGENCE FROM THE LANGUAGE PERSPECTIVE
author Duque-Pereira, Ives da Silva
author_facet Duque-Pereira, Ives da Silva
Moura, Sergio Arruda de
author_role author
author2 Moura, Sergio Arruda de
author2_role author
dc.contributor.author.fl_str_mv Duque-Pereira, Ives da Silva
Moura, Sergio Arruda de
dc.subject.por.fl_str_mv Inteligência Artificial Generativa
língua
Lingüística
ChatGPT
Generative Artificial Intelligence
Language
Linguistics
ChatGPT
topic Inteligência Artificial Generativa
língua
Lingüística
ChatGPT
Generative Artificial Intelligence
Language
Linguistics
ChatGPT
description This article explores text generation through Generative Artificial Intelligence (Gen AI), focusing on the interactions between AI and Language. The research aims to elucidate the underlying mechanisms of text-to-text generation tools, such as ChatGPT, placing it within the broad field of AI, an interdisciplinary area that counts Linguistics as one of its pillars. The investigative journey spans from the theoretical foundations of AI, traversing fields like Natural Language Processing, Machine Learning, Deep Learning, and the revolutionary Transformer Architecture. The study emphasizes Distributed Semantics as the enabler for the emergence of Large Language Models. Highlighting the confluence of technology with natural language, the paper outlines the capabilities, limitations, and challenges of these models, especially in generating textual content from input commands, known as "prompts". In this context, our primary goal is to understand the fundamentals and workings of Generative AI and its intersections with Language, enabling the use of tools geared towards text-to-text generation, like ChatGPT.
publishDate 2023
dc.date.none.fl_str_mv 2023-10-06
dc.type.driver.fl_str_mv info:eu-repo/semantics/preprint
info:eu-repo/semantics/publishedVersion
format preprint
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://preprints.scielo.org/index.php/scielo/preprint/view/7077
10.1590/SciELOPreprints.7077
url https://preprints.scielo.org/index.php/scielo/preprint/view/7077
identifier_str_mv 10.1590/SciELOPreprints.7077
dc.language.iso.fl_str_mv por
language por
dc.relation.none.fl_str_mv https://preprints.scielo.org/index.php/scielo/article/view/7077/13284
dc.rights.driver.fl_str_mv Copyright (c) 2023 Ives da Silva Duque-Pereira, Sergio Arruda de Moura
https://creativecommons.org/licenses/by/4.0
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Copyright (c) 2023 Ives da Silva Duque-Pereira, Sergio Arruda de Moura
https://creativecommons.org/licenses/by/4.0
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv SciELO Preprints
SciELO Preprints
SciELO Preprints
publisher.none.fl_str_mv SciELO Preprints
SciELO Preprints
SciELO Preprints
dc.source.none.fl_str_mv reponame:SciELO Preprints
instname:Scientific Electronic Library Online (SCIELO)
instacron:SCI
instname_str Scientific Electronic Library Online (SCIELO)
instacron_str SCI
institution SCI
reponame_str SciELO Preprints
collection SciELO Preprints
repository.name.fl_str_mv SciELO Preprints - Scientific Electronic Library Online (SCIELO)
repository.mail.fl_str_mv scielo.submission@scielo.org
_version_ 1797047813596512256

Registros relacionados