Special session: how much quality is enough quality? A case for acceptability in approximate designs
Autor(a) principal: | |
---|---|
Data de Publicação: | 2021 |
Outros Autores: | , , |
Tipo de documento: | Artigo de conferência |
Idioma: | eng |
Título da fonte: | Repositório Institucional da UTFPR (da Universidade Tecnológica Federal do Paraná (RIUT)) |
Texto Completo: | http://repositorio.utfpr.edu.br/jspui/handle/1/29755 |
Resumo: | Approximate systems are designed to offer improved efficiency with potentially reduced quality of results. Quality of output in these systems is typically quantified in comparison to a precise result using metrics such as RMSE, MAE, PSNR, or application-specific metrics such as structural similarity of images (SSIM). Furthermore, systems are typically designed to maximize efficiency for a given minimum quality requirement. It is often difficult to determine what this quality requirement should be for an application, let alone a system. Thus, a fixed quality requirement may be overly conservative, and leave optimization opportunities on the table. In this work, we present a different approach to evaluate approximate systems based on the usefulness of results instead of quality. Our method qualitatively determines the acceptability of approximate results within different processing pipelines. To demonstrate the method, we implement three image and signal processing applications featuring scenarios of image classification, image recognition, and frequency estimation. Our results show that designing approximate systems to guarantee acceptability can produce up to 20% more valid results than the conservative quality thresholds commonly adopted in the literature, allowing for higher error rates and, consequently, lower energy cost. |
id |
UTFPR-12_e6ec0c2eb746f69c99393dc55f31aa39 |
---|---|
oai_identifier_str |
oai:repositorio.utfpr.edu.br:1/29755 |
network_acronym_str |
UTFPR-12 |
network_name_str |
Repositório Institucional da UTFPR (da Universidade Tecnológica Federal do Paraná (RIUT)) |
repository_id_str |
|
spelling |
2022-09-27T17:01:34Z50002022-09-27T17:01:34Z2021-10-24FELZMANN, Isaías; FABRÍCIO FILHO, João; OLIVEIRA, Juliane Regina de; WANNER, Lucas. Special session: how much quality is enough quality? A case for acceptability in approximate designs. In: INTERNATIONAL CONFERENCE ON COMPUTER DESIGN, 39., 2021, Storrs. Anais eletrônicos […]. Los Alamitos: IEEE Computer Society, Conference Publishing Services, 2021. p. 5-8. DOI: 10.1109/ICCD53106.2021.00013. Disponível em: https://ieeexplore.ieee.org/document/9643638. Acesso em: 09 jun. 2022.97816654321912576-6996http://repositorio.utfpr.edu.br/jspui/handle/1/2975510.1109/ICCD53106.2021.00013Approximate systems are designed to offer improved efficiency with potentially reduced quality of results. Quality of output in these systems is typically quantified in comparison to a precise result using metrics such as RMSE, MAE, PSNR, or application-specific metrics such as structural similarity of images (SSIM). Furthermore, systems are typically designed to maximize efficiency for a given minimum quality requirement. It is often difficult to determine what this quality requirement should be for an application, let alone a system. Thus, a fixed quality requirement may be overly conservative, and leave optimization opportunities on the table. In this work, we present a different approach to evaluate approximate systems based on the usefulness of results instead of quality. Our method qualitatively determines the acceptability of approximate results within different processing pipelines. To demonstrate the method, we implement three image and signal processing applications featuring scenarios of image classification, image recognition, and frequency estimation. Our results show that designing approximate systems to guarantee acceptability can produce up to 20% more valid results than the conservative quality thresholds commonly adopted in the literature, allowing for higher error rates and, consequently, lower energy cost.engInternational Conference on Computer Designhttps://ieeexplore.ieee.org/document/9643638https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9643822info:eu-repo/semantics/embargoedAccessCNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAOTeoria da aproximaçãoImagens digitaisProcessamento de sinaisEnergia - ConsumoApproximation theoryDigital imagesSignal processingEnergy consumptionSpecial session: how much quality is enough quality? A case for acceptability in approximate designsinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/conferenceObjectCampo MouraoEstados unidos39Felzmann, Isaías BittencourtFabrício Filho, JoãoOliveira, Juliane Regina deWanner, Lucas Franciscoreponame:Repositório Institucional da UTFPR (da Universidade Tecnológica Federal do Paraná (RIUT))instname:Universidade Tecnológica Federal do Paraná (UTFPR)instacron:UTFPRORIGINALqualityacceptabilityapproximatedesigns.pdfqualityacceptabilityapproximatedesigns.pdfapplication/pdf1816301http://repositorio.utfpr.edu.br:8080/jspui/bitstream/1/29755/1/qualityacceptabilityapproximatedesigns.pdf77a6876bf7a3deb65ee736c20fc33765MD51LICENSElicense.txtlicense.txttext/plain; charset=utf-81290http://repositorio.utfpr.edu.br:8080/jspui/bitstream/1/29755/2/license.txtb9d82215ab23456fa2d8b49c5df1b95bMD52TEXTqualityacceptabilityapproximatedesigns.pdf.txtqualityacceptabilityapproximatedesigns.pdf.txtExtracted texttext/plain20729http://repositorio.utfpr.edu.br:8080/jspui/bitstream/1/29755/3/qualityacceptabilityapproximatedesigns.pdf.txt5200c026a8af031496945f0e95d99824MD53THUMBNAILqualityacceptabilityapproximatedesigns.pdf.jpgqualityacceptabilityapproximatedesigns.pdf.jpgGenerated Thumbnailimage/jpeg1806http://repositorio.utfpr.edu.br:8080/jspui/bitstream/1/29755/4/qualityacceptabilityapproximatedesigns.pdf.jpg8382d77334ca506967482dbc6a5c0f43MD541/297552022-09-28 03:07:13.735oai:repositorio.utfpr.edu.br:1/29755TmEgcXVhbGlkYWRlIGRlIHRpdHVsYXIgZG9zIGRpcmVpdG9zIGRlIGF1dG9yIGRhIHB1YmxpY2HDp8OjbywgYXV0b3Jpem8gYSBVVEZQUiBhIHZlaWN1bGFyLCAKYXRyYXbDqXMgZG8gUG9ydGFsIGRlIEluZm9ybWHDp8OjbyBlbSBBY2Vzc28gQWJlcnRvIChQSUFBKSBlIGRvcyBDYXTDoWxvZ29zIGRhcyBCaWJsaW90ZWNhcyAKZGVzdGEgSW5zdGl0dWnDp8Ojbywgc2VtIHJlc3NhcmNpbWVudG8gZG9zIGRpcmVpdG9zIGF1dG9yYWlzLCBkZSBhY29yZG8gY29tIGEgTGVpIG5vIDkuNjEwLzk4LCAKbyB0ZXh0byBkZXN0YSBvYnJhLCBvYnNlcnZhbmRvIGFzIGNvbmRpw6fDtWVzIGRlIGRpc3BvbmliaWxpemHDp8OjbyByZWdpc3RyYWRhcyBubyBpdGVtIDQgZG8gCuKAnFRlcm1vIGRlIEF1dG9yaXphw6fDo28gcGFyYSBQdWJsaWNhw6fDo28gZGUgVHJhYmFsaG9zIGRlIENvbmNsdXPDo28gZGUgQ3Vyc28gZGUgR3JhZHVhw6fDo28gZSAKRXNwZWNpYWxpemHDp8OjbywgRGlzc2VydGHDp8O1ZXMgZSBUZXNlcyBubyBQb3J0YWwgZGUgSW5mb3JtYcOnw6NvIGUgbm9zIENhdMOhbG9nb3MgRWxldHLDtG5pY29zIGRvIApTaXN0ZW1hIGRlIEJpYmxpb3RlY2FzIGRhIFVURlBS4oCdLCBwYXJhIGZpbnMgZGUgbGVpdHVyYSwgaW1wcmVzc8OjbyBlL291IGRvd25sb2FkLCB2aXNhbmRvIGEgCmRpdnVsZ2HDp8OjbyBkYSBwcm9kdcOnw6NvIGNpZW50w61maWNhIGJyYXNpbGVpcmEuCgogIEFzIHZpYXMgb3JpZ2luYWlzIGUgYXNzaW5hZGFzIHBlbG8ocykgYXV0b3IoZXMpIGRvIOKAnFRlcm1vIGRlIEF1dG9yaXphw6fDo28gcGFyYSBQdWJsaWNhw6fDo28gZGUgClRyYWJhbGhvcyBkZSBDb25jbHVzw6NvIGRlIEN1cnNvIGRlIEdyYWR1YcOnw6NvIGUgRXNwZWNpYWxpemHDp8OjbywgRGlzc2VydGHDp8O1ZXMgZSBUZXNlcyBubyBQb3J0YWwgCmRlIEluZm9ybWHDp8OjbyBlIG5vcyBDYXTDoWxvZ29zIEVsZXRyw7RuaWNvcyBkbyBTaXN0ZW1hIGRlIEJpYmxpb3RlY2FzIGRhIFVURlBS4oCdIGUgZGEg4oCcRGVjbGFyYcOnw6NvIApkZSBBdXRvcmlh4oCdIGVuY29udHJhbS1zZSBhcnF1aXZhZGFzIG5hIEJpYmxpb3RlY2EgZG8gQ8OibXB1cyBubyBxdWFsIG8gdHJhYmFsaG8gZm9pIGRlZmVuZGlkby4gCk5vIGNhc28gZGUgcHVibGljYcOnw7VlcyBkZSBhdXRvcmlhIGNvbGV0aXZhIGUgbXVsdGljw6JtcHVzLCBvcyBkb2N1bWVudG9zIGZpY2Fyw6NvIHNvYiBndWFyZGEgZGEgCkJpYmxpb3RlY2EgY29tIGEgcXVhbCBvIOKAnHByaW1laXJvIGF1dG9y4oCdIHBvc3N1YSB2w61uY3Vsby4KRepositório de PublicaçõesPUBhttp://repositorio.utfpr.edu.br:8080/oai/requestopendoar:2022-09-28T06:07:13Repositório Institucional da UTFPR (da Universidade Tecnológica Federal do Paraná (RIUT)) - Universidade Tecnológica Federal do Paraná (UTFPR)false |
dc.title.pt_BR.fl_str_mv |
Special session: how much quality is enough quality? A case for acceptability in approximate designs |
title |
Special session: how much quality is enough quality? A case for acceptability in approximate designs |
spellingShingle |
Special session: how much quality is enough quality? A case for acceptability in approximate designs Felzmann, Isaías Bittencourt CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO Teoria da aproximação Imagens digitais Processamento de sinais Energia - Consumo Approximation theory Digital images Signal processing Energy consumption |
title_short |
Special session: how much quality is enough quality? A case for acceptability in approximate designs |
title_full |
Special session: how much quality is enough quality? A case for acceptability in approximate designs |
title_fullStr |
Special session: how much quality is enough quality? A case for acceptability in approximate designs |
title_full_unstemmed |
Special session: how much quality is enough quality? A case for acceptability in approximate designs |
title_sort |
Special session: how much quality is enough quality? A case for acceptability in approximate designs |
author |
Felzmann, Isaías Bittencourt |
author_facet |
Felzmann, Isaías Bittencourt Fabrício Filho, João Oliveira, Juliane Regina de Wanner, Lucas Francisco |
author_role |
author |
author2 |
Fabrício Filho, João Oliveira, Juliane Regina de Wanner, Lucas Francisco |
author2_role |
author author author |
dc.contributor.author.fl_str_mv |
Felzmann, Isaías Bittencourt Fabrício Filho, João Oliveira, Juliane Regina de Wanner, Lucas Francisco |
dc.subject.cnpq.fl_str_mv |
CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO |
topic |
CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO Teoria da aproximação Imagens digitais Processamento de sinais Energia - Consumo Approximation theory Digital images Signal processing Energy consumption |
dc.subject.por.fl_str_mv |
Teoria da aproximação Imagens digitais Processamento de sinais Energia - Consumo Approximation theory Digital images Signal processing Energy consumption |
description |
Approximate systems are designed to offer improved efficiency with potentially reduced quality of results. Quality of output in these systems is typically quantified in comparison to a precise result using metrics such as RMSE, MAE, PSNR, or application-specific metrics such as structural similarity of images (SSIM). Furthermore, systems are typically designed to maximize efficiency for a given minimum quality requirement. It is often difficult to determine what this quality requirement should be for an application, let alone a system. Thus, a fixed quality requirement may be overly conservative, and leave optimization opportunities on the table. In this work, we present a different approach to evaluate approximate systems based on the usefulness of results instead of quality. Our method qualitatively determines the acceptability of approximate results within different processing pipelines. To demonstrate the method, we implement three image and signal processing applications featuring scenarios of image classification, image recognition, and frequency estimation. Our results show that designing approximate systems to guarantee acceptability can produce up to 20% more valid results than the conservative quality thresholds commonly adopted in the literature, allowing for higher error rates and, consequently, lower energy cost. |
publishDate |
2021 |
dc.date.issued.fl_str_mv |
2021-10-24 |
dc.date.accessioned.fl_str_mv |
2022-09-27T17:01:34Z |
dc.date.available.fl_str_mv |
2022-09-27T17:01:34Z 5000 |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/conferenceObject |
format |
conferenceObject |
status_str |
publishedVersion |
dc.identifier.citation.fl_str_mv |
FELZMANN, Isaías; FABRÍCIO FILHO, João; OLIVEIRA, Juliane Regina de; WANNER, Lucas. Special session: how much quality is enough quality? A case for acceptability in approximate designs. In: INTERNATIONAL CONFERENCE ON COMPUTER DESIGN, 39., 2021, Storrs. Anais eletrônicos […]. Los Alamitos: IEEE Computer Society, Conference Publishing Services, 2021. p. 5-8. DOI: 10.1109/ICCD53106.2021.00013. Disponível em: https://ieeexplore.ieee.org/document/9643638. Acesso em: 09 jun. 2022. |
dc.identifier.uri.fl_str_mv |
http://repositorio.utfpr.edu.br/jspui/handle/1/29755 |
dc.identifier.isbn.pt_BR.fl_str_mv |
9781665432191 |
dc.identifier.issn.pt_BR.fl_str_mv |
2576-6996 |
dc.identifier.doi.pt_BR.fl_str_mv |
10.1109/ICCD53106.2021.00013 |
identifier_str_mv |
FELZMANN, Isaías; FABRÍCIO FILHO, João; OLIVEIRA, Juliane Regina de; WANNER, Lucas. Special session: how much quality is enough quality? A case for acceptability in approximate designs. In: INTERNATIONAL CONFERENCE ON COMPUTER DESIGN, 39., 2021, Storrs. Anais eletrônicos […]. Los Alamitos: IEEE Computer Society, Conference Publishing Services, 2021. p. 5-8. DOI: 10.1109/ICCD53106.2021.00013. Disponível em: https://ieeexplore.ieee.org/document/9643638. Acesso em: 09 jun. 2022. 9781665432191 2576-6996 10.1109/ICCD53106.2021.00013 |
url |
http://repositorio.utfpr.edu.br/jspui/handle/1/29755 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.ispartof.pt_BR.fl_str_mv |
International Conference on Computer Design |
dc.relation.uri.pt_BR.fl_str_mv |
https://ieeexplore.ieee.org/document/9643638 |
dc.rights.driver.fl_str_mv |
https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9643822 info:eu-repo/semantics/embargoedAccess |
rights_invalid_str_mv |
https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9643822 |
eu_rights_str_mv |
embargoedAccess |
dc.publisher.none.fl_str_mv |
Campo Mourao |
dc.publisher.country.fl_str_mv |
Estados unidos |
publisher.none.fl_str_mv |
Campo Mourao |
dc.source.none.fl_str_mv |
reponame:Repositório Institucional da UTFPR (da Universidade Tecnológica Federal do Paraná (RIUT)) instname:Universidade Tecnológica Federal do Paraná (UTFPR) instacron:UTFPR |
instname_str |
Universidade Tecnológica Federal do Paraná (UTFPR) |
instacron_str |
UTFPR |
institution |
UTFPR |
reponame_str |
Repositório Institucional da UTFPR (da Universidade Tecnológica Federal do Paraná (RIUT)) |
collection |
Repositório Institucional da UTFPR (da Universidade Tecnológica Federal do Paraná (RIUT)) |
bitstream.url.fl_str_mv |
http://repositorio.utfpr.edu.br:8080/jspui/bitstream/1/29755/1/qualityacceptabilityapproximatedesigns.pdf http://repositorio.utfpr.edu.br:8080/jspui/bitstream/1/29755/2/license.txt http://repositorio.utfpr.edu.br:8080/jspui/bitstream/1/29755/3/qualityacceptabilityapproximatedesigns.pdf.txt http://repositorio.utfpr.edu.br:8080/jspui/bitstream/1/29755/4/qualityacceptabilityapproximatedesigns.pdf.jpg |
bitstream.checksum.fl_str_mv |
77a6876bf7a3deb65ee736c20fc33765 b9d82215ab23456fa2d8b49c5df1b95b 5200c026a8af031496945f0e95d99824 8382d77334ca506967482dbc6a5c0f43 |
bitstream.checksumAlgorithm.fl_str_mv |
MD5 MD5 MD5 MD5 |
repository.name.fl_str_mv |
Repositório Institucional da UTFPR (da Universidade Tecnológica Federal do Paraná (RIUT)) - Universidade Tecnológica Federal do Paraná (UTFPR) |
repository.mail.fl_str_mv |
|
_version_ |
1805923159492263936 |