A majorization–minimization-based method for nonconvex inverse rig problems in facial animation

Detalhes bibliográficos
Autor(a) principal: Racković, Stevo
Data de Publicação: 2024
Outros Autores: Soares, Cláudia, Jakovetić, Dušan, Desnica, Zoranka
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10362/164432
Resumo: Funding Information: This work has received funding from the European Union’s Horizon 2020 research and innovation program under the Marie Skłodowska-Curie grant agreement No. 812912, from FCT IP strategic project NOVA LINCS (FCT UIDB/04516/2020) and project DSAIPA/AI/0087/2018. The work has also been supported in part by the Ministry of Education, Science and Technological Development of the Republic of Serbia (Grant No. 451-03-9/2021-14/200125) and Provincial Secretariat for Higher Education and Scientific Research (Grant No. 142-451-2593/2021-01/2). Funding Open access funding provided by FCT|FCCN (b-on). Publisher Copyright: © 2023, The Author(s).
id RCAP_29021d4a849bdeb20af57d0e100a8773
oai_identifier_str oai:run.unl.pt:10362/164432
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling A majorization–minimization-based method for nonconvex inverse rig problems in facial animationalgorithm derivationInverse rigMajorization–MinimizationQuadratic blendshape modelBusiness, Management and Accounting (miscellaneous)Control and OptimizationFunding Information: This work has received funding from the European Union’s Horizon 2020 research and innovation program under the Marie Skłodowska-Curie grant agreement No. 812912, from FCT IP strategic project NOVA LINCS (FCT UIDB/04516/2020) and project DSAIPA/AI/0087/2018. The work has also been supported in part by the Ministry of Education, Science and Technological Development of the Republic of Serbia (Grant No. 451-03-9/2021-14/200125) and Provincial Secretariat for Higher Education and Scientific Research (Grant No. 142-451-2593/2021-01/2). Funding Open access funding provided by FCT|FCCN (b-on). Publisher Copyright: © 2023, The Author(s).Automated methods for facial animation are a necessary tool in the modern industry since the standard blendshape head models consist of hundreds of controllers, and a manual approach is painfully slow. Different solutions have been proposed that produce output in real-time or generalize well for different face topologies. However, all these prior works consider a linear approximation of the blendshape function and hence do not provide a high-enough level of detail for modern realistic human face reconstruction. A second-order blendshape approximation leads to higher fidelity facial animation but generates a non-linear least squares optimization problem with high dimensionality. We derive a method for solving the inverse rig in blendshape animation using quadratic corrective terms, which increases accuracy. At the same time, due to the proposed construction of the objective function, it yields a sparser estimated weight vector compared to the state-of-the-art methods. The former feature means lower demand for subsequent manual corrections of the solution, while the latter indicates that the manual modifications are also easier to include. Our algorithm is iterative and employs a Majorization–Minimization paradigm to cope with the increased complexity produced by adding corrective terms. The surrogate function is easy to solve and allows for further parallelization on the component level within each iteration. This paper is complementary to an accompanying paper (Racković et al. arxiv preprint. https://arxiv.org/abs/2302.04843 , 2023) where we provide detailed experimental results and discussion, including highly-realistic animation data, and show a clear superiority of the results compared to the state-of-the-art methods.DI - Departamento de InformáticaRUNRacković, StevoSoares, CláudiaJakovetić, DušanDesnica, Zoranka2024-03-05T00:16:05Z2024-032024-03-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/article15application/pdfhttp://hdl.handle.net/10362/164432eng1862-4472PURE: 84311299https://doi.org/10.1007/s11590-023-02012-winfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-03-11T05:52:12Zoai:run.unl.pt:10362/164432Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-20T04:00:10.295248Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv A majorization–minimization-based method for nonconvex inverse rig problems in facial animation
algorithm derivation
title A majorization–minimization-based method for nonconvex inverse rig problems in facial animation
spellingShingle A majorization–minimization-based method for nonconvex inverse rig problems in facial animation
Racković, Stevo
Inverse rig
Majorization–Minimization
Quadratic blendshape model
Business, Management and Accounting (miscellaneous)
Control and Optimization
title_short A majorization–minimization-based method for nonconvex inverse rig problems in facial animation
title_full A majorization–minimization-based method for nonconvex inverse rig problems in facial animation
title_fullStr A majorization–minimization-based method for nonconvex inverse rig problems in facial animation
title_full_unstemmed A majorization–minimization-based method for nonconvex inverse rig problems in facial animation
title_sort A majorization–minimization-based method for nonconvex inverse rig problems in facial animation
author Racković, Stevo
author_facet Racković, Stevo
Soares, Cláudia
Jakovetić, Dušan
Desnica, Zoranka
author_role author
author2 Soares, Cláudia
Jakovetić, Dušan
Desnica, Zoranka
author2_role author
author
author
dc.contributor.none.fl_str_mv DI - Departamento de Informática
RUN
dc.contributor.author.fl_str_mv Racković, Stevo
Soares, Cláudia
Jakovetić, Dušan
Desnica, Zoranka
dc.subject.por.fl_str_mv Inverse rig
Majorization–Minimization
Quadratic blendshape model
Business, Management and Accounting (miscellaneous)
Control and Optimization
topic Inverse rig
Majorization–Minimization
Quadratic blendshape model
Business, Management and Accounting (miscellaneous)
Control and Optimization
description Funding Information: This work has received funding from the European Union’s Horizon 2020 research and innovation program under the Marie Skłodowska-Curie grant agreement No. 812912, from FCT IP strategic project NOVA LINCS (FCT UIDB/04516/2020) and project DSAIPA/AI/0087/2018. The work has also been supported in part by the Ministry of Education, Science and Technological Development of the Republic of Serbia (Grant No. 451-03-9/2021-14/200125) and Provincial Secretariat for Higher Education and Scientific Research (Grant No. 142-451-2593/2021-01/2). Funding Open access funding provided by FCT|FCCN (b-on). Publisher Copyright: © 2023, The Author(s).
publishDate 2024
dc.date.none.fl_str_mv 2024-03-05T00:16:05Z
2024-03
2024-03-01T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10362/164432
url http://hdl.handle.net/10362/164432
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv 1862-4472
PURE: 84311299
https://doi.org/10.1007/s11590-023-02012-w
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv 15
application/pdf
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799138177733099520

Registros relacionados