VSE knjižnice (vzajemna bibliografsko-kataložna baza podatkov COBIB.SI)
  • Advanced Objective Evaluation Metrics for Gesture Generation in Embodied Conversational Agents : doktoral dissertation
    Crnek, Karlo
    This doctoral thesis addresses the challenge of generating natural and expressive co-speech gestures for embodied conversational agents (ECAs), specifically focusing on developing reliable objective ... evaluation methods and controllable gesture generation models. Current approaches to gesture generation often rely on subjective evaluations, which are costly, time-consuming, and challenging to scale. To address this, we systematically analyze objective evaluation metrics by validating their correlation with large-scale subjective studies. We investigate feature extractors and distance measures within similarity-based evaluation paradigms. We compare hand-crafted and neural network-based extractors under different training setups, including within-dataset and cross-dataset paradigms. Our results show that neural feature extractors often achieve stronger correlations with subjective evaluation studies, though their performance depends on training data and architecture. Interestingly, some hand-crafted feature extractors also achieve a high correlation with subjective studies. More specifically, the proposed CNN-based feature extractor trained on the task of sync classification achieved a correlation of 0.809. In contrast, the best-performing hand-crafted Kinetic-Hellinger achieved a correlation of 0.7. Additionally, we empirically demonstrate that the choice of distance measures significantly impacts metric performance. Based on these findings, we integrate the Kinetic-Hellinger distance into an evaluation-driven development (EDD) workflow to guide the creation of a Transformer-based controllable gesture generation model. This model supports selective activation of control signals, enabling fine-grained manipulation of gesture properties while maintaining motion naturalness. Overall, this work establishes validated objective evaluation practices and demonstrates their utility for developing more natural and expressive ECAs.
    Vrsta gradiva - disertacija ; neleposlovje za odrasle
    Založništvo in izdelava - Maribor : [K. Crnek], 2025
    Jezik - angleški
    COBISS.SI-ID - 269719811

    Povezava(-e):

    Digitalna knjižnica Univerze v Mariboru – DKUM

Knjižnica/institucija Kraj Akronim Za izposojo Druga zaloga
Knjižnica tehniških fakultet, Maribor Maribor KTFMB v čitalnico 1 izv.
loading ...
loading ...
loading ...

Vnos na polico