Keynote Speakers

Abstract: Today, a wide range of extended reality (XR) devices enables us to collaborate in new ways. Social virtual reality (SVR) already allows millions of users to socialize, play games, and work together. Meanwhile, augmented reality (AR) devices hold the promise of wearable, all-day solutions that support both immersive and augmented experiences. A common vision for the future of collaboration involves users accessing shared virtual environments from anywhere, engaging with large groups, and creating personalized spaces to share with others. These systems are often referred to as "metaverses."

 In this talk, I will review some of the challenges in realising aspects of these metaverse systems. I will talk about the progress of collaborative systems and their interaction with the game engine systems that we’ve become used to. I will talk about how usability and accessibility are related to content generation and content customisation. I will talk about the role generative AI systems have in supporting users, both producers of virtual environments and also those who want to adapt existing systems for their use.

Abstract: In my talk, I will explore analytical and generative AI approaches designed to enhance both human-human and human-computer communication across diverse xVR-settings. The focus will be on developing believable communicative behaviors for avatars, including facial expressions and body postures, derived from neural models of human behavior. To complement the visual modality, I will present an evolutionary mechanism for customizing voices for virtual agents, leveraging a human-in-the-loop paradigm to intuitively explore latent speaker embedding spaces. Intrapersonal and interpersonal synchrony between modalities, such as the timing and coordination of verbal and non-verbal behaviors within and among interlocutors, will be discussed as a critical aspect of achieving natural and engaging interactions. Drawing on research projects conducted in my lab featuring social coaching and classroom meetings with virtual agents and avatars, health care assistants, and signing avatars, I will demonstrate how analytic and generative AI can foster authentic expression, build rapport between participants and overcome communication barriers. The talk will also address ethical considerations including strategies to mitigate the risk of reinforcing stereotypes when creating virtual agents.