HTC at SIGGRAPH: Elevating VIVERSE Avatar Interactions with NVIDIA ACE
Metaverse | Extended Reality | Artificial Intelligence | Business
5 minutes read
HTC’s spatial computing platform, VIVERSE, was built to deliver the most meaningful, immersive experiences for its users. At SIGGRAPH 2024, we are thrilled to announce that we are collaborating with NVIDIA to demo an integration of NVIDIA ACE into VIVERSE Avatar, enhancing the realism and authenticity of interactions in extended reality (XR).
VIVERSE Avatar is an open avatar creation system, not only providing a range of full-body avatar styles, but also allowing users to import VRM 3D model avatars to create their own identity in VIVERSE.
NVIDIA ACE is a suite of technologies that help bring digital humans to life. One of these technologies, the NVIDIA Audio2Face NIM microservice, matches spoken audio to a wide range of facial expressions based solely on the tone of voice. Attendees at the NVIDIA Inception Startups Innovation Zone can experience a live demo of the ACE NIM integration with VIVERSE Avatar on the VIVE XR Elite headset.
The Audio2Face NIM supports multiple languages and can be applied to various avatar styles, from realistic to whimsical. This versatility aligns with VIVERSE’s open-platform approach, which allows users to import avatars using the open VRM standard or create their own cartoonish avatars from scratch. With the incorporation of the Audio2Face NIM into VIVERSE Avatar, remote teams can collaborate more naturally, addressing employee isolation—a significant issue experienced by more than 50% of remote employees, according to Forbes. The demo integration of ACE underscores VIVERSE’s dedication to continually enhancing its collaboration and productivity features. Earlier this month, VIVERSE launched a standalone service for Polygon Streaming, a low-latency, high-fidelity 3D model visualization technology. Polygon Streaming is versatile and can be used in various fields, such as architecture and design, where 3D models can be visualized.
“The integration of NVIDIA ACE NIM microservices brings greater nuance to our virtual avatar technologies, helping overcome one of the biggest challenges in fostering collaboration in XR,” said Joseph Lin, General Manager at VIVERSE. “We’re excited to join this year’s Innovation Zone and show the combined impact of HTC VIVE and NVIDIA’s technologies working together.”
“Unlocking the potential for more dynamic interactions has been a key pursuit in XR,” said Seth Schneider, Director of Digital Human Product Management at NVIDIA. “The integration of the NVIDIA Audio2Face NIM with VIVERSE Avatar enables dynamic lip-syncing, enhancing your conversational experiences.”
HTC’s immersive XR platforms have demonstrated substantial value across industries. For instance, HTC previously collaborated with Bell Helicopter and Hard Rock Hotel, who used our VR headsets for design and prototyping. These partnerships have significantly accelerated project timelines and reduced costs, saving years of time and millions of dollars.
Immersive XR platforms like VIVERSE offer tremendous value for organizations by fostering better collaboration, providing advanced XR training, and creating more engaging virtual environments. For example, remote teams can interact in virtual meetings, enhancing communication and productivity. Additionally, XR training can simulate real-world scenarios, offering a safe and effective way for employees to develop skills.
Previously, HTC collaborated with NVIDIA on an integration of NVIDIA CloudXR for the VIVE Focus 3 headset. This integration allowed for seamless remote rendering of XR applications, empowering users to design, modify, and collaborate on large assets in an immersive environment.
HTC aims to continue providing the most effective and cutting-edge immersive solutions to users worldwide. For more information, please visit the VIVERSE website, and try the NVIDIA Audio2Face preview now.
