ElevenLabs and NVIDIA ACE Revolutionize Multilingual AI Voice Technology
In a groundbreaking development at Computex, ElevenLabs has showcased its cutting-edge multilingual AI voice technology in collaboration with NVIDIA ACE. According to ElevenLabs, this innovation was prominently displayed during the keynote address delivered by NVIDIA founder and CEO Jensen Huang, who used the AI technology to narrate several chapters in both English and Mandarin.
Transforming Keynote Presentations
Traditionally, delivering keynote presentations in multiple languages has required live translators or subtitles. However, ElevenLabs' AI voice technology changes the game by preserving the speaker's unique voice traits while translating the content. Jensen Huang's keynote at Computex exemplified this capability, as he managed to create an AI voice on ElevenLabs' platform in under an hour with just seven minutes of recorded audio.
This use of synthetic voice technology is a significant milestone, making content more accessible to a global audience and opening up new possibilities for delivering immersive experiences. The ability to maintain the speaker's voice characteristics in different languages ensures a more engaging and authentic presentation.
Enhancing Video Game NPCs
Beyond keynote presentations, the partnership between ElevenLabs and NVIDIA extends to the realm of video games. The goal is to create dynamic, human-like non-playable characters (NPCs) that react and adapt to players, providing a more immersive and lifelike gaming experience. Traditionally, NPC interactions have been brief and scripted, but this collaboration aims to revolutionize these interactions.
NVIDIA ACE, a suite of technologies designed to bring digital humans to life with generative AI, plays a crucial role in this endeavor. The ACE NIM microservices serve as the building blocks for digital humans, AI NPCs, and interactive avatars. Developers have the flexibility to integrate individual or all ACE NIM microservices into their products, tools, services, or games, enhancing the overall user experience.
Industry Impact and Future Prospects
The impact of this technology was showcased in the Covert Protocol tech demo, where ElevenLabs' voice AI powered NPC interactions. Developers, journalists, and influencers who experienced the demo highlighted the realistic and engaging nature of the characters, praising their lifelike voices for enhancing player immersion.
Mati Staniszewski, CEO and co-founder at ElevenLabs, emphasized the transformative potential of this collaboration, stating, “The work NVIDIA and ElevenLabs are doing is reshaping our interactions with the world and the content that can be created – from real-time interactions and gaming to presentations and accessibility. NVIDIA has built the infrastructure for the generative AI revolution with accelerated computing; we are building the technology to generate lifelike content across any language, in a scalable, emotional, and personalized way.”
This collaboration between ElevenLabs and NVIDIA ACE heralds a new era in AI voice technology, promising more immersive and accessible experiences across various domains. As the technology continues to evolve, it is set to revolutionize not just gaming and presentations but potentially all forms of digital human interaction.