Nvidia introduced a range of AI innovations during its CES 2024 showcase, focusing on expanding the accessibility of generative AI for developers. The company showcased new additions to its ACE suite of technologies, particularly tools designed to assist developers in creating interactive avatars using AI models.
The featured avatar-focused tools empower users to construct assistants with expressive facial animations and multilingual speech capabilities. Keita Iida, vice president of developer relations at Nvidia, emphasized the impact of these advancements, stating, "ACE opens up new possibilities for game developers by populating their worlds with lifelike digital characters while removing the need for pre-scripted dialogue, delivering greater in-game immersion."
A notable demonstration involved Nvidia's collaboration with Convai, a conversational AI startup, showcasing digital avatars engaged in conversation using generative AI. This interactive scenario resembled the environment of the popular video game Cyberpunk 2077.
The demonstration highlighted the process: the player's voice input underwent automatic speech recognition, converting it into text. Subsequently, a language model generated the character's response, which was then vocalized using a text-to-speech model. The final touch involved an animation model creating a realistic lip sync for the dynamic character integrated into the game scene.
In addition to advancements in gaming AI, Nvidia announced a collaboration with Getty for a new stock image solution. IStock by Getty is launching a generative AI service built on Nvidia Picasso, a cloud-based platform for developing generative visual solutions. This service allows users to generate 4K imagery from text, leveraging an AI model trained on Getty Images' extensive library. The iStock generative AI service is accessible at istock.com, with advanced editing features anticipated through API integration.
Nvidia also shared plans for the launch of RTX Remix, an application for Omniverse enabling gamers to create mods for their favorite games. Originally unveiled at the GTC event in 2022, RTX Remix will enter open beta at the end of January. The application has already been employed to remaster games like Portal and is currently enhancing the graphical fidelity of the iconic title Half-Life 2, demonstrating its versatility in revitalizing gaming experiences.
