NVIDIA wows attendees at GTC 24 with Covert Protocol demo powered by Inworld AI
During the GTC 2024 keynote, NVIDIA CEO Jensen Huang wowed attendees with a new AI-powered NPC demo, called Covert Protocol.
This demo differs from the Kairos demo presented at CES 2024, as Kairos is based on Convai technology, while Covert Protocol is based on Inworld AI, another leading NPC character development platform used specifically in games.
In November 2023, Microsoft announced a partnership with Inworld AI to develop a cross-platform toolkit featuring an AI-powered character playback engine. Now, Inworld technology has been combined with the NVIDIA ACE Gaming Engine that was unveiled last year at Computex.
How it works?
NVIDIA ACE aims to provide a fully interactive environment for human subjects within games. This environment includes:
png.webp)
Riva: Enables automatic speech recognition (ASR) and text-to-speech (TTS) technologies using the customizable Nemotron Language Model (LLM).
NeMo Guardrails: Allows developers to juggle player and sub-character interactions within scenes.
Audio2Face: Automatically creates facial expressions based on audio files.
On the other hand, Inworld helps developers define personality traits for NPC characters:
Knowledge
perception
Objectives
Long-term memory
relations
And others
Kellan Gibbs, CEO of Inworld AI, commented on the collaboration:
“Combining NVIDIA ACE services and Inworld Engine allows developers to create digital characters that can drive dynamic narratives, opening up new possibilities for how players interact, reason and play.”
