PlayStation is reportedly utilizing characters from its largest franchises in an AI prototype.
A leaked video appeared to show PlayStation’s director of software program engineering, Sharwin Raghoebardajal, conversing with an early AI Aloy prototype.
The video – despatched to The Verge however since taken offline following a copyright declare from Sony – confirmed Raghoebardajal give a short tech demo of Aloy speaking with him voice prompts each inside the AI prototype and within the recreation Horizon Forbidden West itself.
“This is just a glimpse of what is possible,” Raghoebardajal mentioned, earlier than demonstrating how Aloy can provide gamers lore and background data upon request.
Whilst the voice doesn’t match that of the in-game Aloy, the character mannequin responds intelligently to questions with some synchronised facial expressions and motion. According to Raghoebardajal, that is solely an inside demo developed at Sony.
According to The Verge’s reporting, the AI system makes use of OpenAI’s whisper for speech-to-text and GPT-4 and Llama 3 for its communication and decision-making, while Sony’s personal Mockingbird tech powers the audio-to-facial animation and Emotional Voice Synthesis (EVS) powers speech.
Although the prototype was working on a PC, Sony believes it could actually run the identical tech on PS5 consoles with “little overhead.”
Last week, the voice talent team that brings Apex Legends’ characters to life in French reportedly refused to signal contracts that may authorize their voices to be used to practice AI.
