Holograms engage in autonomous dialogue that responds to human input in real-time
Amazon Web Services (AWS) and Proto plan to showcase the world's first autonomous, generative conversations between AI-powered holograms at AWS re:Invent 2024.
The installation is set to show holograms of AWS leadership team members engaging in dynamic, AI-driven dialogs that respond to participant input in real time to demonstrate collaborative intelligence.
Representations of Swami Sivasubramanian, AWS vice president of AI and data, and Nandini Ramani, vice president of monitoring and observability, plan to converse without using a pre-scripted dialog.
It brings together Proto’s holographic communications technology, AI and personalized interaction, to generate immersive, contextual conversations between two AI entities.
“This activation represents more than just a technological demonstration—it's a glimpse into the future of human-AI interaction,” said Proto chief product and AI officer Raffi Kryszek.
“By combining Proto's groundbreaking holographic technology with AWS's advanced AI capabilities, we're showcasing how multiple AI agents can collaborate autonomously while maintaining natural, engaging dialogue.”
The installation represents the first demonstration of generative conversations between two AI-powered holograms and the integration of real-time participant hologram capture into an AI-driven narrative.
It brings together multiple AI modalities, including natural language processing, voice synthesis and lifelike holography. It also boasts multilingual capability with dynamic personality adaptation.
The technology behind the achievement includes Proto's AI Conversational Persona Technology, Amazon Bedrock with Anthropic's Claude and multiple AWS services including SageMaker, Rekognition and Translate.
HeyGen's ultra-realistic synchronous facial expressions and movement technology and Eleven Labs' voice synthesis technology make the holograms lifelike.
The technology could have future applications in fields such as education, healthcare, retail and corporate training, using AI to create more engaging, personalized interactions while maintaining natural conversation flow and emotional intelligence.
“The future of human-AI interaction will be increasingly collaborative and multimodal,” said Proto chief technology officer Edward Ginis.
“Our presentation at re:Invent shows how we can create experiences that are not just technologically advanced, but genuinely engaging and personally meaningful.”
You May Also Like
