VR Therapist [OpenAI]

^{Tags: Virtual Reality, Avatar, OpenAI, Mental health, Voice-to-text, Text-to-speech
Time : 3 days (2023)}

This prototype implements an animated avatar with ChatGPT responses as a VR therapist.
Core features:

• Speech-to-text (OpenAI-Whisper)
• Text-to-speech (AWS Polly)
• AI Responses (OpenAI-ChatGPT)
• Sound interactions (volume as input)
• Avatar animations

^References:

• ^{Text to Speech with AWS Polly in Unity}
• ^{ChatGPT in Unity}
  
• ^{Use Your Voice as Input in Unity}
  
• ^{Background music: Renda,David. “Tranquility.” Ambient Chill}

 
Softwares: Unity, Jetbrains Rider (C#), Revit
Tech Specification:

• Unity Engine [2021.3.23f1]
  
• XR Interaction Toolkiot [2.3.1]
  
• Oculus XR Plugin [3.3.0]
• Universal Render Pipeline [12.1.11]
  
• XR Plugin Management [4.3.3]
• OpenAI Unity [0.1.12] (including Whisper)
• AWS SDK for .NET [Standard 2.0 and 2.1]

Prototype Demo