Skip to content

Allows you to controll your avatar parameters in VRChat via voice. Also provides a voice to chatbox mode. "I cast fireball..."

License

Notifications You must be signed in to change notification settings

DeMuenu/VoiceToOSC

Repository files navigation


Voice to VRChat-OSC

An Application for VRChat, that allows you to simply map voice commands to avatar toggles.
Report Bug  ·  Request Feature


📖 About

This tool allows you to define a voice command, which you can link to multiple OSC actions. The program allows setting bool/int/floats. For bool's you can enable a toggle mode, which flips the bool every time you speak the associated command. There is also a voice to chatbox mode, with live preview and triggerwords.

All voice recognition runs locally. With a voice recognition model by VOSK, it uses around 300 MB of RAM at Runtime. The Tool doesn't connect to any service except for the locally running VRChat OSC connection and a update check when starting the programm.

🛑 Discontinued

I've lost motivation to work on this project, so don't expect any updates😑

🏗️ Built With

  • Language/Framework: Python 3.13
  • Key Libraries / Tools:

💡 Planned features

  • In sentence recognition → v0.0.2
  • Delayed actions → v0.0.2
  • Chat box Integration → v0.0.3
  • Modular chat box, example: "chat(trigger-word) hello there (to be written to the chat box)" → v0.0.3
  • JSON per avatar config in/export
  • En/disable voice recognition via OSC-Parameter
  • Optionally listen to game sound, to allow others to control your avatar
  • Emotion detection, to be able to map emotions to facial expressions
  • Action recording
  • A local TTS (text to speech) model.
  • STTTS (speech to text to speech)

⚙️ Installation

Download the latest installer from releases and install it to a non-admin folder. (The standard path works)

To update the program, just install the new version into the same folder (I'd recommend to just always keep the standard path). It will override the .exe and internals, but keep your config, settings and models.

🚀 Usage

You need to turn on OSC in the Action Menu under OSC > Enabled.

To see how to configure Commands and TextToChatbox, see the wiki.

Support

If something is broken please submit a bug report here Bug Report or send me a message on Discord @demuenu

About

Allows you to controll your avatar parameters in VRChat via voice. Also provides a voice to chatbox mode. "I cast fireball..."

Topics

Resources

License

Stars

Watchers

Forks

Languages