Skip to content

Fix for long text inputs, send text as payload, not url parameter. #149

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
bioluminesceme wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Fix for long text inputs, send text as payload, not url parameter. #149

bioluminesceme wants to merge 1 commit into from

Conversation

@bioluminesceme
Copy link

@bioluminesceme bioluminesceme commented Dec 8, 2025 •
edited
Loading

If you paste in too much text, the webui of VibeVoice-Realtime TTS errors with a 400 Bad Request.
Fix: send all the text as a websocket payload, not as a URL parameter. Then streaming the text works great again.

I used Claude Code for part of this.

@bioluminesceme
Copy link
Author

bioluminesceme commented Dec 8, 2025

@microsoft-github-policy-service agree

@YaoyaoChang
Copy link
Collaborator

YaoyaoChang commented Dec 9, 2025

Error on my side.

APEX FusedRMSNorm not available, using native implementation
INFO:     Started server process [2850394]
INFO:     Waiting for application startup.
[startup] Loading processor from microsoft/VibeVoice-Realtime-0.5B
The tokenizer class you load from this checkpoint is not the same type as the class this function is called from. It may result in unexpected tokenization. 
The tokenizer class you load from this checkpoint is 'Qwen2Tokenizer'. 
The class this function is called from is 'VibeVoiceTextTokenizerFast'.
Using device: cuda, torch_dtype: torch.bfloat16, attn_implementation: flash_attention_2
[startup] Found 25 voice presets
[startup] Using fallback voice preset: de-Spk0_man
[startup] Loading voice preset de-Spk0_man from /data/yaoyaochang/code/speech/microsoft/microsoft/VibeVoice/demo/voices/streaming_model/de-Spk0_man.pt
[startup] Loading prefilled prompt from /data/yaoyaochang/code/speech/microsoft/microsoft/VibeVoice/demo/voices/streaming_model/de-Spk0_man.pt
[startup] Model ready.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:3000 (Press CTRL+C to quit)
INFO:     127.0.0.1:57894 - "WebSocket /stream?text=Enter+your+text+here+and+click+%22Start%22+to+instantly+hear+the+VibeVoice-Realtime+TTS+output+audio.&cfg=1.500&steps=5&voice=de-Spk0_man" [accepted]
INFO:     connection open
Error receiving config: (<CloseCode.NO_STATUS_RCVD: 1005>, '')
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/data/yaoyaochang/code/speech/microsoft/microsoft/VibeVoice/demo/web/app.py", line 369, in websocket_stream
    config_message = await ws.receive_text()
                     ^^^^^^^^^^^^^^^^^^^^^^^
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/websockets.py", line 120, in receive_text
    self._raise_on_disconnect(message)
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/websockets.py", line 114, in _raise_on_disconnect
    raise WebSocketDisconnect(message["code"], message.get("reason"))
starlette.websockets.WebSocketDisconnect: (<CloseCode.NO_STATUS_RCVD: 1005>, '')

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 244, in run_asgi
    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)  # type: ignore[func-returns-value]
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
    return await self.app(scope, receive, send)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in __call__
    await super().__call__(scope, receive, send)
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/applications.py", line 113, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/middleware/errors.py", line 151, in __call__
    await self.app(scope, receive, send)
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 63, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/routing.py", line 716, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/routing.py", line 736, in app
    await route.handle(scope, receive, send)
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/routing.py", line 364, in handle
    await self.app(scope, receive, send)
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/routing.py", line 97, in app
    await wrap_app_handling_exceptions(app, session)(scope, receive, send)
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/routing.py", line 95, in app
    await func(session)
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/fastapi/routing.py", line 384, in app
    await dependant.call(**solved_result.values)
  File "/data/yaoyaochang/code/speech/microsoft/microsoft/VibeVoice/demo/web/app.py", line 373, in websocket_stream
    await ws.close(code=1003, reason="Invalid configuration")
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/websockets.py", line 181, in close
    await self.send({"type": "websocket.close", "code": code, "reason": reason or ""})
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/websockets.py", line 86, in send
    await self._send(message)
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/starlette/_exception_handler.py", line 39, in sender
    await send(message)
  File "/data/yaoyaochang/miniconda3/envs/VibeVoiceStreaming/lib/python3.11/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 360, in asgi_send
    raise RuntimeError(msg % message_type)
RuntimeError: Unexpected ASGI message 'websocket.close', after sending 'websocket.close' or response already completed.
INFO:     connection closed

@bioluminesceme
Copy link
Author

bioluminesceme commented Dec 9, 2025 •
edited
Loading

That looks like you are still using the old code that sends the text as a URL parameter?
With the same voice, I get this:

INFO:     Started server process [2784]
INFO:     Waiting for application startup.
[startup] Loading processor from models/VibeVoice-Realtime-0.5B
The tokenizer class you load from this checkpoint is not the same type as the class this function is called    
 from. It may result in unexpected tokenization. 
The tokenizer class you load from this checkpoint is 'Qwen2Tokenizer'. 
The class this function is called from is 'VibeVoiceTextTokenizerFast'.
Using device: cuda, torch_dtype: torch.bfloat16, attn_implementation: flash_attention_2
[startup] Found 25 voice presets
[startup] Using fallback voice preset: de-Spk0_man
[startup] Loading voice preset de-Spk0_man from 
F:\VoiceCloning\VibeVoiceNEW\demo\voices\streaming_model\de-Spk0_man.pt
[startup] Loading prefilled prompt from 
F:\VoiceCloning\VibeVoiceNEW\demo\voices\streaming_model\de-Spk0_man.pt
[startup] Model ready.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:4243 (Press CTRL+C to quit)
INFO:     127.0.0.1:57159 - "GET / HTTP/1.1" 200 OK
INFO:     127.0.0.1:57159 - "GET /config HTTP/1.1" 200 OK
INFO:     127.0.0.1:57159 - "GET /favicon.ico HTTP/1.1" 404 Not Found
INFO:     127.0.0.1:57163 - "WebSocket /stream" [accepted]
INFO:     connection open
Client connected, text length=97, cfg=1.500, steps=5, voice=de-Spk0_man
WS handler exit

My URL is "WebSocket /stream without the long ?text= thing after it (which is what is causing the problems when the text it so long that that string goes over the character limit for a URL I think?).

@bioluminesceme
Copy link
Author

bioluminesceme commented Dec 9, 2025

If you have both the changed demo/web/app.py and demo/web/index.html that url should not have the parameters in it anymore

in the index.html this

``` const wsUrl = ${location.origin.replace(/^http/, 'ws')}/stream?${params.toString()};````

was changed to

const wsUrl = `${location.origin.replace(/^http/, 'ws')}/stream`;

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@bioluminesceme @YaoyaoChang