Request for Integration of LLM with ASR and TTS

[TDA-2030]

Hello,

I noticed that the current codebase primarily focuses on ASR (Automatic Speech Recognition) and TTS (Text-to-Speech) functionalities. I was wondering if there are any plans to integrate a Large Language Model (LLM) with these components to create a more comprehensive pipeline. Additionally, could you share if there are plans to open-source more code related to this integration or other features in the future?

Thank you for your hard work!

[78]

Thank you for your interest and thoughtful question! While part of our current implementation is integrated with our platform xiaozhi.me (which remains closed-source), I want to share that we do plan to develop a lightweight open-source version to demonstrate the server-side integration architecture. This mini-version will help showcase how different components like ASR/TTS could potentially interact with LLMs in a pipeline.

We're actively working to improve our existing open-source offerings and explore multimodal integrations. While I can't share specific timelines yet, stay tuned for updates as we continue to expand both our core functionalities and system integration capabilities 😊

[kaiyuanwansui]

Hello,

I noticed that the current codebase primarily focuses on ASR (Automatic Speech Recognition) and TTS (Text-to-Speech) functionalities. I was wondering if there are any plans to integrate a Large Language Model (LLM) with these components to create a more comprehensive pipeline. Additionally, could you share if there are plans to open-source more code related to this integration or other features in the future?

Thank you for your hard work!

This is a backend open-source project developed by another team :xiaozhi-esp32-server

[TDA-2030]

Hello,
I noticed that the current codebase primarily focuses on ASR (Automatic Speech Recognition) and TTS (Text-to-Speech) functionalities. I was wondering if there are any plans to integrate a Large Language Model (LLM) with these components to create a more comprehensive pipeline. Additionally, could you share if there are plans to open-source more code related to this integration or other features in the future?
Thank you for your hard work!

This is a backend open-source project developed by another team :xiaozhi-esp32-server

@kaiyuanwansui Thank you for your response and for sharing the link to the xiaozhi-esp32-server project.

[dujiaoxi-t]

克隆到设备后怎么运行啊，我是在树莓派上运行的，无从下手测试呀，只有一点点 python 基础，项目弄到手不会运行，有大神请给出个教程指导指导吧！

[gmm932]

辛苦发布一个轻量级且稳定的后端服务！

[78]

此项目不再更新维护！

在个人电脑上部署服务器，可以参考以下第三方开源的项目：

xinnan-tech/xiaozhi-esp32-server Python 服务器
joey-zhou/xiaozhi-esp32-server-java Java 服务器
AnimeAIChat/xiaozhi-server-go Golang 服务器