I have an idea that will make your app run like a rocket.

[hassanali112012-coder]

The app operit ai Very nice, many features, but there are two major problems.The first problem is the slow loading of local forms, whether in MMU or GRGUF format. I've got an idea I want to share with you that will make this application very fast... There's an application whose name I'll leave for you to try.It uses settings that make the form load fast and it types very quickly. I tried many of its forms and when I tried them on your application, they almost didn't work at all. I hope you try the application and see the settings that allow the user to control them.
This app is called Off Grid
My main idea is to take the same settings and capabilities that run the local model and add them to your application. This will streamline your application and make the user very happy because it will provide a significant speed boost.
The second issue is that you need to add the GGUF settings. We use the CPU and GPU together because some models require it. Finally, I wish you success. Thank you, and thank you to everyone involved in this project.