mlc_llm function adds minicpm and minicpm_v adaptations
Modified all the contents in the mistral folder under the mlc-llm/python/mlc_llm/model
Also modified the code of model.py under the mlc-llm/python/mlc_llm/model
When implementing the mlc_llmg tool operation, you can accept large language models with model types minicpm and minicpm_v.
If you want to get the pre-built mlc_llm toolkit directly, you can visit the link https://huggingface.co/spaces/Mos-fine/mlc_llm_Modify/tree/main , Please note that this link only supports CU122, CP310, and Linux systems.
Other tools can download the official preparation work by yourself:https://mlc.ai/wheels. The specific modification is the mlc_llm_nightly part