|
| 1 | +# Twinkle Training Service on ModelScope |
| 2 | + |
| 3 | +Alongside the open-source release of the Twinkle framework, we also provide a hosted model training service (Training as a Service) powered by ModelScope's backend infrastructure. Developers can use this service to experience Twinkle's training API for free. |
| 4 | + |
| 5 | +The model currently running on the cluster is [Qwen/Qwen3-30B-A3B-Instruct-2507](https://www.modelscope.cn/models/Qwen/Qwen3-30B-A3B-Instruct-2507). Below are the detailed usage instructions: |
| 6 | + |
| 7 | +## Step 1. Register a ModelScope Account and Apply to Join the twinkle-explorers Organization |
| 8 | + |
| 9 | +Developers first need to register as a ModelScope user and apply to join the [Twinkle-Explorers](https://modelscope.cn/organization/twinkle-explorers) organization to obtain access permissions. The current free Serverless training experience is still in beta testing and is only available to users within the organization. You can also use Twinkle✨ by deploying the service locally. |
| 10 | + |
| 11 | +Registration link: https://www.modelscope.cn/ |
| 12 | + |
| 13 | +After registering and being approved to join the [Twinkle-Explorers](https://modelscope.cn/organization/twinkle-explorers) organization, obtain your API-Key (i.e., the ModelScope platform access token) from this page: https://www.modelscope.cn/my/access/token. |
| 14 | + |
| 15 | +API endpoint: `base_url="https://www.modelscope.cn/twinkle"` |
| 16 | + |
| 17 | +## Step 2. Review the Cookbook and Customize Development |
| 18 | + |
| 19 | +We strongly recommend that developers review our [cookbook](https://github.com/modelscope/twinkle/tree/main/cookbook/client/) and build upon the training code provided there. |
| 20 | + |
| 21 | +Developers can customize datasets, advantage functions, rewards, templates, and more. However, the Loss component is not currently customizable since it needs to be executed on the server side (for security reasons). If you need support for additional Loss functions, you can upload your Loss implementation to ModelHub and contact us via the Q&A group or through an issue to have the corresponding component added to the whitelist. |
| 22 | + |
| 23 | +## Appendix: Supported Training Methods |
| 24 | + |
| 25 | +This model is a text-only model, so multimodal tasks are not currently supported. For text-only tasks, you can train using: |
| 26 | + |
| 27 | +1. Standard PT/SFT training methods, including Agentic training |
| 28 | +2. Self-sampling RL algorithms such as GRPO/RLOO |
| 29 | +3. Distillation methods like GKD/On-policy. Since the official ModelScope endpoint only supports a single model, the other Teacher/Student model must be prepared by the developer |
| 30 | + |
| 31 | +The current official environment only supports LoRA training, with the following requirements: |
| 32 | + |
| 33 | +1. Maximum rank = 32 |
| 34 | +2. modules_to_save is not supported |
0 commit comments