ollama: tools only called with Qwan2.5

[deadprogram]

Hello, all

Had immediate success using Qwen2.5 calling my custom MCP server based on mcp-go using http streaming interface.

This works:

mcphost -m ollama:qwen2.5 --config ./examples/mcp/mcp.yml

Feeling excited, I tried some other models.

However, I was not able to get any other models to call any tools.

For example this does not make any calls:

mcphost -m ollama:mistral:7b-instruct --config ./examples/mcp/mcp.yml

It just outputs suggestions on how to write some Python code.

nor does

mcphost -m ollama:llama3.2:latest --config ./examples/mcp/mcp.yml

Has anyone else gotten any other models to make tool calls? Am I missing something here?

Thanks in advance!

[ezynda3]

For me local models are always hit and miss when it comes to tool calling...

[enzomich]

You should only use models for which Ollama declares the "Toos" capability. Qwen2.5 is Tools-capable: https://ollama.com/library/qwen2.5

...but https://ollama.com/library/llama2 is not.

Mistral is listed as Tools-capable but in the version 0.3, loaded through an update three weeks ago: https://ollama.com/library/mistral , so you may try to refresh your copy with an ollama pull mistral .

[hemosu-kjw]

The mistral:last model also cannot utilize tools.

[john3parker]

I've tried both mistral:latest and qwen2.5:7b and neither one of them are able to call tools. I can see mcphost has loaded 10 tools and they are all available (using /tools) but the models do not appear to have access to them.

┃ Loaded 10 tools from MCP servers ┃
┃ MCPHost System (09:44) ┃
┃ ┃

┃ ┃
┃ ## Available Tools ┃
┃ ┃
┃ 1. sm-users-api__get_all_users ┃
┃ 2. sm-users-api__users_by_email_domain ┃
┃ 3. sm-users-api__users_by_state ┃
┃ 4. sm-users-api__user_recent_logins ┃
┃ 5. sm-users-api__get_user_by_id ┃
┃ 6. sm-users-api__users_by_gender ┃
┃ 7. sm-users-api__users_by_grade ┃
┃ 8. sm-users-api__search_users_by_filter ┃
┃ 9. sm-users-api__user_total ┃
┃ 10. sm-users-api__user_search ┃
┃ MCPHost System (09:44) ┃