Skip to content

Conversation

@penfever
Copy link
Owner

No description provided.

response4 = classifier.chat("Test chat method fallback")
assert response4 == "Chat method response"
response4 = classifier.chat("Test generate method fallback")
assert response4 == "Generate method response"

Check notice

Code scanning / Bandit

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code. Note test

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.
for s in suggestions[:3]
)
# Check that suggestions contain .gguf files and are valid URLs
assert all(".gguf" in s for s in suggestions)

Check notice

Code scanning / Bandit

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code. Note test

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.
any(pattern in s for pattern in ["q4_k_m", "q5_k_m", "q8_0", "q4_0", "q5_0"])
for s in suggestions
)
assert has_quantization, f"No quantized models found in suggestions: {suggestions[:5]}"

Check notice

Code scanning / Bandit

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code. Note test

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants