Skip to content

Adds end to end functional tests#45

Merged
iwillspeak merged 43 commits intomainfrom
feature/e2e-func-tests
Feb 13, 2026
Merged

Adds end to end functional tests#45
iwillspeak merged 43 commits intomainfrom
feature/e2e-func-tests

Conversation

@stewart-r
Copy link
Collaborator

@stewart-r stewart-r commented Oct 10, 2025

Adds end to end functional tests with specific test case images using those in crispthinking/athena-protobufs#36.

iwillspeak
iwillspeak previously approved these changes Dec 1, 2025
@iwillspeak
Copy link
Member

Can we add a README into the images folder with a copyright declaration explaining the licensing for them.

@iwillspeak iwillspeak marked this pull request as ready for review February 12, 2026 17:23
Robertson and others added 13 commits February 12, 2026 17:25
Better Logging, Enhanced Error Handling, and Updated Expected Outputs
* feat: correlationid can be specified on ImageData

* feat: set brotli compression quality

* style: lint

* fix: fixup example code

* feat: configurable resizing algorithm

---------

Co-authored-by: anna-singleton-resolver <anna.singleton@resolver.com>
…tream

- Call results.aclose() before breaking from response loop to properly
  terminate the async generator and underlying gRPC stream
- Update snapshot for lakeside/pexels-pixabay-210288.jpg (weight 0.9259 -> 0.9215)
- Apply same fix to examples/utils for consistency
Add aclose() in exception handlers to ensure the gRPC stream is
terminated even when an error occurs during classification.
iwillspeak
iwillspeak previously approved these changes Feb 13, 2026
iwillspeak
iwillspeak previously approved these changes Feb 13, 2026
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds end-to-end functional tests for the benign test version of the model, improves streaming classification resource cleanup, and updates test configurations.

Changes:

  • Added E2E functional tests using specific test case images from athena-protobufs
  • Fixed resource leaks in streaming classification by explicitly closing async generators
  • Updated test configurations including reduced default test image count and added VS Code test settings

Reviewed changes

Copilot reviewed 10 out of 12 changed files in this pull request and generated 3 comments.

Show a summary per file
File Description
tests/functional/e2e/testcases/parser.py New test case parser for loading expected outputs from athena-protobufs
tests/functional/e2e/test_classify_single.py New E2E test validating classification output against expected results
tests/functional/test_color_channels.py New functional test for RGB color channel classification
tests/utils/streaming_classify_utils.py Added async generator cleanup calls to prevent resource leaks
examples/utils/streaming_classify_utils.py Added async generator cleanup calls to prevent resource leaks
tests/functional/test_classify_streaming.py Reduced default test image count and skipped flaky test
tests/functional/conftest.py Changed credential_helper fixture scope to session
examples/classify_single_example.py Made affiliate configurable via environment variable
athena-protobufs Updated submodule to include test cases
.vscode/settings.json Added VS Code pytest configuration

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 10 out of 12 changed files in this pull request and generated 1 comment.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copy link
Collaborator

@anna-singleton-resolver anna-singleton-resolver left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@iwillspeak iwillspeak enabled auto-merge (squash) February 13, 2026 16:26
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
@iwillspeak iwillspeak merged commit ec35916 into main Feb 13, 2026
17 checks passed
@iwillspeak iwillspeak deleted the feature/e2e-func-tests branch February 13, 2026 16:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants