Skip to content

release: v0.16.0#395

Open
tmcneal wants to merge 2 commits intomainfrom
release-0-16
Open

release: v0.16.0#395
tmcneal wants to merge 2 commits intomainfrom
release-0-16

Conversation

@tmcneal
Copy link
Contributor

@tmcneal tmcneal commented Mar 25, 2026

Added

  • [Reflect] Added list_segments tool: Lists the reusable test steps in the account, and includes some relevant metadata about each segment to help the Agent understand when a segment could be used as part of accomplishing a task. #369
  • [Reflect] Added connect_to_session tool: Establishes a WebSocket connection to a live Reflect test recording session. #369
  • [Reflect] Added add_prompt_step tool: Adds a natural language instruction to the test. This could be a single action, assertion, or query. #369
  • [Reflect] Added get_screenshot tool: Returns a screenshot of the current browser window (Web) or device (Mobile). The Agent is instructed to analyze the screenshot to determine the current state of the page and to decide what to do next to complete its assigned task. #369
  • [Reflect] Added delete_previous_step: Performs an "undo" on a step or segment that was previously added. The Agent is instructed to use this tool when a step or segment that it has added has failed or did not perform the task as intended. #369
  • [Reflect] Added add_segment tool: Adds an existing set of reusable test steps to the test. #369
  • [Reflect] Updated "instructions" with guidance to the Agent on how to properly construct a Reflect test. #369
  • [Reflect] Added a "reflect-sap-test" skill that includes additional guidance for the Agent when creating tests for SAP. #369

Changed

  • [Zephyr] Enforce strictness of Zephyr's schemas. #383

@tmcneal tmcneal requested a review from a team as a code owner March 25, 2026 18:05
@github-actions
Copy link
Contributor

🎯 Coverage Target Met!

📈 Coverage Metrics

Metric Coverage Target Status
Lines 93.5% 80%
Functions 85.9% 80%
Branches 86.7% 80%
Statements 93.5% 80%

📊 Test Statistics

  • Total Lines: 20,688 / 22,119
  • Total Functions: 318 / 370
  • Total Branches: 937 / 1081
  • Total Statements: 20688 / 22119

🔍 Files Needing Coverage

File Coverage
src/reflect/prompt/sap-test.ts 9.5%
src/qmetry/client/testsuite.ts 10.3%
src/common/prompts.ts 16.7%
src/qmetry/client/issues.ts 20.1%
src/swagger/client/api.ts 30.0%

📝 Report generated on Node.js v24.13.1 • View workflow • Coverage by Vitest + v8

@tmcneal
Copy link
Contributor Author

tmcneal commented Mar 25, 2026

@assisblf Does this look good to merge? It includes one Zephyr change:

[Zephyr] Enforce strictness of Zephyr's schemas

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants