Skip to content
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
45 changes: 45 additions & 0 deletions proposals/NNNN-Change_ATF_test_reports_folder_structure.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,45 @@
# Change ATF test reports folder structure

* Proposal: [SDL-NNNN](NNNN-Change_ATF_test_reports_folder_structure.md)
* Author: [Irina Getmanets](https://github.com/GetmanetsIrina)
* Status: **Awaiting review**
* Impacted Platforms: ATF

## Introduction

Main output of ATF is test reports.
ATF provide such reports:
* Console logs - name of test cases with execution status FAILED/PASSED.
* SDL logs - SDL log received by ATF via telnet logger.
* Transport logs - all received and sent data from/to SDL. Transport log can have default view - messages on protocol level (except binaries) and full view - log will be expanded with packages: streamings, service messages, heartbeat, json files.
* Detailed report - all expected and sent massages related to test cases with expected and actual result.Also contains info about test cases: name, time, sequence, status, duration.

This proposal is about creating clear and useful structure of test scripts reports.

## Motivation

Create more convenient reports structure, less nested. Running multiple test scripts should not override old reports. Structure of reports should be clear, so you can easily search for a certain report.

## Proposed solution

The solution is to create new structure:
```
TestingReports
-> ScriptName_YYYYMMDDHHMMSS
-> ATF
-> SDL
```
Subfolder ATF will contain ATF logs and report.
Subfolder SDL will contain SDL logs.

## Potential downsides

n/a

## Impact on existing code

Impact on ATF reporting functionality.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@GetmanetsIrina Please note that CI jobs will require an update


## Alternatives considered

Leave as is.