Skip to content

Quality Attributes

Yue Qi edited this page May 9, 2019 · 2 revisions
ID QA-P01
Category Performance
Priority Medium
Source Jenkins
Stimulus A new testing report is generated in Jenkins.
Artifact CAS service dashboard
Environment Running time
Response The dashboard should show the latest results of the testing.
Response Measure The time CAS takes to update the dashboard in less 90 seconds.
ID QA-P02
Category Performance
Priority Medium
Source User
Stimulus Http requests are made from the client browser
Artifact CAS web service
Environment Running time with the normal load (less than 50 concurrent users)
Response The browser shows the list of controller classes on the web page.
Response Measure 1. Average response time should be less than 3 seconds.
2. The response time of 95% request should be less than 5 seconds.
ID QA-M01
Category Modifiability
Priority High
Source Developers in open source community.
Stimulus A directive to add new plugins for letting CAS compatible with other CI services (e.g. Travis).
Artifact Components
Environment Design time
Response The new plugin component should be completed and tested.
Response Measure 1. For skilled CI tool developers, the developing time for additional CI plugin shall be less than 5 days.
2. The only part shall be affected for adding additional CI plugin is the CI plugin itself.
ID QA-M02
Category Modifiability
Priority High
Source Developers in open source community.
Stimulus A directive to add new parser to support the reports of other static analysis tools (e.g. Sonarqube).
Artifact Components
Environment Design time
Response The new parser should be completed and tested.
Response Measure 1. For skilled parser developers, the developing time for additional parser shall be less than 3 days.
2. The only part shall be affected for adding a new parser is the new parser itself.
ID QA-A01
Category Availability
Source CAS service failure
Stimulus The CAS service is down
Artifact CAS
Environment Running time
Response The CAS service should restart itself.
Response Measure The availability percentage of CAS service should be more than 99%

Clone this wiki locally