Skip to content

QA v1.10.0-rc32 #103

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
EZheln wants to merge 1 commit into
base: development
Choose a base branch
from
Open

QA v1.10.0-rc32 #103

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion tests/features/MLFunction.feature
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1110,7 +1110,7 @@ Feature: ML Functions
Then verify "Cross_Cancel_Button" element visibility on "View_YAML" wizard
Then verify "YAML_Modal_Container" element visibility on "View_YAML" wizard
Then click on "Cross_Cancel_Button" element on "View_YAML" wizard
Then click on cell with row index 8 in "expand_btn" column in "Functions_Table" table on "ML_Functions" wizard
Then click on cell with row index 9 in "expand_btn" column in "Functions_Table" table on "ML_Functions" wizard
And wait load page
Then select "View YAML" option in action menu on "ML_Functions" wizard in "Functions_Table" table at row with "Nov 23, 2021, 10:31:51 AM" value in "name" column
Then verify if "View_YAML" popup dialog appears
Expand Down
4 changes: 3 additions & 1 deletion tests/features/common-tools/common-consts.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -96,6 +96,7 @@ export default {
},
Feature_Vectors_Info_Pane: {
Tab_List: ['Overview', 'Requested Features', 'Analysis'],
Tab_List_Extended: ['Overview', 'Requested Features', 'Returned Features', 'Statistics', 'Analysis'],
Overview_General_Headers: [
'Description:',
'Labels:',
Expand Down Expand Up @@ -428,7 +429,8 @@ export default {
Expand_All_Button: 'Expand all',
In_Process_Jobs: 'Aborting, Pending, Pending retry, Running',
Running_Tip: 'Running, Terminating',
Failed_Tip: 'Failed',
Running: 'Running',
Failed_Tip: 'Error, Unhealthy',
Failed_Jobs: 'Aborted, Error',
Failed_Worflows: 'Error, Failed',
Succeeded: 'Completed',
Expand Down
11 changes: 7 additions & 4 deletions tests/features/common/page-objects/info-pane.po.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -157,6 +157,7 @@ const infoPaneOverviewProducerHeaders = {
fields: {
key: '.details-item__header',
link: '.details-item__data .link',
producer_link: '.details-item__link',
value: '.details-item__data'
}
}
Expand Down Expand Up @@ -313,7 +314,7 @@ const infoPaneDriftHeaders = {
}

const filesInfoSourcesTable = {
root: '.info-sources .info-sources-table',
root: '.info-sources',
header: {
root: '.info-sources-table__header',
sorters: {
Expand All @@ -323,10 +324,12 @@ const filesInfoSourcesTable = {
},
body: {
row: {
root: '.info-sources-table__content',
root: '.info-sources__table',
fields: {
name: '.info-sources-table__content-key .data-ellipsis',
path: '.info-sources-table__content-value'
name_key: '.info-sources__table-row:nth-of-type(1) .info-sources__table-key',
name_value: '.info-sources__table-row:nth-of-type(1) .info-sources__table-value',
path_key: '.info-sources__table-row:nth-of-type(2) .info-sources__table-key',
path_value: '.info-sources__table-row:nth-of-type(2) .info-sources__table-value'
}
}
}
Expand Down
12 changes: 11 additions & 1 deletion tests/features/common/page-objects/interactive-popup.po.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -810,7 +810,10 @@ export default {
Title_Function_Log_Info: By.css('.item-info > div > h3:nth-of-type(2)'),
Content_Function_Log_Info: By.css('.item-info .table__item-logs:nth-of-type(2)'),
Logs_Text_container: By.css('#overlay_container .table__item .table__item-logs-content'),
Logs_Refresh_Button: By.css('#overlay_container .table__item .logs-refresh')
Logs_Refresh_Button: By.css('#overlay_container .table__item .logs-refresh'),
Requested_Features_Table: By.css('.item-info .item-requested-features__table'),
Returned_Features_Table: By.css('.item-info .details-metadata__table'),
Statistics_Table: By.css('.item-info #DETAILS_STATISTICS_TABLE_ID')
},
modalWizardForm: {
Title: By.css('.modal .modal__header-title'),
Expand Down Expand Up @@ -1734,6 +1737,13 @@ export default {
),
Type_Filter_Element: By.css('[data-testid="type-form-field-select"]'),
Type_Filter_Dropdown: dropdownComponent(
generateDropdownGroup(
'[data-testid="type-form-field-select"]',
'[data-testid="select-header"]',
'.options-list .select__item:not(.hidden) .tooltip-wrapper'
)
),
Type_Filter_Dropdown_Schedule: dropdownComponent(
generateDropdownGroup(
'[data-testid="type-form-field-select"]',
'[data-testid="select-header"]',
Expand Down
1 change: 1 addition & 0 deletions tests/features/common/page-objects/models.po.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -193,6 +193,7 @@ const realTimePipelinesTable = {
)
},
name: '.table-body__cell:nth-of-type(1) a.data-ellipsis',
name_link: '.table-body__cell:nth-of-type(1) a .link',
type: '.table-body__cell:nth-of-type(2) .data-ellipsis',
function: '.table-body__cell:nth-of-type(3) .data-ellipsis',
action_menu: {
Expand Down
4 changes: 2 additions & 2 deletions tests/features/common/page-objects/project.po.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -52,10 +52,10 @@ const realtimeFunctionsNuclioTable = {
root: '.project-data-card__header',
sorters: {
title: '.project-data-card__header-text a',
running_counter_number: '.project-data-card__statistics-item:nth-of-type(1) .project-data-card__statistics-value .tooltip-wrapper',
running_counter_number: '.project-data-card__statistics-item:nth-of-type(1) .project-data-card__statistics-value.statistics_running',
running_counter_subtitle: '.project-data-card__statistics-item:nth-of-type(1) .project-data-card__statistics-label span',
running_counter_icon: '.project-data-card__statistics-item:nth-of-type(1) .project-data-card__statistics-label i',
failed_counter_number: '.project-data-card__statistics-item:nth-of-type(2) .project-data-card__statistics-value .tooltip-wrapper',
failed_counter_number: '.project-data-card__statistics-item:nth-of-type(2) .project-data-card__statistics-value.statistics_failed',
failed_counter_subtitle: '.project-data-card__statistics-item:nth-of-type(2) .project-data-card__statistics-label span',
failed_counter_icon: '.project-data-card__statistics-item:nth-of-type(2) .project-data-card__statistics-label i',
api_gateways_counter_number: '.project-data-card__statistics-item:nth-of-type(3) .project-data-card__statistics-value .tooltip-wrapper',
Expand Down
1 change: 1 addition & 0 deletions tests/features/jobsAndWorkflows.feature
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -430,6 +430,7 @@ Feature: Jobs and workflows
And hover "MLRun_Logo" component on "commonPagesHeader" wizard
And wait load page
When pick up "Custom range" from "09/03/2021 00:00" to "09/04/2021 00:00" in "Date_Time_Picker" via "Date_Picker_Filter_Dropdown" on "Jobs_Monitor_Tab" wizard
And wait load page
Then verify from "09/03/2021 00:00" to "09/04/2021 00:00" filter band in "Custom_Range_Filter_Dropdown" filter dropdown on "Jobs_Monitor_Tab" wizard
And wait load page
Then click on "Table_FilterBy_Button" element on "Jobs_Monitor_Tab" wizard
Expand Down
9 changes: 9 additions & 0 deletions tests/features/llmPrompts.feature
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -151,6 +151,9 @@ Feature: LLM prompts Page
Then click on "Refresh_Button" element on "LLM_Prompts" wizard
And wait load page
Then value in "labels" column with "dropdowns" in "LLMPrompts_Table" on "LLM_Prompts" wizard should contains "language" in "Overlay"
Then type value "5" to "Search_By_Name_Filter_Input" field on "LLM_Prompts" wizard
Then click on "Refresh_Button" element on "LLM_Prompts" wizard
And wait load page
Then click on "Table_FilterBy_Button" element on "LLM_Prompts" wizard
Then type value "type=qa" to "Table_Label_Filter_Input" field on "FilterBy_Popup" wizard
Then click on "Apply_Button" element on "FilterBy_Popup" wizard
Expand Down Expand Up @@ -750,6 +753,7 @@ Feature: LLM prompts Page
Then verify "Add_Tag_Popup" element visibility on "Add_Tag_Popup" wizard
Then type value "system" to "Tag_Input" field on "Add_Tag_Popup" wizard
Then click on "Add_Button" element on "Add_Tag_Popup" wizard
And wait load page
Then verify if "Confirm_Popup" popup dialog appears
Then "Title" element on "Confirm_Popup" should contains "Overwrite LLM prompt?" value
Then verify "Cross_Cancel_Button" element visibility on "Confirm_Popup" wizard
Expand All @@ -760,6 +764,11 @@ Feature: LLM prompts Page
Then verify "Overwrite_Button" element visibility on "Confirm_Popup" wizard
Then "Overwrite_Button" element on "Confirm_Popup" should contains "Overwrite" value
When click on "Cancel_Button" element on "Confirm_Popup" wizard
When click on "Cancel_Button" element on "Add_Tag_Popup" wizard
Then verify if "Common_Popup" popup dialog appears
Then "Title" element on "Common_Popup" should contains "Are you sure?" value
Then "Description" element on "Common_Popup" should contains "All changes will be lost" value
Then click on "Confirm_Button" element on "Common_Popup" wizard
Then select "Add a tag" option in action menu on "LLM_Prompts" wizard in "LLMPrompts_Table" table at row with "my_llm" value in "name" column
And wait load page
Then verify "Add_Tag_Popup" element visibility on "Add_Tag_Popup" wizard
Expand Down
94 changes: 86 additions & 8 deletions tests/features/models.feature
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -851,26 +851,103 @@ Feature: Models Page
And wait load page
Then verify "Header" element visibility on "Models_Info_Pane" wizard
Then "Header" element on "Models_Info_Pane" should contains "test-model" value
Then click on "Table_FilterBy_Button" element on "Models" wizard
Then click on "Clear_Button" element on "FilterBy_Popup" wizard
And wait load page
When click on cell with value "train_model" in "name" column in "Models_Table" table on "Models" wizard
And wait load page
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Models_Info_Pane" wizard
Then verify "Overview_Producer_Headers" on "Models_Info_Pane" wizard should contains "Models_Info_Pane"."Overview_Producer_Headers"
When click on cell with value "sk-project-admin/3d03c190ad57442099024be6bb8f5895-3" in "producer_link" column in "Overview_Producer_Headers" table on "Models_Info_Pane" wizard
And wait load page
Then verify if "Modal_Transition_Popup" popup dialog appears
Then verify "Title" element visibility on "Modal_Transition_Popup" wizard
Then "Title" element on "Modal_Transition_Popup" should contains "train" value
Then verify "Data_Status" element visibility on "Modal_Transition_Popup" wizard

@MLM
@passive
@inProgress
@smoke
Scenario: MLM028 - Check tab list compontnts on Model Item infopane
Scenario: MLM028 - Check Overview tab Sources components on Model Item infopane
Given open url
And wait load page
And click on row root with value "default" in "name" column in "Projects_Table" table on "Projects" wizard
And click on row root with value "churn-project-admin" in "name" column in "Projects_Table" table on "Projects" wizard
And wait load page
And hover "Project_Navigation_Toggler" component on "commonPagesHeader" wizard
And click on cell with value "Models" in "link" column in "General_Info_Quick_Links" table on "commonPagesHeader" wizard
And hover "MLRun_Logo" component on "commonPagesHeader" wizard
And wait load page
When click on cell with row index 1 in "name" column in "Models_Table" table on "Models" wizard
When click on cell with value "transaction_fraud_adaboost" in "name" column in "Models_Table" table on "Models" wizard
And wait load page
Then verify "Info_Pane_Tab_Selector" element visibility on "Models_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" on "Models_Info_Pane" wizard should contains "Models_Info_Pane"."Tab_List_Extended"
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Models_Info_Pane" wizard
Then verify "Overview_Sources_Headers" on "Models_Info_Pane" wizard should contains "Models_Info_Pane"."Overview_Sources_Headers"
Then check "dataset" value in "name_value" column in "Info_Sources_Table" table on "Models_Info_Pane" wizard
Then check "store://feature-vectors/churn-project-admin/transactions-fraud" value in "path_value" column in "Info_Sources_Table" table on "Models_Info_Pane" wizard
When click on cell with value "store://feature-vectors/churn-project-admin/transactions-fraud" in "path_value" column in "Info_Sources_Table" table on "Models_Info_Pane" wizard
And wait load page
Then verify if "Modal_Transition_Popup" popup dialog appears
Then verify "Title" element visibility on "Modal_Transition_Popup" wizard
Then "Title" element on "Modal_Transition_Popup" should contains "transactions-fraud" value
Then verify "Data_Status" element visibility on "Modal_Transition_Popup" wizard
Then verify "Refresh_Button" element visibility on "Modal_Transition_Popup" wizard
Then verify "Refresh_Button" element on "Modal_Transition_Popup" wizard should display hover tooltip "Common_Tooltips"."Refresh_Button"
Then click on "Refresh_Button" element on "Modal_Transition_Popup" wizard
And wait load page
Then verify "Refresh_Button" element visibility on "Modal_Transition_Popup" wizard
Then verify "Action_Menu" element visibility on "Modal_Transition_Popup" wizard
Then verify "Action_Menu" dropdown element on "Modal_Transition_Popup" wizard should contains "Common_Lists"."Action_Menu_List_Function_Transition_Popup"
Then select "View YAML" option in action menu on "Modal_Transition_Popup" wizard
And wait load page
Then verify if "View_YAML" popup dialog appears
Then verify "Cross_Cancel_Button" element visibility on "View_YAML" wizard
Then verify "YAML_Modal_Container" element visibility on "View_YAML" wizard
Then click on "Cross_Cancel_Button" element on "View_YAML" wizard
And wait load page
Then verify "Tab_Selector" element visibility on "Modal_Transition_Popup" wizard
Then verify "Tab_Selector" on "Modal_Transition_Popup" wizard should contains "Feature_Vectors_Info_Pane"."Tab_List_Extended"
Then verify "Overview" tab is active in "Tab_Selector" on "Modal_Transition_Popup" wizard
Then verify "Overview_General_Headers" on "Modal_Transition_Popup" wizard should contains "Feature_Vectors_Info_Pane"."Overview_General_Headers"
And select "Requested Features" tab in "Tab_Selector" on "Modal_Transition_Popup" wizard
And wait load page
Then verify "Requested Features" tab is active in "Tab_Selector" on "Modal_Transition_Popup" wizard
Then verify "Requested_Features_Table" element visibility on "Modal_Transition_Popup" wizard
And select "Returned Features" tab in "Tab_Selector" on "Modal_Transition_Popup" wizard
And wait load page
Then verify "Returned Features" tab is active in "Tab_Selector" on "Modal_Transition_Popup" wizard
Then verify "Returned_Features_Table" element visibility on "Modal_Transition_Popup" wizard
Then select "Statistics" tab in "Tab_Selector" on "Modal_Transition_Popup" wizard
Then verify "Statistics" tab is active in "Tab_Selector" on "Modal_Transition_Popup" wizard
Then verify cell with "Statistics" value in "key" column in "Tab_Selector" table on "Modal_Transition_Popup" wizard should display "Label_Hint"."Models_Statistics"
Then verify "Statistics_Table" element visibility on "Modal_Transition_Popup" wizard
Then select "Analysis" tab in "Tab_Selector" on "Modal_Transition_Popup" wizard
Then verify "Analysis" tab is active in "Tab_Selector" on "Modal_Transition_Popup" wizard
And verify "No_Data_Message" element visibility on "commonPagesHeader" wizard
Then "No_Data_Message" component on "commonPagesHeader" should contains "No_Data_Message"."No_Data"
Then verify "Cross_Close_Button" element visibility on "Modal_Transition_Popup" wizard
Then click on "Cross_Close_Button" element on "Modal_Transition_Popup" wizard
And wait load page
Then verify "Info_Pane_Tab_Selector" element visibility on "Models_Info_Pane" wizard
Then verify "Info_Pane_Tab_Selector" on "Models_Info_Pane" wizard should contains "Models_Info_Pane"."Tab_List_Extended"
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Models_Info_Pane" wizard
When click on cell with value "current-state_model" in "name" column in "Models_Table" table on "Models" wizard
And wait load page
Then verify "Header" element visibility on "Models_Info_Pane" wizard
Then "Header" element on "Models_Info_Pane" should contains "current-state_model" value
Then check "dataset" value in "name_value" column in "Info_Sources_Table" table on "Models_Info_Pane" wizard
Then check "/User/demos/customer-churn-prediction/data/pipeline/eaae138e-439a-47fa-93c6-ba0fe1dc3b79/encoded-data.csv" value in "path_value" column in "Info_Sources_Table" table on "Models_Info_Pane" wizard
When click on cell with value "/User/demos/customer-churn-prediction/data/pipeline/eaae138e-439a-47fa-93c6-ba0fe1dc3b79/encoded-data.csv" in "path_value" column in "Info_Sources_Table" table on "Models_Info_Pane" wizard
And wait load page
And wait load page
Then verify if "Notification_Popup" popup dialog appears
Then verify "Notification_Pop_Up" element visibility on "Notification_Popup" wizard
Then "Notification_Pop_Up" element on "Notification_Popup" should contains "Copied to clipboard successfully" value
Then verify "Notification_Pop_Up_Cross_Close_Button" element visibility on "Notification_Popup" wizard
Then click on "Notification_Pop_Up_Cross_Close_Button" element on "Notification_Popup" wizard
Then verify "Info_Pane_Tab_Selector" element visibility on "Models_Info_Pane" wizard
Then verify "Overview" tab is active in "Info_Pane_Tab_Selector" on "Models_Info_Pane" wizard

@MLM
@passive
Expand Down Expand Up @@ -1039,8 +1116,9 @@ Feature: Models Page
And select "Real-Time Pipelines" tab in "Models_Tab_Selector" on "Models" wizard
And wait load page
Then verify "Real-Time Pipelines" tab is active in "Models_Tab_Selector" on "Models" wizard
Then save to context "name" column and "href" attribute on 2 row from "Real_Time_Pipelines_Table" table on "Real_Time_Pipelines" wizard
When click on cell with row index 2 in "name" column in "Real_Time_Pipelines_Table" table on "Real_Time_Pipelines" wizard
Then save to context "name" column and "href" attribute on 3 row from "Real_Time_Pipelines_Table" table on "Real_Time_Pipelines" wizard
When click on cell with value "model-monitoring-stream" in "name_link" column in "Real_Time_Pipelines_Table" table on "Real_Time_Pipelines" wizard
And wait load page
And wait load page
Then compare current browser URL with test "href" context value
Then verify "Real_Time_Pipelines_Graph" element visibility on "Real_Time_Pipelines" wizard
Expand All @@ -1051,7 +1129,7 @@ Feature: Models Page
Then verify "Overview_Headers" on "Real_Time_Pipeline_Pane" wizard should contains "Real_Time_Pipeline_Pane"."Overview_Headers"
Then click on "Arrow_Back" element on "Real_Time_Pipeline_Pane" wizard
And wait load page
Then click on cell with row index 2 in "function" column in "Real_Time_Pipelines_Table" table on "Real_Time_Pipelines" wizard
Then click on cell with row index 3 in "function" column in "Real_Time_Pipelines_Table" table on "Real_Time_Pipelines" wizard
And wait load page
Then verify if "Modal_Transition_Popup" popup dialog appears
Then verify "Title" element visibility on "Modal_Transition_Popup" wizard
Expand All @@ -1076,7 +1154,7 @@ Feature: Models Page
Then verify "Cross_Close_Button" element visibility on "Modal_Transition_Popup" wizard
Then click on "Cross_Close_Button" element on "Modal_Transition_Popup" wizard
And wait load page
Then click on cell with row index 2 in "function" column in "Real_Time_Pipelines_Table" table on "Real_Time_Pipelines" wizard
Then click on cell with row index 3 in "function" column in "Real_Time_Pipelines_Table" table on "Real_Time_Pipelines" wizard
And wait load page
Then verify if "Modal_Transition_Popup" popup dialog appears
Then verify "Tab_Selector" element visibility on "Modal_Transition_Popup" wizard
Expand All @@ -1099,7 +1177,7 @@ Feature: Models Page
Then click on "Cross_Close_Button" element on "Modal_Transition_Popup" wizard
And wait load page
Then verify "Real_Time_Pipelines_Table" element visibility on "Real_Time_Pipelines" wizard
Then click on cell with row index 1 in "name" column in "Real_Time_Pipelines_Table" table on "Real_Time_Pipelines" wizard
When click on cell with value "vizro" in "name_link" column in "Real_Time_Pipelines_Table" table on "Real_Time_Pipelines" wizard
And wait load page
And verify "No_Data_Message" element visibility on "commonPagesHeader" wizard
Then "No_Data_Message" element on "commonPagesHeader" should contains "The ingestion function has no steps and therefore no graph." value
Expand Down
Loading