@skip_if_github_validation @sle_minion @scope_cve_audit

Feature: 0042 - CVE Audit on SLE Salt Minions

Description: In order to check if systems are patched against certain vulnerabilities
As an authorized user
I want to see the Salt Minions that need to be patched

File name: min_cve_audit.feature

Relative path: secondary/min_cve_audit.feature

Scenarios

Chart

Status

Progress

Passed	100.00 %
Failed	0.00 %

Total duration:

00:01:15.149

@skip_if_github_validation @sle_minion @scope_cve_audit

Scenario: Log in as admin user

@skip_if_github_validation @sle_minion @scope_cve_audit

Scenario: Pre-requisite: downgrade milkyway-dummy to lower version

When I enable repository "test_repo_rpm_pool" on this "sle_minion" 00:00:01.086

And I install old package "milkyway-dummy-1.0" on this "sle_minion" 00:00:01.672

And I refresh the metadata for "sle_minion" 00:00:01.064

And I follow the left menu "Admin > Task Schedules" 00:00:00.140

And I follow "errata-cache-default" 00:00:01.212

And I follow "errata-cache-bunch" 00:00:00.397

And I click on "Single Run Schedule" 00:00:01.243

Then I should see a "bunch was scheduled" text 00:00:00.270

And I wait until the table contains "FINISHED" or "SKIPPED" followed by "FINISHED" in its first rows 00:00:01.226

@skip_if_github_validation @sle_minion @scope_cve_audit

Scenario: Schedule channel data refresh

When I follow the left menu "Admin > Task Schedules" 00:00:00.065

And I follow "cve-server-channels-default" 00:00:01.064

And I follow "cve-server-channels-bunch" 00:00:00.280

And I click on "Single Run Schedule" 00:00:00.347

Then I should see a "bunch was scheduled" text 00:00:00.060

And I wait until the table contains "FINISHED" or "SKIPPED" followed by "FINISHED" in its first rows 00:00:01.276

@skip_if_github_validation @sle_minion @scope_cve_audit

Scenario: Display CVE audit page

When I follow the left menu "Audit > CVE Audit" 00:00:00.174

Then I should see a "CVE Audit" link in the left menu 00:00:00.034

And I should see a "CVE Audit" text 00:00:00.073

@skip_if_github_validation @sle_minion @scope_cve_audit

Scenario: Search for a known CVE number

When I follow the left menu "Audit > CVE Audit" 00:00:00.062

And I select "1999" from "cveIdentifierYear" 00:00:00.069

And I enter "9999" as "cveIdentifierId" 00:00:00.068

And I click on "Audit Servers" 00:00:00.059

Then I should see "sle_minion" as link 00:00:00.778

And I should see a "Affected, at least one patch available in an assigned channel" text 00:00:00.091

And I should see a "Install a new patch on this system" link 00:00:00.011

And I should see a "milkyway-dummy-2345" text 00:00:00.084

And I should see a "Download CSV" link 00:00:00.011

And I should see a "Status" button 00:00:00.018

And I should see a "Name" button 00:00:00.017

And I should see a "extra CVE data update" link 00:00:00.014

Then I follow "Install a new patch on this system" on "sle_minion" row 00:00:20.058

And I should see a "Relevant Patches" text 00:00:00.081

@skip_if_github_validation @sle_minion @scope_cve_audit

Scenario: Search for an unknown CVE number

When I follow the left menu "Audit > CVE Audit" 00:00:00.110

And I select "2012" from "cveIdentifierYear" 00:00:00.058

And I enter "2806" as "cveIdentifierId" 00:00:00.053

And I click on "Audit Servers" 00:00:00.051

Then I should see a "The specified CVE number was not found" text 00:00:00.193

@skip_if_github_validation @sle_minion @scope_cve_audit

Scenario: Select a system for the System Set Manager

And I click on the clear SSM button 00:00:00.061

And I follow the left menu "Audit > CVE Audit" 00:00:00.061

And I select "1999" from "cveIdentifierYear" 00:00:00.050

And I enter "9999" as "cveIdentifierId" 00:00:00.054

And I click on "Audit Servers" 00:00:00.049

Then I should see a "Affected, at least one patch available in an assigned channel" text 00:00:00.070

When I check the "sle_minion" client 00:00:00.725

Then I should see a "system selected" text 00:00:00.208

When I follow the left menu "Systems > System List > All" 00:00:00.203

Then I should see "sle_minion" as link 00:00:00.429

And I click on the clear SSM button 00:00:00.048

@skip_if_github_validation @sle_minion @scope_cve_audit

Scenario: List systems by patch status via API before patch

When I follow the left menu "Admin > Task Schedules" 00:00:00.133

And I follow "cve-server-channels-default" 00:00:00.364

And I follow "cve-server-channels-bunch" 00:00:01.311

And I click on "Single Run Schedule" 00:00:01.335

Then I should see a "bunch was scheduled" text 00:00:00.061

And I wait until the table contains "FINISHED" or "SKIPPED" followed by "FINISHED" in its first rows 00:00:01.167

When I call audit.list_systems_by_patch_status() with CVE identifier "CVE-1999-9979" 00:00:01.615

+ Show Info

Result list: [{"errata_advisories"=>[], "system_id"=>1000010001, "channel_labels"=>[], "patch_status"=>"NOT_AFFECTED"}, {"errata_advisories"=>[], "system_id"=>1000010004, "channel_labels"=>[], "patch_status"=>"NOT_AFFECTED"}, {"errata_advisories"=>[], "system_id"=>1000010003, "channel_labels"=>[], "patch_status"=>"NOT_AFFECTED"}, {"errata_advisories"=>[], "system_id"=>1000010000, "channel_labels"=>[], "patch_status"=>"UNKNOWN"}, {"errata_advisories"=>[], "system_id"=>1000010005, "channel_labels"=>[], "patch_status"=>"UNKNOWN"}, {"errata_advisories"=>[], "system_id"=>1000010002, "channel_labels"=>[], "patch_status"=>"UNKNOWN"}]

Then I should get status "NOT_AFFECTED" for "sle_minion" 00:00:00.939

When I call audit.list_systems_by_patch_status() with CVE identifier "CVE-1999-9999" 00:00:01.551

+ Show Info

Result list: [{"errata_advisories"=>["milkyway-dummy-2345"], "system_id"=>1000010001, "channel_labels"=>["fake-base-channel-rh-like"], "patch_status"=>"AFFECTED_FULL_PATCH_APPLICABLE"}, {"errata_advisories"=>["milkyway-dummy-2345"], "system_id"=>1000010004, "channel_labels"=>["fake-rpm-suse-channel"], "patch_status"=>"AFFECTED_FULL_PATCH_APPLICABLE"}, {"errata_advisories"=>[], "system_id"=>1000010003, "channel_labels"=>[], "patch_status"=>"NOT_AFFECTED"}, {"errata_advisories"=>[], "system_id"=>1000010000, "channel_labels"=>[], "patch_status"=>"UNKNOWN"}, {"errata_advisories"=>[], "system_id"=>1000010005, "channel_labels"=>[], "patch_status"=>"UNKNOWN"}, {"errata_advisories"=>[], "system_id"=>1000010002, "channel_labels"=>[], "patch_status"=>"UNKNOWN"}]

Then I should get status "AFFECTED_FULL_PATCH_APPLICABLE" for "sle_minion" 00:00:00.972

And I should get the "fake-rpm-suse-channel" channel label 00:00:00.000

And I should get the "milkyway-dummy-2345" patch 00:00:00.000

+ Show Info

result: {"errata_advisories"=>["milkyway-dummy-2345"], "system_id"=>1000010004, "channel_labels"=>["fake-rpm-suse-channel"], "patch_status"=>"AFFECTED_FULL_PATCH_APPLICABLE"}

@skip_if_github_validation @sle_minion @scope_cve_audit

Scenario: Apply patches

Given I am on the Systems overview page of this "sle_minion" 00:00:01.496

When I follow "Software" in the content area 00:00:00.079

And I follow "Patches" in the content area 00:00:00.062

And I enter "milkyway" as the filtered synopsis 00:00:00.044

And I click on the filter button 00:00:00.504

And I check "milkyway-dummy-2345" in the list 00:00:00.056

And I click on "Apply Patches" 00:00:00.602

And I click on "Confirm" 00:00:00.679

Then I should see a "patch update has been scheduled" text 00:00:00.080

And I wait until event "Patch Update: milkyway-dummy-2345" is completed 00:00:18.976

@skip_if_github_validation @sle_minion @scope_cve_audit

Scenario: List systems by patch status via API after patch

And I call audit.list_systems_by_patch_status() with CVE identifier "CVE-1999-9999" 00:00:01.499

+ Show Info

Result list: [{"errata_advisories"=>["milkyway-dummy-2345"], "system_id"=>1000010001, "channel_labels"=>["fake-base-channel-rh-like"], "patch_status"=>"AFFECTED_FULL_PATCH_APPLICABLE"}, {"errata_advisories"=>[], "system_id"=>1000010003, "channel_labels"=>[], "patch_status"=>"NOT_AFFECTED"}, {"errata_advisories"=>[], "system_id"=>1000010004, "channel_labels"=>[], "patch_status"=>"PATCHED"}, {"errata_advisories"=>[], "system_id"=>1000010000, "channel_labels"=>[], "patch_status"=>"UNKNOWN"}, {"errata_advisories"=>[], "system_id"=>1000010005, "channel_labels"=>[], "patch_status"=>"UNKNOWN"}, {"errata_advisories"=>[], "system_id"=>1000010002, "channel_labels"=>[], "patch_status"=>"UNKNOWN"}]

Then I should get status "PATCHED" for "sle_minion" 00:00:01.016

@skip_if_github_validation @sle_minion @scope_cve_audit

Scenario: Cleanup: remove installed packages

When I disable repository "test_repo_rpm_pool" on this "sle_minion" without error control 00:00:00.838

And I remove package "milkyway-dummy" from this "sle_minion" without error control 00:00:01.833

@skip_if_github_validation @sle_minion @scope_cve_audit

Feature: 0042 - CVE Audit on SLE Salt Minions

Scenarios

Scenario: Log in as admin user

Scenario: Pre-requisite: downgrade milkyway-dummy to lower version

Scenario: Schedule channel data refresh

Scenario: Display CVE audit page

Scenario: Search for a known CVE number

Scenario: Search for an unknown CVE number

Scenario: Select a system for the System Set Manager

Scenario: List systems by patch status via API before patch

Scenario: Apply patches

Scenario: List systems by patch status via API after patch

Scenario: Cleanup: remove installed packages

Scenario: Cleanup: remove remaining systems from SSM after CVE audit tests