| A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | # | DOMAIN | TEST CASE | PRIORITY | RESULT | INFO | COMMENT | Pass/Fail/Block | ||||||||||||||||||
2 | Containers/k8 platform support | Test config_controller with Kubernetes support | 1 | PASS | BUILD_IBUILD_ID="20190523T013000Z" | sx | ||||||||||||||||||||
3 | Containers/k8 platform support | Test SM is able to manage the service ETCD on active controller | 1 | PASS | BUILD_IBUILD_ID="20190523T013000Z" | sx | ||||||||||||||||||||
4 | Containers/k8 platform support | Test support “rudimentary” for kubernetes on second controller | 1 | PASS | BUILD_IBUILD_ID="20190523T013000Z" | 2+2 | ||||||||||||||||||||
5 | Containers/k8 platform support | Test pods network | 1 | PASS | BUILD_IBUILD_ID="20190523T013000Z" | sx | ||||||||||||||||||||
6 | Containers/k8 platform support | Test detection/response on node failures | 1 | PASS | BUILD_ID="20190711T013000Z" | DX | ||||||||||||||||||||
7 | Containers/k8 platform support | Test kube-dns and tiller-deploy only running on master nodes | 1 | PASS | BUILD_IBUILD_ID="20190523T013000Z" | 2+2 | ||||||||||||||||||||
8 | Containers/k8 platform support | Test NoExecute taint status on kubernetes node on host failure | 1 | PASS | BUILD_IBUILD_ID="20190613T013000Z | DX | ||||||||||||||||||||
9 | Containers/k8 platform support | Test VIM monitoring status of services | 2 | OBSOLETE | TBD | |||||||||||||||||||||
10 | Containers/k8 platform support | Test host delete for kubernetes nodes | 1 | PASS | BUILD_IBUILD_ID="20190523T013000Z" | |||||||||||||||||||||
11 | Containers/k8 platform support | Test external access on compute nodes | 1 | PASS | BUILD_ID="20190711T013000Z" | 2+2+2 | ||||||||||||||||||||
12 | Containers/k8 platform support | Test compute nodes access to private docker image server | 1 | OBSOLETE | Feature reverted | |||||||||||||||||||||
13 | Containers/k8 platform support | Test kubelet service is monitored by pmond | 2 | PASS | BUILD_ID="20190718T013000Z" | TBD | ||||||||||||||||||||
14 | Containers/k8 platform support | Test NoExecute taint to locked nodes | 1 | PASS | BUILD_IBUILD_ID="20190523T013000Z" | |||||||||||||||||||||
15 | Containers/k8 platform support | Test criteria to determine if stx-openstack is installed | 1 | PASS | BUILD_ID="20190627T013000Z" | TBD | ||||||||||||||||||||
16 | Containers/k8 platform support | Test nova listener queue as HA | 1 | PASS | Validated on daily Sanity-Tests | TBD | ||||||||||||||||||||
17 | Containers/k8 platform support | Test docker service is monitored by pmond | 2 | PASS | BUILD_ID="20190718T013000Z" | TBD | ||||||||||||||||||||
18 | Containers/k8 platform support | Test compute host delete with no kubernetes node | 1 | PASS | BUILD_IBUILD_ID="20190523T013000Z" | 2+2 | ||||||||||||||||||||
19 | Containers/k8 labels | Test support for k8s labels to inventory panel | 1 | PASS | BUILD_IBUILD_ID="20190521T132734Z"D="20190521T132734Z" | |||||||||||||||||||||
20 | Containers/k8 labels | Test inventory panel: add 'label' drop-down for assign-label form | 1 | PASS | BUILD_IBUILD_ID="20190521T132734Z"D="20190521T132734Z" | |||||||||||||||||||||
21 | Containers/Calico | Test Calico host endpoints creation | 1 | PASS | BUILD_ID="20190627T013000Z" | |||||||||||||||||||||
22 | Containers/Calico | Existing Firewall Tests | 1 | PASS | BUILD_ID="20190627T013000Z" | |||||||||||||||||||||
23 | Containers/compute-worker | Test adding compute node as worker | 1 | PASS | Validated everyday during Provisioning | |||||||||||||||||||||
24 | Containers/compute-worker | Test adding, deleting, locking and unlocking compute (worker) nodes | 1 | PASS | Validated everyday Sanity-Platform -> 01-Host-Management | |||||||||||||||||||||
25 | Containers/compute-worker | Test normal Instances creation on compute (worker) nodes | 1 | PASS | Validate everyday on Sanity-OpenStack | |||||||||||||||||||||
26 | Containers/compute-worker | Test vswitch cpu core changes | 1 | PASS | BUILD_ID="20190531T013000Z" | |||||||||||||||||||||
27 | Conatiners/sriov | Test SRIOV functionality | 1 | OBSOLETE | This will be covered by patch elimination tests | |||||||||||||||||||||
28 | Containers/helm charts | Test FM container running | 1 | BLOCK | Feature not yet merged https://review.opendev.org/#/c/642925/ | TBD | ||||||||||||||||||||
29 | Containers/helm charts | Test FM alarm service availability on Dashboard | 1 | BLOCK | Feature not yet merged https://review.opendev.org/#/c/642925/ | TBD | ||||||||||||||||||||
30 | Containers/helm charts | Test FM alarm service functionality | 1 | BLOCK | Feature not yet merged https://review.opendev.org/#/c/642925/ | TBD | ||||||||||||||||||||
31 | Containers/k8 API authentication | Keystone is enabled to be used by kubectl client. | 1 | OBSOLETE | FEATURE WONT BE IMPLEMENTED | TBD | ||||||||||||||||||||
32 | Containers/k8 API authentication | kubectl client keystone context is created. | 1 | OBSOLETE | FEATURE WONT BE IMPLEMENTED | TBD | ||||||||||||||||||||
33 | Containers/k8 API authentication | Test kubectl client keystone backend. | 1 | OBSOLETE | FEATURE WONT BE IMPLEMENTED | TBD | ||||||||||||||||||||
34 | Containers/Local registry auth | Test that a valid certificate is being created for Local Docker Registry | 1 | PASS | BUILD_ID="20190704T013000Z" | |||||||||||||||||||||
35 | Containers/Local registry auth | Test that the registry is configured as secure registry | 1 | PASS | BUILD_ID="20190704T013000Z" | |||||||||||||||||||||
36 | Containers/Local registry auth | Test that docker registry is working with keystone authentication. | 1 | PASS | BUILD_ID="20190704T013000Z" | |||||||||||||||||||||
37 | Containers/https support | Test application apply of helm chart: | 1 | PASS | BUILD_IBUILD_ID="20190523T013000Z" | |||||||||||||||||||||
38 | Containers/https support | Test re-application apply of helm chart | 1 | PASS | BUILD_ID="20190708T233000Z" | |||||||||||||||||||||
39 | Containers/https support | Test Modified endpoints are listed: | 1 | PASS | Test Modified endpoints are listed: | |||||||||||||||||||||
40 | Containes/huge pages mgmt | Test k8s labels for nodes in puppet | 2 | PASS | BUILD_ID="20190521T132734Z" | |||||||||||||||||||||
41 | Containes/huge pages mgmt | Test Huge pages support for workers w/o openstack compute label | 1 | PASS | BUILD_ID="20190527T233000Z" | |||||||||||||||||||||
42 | Containes/huge pages mgmt | Test auto default huge pages for workers openstackcompute labels | 1 | PASS | BUILD_ID="20190521T132734Z" | |||||||||||||||||||||
43 | Containes/huge pages mgmt | Test default values not set for worker without vswitch | 1 | OBSOLETE | Test Huge pages support for workers only | |||||||||||||||||||||
44 | Containes/huge pages mgmt | Test ovs puppet set only for computes with vswitch enabled | 2 | OBSOLETE | Feature reverted | |||||||||||||||||||||
45 | Containers/node feature disc | Test NFD for kubernetes installation on a Deployment | 1 | PASS | BUILD_ID="20190527T233000Z" | |||||||||||||||||||||
46 | Containers/node feature disc | Test NFD for kubernetes on master node | 1 | PASS | BUILD_ID="20190527T233000Z" | |||||||||||||||||||||
47 | Containers/node feature disc | Test NFD for kubernetes on worker node | 1 | PASS | BUILD_ID="20190527T233000Z" | |||||||||||||||||||||
48 | Containers/cpu pinning | Test platform-cpuaffinity.conf is poresent | 2 | PASS | BUILD_ID="20190527T233000Z" | |||||||||||||||||||||
49 | Containers/cpu pinning | Test cgroup 'k8s-infra' is created | 2 | PASS | BUILD_ID="20190527T233000Z" | |||||||||||||||||||||
50 | Containers/cpu pinning | Test platform-cpuaffinity.conf is poresent on worker nodes | 2 | PASS | BUILD_ID="20190708T233000Z" | |||||||||||||||||||||
51 | Containers/cpu pinning | Test cgroup 'machine.slice' is created | 2 | PASS | BUILD_ID="20190527T233000Z" | |||||||||||||||||||||
52 | Containers/cpu pinning | Test assigned platform cores for openstack based worker nodes | 1 | PASS | BUILD_ID="20190527T233000Z" | |||||||||||||||||||||
53 | Containers/cpu pinning | Test assigned platform cores | 1 | PASS | BUILD_ID="20190527T233000Z" | |||||||||||||||||||||
54 | Containers/cpu pinning | Test assigned platform cores for non-openstack based worker nodes including AIO. | 1 | PASS | BUILD_ID="20190527T233000Z" | |||||||||||||||||||||
55 | Containers/cpu mgr | Test K8s cpu manager static policies for non-openstack based worker nodes | 1 | PASS | BUILD_ID="20190527T233000Z" | |||||||||||||||||||||
56 | Containers/cpu mgr | Test kube-reserved and system-reserved configuration for non-openstack based worker nodes | 2 | PASS | BUILD_ID="20190527T233000Z" | |||||||||||||||||||||
57 | Containers/backup and restore | Test StarlingX backup and restore capability | 1 | DEFERRED | NOT MERGED | |||||||||||||||||||||
58 | Containers/docker img updates | Test Docker images are correctly downloaded | 1 | PASS | Validate everyday on Sanity: Provision Containers | |||||||||||||||||||||
59 | Containers/docker img updates | Test application apply is completed successfully | 1 | PASS | BUILD_IBUILD_ID="20190523T013000Z" | |||||||||||||||||||||
60 | Containers/docker img updates | Test Docker images manipulation after application-apply | 1 | OBSOLETE | Split in below 2 test cases `Test killing kube-system PODs & Test killing kube-system PODs` | |||||||||||||||||||||
61 | Containers/docker img updates | Test killing kube-system PODs | 1 | PASS | BUILD_ID="20190708T233000Z" | |||||||||||||||||||||
62 | Containers/docker img updates | Test killing openstack PODs | 1 | PASS | BUILD_ID="20190708T233000Z" | |||||||||||||||||||||
63 | Containers/bare metal openstack removal | Test that all puppet manifests related to openstack services were removed. | 1 | PASS | BUILD_ID="20190613T013000Z" | |||||||||||||||||||||
64 | Containers/bare metal openstack removal | Test that all openstack templates were removed. | 1 | PASS | BUILD_ID="20190613T013000Z" | |||||||||||||||||||||
65 | Containers/bare metal openstack removal | Test that puppet modules used to configure openstack on baremetal were removed. | 1 | PASS | BUILD_ID="20190613T013000Z" | |||||||||||||||||||||
66 | Containers/Openstack static cleanup | Test that static configurations of openstack services were removed from puppet manifests. | 1 | PASS | BUILD_ID="20190613T013000Z" | |||||||||||||||||||||
67 | Containers/Ceph for k8 | Test CEPH backend provisioning | 1 | PASS | Validated on daily Sanity-Tests | |||||||||||||||||||||
68 | Containers/Ceph for k8 | Test Storage scenarios | 1 | OBSOLETE | Covered on Feature Testing for CEPH | |||||||||||||||||||||
69 | Containers/Ceph for k8 | Test CEPH backend for Simplex and Duplex deployments | 1 | PASS | Validated on daily Sanity-Tests | |||||||||||||||||||||
70 | Containers/Ceph for k8 | Test CEPH monitor on standard without dedicated storage | 1 | PASS | Validated on daily Sanity-Tests | |||||||||||||||||||||
71 | Containers/Ceph for k8 | Test specific restart command for Ceph monitors | 1 | PASS | BUILD_ID="20190531T013000Z" | |||||||||||||||||||||
72 | Containers/Replication of mariadb | Test mariadb replication for AIO-SX | 1 | PASS | BUILD_ID="20190531T013000Z" | |||||||||||||||||||||
73 | Containers/Replication of mariadb | Test mariadb replication for AIO-DX | 1 | PASS | BUILD_ID="20190604T144018Z" | |||||||||||||||||||||
74 | Containers/Replication of mariadb | Test dbmon service is set correctly on DX | 1 | FAIL | BUILD_ID="20190604T144018Z" LP: https://bugs.launchpad.net/starlingx/+bug/1826891 | |||||||||||||||||||||
75 | Containers/Replication of mariadb | Test mariadb replication for Standard | 1 | PASS | BUILD_ID="20190527T233000Z" | |||||||||||||||||||||
76 | Containers/Container log persistence & monitoring | Test new Armada manifest (stx-monitor) | 1 | DEFERRED | FEATURE NOT MERGED | |||||||||||||||||||||
77 | ||||||||||||||||||||||||||
78 | ||||||||||||||||||||||||||
79 | ||||||||||||||||||||||||||
80 | ||||||||||||||||||||||||||
81 | ||||||||||||||||||||||||||
82 | ||||||||||||||||||||||||||
83 | ||||||||||||||||||||||||||
84 | ||||||||||||||||||||||||||
85 | ||||||||||||||||||||||||||
86 | ||||||||||||||||||||||||||
87 | ||||||||||||||||||||||||||
88 | ||||||||||||||||||||||||||
89 | ||||||||||||||||||||||||||
90 | ||||||||||||||||||||||||||
91 | ||||||||||||||||||||||||||
92 | ||||||||||||||||||||||||||
93 | ||||||||||||||||||||||||||
94 | ||||||||||||||||||||||||||
95 | ||||||||||||||||||||||||||
96 | ||||||||||||||||||||||||||
97 | ||||||||||||||||||||||||||
98 | ||||||||||||||||||||||||||
99 | ||||||||||||||||||||||||||
100 |