CNTT RA-2 requirements and relationship to testing in different initiatives (Last updated: 2020-06-25)

	B	D	E	F	G	H	I	J	M	N	O	P
1	CNTT Priority	CNTT Test Category	CNTT Test Type	Requirement	Section	CNTT Notes	Covered by Industry	CNF Conformance notes	K8s Conformance Tests	K8s Conformance Category	K8s e2e	K8s e2e category

2	CNTT Kubernetes based Reference Architecture (RA-2) requirements
3	Snapshot of RA2 requirements https://github.com/cntt-n/CNTT/tree/9b6f21999b0865bc317fa4a967c6d130a0bc3954/doc/ref_arch/kubernetes
4	Introduction
5	SHOULD			Open Source preference	Principles		NA	Possible Test: check for open source license (URL or path)	No	N/A	No	N/A
6	MUST			Open APIs	Principles		NA	This is really broad. K8s conformance and e2e tests will show some of these. Possible Test: Using APISnoop	Yes		Yes
7	MUST			Separation of concerns	Principles
8	MUST			Automated lifecycle management	Principles
9	MUST			Automated scalability	Principles			Multiple. https://github.com/cncf/k8s-conformance/blob/master/docs/KubeConformance-1.9.md#update-demo-should-scale-a-replication-controller- https://github.com/kubernetes/kubernetes/blob/master/test/e2e/autoscaling/horizontal_pod_autoscaling.go#L31	Yes		Yes
10	MUST			Automated closed loop assurance	Principles			reconciler pattern
11	MUST			Cloud nativeness	Principles		P	This depends on what extensions beyond a base certified K8s is used	Yes
12	MUST			Security compliance	Principles
13	MUST			Resilience and Availability	Principles			Multiple https://github.com/cncf/k8s-conformance/blob/master/docs/KubeConformance-1.9.md#pods-cat-liveness-probe-restarted https://github.com/cncf/k8s-conformance/blob/master/docs/KubeConformance-1.9.md#pods-http-liveness-probe-restarted https://github.com/kubernetes/kubernetes/blob/master/test/e2e/autoscaling/cluster_autoscaler_scalability.go#L62
14	MUST			Kubernetes can be executed on top of different types of underlying infrastrucutre.	Scope				Yes
15	MUST			Underlying infrastructure supports resources and capabilities needed by K8s, including storage, network connectivity, and compute	Scope				Yes
16	MAY			Infrastructure may dynamically allocate resources and integrate with K8s for dynamic consumption of those resources	Scope			maybe: cluster-api?	Yes
17
18	Chapter 1: Overview
19
20	1.4 Scope			https://cntt-n.github.io/CNTT/doc/ref_arch/kubernetes/chapters/chapter01.html
21	MUST			Kubernetes capabilities required to conform to the Reference Model requirements				TODO (Maybe): check reference model requirements related to K8s capabilities and add them individualy? https://cntt-n.github.io/CNTT/doc/ref_model/chapters/chapter02.html
22	MUST			Support for CNFs that consist wholly of containers	1.4 Scope				Yes		Yes
23	SHOULD			Support for CNFs that consist partly of containers and partly of VMs, both of which will be orchestrated by Kubernetes				Possible test: K8s addons/extensions which support VMs	No		No
24				Kubernetes cluster lifecycle management					No		Yes
25				Kubernetes-based Application Management				https://github.com/flant/addon-operator	Yes		Yes
26				Application VNF Management					N/A		N/A
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100