ABCDEFGHIJKLMNOPQRSTUVWXYZAAABACADAEAFAGAHAIAJAKALAMAN
1
2
ProductGoogle Kubernetes Engine (GKE)Amazon Elastic Kubernetes Service
(EKS)
Azure Kubernetes Service (AKS)IBM Cloud
Kubernetes Service (IKS)
OVHcloud Managed Kubernetes Service (MKS)Scaleway KapsuleDigitalocean Kubernetes (DOKS)Alibaba Cloud Container Service for Kubernetes (ACK)IONOS Kubernetes ServiceCivo Kube100Gridscale Managed Kubernetes (GSK)Linode Kubernetes Engine (LKE)SymbiosisKubernetes on PacketOracle Kubernetes Engine (OKE)MetaKubeVultr Kubernetes Engine (VKE)F5 XC AppStack
3
1. General info(status: needs help)(status: needs help)(status: in progress)
4
Linkhttps://cloud.google.com/kubernetes-enginehttps://aws.amazon.com/eks/
https://azure.microsoft.com/en-us/services/kubernetes-service/
https://www.ibm.com/cloud/container-service/
https://www.ovhcloud.com/en-gb/public-cloud/kubernetes
https://www.scaleway.com/en/kubernetes-kapsule/
https://www.digitalocean.com/products/kubernetes/
https://www.alibabacloud.com/product/kuberneteshttps://cloud.ionos.com/managed/kuberneteshttps://www.civo.com/kube100https://gridscale.io/en/products/kubernetes/https://www.linode.com/docs/kubernetes/https://symbiosis.hosthttps://www.packet.com/solutions/kubernetes/
https://www.oracle.com/cloud/compute/container-engine-kubernetes.html
https://metakube.syseleven.de/https://www.vultr.com/kubernetes/https://docs.cloud.f5.com/docs/services/app-stack
5
Release NotesGKE release notesAmazon EKS Kubernetes versionshttps://github.com/Azure/AKS/releasesKubernetes version information
https://github.com/ovh/public-cloud-roadmap/projects/1
Kubernetes version support policyDigitalOcean Kubernetes Supported ReleasesRelease notes (aliyun.com)Release Notes | Documentation (syseleven.de)https://www.vultr.com/docs/vultr-kubernetes-engine-changelog
https://docs.cloud.f5.com/docs/changelog/saas-rel-notes
6
7
2. Supported versions
8
1.24✖︎✖︎✖︎✖︎✔️✔️✖︎✖︎✔️✖︎
9
1.23Comparison of Kubernetes managed services✖︎✖︎✔️✔️✔️✔️✖︎✖︎✔️✔️
10
1.22✔️✔️✔️✔️✔️✔️✔️✔️✔️✔️✔️
11
1.21✔️✔️✔️✔️✔️✔️✔️✖︎✖︎✔️✔️✔️
12
1.20✔️✔️✖︎✔️✔️✔️✖︎✔️✔️Needs help✔️Needs help✖︎✔️✖︎
13
1.19✔️✔️✖︎✔️Deprecated✔️✖︎✖︎✔️Needs help✔️✖︎✖︎✔️✖︎
14
1.18✔️✖︎✖︎✖︎Deprecated✖︎✖︎✔️✔️✖︎✔️✔️✖︎✖︎
15
Notes
16
NotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotes
17
How to contribute:
18
3. QuotasLeave a comment or drop us a line at research@learnk8s.io
19
Max number of clusters per region50/zone + 50 regional clusters100 (can be increased on request)1000 (maximum number of clusters per account)10020 (can be increased on request)UnlimitedNeeds help2000Unlimited99UnlimitedUnlimitedUnlimitedUnlimited1 to Unlimited: based on tier
20
Max nodes per clusterLicense:150001350010005001005005125000500099301261003 Controller & 21 Worker/per AZ
21
Max nodes per node poolApache 2.010004501005001005005121000100099N/A100Unlimited
22
Max node poolsLast updated:No documented3010500100500Needs help5005001Not supported126Unlimited
23
Max pods per NodeAugust 23, 2022110250250250100110 per default (configurable per pool)110256100100110110100
24
Max pods per cluster150,000Not documentedNot documentedNot documentedNot documentedNot documented3300
25
Max containers per cluster300,000Not documentedNot documentedNot documentedNot documentedNot documentedNot documented
26
Notes
27
NotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotes
28
Find more research at:
29
4. Pricehttps://learnk8s.io/research
30
Control plane10 cents per hour per control plane10 cents per hour per control plane
Default - Free
Uptime SLA-10 cents per cluster per hour
FreeFreeFreeFree
Default - Free
Uptime SLA-9 cents per cluster per hour
FreeFreeFreeFreeFreeFreeMulti Tier: Free, Individual, Team, Organization
31
Notes
32
NotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotes
33
34
5. Upgrades and maintainance
35
Control plane upgradesAutomatic + ManualAutomatic + ManualAutomatic + ManualPatch upgrades - Automatic
Major/Minor upgrades - Manual
Automatic + ManualAutomatic + ManualAutomatic + ManualAutomatic + ManualAutomatic + ManualAutomaticAutomaticAutomaticAutomaticAutomaticAutomatic
36
Worker nodes upgradesAutomatic + ManualAutomatic + ManualAutomatic + ManualManualAutomatic + ManualAutomatic + ManualAutomatic + ManualAutomatic + ManualAutomatic + ManualAutomaticPatch upgrades - Automatic
Major/Minor - Manual
Automatic + ManualAutomaticAutomaticManual & Automatic (optional)
37
Notes
38
NotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotes
39
40
6. Nodes
41
Operating systemContainer Optimised OS, Ubuntu, Windows ServerAmazon Linux 2
Ubuntu
Bottlerocket
Windows
Ubuntu
Windows Server
UbuntuUbuntuUbuntu 20.04Debian 9Alibaba Cloud Linux 2, CentOS, Windows Server and Bring-Your-Own-OSCentOSUbuntuUbuntuDebianUbuntuDebian 9Container Optimized OS; CentOS 7
42
Container runtimeContainerd (default from 1.19)
Docker (deprecated)
DockerContainerd (from 1.19)
Docker (before 1.19)
containerdContainerdDocker, containerd, CRI-ODockerDocker, containerdcontainerdcontainerdDockerDockerContainerdContainerdContainerd
43
Serverless containersGKE AutopilotAWS FargateAzure Virtual Nodes✖︎✖︎In Beta stateAlibaba Cloud ASK/ECI✖︎✔️
44
Managed nodes✔️✔️✖︎✖︎✔️✔️✔️✖︎✔️
45
SandboxgVisorNot availableNot availableNot availableSmall D2-4 and D2-8 VMsgVisor, Kata ContainersNot availableAlibaba Cloud Sandboxed-Container (Based on Kata)Not availableNot available✖︎Not AvailableNot AvailableNot AvailableVirtual Kubernetes / vk8s
46
Bare metal nodes support✖︎✖︎✖︎✔️In private preview / To be released✖︎✖︎✔️✖︎✖︎✖︎✖︎✖︎✖︎✔️
47
GPU nodes✔️✔️✔️✔️✔️✔️✖︎✔️✖︎✖︎✖︎✖︎✖︎✖︎✔️
48
TPU nodes✔️✖︎✖︎✖︎✖︎✖︎Needs help✖︎✖︎Needs help✖︎Needs help✖︎✖︎✔️
49
Node Auto-repair✔️✖︎✔️✔️✔️✔️Needs help✔️✔️Needs help✖︎Needs help✔️✖︎✔️
50
Custom Kubelet arguments✔️✔️✔️Not documented✔️✔️✔️✖︎✖︎✔️✖︎✖︎
51
Notes
52
NotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotes
53
54
7. Networking
55
Container NetworkingNative GKE CNI, Cilium, CalicoAmazon VPC CNI (official support)
Cilium, Calico, Weave Net, Antrea
Kubenet, Azure CNICalicoCalicoCilium, Calico, WeaveNet, FlannelCiliumACK Terway, FlannelCalicoFlannelFlannelCalicoCiliumCalicoNative
56
Multi-cluster networking✔️✖︎✖︎✖︎Possible via vRack✖︎✖︎✖︎✔️
57
Service meshAnthos, Istio (Beta)AWS AppMesh, IstioIstio, Linkered, ConsulIstioSelf managed✖︎Istio✖︎✖︎✔️
58
L4 load balancing✔️✔️✔️Classic and VPC clusters✔️✔️✔️✔️✔️✔️✔️
59
L7 load balancing✔️✔️✖︎VPC Clusters only✔️Nginx, Traefik✖︎✔️Nginx✔️
60
NotesNotes
61
NotesNotesNotesNotesNotesNotesNotes
62
63
8. Autoscaling
64
Cluster Autoscaling✔️✔️✔️✔️✔️✔️✔️✔️✔️Needs help✖︎Needs helpTo be released✔️✔️
65
Autoscaling ProfileBalanced, Optimize UtilizationBalanced, Optimize UtilizationBalanced, Optimize Utilization✖︎✖︎Cluster Autoscaler optionsBalanced, Optimize Utilization✖︎
66
Vertical Pod Autoscaling✔️✔️✖︎✖︎✔️✔️✔️✔️
67
Horizontal Pod Autoscaling✔️✔️✔️✖︎✔️✔️✔️✔️✔️✔️✔️✔️
68
NotesNotes
69
NotesNotesNotesNotesNotesNotesNotes
70
71
9.Security
72
SecretsEncrypted at rest with Cloud KMSEncrypted at rest with AWS KMSEncrypted at rest with Azure KMS (KeyVault)Encrypted at rest with IBM Key ProtectKubernetes SecretsKubernetes SecretsEncrypted at restEncrypted at rest with Alibaba Cloud KMSEncrypted at restNot encrypted at restEncrypted at restEncrypted at restNot encrypted at restEncrypted at restBlindfold
73
Key for encryptionConfigurableConfigurableManaged by AKSConfigurable✖︎✖︎Managed by DigitaloceanConfigurableManaged by IONOSNot available✖︎Not availableNot availableManaged by Vultr✔️
74
Network policy support✔️Yes (Calico)Yes (Azure, Calico)Yes (Calico)Yes (Calico)Yes (Cilium, Calico)Yes (Cilium)Yes (Terway)Yes (Calico)Yes (k3s automatic)✖︎Yes (Calico)Yes (Calico)Yes (Calico)✔️
75
Kubernetes RBAC✔️✔️✔️✔️✔️✔️✔️✔️✔️✔️✔️✔️
76
IP Address for control planePublic (default)
Private (configurable)
Public (default)
Private (configurable)
Public (default)
Private (configurable)
Public (default)
Private (configurable)
PublicPublicPrivate (default)
Public (configurable)
PublicPublicPublicPublicLocal & Global
77
Multi-tenancy in single cluster✔️✔️✔️✔️✔️✔️✔️✔️✔️
78
Kubernetes Admission Controllers✖︎✔️✔️✔️✔️✔️✔️✔️✔️
79
Pod Security Policies✔️✔️✔️✔️✔️✔️✔️✖︎✔️
80
Shielded Node✔️✖︎✔️✖︎gVisor, Kata with Containerd✔️✖︎
81
OIDC✔️✔️✔️Not Documented✔️✔️✔️✖︎
82
Notes
83
NotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotes
84
85
10. Availability
86
SLAs99.5% (zonal), 99.95% (regional), 99.95% (Autopilot cluster), 99.9% (Autopilot pods in multiple zones)99.00%99.95% (with az), 99.9% (without az)99.9% (single-zone region), 99.99% (multi-zone region)Worker nodes: 99.999%
APIserver: 99.5%
99.95%Needs help99.5% (single-zone region), 99.95% (multi-zone region)99.95%Beta100%99.9%Beta100%99. 99%
87
Financially backed SLA✔️✔️Opt-in✔️
On worker nodes, load balancer, persistent storage
✖︎✖︎✔️✔️N/AOpt-in✔️
88
Control plane replica✔️✔️Not documented✔️✔️✔️✔️✔️✔️
89
Control plane in multiple zones✔️✔️✔️✔️✖︎✔️✖︎✖︎✔️
90
Control plane in multiple regions✖︎✖︎✖︎✖︎✔️✖︎✔️✖︎✖︎✔️
91
Nodes in multiple zones✔️✔️✔️✔️✖︎✔️✔️✔️✖︎✔️
92
Nodes in multiple regions✖︎✖︎✖︎✖︎✖︎✔️✔️✖︎✖︎✔️
93
Notes10+ regions available worldwide
94
NotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotes
95
96
11. Monitoring & Management Tools
97
Dashboard GUIGoogle Cloud ConsoleKubernetes DashboardContainer insightsIBM Cloud CatalogOVHcloud console✔️ACK Console
Kubernetes Dashbord(Helm Chart)
Kubernetes Dashboard✖︎✔️
98
Integrated Log Service (Resource level)Cloud Operations suite for GKEControl plane logging (CLoudWatch)Container insights✔️✖︎✖︎✖︎Alibaba Cloud SLS✖︎✖︎✔️
99
Integrated Metrics (Resource level)Cloud Operations suite for GKEContainer InsightsContainer insightsIBM Cloud Monitoring✖︎✖︎✖︎Alibaba Cloud Prometheus
Metrics Server
✖︎✖︎✔️
100
Resource monitoring dashboard✔️✔️Container insightsNot Documented✖︎✖︎✔️✖︎✖︎✔️