ABCDEFGHIJKLMNOPQRSTUVWXYZAAABACADAEAFAGAHAIAJAKALAMAN
1
2
ProductGoogle Kubernetes Engine (GKE)Amazon Elastic Kubernetes Service
(EKS)
Azure Kubernetes Service (AKS)IBM Cloud
Kubernetes Service (IKS)
OVHcloud Managed Kubernetes Service (MKS)Scaleway KapsuleDigitalocean Kubernetes (DOKS)Alibaba Cloud Container Service for Kubernetes (ACK)IONOS Kubernetes ServiceCivo Kube100Gridscale Managed Kubernetes (GSK)Linode Kubernetes Engine (LKE)SymbiosisKubernetes on PacketOracle Kubernetes Engine (OKE)MetaKubeVultr Kubernetes Engine (VKE)F5 XC AppStack
3
1. General info(status: needs help)(status: needs help)(status: in progress)
4
Linkhttps://cloud.google.com/kubernetes-enginehttps://aws.amazon.com/eks/
https://azure.microsoft.com/en-us/services/kubernetes-service/
https://www.ibm.com/cloud/container-service/
https://www.ovhcloud.com/en-gb/public-cloud/kubernetes
https://www.scaleway.com/en/kubernetes-kapsule/
https://www.digitalocean.com/products/kubernetes/
https://www.alibabacloud.com/product/kuberneteshttps://cloud.ionos.com/managed/kuberneteshttps://www.civo.com/kube100https://gridscale.io/en/products/kubernetes/https://www.linode.com/docs/kubernetes/https://symbiosis.hosthttps://www.packet.com/solutions/kubernetes/
https://www.oracle.com/cloud/compute/container-engine-kubernetes.html
https://metakube.syseleven.de/https://www.vultr.com/kubernetes/https://docs.cloud.f5.com/docs/services/app-stack
5
Release NotesGKE release notesAmazon EKS Kubernetes versionshttps://github.com/Azure/AKS/releasesKubernetes version information
https://github.com/ovh/public-cloud-roadmap/projects/1
Kubernetes version support policyDigitalOcean Kubernetes Supported ReleasesRelease notes (aliyun.com)https://gridscale.io/en/release-notes/Release Notes | Documentation (syseleven.de)https://www.vultr.com/docs/vultr-kubernetes-engine-changelog
https://docs.cloud.f5.com/docs/changelog/saas-rel-notes
6
7
2. Supported versions
8
1.28✔️
9
1.27✔️✔️✔️✔️✖︎✔️✔️✖︎✔️✔️
10
1.26✔️✔️✔️✔️✔️✔️✔️✔️✔️✔️
11
1.25✔️✔️✔️✔️✔️✔️✔️✖︎✔️✔️✔️
12
1.24✔️✔️✔️✔️✔️✔️✔️✔️✖︎✔️✖︎
13
1.23Comparison of Kubernetes managed services✔️✔️✖︎✖︎✖︎✖︎✖︎✖︎✖︎✔️✔️
14
Notes
15
NotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotes
16
How to contribute:
17
3. QuotasLeave a comment or drop us a line at research@learnk8s.io
18
Max number of clusters per region50/zone + 50 regional clusters100 (can be increased on request)1000 (maximum number of clusters per account)10020 (can be increased on request)UnlimitedNeeds help2000Unlimited99UnlimitedUnlimitedUnlimitedUnlimited1 to Unlimited: based on tier
19
Max nodes per clusterLicense:1500013500100050010050051250005000993212610003 Controller & 97 Worker/per AZ
20
Max nodes per node poolApache 2.01000450100500100500512200010099N/A100Unlimited
21
Max node poolsLast updated:No documented3010500100500Needs help3605001Not supported126Unlimited
22
Max pods per NodeJune 18, 2023256250250250100110 per default (configurable per pool)110256100100110110100150
23
Max pods per cluster150,000Not documentedNot documentedNot documentedNot documentedNot documented3300450-15000
24
Max containers per cluster300,000Not documentedNot documentedNot documentedNot documentedNot documentedNot documented
25
Notes
26
NotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotes
27
Find more research at:
28
4. Pricehttps://learnk8s.io/research
29
Control plane10 cents per hour per control plane10 cents per hour per control plane
Default - Free
Uptime SLA-10 cents per cluster per hour
FreeFreeFreeFree
Uptime SLA-9 cents per cluster per hour
Free(Optional)
FreeFreeFreeFreeFreeFreeMulti Tier: Free, Individual, Team, Organization
30
Notes
31
NotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotes
32
33
5. Upgrades and maintainance
34
Control plane upgradesAutomatic + ManualAutomatic + ManualAutomatic + ManualPatch upgrades - Automatic
Major/Minor upgrades - Manual
Automatic + ManualAutomatic + ManualAutomatic + ManualAutomatic + ManualAutomatic + ManualAutomaticAutomaticAutomaticAutomaticAutomaticAutomatic
35
Worker nodes upgradesAutomatic + ManualAutomatic + ManualAutomatic + ManualManualAutomatic + ManualAutomatic + ManualAutomatic + ManualAutomatic + ManualAutomatic + ManualAutomaticPatch upgrades - Automatic
Major/Minor - Manual
Automatic + ManualAutomaticAutomaticManual & Automatic (optional)
36
Notes
37
NotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotes
38
39
6. Nodes
40
Operating systemContainer Optimised OS, Ubuntu, Windows ServerAmazon Linux 2
Ubuntu
Bottlerocket
Windows
Ubuntu
Windows Server
UbuntuUbuntuUbuntu 20.04Debian 9Alibaba Cloud Linux 3/2, ContanerOS, Windows Server and Bring-Your-Own-OSUbuntuUbuntuUbuntuDebianUbuntuDebian 9Container Optimized OS; CentOS 7
41
Container runtimeContainerd (default from 1.19)
Docker (deprecated)
DockerContainerd (from 1.19)
Docker (before 1.19)
containerdContainerdDocker, containerd, CRI-ODockerContainerd, dockercontainerdcontainerdDockerDockerContainerdContainerdContainerd
42
Serverless containersGKE AutopilotAWS FargateAzure Virtual Nodes✖︎✖︎In Beta stateAlibaba Cloud ASK/ECI✖︎✔️
43
Managed nodes✔️✔️✖︎✖︎✔️✔️✔️✔️✖︎✔️
44
SandboxgVisorNot availableNot availableNot availableSmall D2-4 and D2-8 VMsgVisor, Kata ContainersNot availableAlibaba Cloud Sandboxed-Container (Based on Kata)Not availableNot available✖︎Not AvailableNot AvailableNot AvailableVirtual Kubernetes / vk8s
45
Bare metal nodes support✖︎✖︎✖︎✔️In private preview / To be released✖︎✖︎✔️✖︎✖︎✖︎✖︎✖︎✖︎✔️
46
GPU nodes✔️✔️✔️✔️✔️✔️✖︎✔️✖︎✖︎✖︎✖︎✖︎✖︎✔️
47
TPU nodes✔️✖︎✖︎✖︎✖︎✖︎Needs help✖︎✖︎Needs help✖︎Needs help✖︎✖︎✔️
48
Node Auto-repair✔️✖︎✔️✔️✔️✔️Needs help✔️✖︎Needs help✖︎Needs help✔️✖︎✔️
49
Custom Kubelet arguments✔️✔️✔️Not documented✔️✔️✔️✖︎✖︎✔️✖︎✖︎
50
Notes
51
NotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotes
52
53
7. Networking
54
Container NetworkingNative GKE CNI, Cilium, CalicoAmazon VPC CNI (official support)
Cilium, Calico, Weave Net, Antrea
Kubenet, Azure CNICalicoCalicoCilium, Calico, WeaveNet, FlannelCiliumACK Terway, FlannelCalicoFlannelFlannelCalicoCiliumCalicoNative
55
Multi-cluster networking✔️✖︎✖︎✖︎Possible via vRack✖︎✔️✖︎✖︎✖︎✔️
56
Service meshAnthos, Istio (Beta)AWS AppMesh, IstioIstio, Linkered, ConsulIstioSelf managed✖︎Istio, ASM (Alibaba Cloud Service Mesh)✖︎✖︎✖︎✔️
57
L4 load balancing✔️✔️✔️Classic and VPC clusters✔️✔️✔️✔️✔️✔️✔️
58
L7 load balancing✔️✔️✖︎VPC Clusters only✔️Nginx, Traefik✔️✖︎✔️Nginx✔️
59
NotesNotes
60
NotesNotesNotesNotesNotesNotesNotes
61
62
8. Autoscaling
63
Cluster Autoscaling✔️✔️✔️✔️✔️✔️✔️✔️✔️Needs help✔️Needs helpTo be released✔️✔️
64
Autoscaling ProfileBalanced, Optimize UtilizationBalanced, Optimize UtilizationBalanced, Optimize Utilization✖︎✖︎Cluster Autoscaler optionsBalanced, Optimize Utilization✖︎✖︎
65
Vertical Pod Autoscaling✔️✔️✖︎✖︎✔️✔️✔️✖︎✔️
66
Horizontal Pod Autoscaling✔️✔️✔️✖︎✔️✔️✔️✔️✔️✔️✔️✔️
67
NotesNotes
68
NotesNotesNotesNotesNotesNotesNotes
69
70
9.Security
71
SecretsEncrypted at rest with Cloud KMSEncrypted at rest with AWS KMSEncrypted at rest with Azure KMS (KeyVault)Encrypted at rest with IBM Key ProtectKubernetes SecretsKubernetes SecretsEncrypted at restEncrypted at rest with Alibaba Cloud KMSEncrypted at restNot encrypted at restEncrypted at restEncrypted at restNot encrypted at restEncrypted at restBlindfold
72
Key for encryptionConfigurableConfigurableManaged by AKSConfigurable✖︎✖︎Managed by DigitaloceanConfigurableManaged by IONOSNot available✖︎Not availableNot availableManaged by Vultr✔️
73
Network policy support✔️Yes (Calico)Yes (Azure, Calico)Yes (Calico)Yes (Calico)Yes (Cilium, Calico)Yes (Cilium)Yes (Terway)Yes (Calico)Yes (k3s automatic)✖︎Yes (Calico)Yes (Calico)Yes (Calico)✔️
74
Kubernetes RBAC✔️✔️✔️✔️✔️✔️✔️✔️✔️✔️✔️✔️
75
IP Address for control planePublic (default)
Private (configurable)
Public (default)
Private (configurable)
Public (default)
Private (configurable)
Public (default)
Private (configurable)
PublicPublicPrivate (default)
Public (configurable)
PublicPublicPublicPublicLocal & Global
76
Multi-tenancy in single cluster✔️✔️✔️✔️✔️✔️✔️✔️✔️✔️
77
Kubernetes Admission Controllers✖︎✔️✔️✔️✔️✔️✔️✔️✔️✔️
78
Pod Security Policies✔️✔️✔️✔️✔️✔️✔️✔️✖︎✔️
79
Shielded Node✔️✖︎✔️✖︎gVisor, Kata with Containerd✔️✖︎✖︎
80
OIDC✔️✔️✔️Not Documented✔️✔️✔️✖︎✖︎
81
Notes
82
NotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotes
83
84
10. Availability
85
SLAs99.5% (zonal), 99.95% (regional), 99.95% (Autopilot cluster), 99.9% (Autopilot pods in multiple zones)99.00%99.95% (with az), 99.9% (without az)99.9% (single-zone region), 99.99% (multi-zone region)Worker nodes: 99.999%
APIserver: 99.5%
99.95%Needs help99.5% (single-zone region), 99.95% (multi-zone region)99.95%Beta100%99.9%Beta100%99. 99%
86
Financially backed SLA✔️✔️Opt-in✔️
On worker nodes, load balancer, persistent storage
✖︎✖︎✔️✔️N/AOpt-in✔️
87
Control plane replica✔️✔️Not documented✔️✔️✔️✔️✔️✔️
88
Control plane in multiple zones✔️✔️✔️✔️✖︎✔️✔️✖︎✖︎✔️
89
Control plane in multiple regions✖︎✖︎✖︎✖︎✔️✖︎✖︎✖︎✖︎✔️
90
Nodes in multiple zones✔️✔️✔️✔️✖︎✔️✔️✔️✖︎✔️
91
Nodes in multiple regions✖︎✖︎✖︎✖︎✖︎✔️✔️✖︎✖︎✔️
92
Notes10+ regions available worldwide
93
NotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotesNotes
94
95
11. Monitoring & Management Tools
96
Dashboard GUIGoogle Cloud ConsoleKubernetes DashboardContainer insightsIBM Cloud CatalogOVHcloud console✔️ACK Console✖︎Kubernetes Dashboard✖︎✔️
97
Integrated Log Service (Resource level)Cloud Operations suite for GKEControl plane logging (CLoudWatch)Container insights✔️✖︎✖︎✖︎Alibaba Cloud SLS✔️✖︎✖︎✔️
98
Integrated Metrics (Resource level)Cloud Operations suite for GKEContainer InsightsContainer insightsIBM Cloud Monitoring✖︎✖︎✖︎Alibaba Cloud Prometheus✖︎✖︎✖︎✔️
99
Resource monitoring dashboard✔️✔️Container insightsNot Documented✖︎✖︎✔️✖︎✖︎✖︎✔️
100
TraceCloud TraceAWS X-RAYApplication InsightsConfigured Manually✖︎✖︎✖︎Alibaba Cloud Trace Analysis✖︎✖︎✖︎✔️