Kubernetes On-Prem
 Share
The version of the browser you are using is no longer supported. Please upgrade to a supported browser.Dismiss

 
$
%
123
 
 
 
 
 
 
 
 
 
ABCDEFGHIJKLMNOPQRSTUVWXYZAA
1
OpenShift Container PlatformRancher RKEVMware Enterprise PKSDocker Enterprise Charmed KubernetesMicroK8sKubermaticSUSE CaaS Platform v3SUSE CaaS Platform v4 (July 2019)MetalK8sMesosphere Kubernetes Engine
(MKE)
IBMDaoCloud EnterprisePlatform9Giant SwarmGKE On-PremNirmataMirantis Cloud PlatformNutanix
2
CompanyRed HatRancherPivotal / VMwareDockerCanonicalCanonicalLoodseSUSESUSEScalityMesosphereIBMDaoCloud Inc.Platform9 Systems Giant SwarmGoogleNirmata, IncMirantisNutanix Karbon
3
SDNOpenShift SDNCanal, Flannel, CalicoNSX-TCalicoCanal, Flannel, Calico, Tigera Secure EEHost bridgeCanal, CalicoFlannelCiliumCalicoCalicoCalicoCalico, MacVlan, FlannelCalico, Weave, Flannel, OpenContrailCalico, FlannelFlannel, Calico, Cloud ProviderCalico, Tungsten Fabric
4
StorageCNS / including NFS, iSCSI, Fiber Channel, OpenStack Cinder, FlexVolume, GlusterFS, Ceph RBD, Azure Disk, Azure File, AWS EBS, GCE Persistent Disk, VMware VMDKCloud provider, iSCSIvSAN, VMFS, iSCSI, FCNFSCeph, NFS, iSCSI, FTP, hostpath. NetApp Trident (OnTAP, Santricity, etc), StorageOS and Pure. Cloud storage on Openstack (Cinder), AWS (EFS/EBS), GCP Persistent Disk, AzureHost pathCustomSUSE Enterprise Storage (Ceph), NFS, hostpathSUSE Enterprise Storage (Ceph), NFS, hostpathNative LVM, NFS, customCSI, local, Portworx NFS,PortworxSupport all Cinder backed storage endpoints, PortworxNFS, iSCSICloud Provider, Rook, Portworx, Nutanix, NFSCeph, Rook, EMC, NetApp, etc.
5
Security FocusHighModerateModerateHighHighHighModerateHighModerateHighHigh
6
Node OSRHEL AtomicRancherOSUbuntuCentOS, OEL, RHEL, SLES, Ubuntu, Windows, (incl s390x and ppc64le)Ubuntu - x86, ARM, ZUbuntu, Debian, Fedora, Arch, other Linux (AMD64 and ARM64)Ubuntu, CoreOS, Container LinuxSUSE MicroOSSLES 15 SP1CentOSLinux - variousUbuntuLinuxLinux - CentOS, RHEL, Ubuntu all supportedCoreOSESXi/vSphere VMWare 6.5 + Ubuntu 18.04OSCentOS, RHEL, UbuntuUbuntu
7
Vanilla KubernetesNoYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
8
Installation Complexitysimplesimplemoderatesimplesimplesimplesimplesimplesimplesimplesimplesimplesimplesimple - a SaaS managed service SaaS, or consulting deploymentsimple - SaaS
9
Cost is a % of OpenShift100%20%50%Docker EE for RHEL - Advanced $200/pm per Node20%20%FreeSubscription per DC + nodeSubscription per yearSubscription
10
Trial Available30 days - 60 daysUnlimited30 days30 daysFree, support with Ubuntu AdvantageFree, support with Ubuntu Advantageonline demo system60 days with updates60 days with updatesFree with no supportOpen Source - yes, forever
DC/OS Enterprise - Eval and PoC available
YesPoC possibleInvitation OnlyYes (SaaS), PoC (On-prem)
11
Preferred IaaS LayerOpenStack, AWS, GCP, Azure, IBM, VMware-VMware, AWS, GCP, AzureVMware, AWS, AzureBare metal, Openstack, AWS, Azure, Google Cloud, KVM, VMware. Native integration to cloud services like LBaaS.AnyOpenStack, VMware, AWS, Azure, DigitalOceanBare metal, KVM, Xen, VMware vSphere/ESXi, Microsoft HyperV, SUSE OpenStack Cloud, public cloud infrastructureBare metal, KVM, Xen, VMware vSphere/ESXi, Microsoft HyperV, SUSE OpenStack Cloud, public cloud infrastructureBare metal, VMWare, OpenStackBare metal, AWS, Azure, GCP, OpenStack, HyperV, RHV, Vmware, public cloud infrastructure-Bare metal, VMWare, OpenStackBare metal, VMware, OpenStack, AWSBare Metal, VMware, AWS, Azure, AzureStackAWS, Azure, Bare Metal, VMwareBare Metal, OpenStack
12
Cost$1200 per virtual core (workers only)?$1200 per server, $400 per VM$1200 per physical server, $400 per VM0%20%
13
ConfigAnsiblecluster.yamlBOSHAutomatedSnapCRDSaltSaltAnsibleTerraform + Ansible for DC/OS installation. Full Service Automation for Mesosphere Kubernetes EngineCRDs + Ignition + PXESalt
14
Documentationhttps://docs.openshift.com/ tutorials at http://learn.openshift.comhttps://rancher.com/docs/https://docs.pivotal.io/runtimes/pks/1-3/index.htmlhttps://docs.docker.com/ee/https://ubuntu.com/kubernetes/docs/https://microk8s.io/https://docs.kubermatic.io/https://www.suse.com/documentation/suse-caasp-3/https://metal-k8s.readthedocs.io/en/latest/index.htmlhttps://docs.mesosphere.com/services/kubernetes/latesthttps://www.ibm.com/cloud/privatehttp://guide.daocloud.io/dce-v3.0/latest/dce-3-0-lts-20974188.htmlhttps://docs.platform9.com/https://docs.giantswarm.iohttps://docs.nirmata.io/docs.mirantis.com
https://www.nutanix.com/2018/11/27/nutanix-karbon-enterprise-grade-kubernetes-solution/
15
Preferred Load BalancerF5 / NetscalerNginxNSX-TNginxF5 / Nginx, IstioBuilt-in LB, IstioF5 / NginxNginxNginxdklb + Edge-LB plus optional external LB (F5, AWS, GCP, Azure, etc..)IstioHAProxy,NginxOctavia, AVINGINXF5HAProxy, Citrix CPX, Cloud ProviderMetalLB, NGINX included
16
17
OpenShift (container platform)Rancher RKEPKSDocker Enterprise Charmed KubernetesMicroK8sKubermaticSUSE CaaS Platform v3SUSE CaaS Platform v4MetalK8sMesosphereIBMDaoCloud EnterprisePlatform9Giant SwarmGKE On-PremNirmata
18
Why?Large stable company, massive ecosystem, security hardened, 10 years of support.Free software, inexpensive support contract, simple setup and maintenance, awesome team. Can provision K8s on many platforms. No vendor lock-in!Integrates well with VMWare. Cheaper than OpenShift with a comparable ecosystem.Security: Unified RBAC across Kubernetes and registry. FIPS certified. Platform: Supports Windows containers and other architectures for Linux like Z and P.Supports more clouds, metal, virt. Free with support available. Multi-cluster management is easy. Multi-cloud integration is great. The support pricing is very attractive and a fully-managed service is also available. Robust, secure, single-node k8s for IoT, edge, developer workstation, CI/CDKubernetes in Kubernetes architecture means a smaller footprint and complete cluster isolation plus HA master control plane. This architecture is unique.Entire stack supported by one enterprise vendor with a large hardware and cloud provider ecosystem, at a lower cost than similar competitors.Entire stack supported by one enterprise vendor with a large hardware and cloud provider ecosystem, at a lower cost than similar competitors.Free, open source, no commercial people pushing it and being annoyingMesosphere Kubernetes Engine is a pure open source Kubernetes offering with additional benefits such as;
- High Density Multi-Kubernetes - allowing you to run multiple Kubernetes clusters on the same operating systems without the need for virtualization.
- Full Service Automation - push button cloud-like deployment
- Full HA - simply check a box to ensure HA with health monitoring ensuring continual availability and repair in the event of a failure
- Consistent Kubernetes regardless of IaaS - ensure the same developer and operator experience across all your infrastructure providers. Public cloud providers do not all offer the same version of Kubernetes leading to inconsistencies in versions, features, automation and security
 - Templates for Kubernetes cluster deployment - define once and deploy as required
- Single control plane for operators of Kubernetes clusters

Further advantages when;
- deploying across more than one infrastructure provider with stretch and linked DC/OS clusters
- stateful applications with persistent storage requirements
- big data and analytics workloads such as Spark, Kafka, Cassandra, Hadoop, HDFS, HiveMQ, Elastic
- ensure portability across all providers
- HA across providers


KUDO - Kubernetes Operators declarative creation framework without needing code
Fully managed Kubernetes with 24/7 SLA of 99.9% uptime and availability for Kubernetes clusters promised by contract. Easy setup and upgrades. Auto detection and repair of issues.
Can provision Kubernetes on VMware, Linux/KVM, OpenStack, Bare metal and AWS. Comes with it's own IaaS layer provisioning if the customer does not have one.
Running K8s in production on-premise for large enterprises such as Adidas, AMAG and Vodafone since 2016. CI/CD pipeline into every installation that facilitates daily updates, hot-fixes, and security patches. Provided update on latest K8s security bug for all supported Kubernetes versions within 24h. Proactive Troubleshooting as Giant Swarm fixes any issue in one of their hundreds of managed Kubernetes clusters across all their customers preventing everyone else running into the same issue. Providing upgrades for all managed open source components including K8s within 30 days after latest release. Guaranteed uptime of 99.95% via SLAs. Providing lots of additional managed services within your K8s clusters. Their support via Slack is outstanding. Offered as cloud based service and dedicated on-prem. Also works with managed Kubernetes services as well (EKS, GKE, AKS). Easy to use. Built for teams providing centralized container-as-a-service to multiple teams. Multi-tenant, multi-cloud, multi-clusterAddresses key challenges in running k8s on-prem by pre-integrating Ceph, Calico, CoreDNS, MetalLB, NGINX, as well as lifecycle management and continuous monitoring systems. Offered through build-operate-transfer delivery model with up to 99.99% SLA guarantees and zero lock-in.
19
Why Not?Cost. Vendor lock in. IBM.....Smaller company (risk of acquisition), you'd need to setup an IaaS layer or manage bare metal.Can get complex (see NSX-T documention for an example). BOSH may scare some people.Current version uses non-native RBACNo PAAS, just upstream K8s.Single-node specialized distributionSmaller company (risk of acquisition), you'd need to setup an IaaS layer or manage bare metal.If you're a very small team, have only a single Kubernetes cluster, or only running applications in a single provider - other less mature Kubernetes offerings may be easier to start with.
I'd expect this to get sunset after the Redhat acquisition.All of the docs are in ChineseYou need to setup IaaS layer (or bring your own cloud)
20
21
There's an opinionated blog about all of this here: https://kubedex.com/redhat-openshift-vs-pivotal-pks-vs-rancher/
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
Loading...
Main menu