1 of 42

Cost effective

Cloud Storage

Dov Amir

Sr. Solutions Architect

AWS

dov@amazon.com

2 of 42

3 of 42

https://youtu.be/653PUAI0G8s?t=359

4 of 42

5 of 42

6 of 42

7 of 42

8 of 42

9 of 42

5 Pillars of Well-Architected Framework

10 of 42

11 of 42

12 of 42

Cloud storage families

​

Storage

as a API

service

Databases

Mounted drives

13 of 42

Cloud storage family 1 - Mounted drive

​

  • Access with File system mount
  • Storage that connects to a server with CPU

14 of 42

Block storage

​

100$ per TB / Month

price

AWS

Managed disks

Azure

GCP

15 of 42

Network file storage

​

60$ per TB / Month

price

AWS

Azure

GCP

16 of 42

Cloud storage family 2 - Storage as a Service

​

  • Access with REST API
  • Remote storage with no CPU of its own

17 of 42

Personal file storage

​

10$ per USER / Month

price

WorkDocs

AWS

OneDrive \ Sharepoint online

Azure

GDrive

GCP

18 of 42

Object storage

​

10$ per TB / Month

price

AWS

Azure

GCP

19 of 42

Archive storage

​

1$ per TB / Month

price

AWS

Azure

GCP

20 of 42

CDN

​

100$ per TB / Month

price

AWS

Azure

GCP

21 of 42

Cloud storage family 3 - Databases

​

  • Access with DRIVER
  • Storage with its own CPU and query language

22 of 42

23 of 42

SQL Database

​

1000$ per TB / Month

price

RDS

AWS

Azure

GCP

24 of 42

Data Warehouse \ MPP

​

1000-10000$ / Month (sometimes priced by usage)

price

Redshift

AWS

Azure

GCP

25 of 42

NOSQL Database

1000$ per TB / Month (sometimes priced by usage)

price

AWS

Azure

GCP

26 of 42

New SQL Database (sharded sql)

​

​

price

​

AWS

SQL Database Hyperscale (Citus)

Azure

Cloud Spanner

GCP

27 of 42

In memory Database

​

1000$ per 50GB / Month

price

ElastiCache

AWS

Azure

cloud memory store

GCP

28 of 42

Cloud storage types cost / month

Archive storage - AWS Glacier $1 per TB

Object storage - S3 / Blob $10 per TB

File storage - Network folders $60 per TB

Block storage - SSD disk $100 per provisioned TB

Database storage - no/SQL $1000 per provisioned TB

Memory storage - Redis $1000 per 50 GB

Mount

API

Driver

29 of 42

Data lake

30 of 42

31 of 42

Serverless SQL engines on raw data

​

​

​

Athena (Presto), RedShift spectrum

AWS

Data lake analytics

Azure

Big Query

GCP

MongoDB atlas data lake

MongoDB

32 of 42

​

​

​

A future category of cloud databases ?

33 of 42

​

​

​

34 of 42

​

Storage tips

  • Archive
  • Object storage
  • Database
  • Storage lifecycle policy

​

​

35 of 42

36 of 42

backups/snapshots

37 of 42

primary

replica

replica

38 of 42

primary

replica

replica

39 of 42

primary

replica

replica

Writes and reads

Reads only

Reads only

40 of 42

primary

replica

replica

Writes

Reads only

Reads only

41 of 42

primary

replica

replica

primary

replica

replica

primary

replica

replica

Router

Reads and Writes

Shard 1 A-I

Shard 2 J-S

Shard 3 T-Z

42 of 42

THANK YOU

​

​