| A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | SQLFire Sample Capacity Planning Worksheet | V03 | ||||||||||||||||||
2 | ||||||||||||||||||||
3 | Directions: | To enter your own data or check formulas, go to File > Make a Copy. You will have your own version on your own drive. | ||||||||||||||||||
4 | Use the table below to get an estimated amount of storage space. The total storage space is used as input to the second table and set of calculations to show the number and size of servers. | |||||||||||||||||||
5 | Fill out the white cells. For each table in column C, fill out columns D, E, F, G, I and J. Gray columns are calculated. | |||||||||||||||||||
6 | "OTHER Tables" is used as a generic catchall. It is not intended to replace a row for an important table. Add more rows for working tables. | |||||||||||||||||||
7 | If you need to add rows for more tables, make sure you replicate the calculations in columns P thru S to the new rows. These calculations are used in column H and subsequent forumulas. | |||||||||||||||||||
8 | * For more information on row sizes, see the documentation: http://pubs.vmware.com/vfabric53/index.jsp?topic=/com.vmware.vfabric.sqlfire.1.1/data_management/memory_analytics/memory_requirements_chapter.html | |||||||||||||||||||
9 | ||||||||||||||||||||
10 | Estimate Storage Space | |||||||||||||||||||
11 | Table Names | Raw data size per row* | Estimated duplicate rows in table | Overflow table | Persistent table | Disk Overhead | Primary Index | Number of secondary indexes | Index Overhead | Estimated Number of Rows | Estimated storage (GB) | Table Used for Calculations. Do not remove or change! | ||||||||
12 | TABLE1 | 4096 | 0 | Y | N | 64 | Y | 3 | 152 | 1,000,000 | 4.02 | 0 | 0 | 0 | 64 | |||||
13 | TABLE2 | 4096 | 1 | N | Y | 120 | N | 0 | 0 | 1,000,000 | 7.85 | 0 | 0 | 120 | 0 | |||||
14 | TABLE3 | 150 | 3 | N | N | 64 | N | 0 | 0 | 1,000,000 | 0.80 | 0 | 64 | 0 | 0 | |||||
15 | TABLE4 | 150 | 1 | Y | Y | 152 | Y | 1 | 104 | 1,000,000 | 0.76 | 152 | 0 | 0 | 0 | |||||
16 | TABLE5 | 7056 | 4 | Y | Y | 152 | Y | 2 | 128 | 1,000,000 | 34.16 | 152 | 0 | 0 | 0 | |||||
17 | TABLE6 | 100 | 1 | Y | Y | 152 | Y | 2 | 128 | 1,000,000 | 0.71 | 152 | 0 | 0 | 0 | |||||
18 | TABLE7 | 3072 | 0 | Y | Y | 152 | Y | 2 | 128 | 1,000,000 | 3.12 | 152 | 0 | 0 | 0 | |||||
19 | TABLE8 | 200 | 5 | Y | Y | 152 | Y | 2 | 128 | 1,000,000 | 2.68 | 152 | 0 | 0 | 0 | |||||
20 | TABLE9 | 100 | 0 | Y | Y | 152 | Y | 2 | 128 | 1,000,000 | 0.35 | 152 | 0 | 0 | 0 | |||||
21 | OTHER Tables | 5.00 | ||||||||||||||||||
22 | Totals | 9,000,000 | 59.45 | |||||||||||||||||
23 | Directions: | |||||||||||||||||||
24 | In the table below, enter data into the white cells with red text. | |||||||||||||||||||
25 | Choose the number of days you plan to store data in memory. | |||||||||||||||||||
26 | Enter the JVM head room percentage and JVM heap size. | |||||||||||||||||||
27 | Enter the RAM per physical machine. | |||||||||||||||||||
28 | ||||||||||||||||||||
29 | Estimate Number of Machines and RAM | About these Calculations: | ||||||||||||||||||
30 | 59.45 | GB of primary storage per day | The table to the left helps to allocate the number of machines and RAM. This brief narrative helps to explain how we apply JVMs and VMs to physical machines. From the prior table, we take the daily storage as input. In this case, it is almost 60GB. The number of days we store data in this example is 6, so we have almost 360 GB of RAM needed. Then, we add 40% for JVM overhead of 143 GB and make the data redundant to bring the amount to 1 TB ((360+143)*2). We assume a decision to make JVM heap size at 32GB (for performance) and divide the 1 TB by this amount to end up with 16 JVMs for primary RAM and the same for redundant. Next, we allocate to physical machines. If you are hosting 32 GB JVMs on 352GB of RAM, then you can have 352/32 JVMS or 11 JVMs. Before, we caluclated 16 JVMs for our primary data so we would need 2 machines of the 384 GB RAM size. Of course, the pieces of data can change for particular deployments. | |||||||||||||||||
31 | 6.00 | Number of days to store | ||||||||||||||||||
32 | 356.69 | GB of primary data for 6 days | ||||||||||||||||||
33 | 40% | JVM Head Room | ||||||||||||||||||
34 | 143.00 | Total Primary RAM required (for JVM overhead) | ||||||||||||||||||
35 | 999.39 | Total Data w/redundancy (Data RAM + JVM RAM) *2 | ||||||||||||||||||
36 | 1000.00 | Total RAM Required w/Redundancy and JVM overhead | ||||||||||||||||||
37 | 32 | Heap size per JVM | ||||||||||||||||||
38 | 16 | PrimaryNodes required | ||||||||||||||||||
39 | 16 | Redundant nodes required | ||||||||||||||||||
40 | 512.00 | Actual RAM usage per machine (at 16 nodes) | ||||||||||||||||||
41 | 384.00 | RAM per machine | ||||||||||||||||||
42 | 32.00 | RAM per machine available for other processes | ||||||||||||||||||
43 | 352.00 | RAM per machine available to SQLF | ||||||||||||||||||
44 | 11.00 | Max Nodes per box (32GB per/node) | ||||||||||||||||||
45 | 2.00 | Primary Machines needed | ||||||||||||||||||
46 | 2.00 | Secondary Machines needed | ||||||||||||||||||
47 | 4.00 | Physical boxes needed for setup | ||||||||||||||||||
48 | 1536 | GB Total RAM Installed | ||||||||||||||||||
49 | ||||||||||||||||||||
50 | ||||||||||||||||||||
51 | ||||||||||||||||||||
52 | ||||||||||||||||||||
53 | ||||||||||||||||||||
54 | ||||||||||||||||||||
55 | ||||||||||||||||||||
56 | ||||||||||||||||||||
57 | ||||||||||||||||||||
58 | ||||||||||||||||||||
59 | ||||||||||||||||||||
60 | ||||||||||||||||||||
61 | ||||||||||||||||||||
62 | ||||||||||||||||||||
63 | ||||||||||||||||||||
64 | ||||||||||||||||||||
65 | ||||||||||||||||||||
66 | ||||||||||||||||||||
67 | ||||||||||||||||||||
68 | ||||||||||||||||||||
69 | ||||||||||||||||||||
70 | ||||||||||||||||||||
71 | ||||||||||||||||||||
72 | ||||||||||||||||||||
73 | ||||||||||||||||||||
74 | ||||||||||||||||||||
75 | ||||||||||||||||||||
76 | ||||||||||||||||||||
77 | ||||||||||||||||||||
78 | ||||||||||||||||||||