Skip to content

Instantly share code, notes, and snippets.

@layus
Created August 7, 2018 13:03
Show Gist options
  • Select an option

  • Save layus/d4659d0341088d812efd77a3cdc14092 to your computer and use it in GitHub Desktop.

Select an option

Save layus/d4659d0341088d812efd77a3cdc14092 to your computer and use it in GitHub Desktop.
Tup database analysis after building firefox (867MB!)
/** Disk-Space Utilization Report For db
Page size in bytes................................ 4096
Pages in the whole file (measured)................ 211706
Pages in the whole file (calculated).............. 211706
Pages that store data............................. 211706 100.0%
Pages on the freelist (per header)................ 0 0.0%
Pages on the freelist (calculated)................ 0 0.0%
Pages of auto-vacuum overhead..................... 0 0.0%
Number of tables in the database.................. 11
Number of indices................................. 9
Number of defined indices......................... 4
Number of implied indices......................... 5
Size of the file in bytes......................... 867147776
Bytes of user payload stored...................... 189408832 21.8%
*** Page counts for all tables with their indices *****************************
NORMAL_LINK....................................... 175821 83.0%
NODE.............................................. 35378 16.7%
STICKY_LINK....................................... 445 0.21%
GROUP_LINK........................................ 53 0.025%
CONFIG............................................ 2 0.0%
VAR............................................... 2 0.0%
CONFIG_LIST....................................... 1 0.0%
CREATE_LIST....................................... 1 0.0%
MODIFY_LIST....................................... 1 0.0%
SQLITE_MASTER..................................... 1 0.0%
VARIANT_LIST...................................... 1 0.0%
*** Page counts for all tables and indices separately *************************
SQLITE_AUTOINDEX_NORMAL_LINK_1.................... 67665 32.0%
NORMAL_LINK....................................... 57742 27.3%
NORMAL_INDEX2..................................... 50414 23.8%
NODE.............................................. 16475 7.8%
SQLITE_AUTOINDEX_NODE_1........................... 15255 7.2%
SRCID_INDEX....................................... 3648 1.7%
SQLITE_AUTOINDEX_STICKY_LINK_1.................... 172 0.081%
STICKY_LINK....................................... 146 0.069%
STICKY_INDEX2..................................... 127 0.060%
SQLITE_AUTOINDEX_GROUP_LINK_1..................... 22 0.010%
GROUP_LINK........................................ 18 0.009%
GROUP_INDEX2...................................... 13 0.006%
VAR............................................... 2 0.0%
CONFIG............................................ 1 0.0%
CONFIG_LIST....................................... 1 0.0%
CREATE_LIST....................................... 1 0.0%
MODIFY_LIST....................................... 1 0.0%
SQLITE_AUTOINDEX_CONFIG_1......................... 1 0.0%
SQLITE_MASTER..................................... 1 0.0%
VARIANT_LIST...................................... 1 0.0%
*** All tables and indices ****************************************************
Percentage of total database...................... 100.0%
Number of entries................................. 48508271
Bytes of storage consumed......................... 867147776
Bytes of payload.................................. 585335375 67.5%
Bytes of metadata................................. 209663096 24.2%
Average payload per entry......................... 12.07
Average unused bytes per entry.................... 1.49
Average metadata per entry........................ 4.32
Average fanout.................................... 203.00
Maximum payload per entry......................... 48340
Entries that use overflow......................... 4016 0.008%
Index pages used.................................. 1018
Primary pages used................................ 205783
Overflow pages used............................... 4905
Total pages used.................................. 211706
Unused bytes on index pages....................... 539834 12.9%
Unused bytes on primary pages..................... 66393268 7.9%
Unused bytes on overflow pages.................... 5219759 26.0%
Unused bytes on all pages......................... 72152861 8.3%
*** All tables ****************************************************************
Percentage of total database...................... 35.1%
Number of entries................................. 16169444
Bytes of storage consumed......................... 304697344
Bytes of payload.................................. 189410553 62.2%
Bytes of metadata................................. 111006840 36.4%
Average payload per entry......................... 11.71
Average unused bytes per entry.................... 0.26
Average metadata per entry........................ 6.87
Average fanout.................................... 363.00
Maximum payload per entry......................... 48340
Entries that use overflow......................... 724 0.004%
Index pages used.................................. 202
Primary pages used................................ 73265
Overflow pages used............................... 922
Total pages used.................................. 74389
Unused bytes on index pages....................... 116070 14.0%
Unused bytes on primary pages..................... 4121921 1.4%
Unused bytes on overflow pages.................... 42752 1.1%
Unused bytes on all pages......................... 4280743 1.4%
*** All indices ***************************************************************
Percentage of total database...................... 64.9%
Number of entries................................. 32338827
Bytes of storage consumed......................... 562450432
Bytes of payload.................................. 395924822 70.4%
Bytes of metadata................................. 98656256 17.5%
Average payload per entry......................... 12.24
Average unused bytes per entry.................... 2.10
Average metadata per entry........................ 3.05
Average fanout.................................... 163.00
Maximum payload per entry......................... 48318
Entries that use overflow......................... 3292 0.010%
Index pages used.................................. 816
Primary pages used................................ 132518
Overflow pages used............................... 3983
Total pages used.................................. 137317
Unused bytes on index pages....................... 423764 12.7%
Unused bytes on primary pages..................... 62271347 11.5%
Unused bytes on overflow pages.................... 5177007 31.7%
Unused bytes on all pages......................... 67872118 12.1%
*** Table CONFIG and all its indices ******************************************
Percentage of total database...................... 0.0%
Number of entries................................. 6
Bytes of storage consumed......................... 8192
Bytes of payload.................................. 92 1.1%
Bytes of metadata................................. 37 0.45%
Average payload per entry......................... 15.33
Average unused bytes per entry.................... 1343.83
Average metadata per entry........................ 6.17
Maximum payload per entry......................... 19
Entries that use overflow......................... 0 0.0%
Primary pages used................................ 2
Overflow pages used............................... 0
Total pages used.................................. 2
Unused bytes on primary pages..................... 8063 98.4%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 8063 98.4%
*** Table CONFIG w/o any indices **********************************************
Percentage of total database...................... 0.0%
Number of entries................................. 3
Bytes of storage consumed......................... 4096
Bytes of payload.................................. 47 1.1%
Bytes of metadata................................. 20 0.49%
B-tree depth...................................... 1
Average payload per entry......................... 15.67
Average unused bytes per entry.................... 1343.00
Average metadata per entry........................ 6.67
Maximum payload per entry......................... 19
Entries that use overflow......................... 0 0.0%
Primary pages used................................ 1
Overflow pages used............................... 0
Total pages used.................................. 1
Unused bytes on primary pages..................... 4029 98.4%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 4029 98.4%
*** Index SQLITE_AUTOINDEX_CONFIG_1 of table CONFIG ***************************
Percentage of total database...................... 0.0%
Number of entries................................. 3
Bytes of storage consumed......................... 4096
Bytes of payload.................................. 45 1.1%
Bytes of metadata................................. 17 0.42%
B-tree depth...................................... 1
Average payload per entry......................... 15.00
Average unused bytes per entry.................... 1344.67
Average metadata per entry........................ 5.67
Maximum payload per entry......................... 18
Entries that use overflow......................... 0 0.0%
Primary pages used................................ 1
Overflow pages used............................... 0
Total pages used.................................. 1
Unused bytes on primary pages..................... 4034 98.5%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 4034 98.5%
*** Table CONFIG_LIST *********************************************************
Percentage of total database...................... 0.0%
Number of entries................................. 0
Bytes of storage consumed......................... 4096
Bytes of payload.................................. 0 0.0%
Bytes of metadata................................. 8 0.20%
B-tree depth...................................... 1
Average payload per entry......................... 0.0
Average unused bytes per entry.................... 0.0
Average metadata per entry........................ 0.0
Maximum payload per entry......................... 0
Entries that use overflow......................... 0
Primary pages used................................ 1
Overflow pages used............................... 0
Total pages used.................................. 1
Unused bytes on primary pages..................... 4088 99.80%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 4088 99.80%
*** Table CREATE_LIST *********************************************************
Percentage of total database...................... 0.0%
Number of entries................................. 0
Bytes of storage consumed......................... 4096
Bytes of payload.................................. 0 0.0%
Bytes of metadata................................. 8 0.20%
B-tree depth...................................... 1
Average payload per entry......................... 0.0
Average unused bytes per entry.................... 0.0
Average metadata per entry........................ 0.0
Maximum payload per entry......................... 0
Entries that use overflow......................... 0
Primary pages used................................ 1
Overflow pages used............................... 0
Total pages used.................................. 1
Unused bytes on primary pages..................... 4088 99.80%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 4088 99.80%
*** Table GROUP_LINK and all its indices **************************************
Percentage of total database...................... 0.025%
Number of entries................................. 11475
Bytes of storage consumed......................... 217088
Bytes of payload.................................. 141269 65.1%
Bytes of metadata................................. 42636 19.6%
Average payload per entry......................... 12.31
Average unused bytes per entry.................... 2.89
Average metadata per entry........................ 3.72
Average fanout.................................... 17.00
Maximum payload per entry......................... 16
Entries that use overflow......................... 0 0.0%
Index pages used.................................. 3
Primary pages used................................ 50
Overflow pages used............................... 0
Total pages used.................................. 53
Unused bytes on index pages....................... 11499 93.6%
Unused bytes on primary pages..................... 21684 10.6%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 33183 15.3%
*** Table GROUP_LINK w/o any indices ******************************************
Percentage of total database...................... 0.009%
Number of entries................................. 3825
Bytes of storage consumed......................... 73728
Bytes of payload.................................. 49725 67.4%
Bytes of metadata................................. 19274 26.1%
B-tree depth...................................... 2
Average payload per entry......................... 13.00
Average unused bytes per entry.................... 1.24
Average metadata per entry........................ 5.04
Average fanout.................................... 17.00
Non-sequential pages.............................. 16 94.1%
Maximum payload per entry......................... 13
Entries that use overflow......................... 0 0.0%
Index pages used.................................. 1
Primary pages used................................ 17
Overflow pages used............................... 0
Total pages used.................................. 18
Unused bytes on index pages....................... 3956 96.6%
Unused bytes on primary pages..................... 773 1.1%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 4729 6.4%
*** Indices of table GROUP_LINK ***********************************************
Percentage of total database...................... 0.017%
Number of entries................................. 7650
Bytes of storage consumed......................... 143360
Bytes of payload.................................. 91544 63.9%
Bytes of metadata................................. 23362 16.3%
Average payload per entry......................... 11.97
Average unused bytes per entry.................... 3.72
Average metadata per entry........................ 3.05
Average fanout.................................... 17.00
Maximum payload per entry......................... 16
Entries that use overflow......................... 0 0.0%
Index pages used.................................. 2
Primary pages used................................ 33
Overflow pages used............................... 0
Total pages used.................................. 35
Unused bytes on index pages....................... 7543 92.1%
Unused bytes on primary pages..................... 20911 15.5%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 28454 19.8%
*** Index GROUP_INDEX2 of table GROUP_LINK ************************************
Percentage of total database...................... 0.006%
Number of entries................................. 3825
Bytes of storage consumed......................... 53248
Bytes of payload.................................. 30472 57.2%
Bytes of metadata................................. 11627 21.8%
B-tree depth...................................... 2
Average payload per entry......................... 7.97
Average unused bytes per entry.................... 2.91
Average metadata per entry........................ 3.04
Average fanout.................................... 13.00
Non-sequential pages.............................. 11 91.7%
Maximum payload per entry......................... 8
Entries that use overflow......................... 0 0.0%
Index pages used.................................. 1
Primary pages used................................ 12
Overflow pages used............................... 0
Total pages used.................................. 13
Unused bytes on index pages....................... 3919 95.7%
Unused bytes on primary pages..................... 7230 14.7%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 11149 20.9%
*** Index SQLITE_AUTOINDEX_GROUP_LINK_1 of table GROUP_LINK *******************
Percentage of total database...................... 0.010%
Number of entries................................. 3825
Bytes of storage consumed......................... 90112
Bytes of payload.................................. 61072 67.8%
Bytes of metadata................................. 11735 13.0%
B-tree depth...................................... 2
Average payload per entry......................... 15.97
Average unused bytes per entry.................... 4.52
Average metadata per entry........................ 3.07
Average fanout.................................... 22.00
Non-sequential pages.............................. 20 95.2%
Maximum payload per entry......................... 16
Entries that use overflow......................... 0 0.0%
Index pages used.................................. 1
Primary pages used................................ 21
Overflow pages used............................... 0
Total pages used.................................. 22
Unused bytes on index pages....................... 3624 88.5%
Unused bytes on primary pages..................... 13681 15.9%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 17305 19.2%
*** Table MODIFY_LIST *********************************************************
Percentage of total database...................... 0.0%
Number of entries................................. 3
Bytes of storage consumed......................... 4096
Bytes of payload.................................. 6 0.15%
Bytes of metadata................................. 26 0.63%
B-tree depth...................................... 1
Average payload per entry......................... 2.00
Average unused bytes per entry.................... 1354.67
Average metadata per entry........................ 8.67
Maximum payload per entry......................... 2
Entries that use overflow......................... 0 0.0%
Primary pages used................................ 1
Overflow pages used............................... 0
Total pages used.................................. 1
Unused bytes on primary pages..................... 4064 99.22%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 4064 99.22%
*** Table NODE and all its indices ********************************************
Percentage of total database...................... 16.7%
Number of entries................................. 3908520
Bytes of storage consumed......................... 144908288
Bytes of payload.................................. 112014348 77.3%
Bytes of metadata................................. 16120846 11.1%
Average payload per entry......................... 28.66
Average unused bytes per entry.................... 4.29
Average metadata per entry........................ 4.12
Average fanout.................................... 123.00
Maximum payload per entry......................... 48340
Entries that use overflow......................... 4015 0.10%
Index pages used.................................. 247
Primary pages used................................ 30227
Overflow pages used............................... 4904
Total pages used.................................. 35378
Unused bytes on index pages....................... 165900 16.4%
Unused bytes on primary pages..................... 11390991 9.2%
Unused bytes on overflow pages.................... 5219759 26.0%
Unused bytes on all pages......................... 16776650 11.6%
*** Table NODE w/o any indices ************************************************
Percentage of total database...................... 7.8%
Number of entries................................. 1302840
Bytes of storage consumed......................... 67481600
Bytes of payload.................................. 55722675 82.6%
Bytes of metadata................................. 8084971 12.0%
B-tree depth...................................... 3
Average payload per entry......................... 42.77
Average unused bytes per entry.................... 2.82
Average metadata per entry........................ 6.21
Average fanout.................................... 388.00
Non-sequential pages.............................. 12475 75.7%
Maximum payload per entry......................... 48340
Entries that use overflow......................... 723 0.055%
Index pages used.................................. 40
Primary pages used................................ 15514
Overflow pages used............................... 921
Total pages used.................................. 16475
Unused bytes on index pages....................... 23894 14.6%
Unused bytes on primary pages..................... 3608100 5.7%
Unused bytes on overflow pages.................... 42752 1.1%
Unused bytes on all pages......................... 3674746 5.4%
*** Indices of table NODE *****************************************************
Percentage of total database...................... 8.9%
Number of entries................................. 2605680
Bytes of storage consumed......................... 77426688
Bytes of payload.................................. 56291673 72.7%
Bytes of metadata................................. 8035875 10.4%
Average payload per entry......................... 21.60
Average unused bytes per entry.................... 5.03
Average metadata per entry........................ 3.08
Average fanout.................................... 72.00
Maximum payload per entry......................... 48318
Entries that use overflow......................... 3292 0.13%
Index pages used.................................. 207
Primary pages used................................ 14713
Overflow pages used............................... 3983
Total pages used.................................. 18903
Unused bytes on index pages....................... 142006 16.7%
Unused bytes on primary pages..................... 7782891 12.9%
Unused bytes on overflow pages.................... 5177007 31.7%
Unused bytes on all pages......................... 13101904 16.9%
*** Index SQLITE_AUTOINDEX_NODE_1 of table NODE *******************************
Percentage of total database...................... 7.2%
Number of entries................................. 1302840
Bytes of storage consumed......................... 62484480
Bytes of payload.................................. 47166468 75.5%
Bytes of metadata................................. 4083583 6.5%
B-tree depth...................................... 5
Average payload per entry......................... 36.20
Average unused bytes per entry.................... 8.63
Average metadata per entry........................ 3.13
Average fanout.................................... 58.00
Non-sequential pages.............................. 8902 58.4%
Maximum payload per entry......................... 48318
Entries that use overflow......................... 3292 0.25%
Index pages used.................................. 192
Primary pages used................................ 11080
Overflow pages used............................... 3983
Total pages used.................................. 15255
Unused bytes on index pages....................... 131638 16.7%
Unused bytes on primary pages..................... 5928548 13.1%
Unused bytes on overflow pages.................... 5177007 31.7%
Unused bytes on all pages......................... 11237193 18.0%
*** Index SRCID_INDEX of table NODE *******************************************
Percentage of total database...................... 1.7%
Number of entries................................. 1302840
Bytes of storage consumed......................... 14942208
Bytes of payload.................................. 9125205 61.1%
Bytes of metadata................................. 3952292 26.5%
B-tree depth...................................... 3
Average payload per entry......................... 7.00
Average unused bytes per entry.................... 1.43
Average metadata per entry........................ 3.03
Average fanout.................................... 243.00
Non-sequential pages.............................. 3630 99.53%
Maximum payload per entry......................... 9
Entries that use overflow......................... 0 0.0%
Index pages used.................................. 15
Primary pages used................................ 3633
Overflow pages used............................... 0
Total pages used.................................. 3648
Unused bytes on index pages....................... 10368 16.9%
Unused bytes on primary pages..................... 1854343 12.5%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 1864711 12.5%
*** Table NORMAL_LINK and all its indices *************************************
Percentage of total database...................... 83.0%
Number of entries................................. 44466954
Bytes of storage consumed......................... 720162816
Bytes of payload.................................. 471984060 65.5%
Bytes of metadata................................. 193024652 26.8%
Average payload per entry......................... 10.61
Average unused bytes per entry.................... 1.24
Average metadata per entry........................ 4.34
Average fanout.................................... 229.00
Maximum payload per entry......................... 14
Entries that use overflow......................... 0 0.0%
Index pages used.................................. 765
Primary pages used................................ 175056
Overflow pages used............................... 0
Total pages used.................................. 175821
Unused bytes on index pages....................... 356576 11.4%
Unused bytes on primary pages..................... 54797528 7.6%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 55154104 7.7%
*** Table NORMAL_LINK w/o any indices *****************************************
Percentage of total database...................... 27.3%
Number of entries................................. 14822318
Bytes of storage consumed......................... 236511232
Bytes of payload.................................. 133266148 56.3%
Bytes of metadata................................. 102673804 43.4%
B-tree depth...................................... 3
Average payload per entry......................... 8.99
Average unused bytes per entry.................... 0.04
Average metadata per entry........................ 6.93
Average fanout.................................... 360.00
Non-sequential pages.............................. 55383 95.9%
Maximum payload per entry......................... 9
Entries that use overflow......................... 0 0.0%
Index pages used.................................. 160
Primary pages used................................ 57582
Overflow pages used............................... 0
Total pages used.................................. 57742
Unused bytes on index pages....................... 85376 13.0%
Unused bytes on primary pages..................... 485904 0.21%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 571280 0.24%
*** Indices of table NORMAL_LINK **********************************************
Percentage of total database...................... 55.8%
Number of entries................................. 29644636
Bytes of storage consumed......................... 483651584
Bytes of payload.................................. 338717912 70.0%
Bytes of metadata................................. 90350848 18.7%
Average payload per entry......................... 11.43
Average unused bytes per entry.................... 1.84
Average metadata per entry........................ 3.05
Average fanout.................................... 195.00
Maximum payload per entry......................... 14
Entries that use overflow......................... 0 0.0%
Index pages used.................................. 605
Primary pages used................................ 117474
Overflow pages used............................... 0
Total pages used.................................. 118079
Unused bytes on index pages....................... 271200 10.9%
Unused bytes on primary pages..................... 54311624 11.3%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 54582824 11.3%
*** Index NORMAL_INDEX2 of table NORMAL_LINK **********************************
Percentage of total database...................... 23.8%
Number of entries................................. 14822318
Bytes of storage consumed......................... 206495744
Bytes of payload.................................. 139761077 67.7%
Bytes of metadata................................. 45071918 21.8%
B-tree depth...................................... 3
Average payload per entry......................... 9.43
Average unused bytes per entry.................... 1.46
Average metadata per entry........................ 3.04
Average fanout.................................... 223.00
Non-sequential pages.............................. 50006 99.19%
Maximum payload per entry......................... 10
Entries that use overflow......................... 0 0.0%
Index pages used.................................. 226
Primary pages used................................ 50188
Overflow pages used............................... 0
Total pages used.................................. 50414
Unused bytes on index pages....................... 97500 10.5%
Unused bytes on primary pages..................... 21565249 10.5%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 21662749 10.5%
*** Index SQLITE_AUTOINDEX_NORMAL_LINK_1 of table NORMAL_LINK *****************
Percentage of total database...................... 32.0%
Number of entries................................. 14822318
Bytes of storage consumed......................... 277155840
Bytes of payload.................................. 198956835 71.8%
Bytes of metadata................................. 45278930 16.3%
B-tree depth...................................... 4
Average payload per entry......................... 13.42
Average unused bytes per entry.................... 2.22
Average metadata per entry........................ 3.05
Average fanout.................................... 178.00
Non-sequential pages.............................. 48018 71.0%
Maximum payload per entry......................... 14
Entries that use overflow......................... 0 0.0%
Index pages used.................................. 379
Primary pages used................................ 67286
Overflow pages used............................... 0
Total pages used.................................. 67665
Unused bytes on index pages....................... 173700 11.2%
Unused bytes on primary pages..................... 32746375 11.9%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 32920075 11.9%
*** Table SQLITE_MASTER *******************************************************
Percentage of total database...................... 0.0%
Number of entries................................. 19
Bytes of storage consumed......................... 4096
Bytes of payload.................................. 1721 42.0%
Bytes of metadata................................. 186 4.5%
B-tree depth...................................... 1
Average payload per entry......................... 90.58
Average unused bytes per entry.................... 115.21
Average metadata per entry........................ 9.79
Maximum payload per entry......................... 247
Entries that use overflow......................... 0 0.0%
Primary pages used................................ 1
Overflow pages used............................... 0
Total pages used.................................. 1
Unused bytes on primary pages..................... 2189 53.4%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 2189 53.4%
*** Table STICKY_LINK and all its indices *************************************
Percentage of total database...................... 0.21%
Number of entries................................. 121287
Bytes of storage consumed......................... 1822720
Bytes of payload.................................. 1187509 65.2%
Bytes of metadata................................. 474630 26.0%
Average payload per entry......................... 9.79
Average unused bytes per entry.................... 1.32
Average metadata per entry........................ 3.91
Average fanout.................................... 148.00
Maximum payload per entry......................... 13
Entries that use overflow......................... 0 0.0%
Index pages used.................................. 3
Primary pages used................................ 442
Overflow pages used............................... 0
Total pages used.................................. 445
Unused bytes on index pages....................... 5859 47.7%
Unused bytes on primary pages..................... 154722 8.5%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 160581 8.8%
*** Table STICKY_LINK w/o any indices *****************************************
Percentage of total database...................... 0.069%
Number of entries................................. 40429
Bytes of storage consumed......................... 598016
Bytes of payload.................................. 363861 60.8%
Bytes of metadata................................. 228476 38.2%
B-tree depth...................................... 2
Average payload per entry......................... 9.00
Average unused bytes per entry.................... 0.14
Average metadata per entry........................ 5.65
Average fanout.................................... 145.00
Non-sequential pages.............................. 144 99.31%
Maximum payload per entry......................... 9
Entries that use overflow......................... 0 0.0%
Index pages used.................................. 1
Primary pages used................................ 145
Overflow pages used............................... 0
Total pages used.................................. 146
Unused bytes on index pages....................... 2844 69.4%
Unused bytes on primary pages..................... 2835 0.48%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 5679 0.95%
*** Indices of table STICKY_LINK **********************************************
Percentage of total database...................... 0.14%
Number of entries................................. 80858
Bytes of storage consumed......................... 1224704
Bytes of payload.................................. 823648 67.3%
Bytes of metadata................................. 246154 20.1%
Average payload per entry......................... 10.19
Average unused bytes per entry.................... 1.92
Average metadata per entry........................ 3.04
Average fanout.................................... 149.00
Maximum payload per entry......................... 13
Entries that use overflow......................... 0 0.0%
Index pages used.................................. 2
Primary pages used................................ 297
Overflow pages used............................... 0
Total pages used.................................. 299
Unused bytes on index pages....................... 3015 36.8%
Unused bytes on primary pages..................... 151887 12.5%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 154902 12.6%
*** Index SQLITE_AUTOINDEX_STICKY_LINK_1 of table STICKY_LINK *****************
Percentage of total database...................... 0.081%
Number of entries................................. 40429
Bytes of storage consumed......................... 704512
Bytes of payload.................................. 492682 69.9%
Bytes of metadata................................. 123347 17.5%
B-tree depth...................................... 2
Average payload per entry......................... 12.19
Average unused bytes per entry.................... 2.19
Average metadata per entry........................ 3.05
Average fanout.................................... 172.00
Non-sequential pages.............................. 166 97.1%
Maximum payload per entry......................... 13
Entries that use overflow......................... 0 0.0%
Index pages used.................................. 1
Primary pages used................................ 171
Overflow pages used............................... 0
Total pages used.................................. 172
Unused bytes on index pages....................... 831 20.3%
Unused bytes on primary pages..................... 87652 12.5%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 88483 12.6%
*** Index STICKY_INDEX2 of table STICKY_LINK **********************************
Percentage of total database...................... 0.060%
Number of entries................................. 40429
Bytes of storage consumed......................... 520192
Bytes of payload.................................. 330966 63.6%
Bytes of metadata................................. 122807 23.6%
B-tree depth...................................... 2
Average payload per entry......................... 8.19
Average unused bytes per entry.................... 1.64
Average metadata per entry........................ 3.04
Average fanout.................................... 127.00
Non-sequential pages.............................. 125 99.21%
Maximum payload per entry......................... 9
Entries that use overflow......................... 0 0.0%
Index pages used.................................. 1
Primary pages used................................ 126
Overflow pages used............................... 0
Total pages used.................................. 127
Unused bytes on index pages....................... 2184 53.3%
Unused bytes on primary pages..................... 64235 12.4%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 66419 12.8%
*** Table VAR *****************************************************************
Percentage of total database...................... 0.0%
Number of entries................................. 6
Bytes of storage consumed......................... 8192
Bytes of payload.................................. 6368 77.7%
Bytes of metadata................................. 53 0.65%
B-tree depth...................................... 1
Average payload per entry......................... 1061.33
Average unused bytes per entry.................... 295.17
Average metadata per entry........................ 8.83
Non-sequential pages.............................. 0 0.0%
Maximum payload per entry......................... 6262
Entries that use overflow......................... 1 16.7%
Primary pages used................................ 1
Overflow pages used............................... 1
Total pages used.................................. 2
Unused bytes on primary pages..................... 1771 43.2%
Unused bytes on overflow pages.................... 0 0.0%
Unused bytes on all pages......................... 1771 21.6%
*** Table VARIANT_LIST ********************************************************
Percentage of total database...................... 0.0%
Number of entries................................. 1
Bytes of storage consumed......................... 4096
Bytes of payload.................................. 2 0.049%
Bytes of metadata................................. 14 0.34%
B-tree depth...................................... 1
Average payload per entry......................... 2.00
Average unused bytes per entry.................... 4080.00
Average metadata per entry........................ 14.00
Maximum payload per entry......................... 2
Entries that use overflow......................... 0 0.0%
Primary pages used................................ 1
Overflow pages used............................... 0
Total pages used.................................. 1
Unused bytes on primary pages..................... 4080 99.61%
Unused bytes on overflow pages.................... 0
Unused bytes on all pages......................... 4080 99.61%
*** Definitions ***************************************************************
Page size in bytes
The number of bytes in a single page of the database file.
Usually 1024.
Number of pages in the whole file
The number of 4096-byte pages that go into forming the complete
database
Pages that store data
The number of pages that store data, either as primary B*Tree pages or
as overflow pages. The number at the right is the data pages divided by
the total number of pages in the file.
Pages on the freelist
The number of pages that are not currently in use but are reserved for
future use. The percentage at the right is the number of freelist pages
divided by the total number of pages in the file.
Pages of auto-vacuum overhead
The number of pages that store data used by the database to facilitate
auto-vacuum. This is zero for databases that do not support auto-vacuum.
Number of tables in the database
The number of tables in the database, including the SQLITE_MASTER table
used to store schema information.
Number of indices
The total number of indices in the database.
Number of defined indices
The number of indices created using an explicit CREATE INDEX statement.
Number of implied indices
The number of indices used to implement PRIMARY KEY or UNIQUE constraints
on tables.
Size of the file in bytes
The total amount of disk space used by the entire database files.
Bytes of user payload stored
The total number of bytes of user payload stored in the database. The
schema information in the SQLITE_MASTER table is not counted when
computing this number. The percentage at the right shows the payload
divided by the total file size.
Percentage of total database
The amount of the complete database file that is devoted to storing
information described by this category.
Number of entries
The total number of B-Tree key/value pairs stored under this category.
Bytes of storage consumed
The total amount of disk space required to store all B-Tree entries
under this category. The is the total number of pages used times
the pages size.
Bytes of payload
The amount of payload stored under this category. Payload is the data
part of table entries and the key part of index entries. The percentage
at the right is the bytes of payload divided by the bytes of storage
consumed.
Bytes of metadata
The amount of formatting and structural information stored in the
table or index. Metadata includes the btree page header, the cell pointer
array, the size field for each cell, the left child pointer or non-leaf
cells, the overflow pointers for overflow cells, and the rowid value for
rowid table cells. In other words, metadata is everything that is neither
unused space nor content. The record header in the payload is counted as
content, not metadata.
Average payload per entry
The average amount of payload on each entry. This is just the bytes of
payload divided by the number of entries.
Average unused bytes per entry
The average amount of free space remaining on all pages under this
category on a per-entry basis. This is the number of unused bytes on
all pages divided by the number of entries.
Non-sequential pages
The number of pages in the table or index that are out of sequence.
Many filesystems are optimized for sequential file access so a small
number of non-sequential pages might result in faster queries,
especially for larger database files that do not fit in the disk cache.
Note that after running VACUUM, the root page of each table or index is
at the beginning of the database file and all other pages are in a
separate part of the database file, resulting in a single non-
sequential page.
Maximum payload per entry
The largest payload size of any entry.
Entries that use overflow
The number of entries that user one or more overflow pages.
Total pages used
This is the number of pages used to hold all information in the current
category. This is the sum of index, primary, and overflow pages.
Index pages used
This is the number of pages in a table B-tree that hold only key (rowid)
information and no data.
Primary pages used
This is the number of B-tree pages that hold both key and data.
Overflow pages used
The total number of overflow pages used for this category.
Unused bytes on index pages
The total number of bytes of unused space on all index pages. The
percentage at the right is the number of unused bytes divided by the
total number of bytes on index pages.
Unused bytes on primary pages
The total number of bytes of unused space on all primary pages. The
percentage at the right is the number of unused bytes divided by the
total number of bytes on primary pages.
Unused bytes on overflow pages
The total number of bytes of unused space on all overflow pages. The
percentage at the right is the number of unused bytes divided by the
total number of bytes on overflow pages.
Unused bytes on all pages
The total number of bytes of unused space on all primary and overflow
pages. The percentage at the right is the number of unused bytes
divided by the total number of bytes.
*******************************************************************************
The entire text of this report can be sourced into any SQL database
engine for further analysis. All of the text above is an SQL comment.
The data used to generate this report follows:
*/
BEGIN;
CREATE TABLE space_used(
name clob, -- Name of a table or index in the database file
tblname clob, -- Name of associated table
is_index boolean, -- TRUE if it is an index, false for a table
is_without_rowid boolean, -- TRUE if WITHOUT ROWID table
nentry int, -- Number of entries in the BTree
leaf_entries int, -- Number of leaf entries
depth int, -- Depth of the b-tree
payload int, -- Total amount of data stored in this table or index
ovfl_payload int, -- Total amount of data stored on overflow pages
ovfl_cnt int, -- Number of entries that use overflow
mx_payload int, -- Maximum payload size
int_pages int, -- Number of interior pages used
leaf_pages int, -- Number of leaf pages used
ovfl_pages int, -- Number of overflow pages used
int_unused int, -- Number of unused bytes on interior pages
leaf_unused int, -- Number of unused bytes on primary pages
ovfl_unused int, -- Number of unused bytes on overflow pages
gap_cnt int, -- Number of gaps in the page layout
compressed_size int -- Total bytes stored on disk
);
INSERT INTO space_used VALUES('sqlite_master','sqlite_master',0,0,19,19,1,1721,0,0,247,0,1,0,0,2189,0,0,4096);
INSERT INTO space_used VALUES('node','node',0,0,1318353,1302840,3,55722675,3725980,723,48340,40,15514,921,23894,3608100,42752,12475,67481600);
INSERT INTO space_used VALUES('sqlite_autoindex_node_1','node',1,0,1302840,1291761,5,47166468,11121429,3292,48318,192,11080,3983,131638,5928548,5177007,8902,62484480);
INSERT INTO space_used VALUES('normal_link','normal_link',0,0,14879899,14822318,3,133266148,0,0,9,160,57582,0,85376,485904,0,55383,236511232);
INSERT INTO space_used VALUES('sqlite_autoindex_normal_link_1','normal_link',1,0,14822318,14755033,4,198956835,0,0,14,379,67286,0,173700,32746375,0,48018,277155840);
INSERT INTO space_used VALUES('sticky_link','sticky_link',0,0,40573,40429,2,363861,0,0,9,1,145,0,2844,2835,0,144,598016);
INSERT INTO space_used VALUES('sqlite_autoindex_sticky_link_1','sticky_link',1,0,40429,40259,2,492682,0,0,13,1,171,0,831,87652,0,166,704512);
INSERT INTO space_used VALUES('group_link','group_link',0,0,3841,3825,2,49725,0,0,13,1,17,0,3956,773,0,16,73728);
INSERT INTO space_used VALUES('sqlite_autoindex_group_link_1','group_link',1,0,3825,3805,2,61072,0,0,16,1,21,0,3624,13681,0,20,90112);
INSERT INTO space_used VALUES('var','var',0,0,6,6,1,6368,4092,1,6262,0,1,1,0,1771,0,0,8192);
INSERT INTO space_used VALUES('config','config',0,0,3,3,1,47,0,0,19,0,1,0,0,4029,0,0,4096);
INSERT INTO space_used VALUES('sqlite_autoindex_config_1','config',1,0,3,3,1,45,0,0,18,0,1,0,0,4034,0,0,4096);
INSERT INTO space_used VALUES('config_list','config_list',0,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('create_list','create_list',0,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('modify_list','modify_list',0,0,3,3,1,6,0,0,2,0,1,0,0,4064,0,0,4096);
INSERT INTO space_used VALUES('variant_list','variant_list',0,0,1,1,1,2,0,0,2,0,1,0,0,4080,0,0,4096);
INSERT INTO space_used VALUES('normal_index2','normal_link',1,0,14822318,14772131,3,139761077,0,0,10,226,50188,0,97500,21565249,0,50006,206495744);
INSERT INTO space_used VALUES('sticky_index2','sticky_link',1,0,40429,40304,2,330966,0,0,9,1,126,0,2184,64235,0,125,520192);
INSERT INTO space_used VALUES('group_index2','group_link',1,0,3825,3814,2,30472,0,0,8,1,12,0,3919,7230,0,11,53248);
INSERT INTO space_used VALUES('srcid_index','node',1,0,1302840,1299208,3,9125205,0,0,9,15,3633,0,10368,1854343,0,3630,14942208);
COMMIT;
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment