Skip to content

Instantly share code, notes, and snippets.

@dmentipl
Last active July 3, 2019 10:47
Show Gist options
  • Save dmentipl/868570ff149227a42f9911a1e157b0b6 to your computer and use it in GitHub Desktop.
Save dmentipl/868570ff149227a42f9911a1e157b0b6 to your computer and use it in GitHub Desktop.

Phantom dump size comparison

Phantom dump size comparison between pb, ie. Price-Bate Fortran binary format, and HDF5, both with and without compression. The compression is gzip with the highest level of compression (level 9).

Gas only

Gas disc.

100K particles

Type Size Diff. (from pb) Percent (of pb)
pb 6002696 B (5.72 MiB) 0 B 100 %
h5 6162833 B (5.88 MiB) +0160137 B (+0.15 MiB) 103 %
h5 (gzip 9) 4761870 B (4.54 MiB) -1240826 B (-1.18 MiB) 79 %

10M particles

Type Size Diff. (from pb) Percent (of pb)
pb 600002696 B (572 MiB) 0 B 100 %
h5 610108908 B (582 MiB) +010106212 B (+9.64 MiB) 102 %
h5 (gzip 9) 470111623 B (448 MiB) -129891073 B (-124 MiB) 78 %

Dust (1-fluid)

Dust disc with 5 grain sizes.

100K particles

Type Size Diff. (from pb) Percent (of pb)
pb 26004664 B (24.8 MiB) 0 B 100 %
h5 26183359 B (25.0 MiB) +0178695 B (+0.17 MiB) 101 %
h5 (gzip 9) 20319717 B (19.4 MiB) -5684947 B (-5.42 MiB) 78 %

10M particles

Type Size Diff. (from pb) Percent (of pb)
pb 2600004664 B (2.42 GiB) 0 B 100 %
h5 2610280489 B (2.43 GiB) +010275825 B (+9.80 MiB) 100 %
h5 (gzip 9) 2019326328 B (1.88 GiB) -580678336 B (-554 MiB) 78 %

Dust (2-fluid)

Dust disc with 5 grain sizes.

100K particles

50K gas + (10K dust x 5)

Type Size Diff. (from pb) Percent (of pb)
pb 10104056 B (9.64 MiB) 0 B 100 %
h5 14178697 B (13.5 MiB) +4074641 B (+3.89 MiB) 140 %
h5 (gzip 9) 07326226 B (6.99 MiB) -2777830 B (-2.65 MiB) 73 %

10M particles

5M gas + (1M dust x 5)

Type Size Diff. (from pb) Percent (of pb)
pb 1010004056 B (963 MiB) 0 B 100 %
h5 1410185192 B (1345 MiB) +400181136 B (+382 MiB) 140 %
h5 (gzip 9) 0743465087 B (709 MiB) -266538969 B (-254 MiB) 74 %
@dmentipl
Copy link
Author

dmentipl commented Jul 3, 2019

I'm not sure why the 2-fluid dust dumps are so large (when uncompressed).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment