Skip to content

Instantly share code, notes, and snippets.

@palash25
Last active October 11, 2019 12:38
Show Gist options
  • Save palash25/07c9d0fb41161bc18e80f40be0698630 to your computer and use it in GitHub Desktop.
Save palash25/07c9d0fb41161bc18e80f40be0698630 to your computer and use it in GitHub Desktop.
palash25@Lenovo-G50  ~/Dev/Projects/wc   master ?  \time --format "\n real %E\t user %U\t sys %S\t mem %K\t ssize %p" wc ../../small-file-*
48414 81402 556859 ../../small-file-1
48414 81402 556859 ../../small-file-2
48414 81402 556859 ../../small-file-3
145242 244206 1670577 total
real 0:00.05 user 0.05 sys 0.00 mem 0 ssize 0
palash25@Lenovo-G50  ~/Dev/Projects/wc   master ?  \time --format "\n real %E\t user %U\t sys %S\t mem %K\t ssize %p" ./target/release/wc ../../small-file-*
48414 81402 556859 ../../small-file-1
48414 81402 556859 ../../small-file-2
48414 81402 556859 ../../small-file-3
145242 244206 1670577 total
real 0:00.02 user 0.00 sys 0.01 mem 0 ssize 0
2 million lines files time test
palash25@Lenovo-G50  ~/Dev/Projects/wc   master ?  \time --format "\n real %E\t user %U\t sys %S\t mem %K\t ssize %p" wc ../../big-file-*
2091965 3549748 24604624 ../../big-file-1
2091965 3549748 24604624 ../../big-file-2
4183930 7099496 49209248 total
real 0:01.14 user 1.11 sys 0.02 mem 0 ssize 0
palash25@Lenovo-G50  ~/Dev/Projects/wc   master ?  \time --format "\n real %E\t user %U\t sys %S\t mem %K\t ssize %p" ./target/release/wc ../../big-file-*
2091965 3549748 24604624 ../../big-file-1
2091965 3549748 24604624 ../../big-file-2
4183930 7099496 49209248 total
real 0:00.49 user 0.36 sys 0.12 mem 0 ssize 0
PV TESTS
palash25@Lenovo-G50  ~/Dev/Projects/wc   master ?  ./target/release/wc ../../small-file-* | pv  ✔  10396  00:26:37
48414 81402 556859 ../../small-file-1
48414 81402 556859 ../../small-file-2
48414 81402 556859 ../../small-file-3
145242 244206 1670577 total
186 B 0:00:00 [9.57KiB/s] [ <=> ]
palash25@Lenovo-G50  ~/Dev/Projects/wc   master ?  wc ../../small-file-* | pv  ✔  10397  00:26:48
48414 81402 556859 ../../small-file-1
48414 81402 556859 ../../small-file-2
48414 81402 556859 ../../small-file-3
145242 244206 1670577 total
159 B 0:00:00 [ 3.1KiB/s] [ <=> ]
2 milz
palash25@Lenovo-G50  ~/Dev/Projects/wc   master ?  wc ../../big-file-* | pv  ✔  10400  00:29:37
2091965 3549748 24604624 ../../big-file-1
2091965 3549748 24604624 ../../big-file-2 ]
4183930 7099496 49209248 total
121 B 0:00:01 [ 101 B/s] [ <=> ]
palash25@Lenovo-G50  ~/Dev/Projects/wc   master ?  ./target/release/wc ../../big-file-* | pv  ✔  10401  00:29:40
2091965 3549748 24604624 ../../big-file-1
2091965 3549748 24604624 ../../big-file-2
4183930 7099496 49209248 total
148 B 0:00:00 [ 315 B/s] [ <=>
10 million
palash25@Lenovo-G50  ~/Dev/Projects/wc   master ?  wc ../../big-file-* | pv  ✔  10442  11:43:30
10048406 17328448 124739305 ../../big-file-1 ]
10446226 18017383 129746037 ../../big-file-2 ]
20494632 35345831 254485342 total
130 B 0:00:05 [22.5 B/s] [ <=> ]
palash25@Lenovo-G50  ~/Dev/Projects/wc   master ?  ./target/release/wc ../../big-file-* | pv  ✔  10443  11:43:37
10048406:00:02 [17328448] [<=> 124739305 ../../big-file-1 ]
10446226 18017383 129746037 ../../big-file-2
20494632 35345831 254485342 total
157 B 0:00:02 [69.5 B/s] [ <=> ]
TIME TEST FOR 10 MILL
palash25@Lenovo-G50  ~/Dev/Projects/wc   master ?  \time --format "\n real %E\t user %U\t sys %S\t mem %K\t ssize %p" wc ../../big-file-*
10048406 17328448 124739305 ../../big-file-1
10446226 18017383 129746037 ../../big-file-2
20494632 35345831 254485342 total
real 0:05.73 user 5.66 sys 0.05 mem 0 ssize 0
palash25@Lenovo-G50  ~/Dev/Projects/wc   master ?  \time --format "\n real %E\t user %U\t sys %S\t mem %K\t ssize %p" ./target/release/wc ../../big-file-*
10048406 17328448 124739305 ../../big-file-1
10446226 18017383 129746037 ../../big-file-2
20494632 35345831 254485342 total
real 0:02.20 user 1.64 sys 0.55 mem 0 ssize 0
10 mil more dense
palash25@Lenovo-G50  ~/Dev/Projects/wc   master  \time -p ./target/release/wc ../../chunk.txt  ✔  10463  18:05:59
10048951 31711680 274285495 ../../chunk.txt
real 1.89
user 1.36
sys 0.53
palash25@Lenovo-G50  ~/Dev/Projects/wc   master  \time -p wc ../../chunk.txt  ✔  10464  18:06:08
10048951 31711680 274285495 ../../chunk.txt
real 4.72
user 4.67
sys 0.04
palash25@Lenovo-G50  ~/Dev/Projects/wc   master  ./target/release/wc ../../chunk.txt | pv  ✔  10465  18:06:25
10048951:00:01 [31711680] [<=> 274285495 ../../chunk.txt ]
55 B 0:00:01 [29.2 B/s] [ <=> ]
palash25@Lenovo-G50  ~/Dev/Projects/wc   master  wc ../../chunk.txt | pv  ✔  10466  18:06:51
10048951 31711680 274285495 ../../chunk.txt ]
46 B 0:00:04 [9.81 B/s] [ <=> ]
palash25@Lenovo-G50  ~/Dev/Projects/wc   master 
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment