Skip to content

Instantly share code, notes, and snippets.

@den-crane
Created December 27, 2019 17:11
Show Gist options
  • Save den-crane/329aa595c5a2f96fa36e009d4b17a382 to your computer and use it in GitHub Desktop.
Save den-crane/329aa595c5a2f96fa36e009d4b17a382 to your computer and use it in GitHub Desktop.
json_load_test
clickhouse-client -q "drop table json"
clickhouse-client -q "select arrayStringConcat(arrayMap(x->toString (cityHash64(x)) , range(1000)),',\"''') from numbers(100000);" >test.json
clickhouse-client -q "create table json(j String) Engine=Memory"
time clickhouse-client --format_csv_allow_single_quotes=0 --format_csv_allow_double_quotes=0 --format_csv_delimiter=$'\x0B' -q 'insert into json format CSV' <test.json
19.13.6.51
real 0m2.069s user 0m0.520s sys 0m0.746s
real 0m2.043s user 0m0.511s sys 0m0.722s
19.17.6.36
real 0m2.011s user 0m0.549s sys 0m0.625s
real 0m2.027s user 0m0.554s sys 0m0.654s
19.19.1.1957
real 0m1.473s user 0m2.268s sys 0m0.583s
real 0m1.405s user 0m2.155s sys 0m0.525s
@den-crane
Copy link
Author

19.19.1.1957

time curl "http://localhost:8123/?query=INSERT%20INTO%20log%20format%20CSV" --data-binary @test.json

real 0m2.858s
user 0m0.240s
sys 0m1.111s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment