neo4j batch import benchmark

batch-import

Paul-Lams-computer:batch-import paullam$ java TestDataGenerator
Creating 7500000 and 191215478 Relationships took 146 seconds.
Paul-Lams-computer:batch-import paullam$ head nodes.csv 
Node	Rels	Property	Counter:int
0	12	TEST	0
1	14	TEST	1
2	25	TEST	2
3	28	TEST	3
4	4	TEST	4
5	7	TEST	5
6	6	TEST	6
7	44	TEST	7
8	32	TEST	8
Paul-Lams-computer:batch-import paullam$ head rels.csv 
Start	Ende	Type	Property	Counter:long
222395	912976	THREE	Property	1
285082	4446472	TWO	Property	2
5803683	6271672	ONE	Property	3
1598408	439911	TEN	Property	4
6221978	7465660	NINE	Property	5
6509721	7009998	EIGHT	Property	6
5307012	6915817	SEVEN	Property	7
7234257	3926459	SIX	Property	8
1927983	5611015	FIVE	Property	9
Paul-Lams-computer:batch-import paullam$ java -server -Xmx1G -jar target/batch-import-jar-with-dependencies.jar target/db nodes.csv rels.csv
Using Existing Configuration File
remote_logging_host=127.0.0.1
forced_kernel_id=
read_only=false
neo4j.ext.udc.host=udc.neo4j.org
logical_log=nioneo_logical.log
online_backup_enabled=false
remote_logging_port=4560
gc_monitor_threshold=200ms
array_block_size=120
load_kernel_extensions=true
neostore.relationshipstore.db.mapped_memory=1000M
node_auto_indexing=false
intercept_committing_transactions=false
keep_logical_logs=true
dump_configuration=true
gc_monitor_wait_time=100ms
cache_type=none
intercept_deserialized_transactions=false
neostore.nodestore.db.mapped_memory=200M
neo4j.ext.udc.first_delay=600000
neo4j.ext.udc.reg=unreg
lucene_searcher_cache_size=2147483647
neo4j.ext.udc.interval=86400000
use_memory_mapped_buffers=true
rebuild_idgenerators_fast=true
neostore.propertystore.db.index.keys.mapped_memory=5M
neostore.propertystore.db.strings.mapped_memory=200M
neostore.propertystore.db.arrays.mapped_memory=130M
neo_store=neostore
logging.threshold_for_rotation=104857600
neostore.propertystore.db.index.mapped_memory=5M
backup_slave=false
neostore.propertystore.db.mapped_memory=1000M
gcr_cache_min_log_interval=60s
relationship_grab_size=100
relationship_auto_indexing=false
string_block_size=120
lucene_writer_cache_size=2147483647
node_cache_array_fraction=1.0
grab_file_lock=true
remote_logging_enabled=false
allow_store_upgrade=false
neo4j.ext.udc.enabled=true
execution_guard_enabled=false
relationship_cache_array_fraction=1.0
online_backup_port=6362
...........................................................................
Importing 7500000 Nodes took 19 seconds 
.................................................................................................... 46240 ms for 10000000
.................................................................................................... 48288 ms for 10000000
.................................................................................................... 53414 ms for 10000000
.................................................................................................... 56666 ms for 10000000
.................................................................................................... 53448 ms for 10000000
.................................................................................................... 60050 ms for 10000000
.................................................................................................... 56085 ms for 10000000
.................................................................................................... 51794 ms for 10000000
.................................................................................................... 58168 ms for 10000000
.................................................................................................... 62980 ms for 10000000
.................................................................................................... 54274 ms for 10000000
.................................................................................................... 60093 ms for 10000000
.................................................................................................... 64010 ms for 10000000
.................................................................................................... 50907 ms for 10000000
.................................................................................................... 56419 ms for 10000000
.................................................................................................... 61040 ms for 10000000
.................................................................................................... 61256 ms for 10000000
.................................................................................................... 54176 ms for 10000000
.................................................................................................... 63846 ms for 10000000
............
Importing 191215478 Relationships took 1081 seconds 

Total import time: 1108 seconds