Created
January 5, 2016 22:05
-
-
Save steveyen/cb1333c517285d43edb7 to your computer and use it in GitHub Desktop.
bleve rocksdb-firestorm locked during bleve-blast
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Steves-MBP:bleve steveyen$ git log | head | |
| commit 83cd8da39445fa989a1a3b1f7b7de739bad8fcfe | |
| Merge: e5c1af4 89d17f0 | |
| Author: Marty Schoch <[email protected]> | |
| Date: Tue Jan 5 16:04:59 2016 -0500 | |
| Merge pull request #307 from steveyen/WIP-perf-20160105 | |
| analyze locations only if includeTermVectors enabled | |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Steves-MacBook-Pro:bleve-blast steveyen$ git log | head | |
| commit 7fac7f3af1b11c5450b5cdbe3a5e946f32f6535d | |
| Author: Steve Yen <[email protected]> | |
| Date: Tue Dec 29 16:29:27 2015 -0800 | |
| import net/http/pprof for mid-test profile sampling via REST | |
| Example REST endpoint is http://HOST:PORT/debug/pprof/profile | |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| in bleve-bench/cmd/bleve-blast directory... | |
| $ CGO_CFLAGS="-I/usr/local/include" CGO_LDFLAGS="-L/usr/local/lib -lrocksdb -lstdc++ -lm -lz -lbz2 -lsnappy" go build -tags "prod rocksdb" && rm -rf bench.bleve/ && ./bleve-blast -source=../../tmp/enwiki.txt -count=1000000 -numAnalyzers=8 -numIndexers=8 -config=../../configs/rocksdb-firestorm.json -batch=100 -bindHttp=127.0.0.1:5555 | |
| Using Index Type: firestorm | |
| Using KV store: rocksdb | |
| Using KV config: map[string]interface {}{"max_open_files":200, "total_threads":4, "lru_cache_capacity":6.7108864e+07} | |
| date,docs_indexed,plaintext_bytes_indexed,avg_mb_per_second,mb_per_second | |
| 2016-01-05T13:56:37-08:00,0,0,0.000000,0.000000 | |
| 2016-01-05T13:56:42-08:00,3600,55958073,11.183469,11.183474 | |
| 2016-01-05T13:56:47-08:00,7100,109210053,10.916592,10.649541 | |
| 2016-01-05T13:56:52-08:00,7300,112832658,7.520490,0.724619 | |
| 2016-01-05T13:56:57-08:00,7300,112832658,5.640814,0.000000 | |
| 2016-01-05T13:57:02-08:00,7300,112832658,4.512680,0.000000 | |
| 2016-01-05T13:57:07-08:00,7300,112832658,3.760492,0.000000 | |
| 2016-01-05T13:57:12-08:00,7300,112832658,3.223607,0.000000 | |
| 2016-01-05T13:57:17-08:00,7300,112832658,2.820517,0.000000 | |
| 2016-01-05T13:57:22-08:00,7300,112832658,2.507186,0.000000 | |
| 2016-01-05T13:57:27-08:00,7300,112832658,2.256446,0.000000 | |
| 2016-01-05T13:57:32-08:00,7300,112832658,2.051390,0.000000 | |
| 2016-01-05T13:57:37-08:00,7300,112832658,1.880425,0.000000 | |
| 2016-01-05T13:57:42-08:00,7300,112832658,1.735762,0.000000 | |
| 2016-01-05T13:57:47-08:00,7300,112832658,1.611831,0.000000 | |
| 2016-01-05T13:57:52-08:00,7300,112832658,1.504361,0.000000 | |
| 2016-01-05T13:57:57-08:00,7300,112832658,1.410390,0.000000 | |
| 2016-01-05T13:58:02-08:00,7300,112832658,1.327411,0.000000 | |
| 2016-01-05T13:58:07-08:00,7300,112832658,1.253662,0.000000 | |
| 2016-01-05T13:58:12-08:00,7300,112832658,1.187657,0.000000 | |
| 2016-01-05T13:58:17-08:00,7300,112832658,1.128311,0.000000 | |
| 2016-01-05T13:58:22-08:00,7300,112832658,1.074560,0.000000 | |
| 2016-01-05T13:58:27-08:00,7300,112832658,1.025723,0.000000 | |
| 2016-01-05T13:58:32-08:00,7300,112832658,0.981140,0.000000 | |
| 2016-01-05T13:58:37-08:00,7300,112832658,0.940258,0.000000 | |
| 2016-01-05T13:58:42-08:00,7300,112832658,0.902646,0.000000 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Steves-MacBook-Pro:bleve-blast steveyen$ !598 | |
| curl http://127.0.0.1:5555/debug/pprof/goroutine?debug=2 | |
| goroutine 142 [running]: | |
| runtime/pprof.writeGoroutineStacks(0x719adf8, 0xc8318720b0, 0x0, 0x0) | |
| /usr/local/go/src/runtime/pprof/pprof.go:516 +0x84 | |
| runtime/pprof.writeGoroutine(0x719adf8, 0xc8318720b0, 0x2, 0x0, 0x0) | |
| /usr/local/go/src/runtime/pprof/pprof.go:505 +0x46 | |
| runtime/pprof.(*Profile).WriteTo(0x4d20440, 0x719adf8, 0xc8318720b0, 0x2, 0x0, 0x0) | |
| /usr/local/go/src/runtime/pprof/pprof.go:236 +0xd4 | |
| net/http/pprof.handler.ServeHTTP(0xc82d23d001, 0x9, 0x719ad48, 0xc8318720b0, 0xc8200e61c0) | |
| /usr/local/go/src/net/http/pprof/pprof.go:199 +0x37e | |
| net/http/pprof.Index(0x719ad48, 0xc8318720b0, 0xc8200e61c0) | |
| /usr/local/go/src/net/http/pprof/pprof.go:211 +0x200 | |
| net/http.HandlerFunc.ServeHTTP(0x4a8c558, 0x719ad48, 0xc8318720b0, 0xc8200e61c0) | |
| /usr/local/go/src/net/http/server.go:1422 +0x3a | |
| net/http.(*ServeMux).ServeHTTP(0xc8200168a0, 0x719ad48, 0xc8318720b0, 0xc8200e61c0) | |
| /usr/local/go/src/net/http/server.go:1699 +0x17d | |
| net/http.serverHandler.ServeHTTP(0xc820136000, 0x719ad48, 0xc8318720b0, 0xc8200e61c0) | |
| /usr/local/go/src/net/http/server.go:1862 +0x19e | |
| net/http.(*conn).serve(0xc831872000) | |
| /usr/local/go/src/net/http/server.go:1361 +0xbee | |
| created by net/http.(*Server).Serve | |
| /usr/local/go/src/net/http/server.go:1910 +0x3f6 | |
| goroutine 1 [semacquire, 1 minutes]: | |
| sync.runtime_Semacquire(0xc82015b5cc) | |
| /usr/local/go/src/runtime/sema.go:43 +0x26 | |
| sync.(*WaitGroup).Wait(0xc82015b5c0) | |
| /usr/local/go/src/sync/waitgroup.go:126 +0xb4 | |
| main.main() | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:114 +0x987 | |
| goroutine 17 [syscall, 1 minutes, locked to thread]: | |
| runtime.goexit() | |
| /usr/local/go/src/runtime/asm_amd64.s:1721 +0x1 | |
| goroutine 6 [select, 1 minutes]: | |
| github.com/blevesearch/bleve/index.AnalysisWorker(0xc82001a2a0, 0xc82001a300) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:70 +0x14d | |
| created by github.com/blevesearch/bleve/index.NewAnalysisQueue | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:62 +0xf2 | |
| goroutine 7 [select, 1 minutes]: | |
| github.com/blevesearch/bleve/index.AnalysisWorker(0xc82001a2a0, 0xc82001a300) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:70 +0x14d | |
| created by github.com/blevesearch/bleve/index.NewAnalysisQueue | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:62 +0xf2 | |
| goroutine 8 [select, 1 minutes]: | |
| github.com/blevesearch/bleve/index.AnalysisWorker(0xc82001a2a0, 0xc82001a300) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:70 +0x14d | |
| created by github.com/blevesearch/bleve/index.NewAnalysisQueue | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:62 +0xf2 | |
| goroutine 9 [select, 1 minutes]: | |
| github.com/blevesearch/bleve/index.AnalysisWorker(0xc82001a2a0, 0xc82001a300) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:70 +0x14d | |
| created by github.com/blevesearch/bleve/index.NewAnalysisQueue | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:62 +0xf2 | |
| goroutine 10 [IO wait]: | |
| net.runtime_pollWait(0x5ca0fd8, 0x72, 0xc8200101b0) | |
| /usr/local/go/src/runtime/netpoll.go:157 +0x60 | |
| net.(*pollDesc).Wait(0xc820148060, 0x72, 0x0, 0x0) | |
| /usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a | |
| net.(*pollDesc).WaitRead(0xc820148060, 0x0, 0x0) | |
| /usr/local/go/src/net/fd_poll_runtime.go:78 +0x36 | |
| net.(*netFD).accept(0xc820148000, 0x0, 0x5ca10d0, 0xc82ab87fe0) | |
| /usr/local/go/src/net/fd_unix.go:408 +0x27c | |
| net.(*TCPListener).AcceptTCP(0xc82014e000, 0x4056ff0, 0x0, 0x0) | |
| /usr/local/go/src/net/tcpsock_posix.go:254 +0x4d | |
| net/http.tcpKeepAliveListener.Accept(0xc82014e000, 0x0, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/http/server.go:2135 +0x41 | |
| net/http.(*Server).Serve(0xc820136000, 0x5ca1098, 0xc82014e000, 0x0, 0x0) | |
| /usr/local/go/src/net/http/server.go:1887 +0xb3 | |
| net/http.(*Server).ListenAndServe(0xc820136000, 0x0, 0x0) | |
| /usr/local/go/src/net/http/server.go:1877 +0x136 | |
| net/http.ListenAndServe(0x7fff5fbffa7b, 0xe, 0x0, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/http/server.go:1967 +0x8f | |
| created by main.main | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:52 +0x84 | |
| goroutine 11 [select]: | |
| github.com/blevesearch/bleve/index.AnalysisWorker(0xc82001a540, 0xc82001a5a0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:70 +0x14d | |
| created by github.com/blevesearch/bleve/index.NewAnalysisQueue | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:62 +0xf2 | |
| goroutine 12 [select]: | |
| github.com/blevesearch/bleve/index.AnalysisWorker(0xc82001a540, 0xc82001a5a0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:70 +0x14d | |
| created by github.com/blevesearch/bleve/index.NewAnalysisQueue | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:62 +0xf2 | |
| goroutine 13 [select]: | |
| github.com/blevesearch/bleve/index.AnalysisWorker(0xc82001a540, 0xc82001a5a0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:70 +0x14d | |
| created by github.com/blevesearch/bleve/index.NewAnalysisQueue | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:62 +0xf2 | |
| goroutine 14 [select]: | |
| github.com/blevesearch/bleve/index.AnalysisWorker(0xc82001a540, 0xc82001a5a0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:70 +0x14d | |
| created by github.com/blevesearch/bleve/index.NewAnalysisQueue | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:62 +0xf2 | |
| goroutine 15 [select]: | |
| github.com/blevesearch/bleve/index.AnalysisWorker(0xc82001a540, 0xc82001a5a0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:70 +0x14d | |
| created by github.com/blevesearch/bleve/index.NewAnalysisQueue | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:62 +0xf2 | |
| goroutine 16 [select]: | |
| github.com/blevesearch/bleve/index.AnalysisWorker(0xc82001a540, 0xc82001a5a0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:70 +0x14d | |
| created by github.com/blevesearch/bleve/index.NewAnalysisQueue | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:62 +0xf2 | |
| goroutine 18 [select]: | |
| github.com/blevesearch/bleve/index.AnalysisWorker(0xc82001a540, 0xc82001a5a0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:70 +0x14d | |
| created by github.com/blevesearch/bleve/index.NewAnalysisQueue | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:62 +0xf2 | |
| goroutine 19 [select]: | |
| github.com/blevesearch/bleve/index.AnalysisWorker(0xc82001a540, 0xc82001a5a0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:70 +0x14d | |
| created by github.com/blevesearch/bleve/index.NewAnalysisQueue | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/analysis.go:62 +0xf2 | |
| goroutine 20 [select]: | |
| github.com/blevesearch/bleve/index/firestorm.(*GarbageCollector).run(0xc82001aa80) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/garbage.go:66 +0x417 | |
| created by github.com/blevesearch/bleve/index/firestorm.(*GarbageCollector).Start | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/garbage.go:55 +0x58 | |
| goroutine 21 [select]: | |
| github.com/blevesearch/bleve/index/firestorm.(*Lookuper).run(0xc820013840) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/lookup.go:58 +0x1e6 | |
| created by github.com/blevesearch/bleve/index/firestorm.(*Lookuper).Start | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/lookup.go:47 +0x58 | |
| goroutine 22 [select]: | |
| github.com/blevesearch/bleve/index/firestorm.(*DictUpdater).runIncoming(0xc82001ac00) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/dict_updater.go:73 +0x2ae | |
| created by github.com/blevesearch/bleve/index/firestorm.(*DictUpdater).Start | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/dict_updater.go:62 +0x58 | |
| goroutine 23 [syscall, 1 minutes, locked to thread]: | |
| github.com/tecbot/gorocksdb._Cfunc_rocksdb_write(0x5e00d00, 0x5d05690, 0x5e11140, 0xc820ab6028) | |
| github.com/tecbot/gorocksdb/_obj/_cgo_gotypes.go:2877 +0x35 | |
| github.com/tecbot/gorocksdb.(*DB).Write(0xc8201546a0, 0xc820ab6020, 0xc820ab6018, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/tecbot/gorocksdb/db.go:366 +0x73 | |
| github.com/blevesearch/blevex/rocksdb.(*Writer).ExecuteBatch(0xc820ab6008, 0x5c64ef0, 0xc820ab6010, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/blevex/rocksdb/writer.go:37 +0xcb | |
| github.com/blevesearch/bleve/index/firestorm.(*DictUpdater).update(0xc82001ac00) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/dict_updater.go:128 +0x530 | |
| github.com/blevesearch/bleve/index/firestorm.(*DictUpdater).run(0xc82001ac00) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/dict_updater.go:99 +0x17f | |
| created by github.com/blevesearch/bleve/index/firestorm.(*DictUpdater).Start | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/dict_updater.go:63 +0x7a | |
| goroutine 24 [chan send]: | |
| main.readingWorker(0x5c64f58, 0xc82000ad80, 0xc82001ae40) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:198 +0x719 | |
| created by main.main | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:97 +0x8ab | |
| goroutine 25 [chan receive]: | |
| main.printTimeWorker() | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:129 +0x67 | |
| created by main.main | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:101 +0x8d3 | |
| goroutine 26 [syscall, 1 minutes, locked to thread]: | |
| github.com/tecbot/gorocksdb._Cfunc_rocksdb_write(0x5e00d00, 0x700a070, 0x5857f40, 0xc8224de808) | |
| github.com/tecbot/gorocksdb/_obj/_cgo_gotypes.go:2877 +0x35 | |
| github.com/tecbot/gorocksdb.(*DB).Write(0xc8201546a0, 0xc8224de800, 0xc8224de7f8, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/tecbot/gorocksdb/db.go:366 +0x73 | |
| github.com/blevesearch/blevex/rocksdb.(*Writer).ExecuteBatch(0xc8224de600, 0x5c64ef0, 0xc8224de610, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/blevex/rocksdb/writer.go:37 +0xcb | |
| github.com/blevesearch/bleve/index/firestorm.(*Firestorm).batchRows(0xc82010e4d0, 0x5c64eb8, 0xc8224de600, 0xc82e9f6a00, 0x64, 0x65, 0x0, 0x0, 0x0, 0xc82856ab40, ...) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/firestorm.go:246 +0xa65 | |
| github.com/blevesearch/bleve/index/firestorm.(*Firestorm).Batch(0xc82010e4d0, 0xc826e57c20, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/firestorm.go:354 +0xcd0 | |
| github.com/blevesearch/bleve.(*indexImpl).Batch(0xc82000ad80, 0xc82ebb22a0, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index_impl.go:317 +0x122 | |
| main.batchIndexingWorker(0x5c64f58, 0xc82000ad80, 0xc82001ae40, 0xece1e3315, 0x298b4772, 0x4d32740) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:249 +0xb8 | |
| main.main.func1(0x5c64f58, 0xc82000ad80, 0xc82001ae40, 0xc82015b5c0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:109 +0x57 | |
| created by main.main | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:111 +0x969 | |
| goroutine 27 [syscall, 1 minutes, locked to thread]: | |
| github.com/tecbot/gorocksdb._Cfunc_rocksdb_write(0x5e00d00, 0x5d09920, 0x5f129d0, 0xc82014eb00) | |
| github.com/tecbot/gorocksdb/_obj/_cgo_gotypes.go:2877 +0x35 | |
| github.com/tecbot/gorocksdb.(*DB).Write(0xc8201546a0, 0xc82014eaf8, 0xc8206083e8, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/tecbot/gorocksdb/db.go:366 +0x73 | |
| github.com/blevesearch/blevex/rocksdb.(*Writer).ExecuteBatch(0xc8206083d8, 0x5c64ef0, 0xc8206083e0, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/blevex/rocksdb/writer.go:37 +0xcb | |
| github.com/blevesearch/bleve/index/firestorm.(*Firestorm).batchRows(0xc82010e4d0, 0x5c64eb8, 0xc8206083d8, 0xc82e2dc000, 0x64, 0x65, 0x0, 0x0, 0x0, 0xc823454cc0, ...) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/firestorm.go:246 +0xa65 | |
| github.com/blevesearch/bleve/index/firestorm.(*Firestorm).Batch(0xc82010e4d0, 0xc8257d7760, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/firestorm.go:354 +0xcd0 | |
| github.com/blevesearch/bleve.(*indexImpl).Batch(0xc82000ad80, 0xc826b87420, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index_impl.go:317 +0x122 | |
| main.batchIndexingWorker(0x5c64f58, 0xc82000ad80, 0xc82001ae40, 0xece1e3315, 0x298b4772, 0x4d32740) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:249 +0xb8 | |
| main.main.func1(0x5c64f58, 0xc82000ad80, 0xc82001ae40, 0xc82015b5c0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:109 +0x57 | |
| created by main.main | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:111 +0x969 | |
| goroutine 28 [syscall, locked to thread]: | |
| github.com/tecbot/gorocksdb._Cfunc_rocksdb_write(0x5e00d00, 0x5858510, 0x5e03380, 0xc82014e048) | |
| github.com/tecbot/gorocksdb/_obj/_cgo_gotypes.go:2877 +0x35 | |
| github.com/tecbot/gorocksdb.(*DB).Write(0xc8201546a0, 0xc82014e040, 0xc82014e038, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/tecbot/gorocksdb/db.go:366 +0x73 | |
| github.com/blevesearch/blevex/rocksdb.(*Writer).ExecuteBatch(0xc82014e028, 0x5c64ef0, 0xc82014e030, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/blevex/rocksdb/writer.go:37 +0xcb | |
| github.com/blevesearch/bleve/index/firestorm.(*Firestorm).batchRows(0xc82010e4d0, 0x5c64eb8, 0xc82014e028, 0xc824b04000, 0x64, 0x65, 0x0, 0x0, 0x0, 0xc82a693a40, ...) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/firestorm.go:246 +0xa65 | |
| github.com/blevesearch/bleve/index/firestorm.(*Firestorm).Batch(0xc82010e4d0, 0xc82e0037b0, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/firestorm.go:354 +0xcd0 | |
| github.com/blevesearch/bleve.(*indexImpl).Batch(0xc82000ad80, 0xc830ea4ba0, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index_impl.go:317 +0x122 | |
| main.batchIndexingWorker(0x5c64f58, 0xc82000ad80, 0xc82001ae40, 0xece1e3315, 0x298b4772, 0x4d32740) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:249 +0xb8 | |
| main.main.func1(0x5c64f58, 0xc82000ad80, 0xc82001ae40, 0xc82015b5c0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:109 +0x57 | |
| created by main.main | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:111 +0x969 | |
| goroutine 29 [syscall, 1 minutes, locked to thread]: | |
| github.com/tecbot/gorocksdb._Cfunc_rocksdb_write(0x5e00d00, 0x5d0c560, 0x720b3a0, 0xc821382328) | |
| github.com/tecbot/gorocksdb/_obj/_cgo_gotypes.go:2877 +0x35 | |
| github.com/tecbot/gorocksdb.(*DB).Write(0xc8201546a0, 0xc821382318, 0xc82014eaf0, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/tecbot/gorocksdb/db.go:366 +0x73 | |
| github.com/blevesearch/blevex/rocksdb.(*Writer).ExecuteBatch(0xc82014eae0, 0x5c64ef0, 0xc82014eae8, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/blevex/rocksdb/writer.go:37 +0xcb | |
| github.com/blevesearch/bleve/index/firestorm.(*Firestorm).batchRows(0xc82010e4d0, 0x5c64eb8, 0xc82014eae0, 0xc82ab5a000, 0x64, 0x65, 0x0, 0x0, 0x0, 0xc82a0e8360, ...) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/firestorm.go:246 +0xa65 | |
| github.com/blevesearch/bleve/index/firestorm.(*Firestorm).Batch(0xc82010e4d0, 0xc83178eec0, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/firestorm.go:354 +0xcd0 | |
| github.com/blevesearch/bleve.(*indexImpl).Batch(0xc82000ad80, 0xc82e708be0, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index_impl.go:317 +0x122 | |
| main.batchIndexingWorker(0x5c64f58, 0xc82000ad80, 0xc82001ae40, 0xece1e3315, 0x298b4772, 0x4d32740) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:249 +0xb8 | |
| main.main.func1(0x5c64f58, 0xc82000ad80, 0xc82001ae40, 0xc82015b5c0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:109 +0x57 | |
| created by main.main | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:111 +0x969 | |
| goroutine 30 [syscall, 1 minutes, locked to thread]: | |
| github.com/tecbot/gorocksdb._Cfunc_rocksdb_write(0x5e00d00, 0x5f030b0, 0x5d11810, 0xc8224de850) | |
| github.com/tecbot/gorocksdb/_obj/_cgo_gotypes.go:2877 +0x35 | |
| github.com/tecbot/gorocksdb.(*DB).Write(0xc8201546a0, 0xc8224de848, 0xc8224de840, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/tecbot/gorocksdb/db.go:366 +0x73 | |
| github.com/blevesearch/blevex/rocksdb.(*Writer).ExecuteBatch(0xc8224de830, 0x5c64ef0, 0xc8224de838, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/blevex/rocksdb/writer.go:37 +0xcb | |
| github.com/blevesearch/bleve/index/firestorm.(*Firestorm).batchRows(0xc82010e4d0, 0x5c64eb8, 0xc8224de830, 0xc82e531400, 0x64, 0x65, 0x0, 0x0, 0x0, 0xc826e148a0, ...) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/firestorm.go:246 +0xa65 | |
| github.com/blevesearch/bleve/index/firestorm.(*Firestorm).Batch(0xc82010e4d0, 0xc8238b5490, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/firestorm.go:354 +0xcd0 | |
| github.com/blevesearch/bleve.(*indexImpl).Batch(0xc82000ad80, 0xc82259d060, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index_impl.go:317 +0x122 | |
| main.batchIndexingWorker(0x5c64f58, 0xc82000ad80, 0xc82001ae40, 0xece1e3315, 0x298b4772, 0x4d32740) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:249 +0xb8 | |
| main.main.func1(0x5c64f58, 0xc82000ad80, 0xc82001ae40, 0xc82015b5c0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:109 +0x57 | |
| created by main.main | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:111 +0x969 | |
| goroutine 31 [syscall, locked to thread]: | |
| github.com/tecbot/gorocksdb._Cfunc_rocksdb_write(0x5e00d00, 0x5d11080, 0x5e09160, 0xc8224de6d0) | |
| github.com/tecbot/gorocksdb/_obj/_cgo_gotypes.go:2877 +0x35 | |
| github.com/tecbot/gorocksdb.(*DB).Write(0xc8201546a0, 0xc8224de6c8, 0xc8224de6c0, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/tecbot/gorocksdb/db.go:366 +0x73 | |
| github.com/blevesearch/blevex/rocksdb.(*Writer).ExecuteBatch(0xc8224de6b0, 0x5c64ef0, 0xc8224de6b8, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/blevex/rocksdb/writer.go:37 +0xcb | |
| github.com/blevesearch/bleve/index/firestorm.(*Firestorm).batchRows(0xc82010e4d0, 0x5c64eb8, 0xc8224de6b0, 0xc820be2000, 0x64, 0x65, 0x0, 0x0, 0x0, 0xc82e3ee330, ...) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/firestorm.go:246 +0xa65 | |
| github.com/blevesearch/bleve/index/firestorm.(*Firestorm).Batch(0xc82010e4d0, 0xc832447430, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/firestorm.go:354 +0xcd0 | |
| github.com/blevesearch/bleve.(*indexImpl).Batch(0xc82000ad80, 0xc82c1657a0, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index_impl.go:317 +0x122 | |
| main.batchIndexingWorker(0x5c64f58, 0xc82000ad80, 0xc82001ae40, 0xece1e3315, 0x298b4772, 0x4d32740) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:249 +0xb8 | |
| main.main.func1(0x5c64f58, 0xc82000ad80, 0xc82001ae40, 0xc82015b5c0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:109 +0x57 | |
| created by main.main | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:111 +0x969 | |
| goroutine 32 [syscall, 1 minutes, locked to thread]: | |
| github.com/tecbot/gorocksdb._Cfunc_rocksdb_write(0x5e00d00, 0x5f07cf0, 0x5e0ad40, 0xc820ab6488) | |
| github.com/tecbot/gorocksdb/_obj/_cgo_gotypes.go:2877 +0x35 | |
| github.com/tecbot/gorocksdb.(*DB).Write(0xc8201546a0, 0xc820ab6480, 0xc820ab6478, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/tecbot/gorocksdb/db.go:366 +0x73 | |
| github.com/blevesearch/blevex/rocksdb.(*Writer).ExecuteBatch(0xc820ab6468, 0x5c64ef0, 0xc820ab6470, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/blevex/rocksdb/writer.go:37 +0xcb | |
| github.com/blevesearch/bleve/index/firestorm.(*Firestorm).batchRows(0xc82010e4d0, 0x5c64eb8, 0xc820ab6468, 0xc82ec31400, 0x64, 0x65, 0x0, 0x0, 0x0, 0xc82dde9890, ...) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/firestorm.go:246 +0xa65 | |
| github.com/blevesearch/bleve/index/firestorm.(*Firestorm).Batch(0xc82010e4d0, 0xc8260056d0, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/firestorm.go:354 +0xcd0 | |
| github.com/blevesearch/bleve.(*indexImpl).Batch(0xc82000ad80, 0xc825ddcc00, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index_impl.go:317 +0x122 | |
| main.batchIndexingWorker(0x5c64f58, 0xc82000ad80, 0xc82001ae40, 0xece1e3315, 0x298b4772, 0x4d32740) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:249 +0xb8 | |
| main.main.func1(0x5c64f58, 0xc82000ad80, 0xc82001ae40, 0xc82015b5c0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:109 +0x57 | |
| created by main.main | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:111 +0x969 | |
| goroutine 33 [syscall, 1 minutes, locked to thread]: | |
| github.com/tecbot/gorocksdb._Cfunc_rocksdb_write(0x5e00d00, 0x5e04990, 0x585c860, 0xc82014e4d8) | |
| github.com/tecbot/gorocksdb/_obj/_cgo_gotypes.go:2877 +0x35 | |
| github.com/tecbot/gorocksdb.(*DB).Write(0xc8201546a0, 0xc82014e4d0, 0xc82014e4c8, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/tecbot/gorocksdb/db.go:366 +0x73 | |
| github.com/blevesearch/blevex/rocksdb.(*Writer).ExecuteBatch(0xc82014e4b8, 0x5c64ef0, 0xc82014e4c0, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/blevex/rocksdb/writer.go:37 +0xcb | |
| github.com/blevesearch/bleve/index/firestorm.(*Firestorm).batchRows(0xc82010e4d0, 0x5c64eb8, 0xc82014e4b8, 0xc82d85d400, 0x64, 0x65, 0x0, 0x0, 0x0, 0xc82f17dd10, ...) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/firestorm.go:246 +0xa65 | |
| github.com/blevesearch/bleve/index/firestorm.(*Firestorm).Batch(0xc82010e4d0, 0xc82c8f9800, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index/firestorm/firestorm.go:354 +0xcd0 | |
| github.com/blevesearch/bleve.(*indexImpl).Batch(0xc82000ad80, 0xc82c5350c0, 0x0, 0x0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve/index_impl.go:317 +0x122 | |
| main.batchIndexingWorker(0x5c64f58, 0xc82000ad80, 0xc82001ae40, 0xece1e3315, 0x298b4772, 0x4d32740) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:249 +0xb8 | |
| main.main.func1(0x5c64f58, 0xc82000ad80, 0xc82001ae40, 0xc82015b5c0) | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:109 +0x57 | |
| created by main.main | |
| /Users/steveyen/go/src/github.com/blevesearch/bleve-bench/cmd/bleve-blast/main.go:111 +0x969 | |
| goroutine 162 [syscall, 1 minutes, locked to thread]: | |
| runtime.goexit() | |
| /usr/local/go/src/runtime/asm_amd64.s:1721 +0x1 | |
| goroutine 163 [syscall, 1 minutes, locked to thread]: | |
| runtime.goexit() | |
| /usr/local/go/src/runtime/asm_amd64.s:1721 +0x1 | |
| goroutine 164 [syscall, 1 minutes, locked to thread]: | |
| runtime.goexit() | |
| /usr/local/go/src/runtime/asm_amd64.s:1721 +0x1 | |
| Steves-MacBook-Pro:bleve-blast steveyen$ |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment