Skip to content

Instantly share code, notes, and snippets.

View mschoch's full-sized avatar

Marty Schoch mschoch

269 followers · 25 following
View GitHub Profile
@mschoch
mschoch / gist:912abac90750c01ad3f05b3e114ef5f1
Created June 13, 2017 20:43
SIGQUIT: quit
PC=0x105bd9b m=0 sigcode=0
goroutine 0 [idle]:
runtime.mach_semaphore_wait(0xe03, 0x1d5f3a0, 0x0, 0x102141d, 0x1d5f3a0, 0x1d5f520, 0x7fff5fbfee50, 0x1056193, 0xffffffffffffffff, 0x2885fc00026, ...)
/Users/mschoch/.cbdepscache/exploded/x86_64/go-1.8.3/go/src/runtime/sys_darwin_amd64.s:415 +0xb fp=0x7fff5fbfedf8 sp=0x7fff5fbfedf0
runtime.semasleep1(0xffffffffffffffff, 0x2885fc00026)
/Users/mschoch/.cbdepscache/exploded/x86_64/go-1.8.3/go/src/runtime/os_darwin.go:413 +0x4b fp=0x7fff5fbfee38 sp=0x7fff5fbfedf8
runtime.semasleep.func1()
/Users/mschoch/.cbdepscache/exploded/x86_64/go-1.8.3/go/src/runtime/os_darwin.go:432 +0x33 fp=0x7fff5fbfee60 sp=0x7fff5fbfee38
@mschoch
mschoch / sorting_examples.md
Created May 4, 2017 19:08

The simple case of sorting by a field:

      "sort": ["born"]

Equivalent way of sorting, using the object form.

      "sort": [
@mschoch
mschoch / sample.go
Created April 20, 2017 21:52
err = indexMapping.AddCustomTokenMap("myStopWords", map[string]interface{}{
"tokens": []interface{}{"a", "in", "the"},
})
if err != nil {
return nil, err
}
err = indexMapping.AddCustomTokenFilter("myStopFilter", map[string]interface{}{
"type": "stop_tokens",
"stop_token_map": "stop_test",
@mschoch
mschoch / gist:29a6446f86b18aa593bda3bce6ff5dca
Created April 18, 2017 20:49
more collector benchmarks
➜ collector git:(master) ✗ go test -run=xxx -bench=. -benchmem
BenchmarkTop10of0Scores-4 1000000 1242 ns/op 2288 B/op 15 allocs/op
BenchmarkTop10of3Scores-4 1000000 1618 ns/op 2320 B/op 19 allocs/op
BenchmarkTop10of10Scores-4 500000 2724 ns/op 2376 B/op 26 allocs/op
BenchmarkTop10of10000Scores-4 5000 352379 ns/op 2552 B/op 27 allocs/op
BenchmarkTop100of10000Scores-4 3000 532882 ns/op 19744 B/op 117 allocs/op
BenchmarkTop1000of10000Scores-4 1000 1856786 ns/op 184744 B/op 1017 allocs/op
BenchmarkTop10000of100000Scores-4 50 28494243 ns/op 1939640 B/op 19024 allocs/op
BenchmarkTop10of100000Scores-4 300 4089210 ns/op 2560 B/op 27 allocs/op
BenchmarkTop100of100000Scores-4 300 4344005 ns/op 19896 B/op 117 allocs/op
@mschoch
mschoch / gist:d980efade1b2df6d9ba29d551111253a
Created April 4, 2017 13:51
➜ bleve-bench git:(master) go install ./...
➜ bleve-bench git:(master) bleve-analyzer -source ~/Documents/research/lucene/data/enwiki-20120502-lines-1k.txt
date,tokens,avg_million_tokens_per_second,milllion_tokens_per_second
2017-04-04T09:49:40-04:00,0,0.000000,0.000000
2017-04-04T09:49:44-04:00,10399672,2.665242,2.665242
➜ bleve-bench git:(master) bleve-analyzer -source ~/Documents/research/lucene/data/enwiki-20120502-lines-1k.txt
date,tokens,avg_million_tokens_per_second,milllion_tokens_per_second
2017-04-04T09:49:46-04:00,0,0.000000,0.000000
2017-04-04T09:49:50-04:00,10399672,2.654371,2.654371
➜ bleve-bench git:(master) bleve-analyzer -source ~/Documents/research/lucene/data/enwiki-20120502-lines-1k.txt
@mschoch
mschoch / gist:e702631dd658a81b0857833db7694cd1
Created April 1, 2017 02:58
{
"status": {
"total": 6,
"failed": 6,
"successful": 0,
"errors": {
"b2_6dce932ccb9d8fba_13aa53f3": "TooManyClauses[maxClauseCount is set to 1024]",
"b2_6dce932ccb9d8fba_18572d87": "TooManyClauses[maxClauseCount is set to 1024]",
"b2_6dce932ccb9d8fba_54820232": "TooManyClauses[maxClauseCount is set to 1024]",
"b2_6dce932ccb9d8fba_6ddbfb54": "TooManyClauses[maxClauseCount is set to 1024]",
@mschoch
mschoch / gist:e94952f5608a84864cdae78ce1b9680e
Created April 1, 2017 02:37
../../../../../../goproj/src/github.com/couchbase/query/datastore/couchbase/get_inferencer_ee.go:22:2: cannot find package "github.com/couchbase/cbq-gui/inferencer" in any of:
/Users/mschoch/.cbdepscache/exploded/x86_64/go-1.8/go/src/github.com/couchbase/cbq-gui/inferencer (from $GOROOT)
/Users/mschoch/Documents/research/cbsource/goproj/src/github.com/couchbase/cbq-gui/inferencer (from $GOPATH)
/Users/mschoch/Documents/research/cbsource/godeps/src/github.com/couchbase/cbq-gui/inferencer
-- @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
-- @ 'go install' failed! Re-running as 'go build' to help debug...
-- @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
WORK=/var/folders/ld/hw3n9n0n4w762w8_9hr9cmr00000gn/T/go-build889987646
../../../../../../goproj/src/github.com/couchbase/query/datastore/couchbase/get_inferencer_ee.go:22:2: cannot find package "github.com/couchbase/cbq-gui/inferencer" in any of:
/Users/mschoch/.cbdepscache/exploded/x86_64/go-1.8/go/src/github.com/couchbase/cbq-gui/inferencer (from $GOR
@mschoch
mschoch / gist:1c2dd0796c8d550c4b8d685ce1fec163
Created March 30, 2017 13:29
./testrunner -i cbft3.ini -t fts.stable_topology_fts.StableTopFTS.test_sorting_of_results,items=100,sort_fields=languages_known,advanced_sort=True,sort_by=field,sort_missing=first,sort_desc=False,sort_mode=min,expected=emp10000001,emp10000071,emp10000042,cluster=D+F,D+F,F
Global Test input params:
{'cluster_name': 'cbft3', 'ini': 'cbft3.ini', 'num_nodes': 3}
Logs will be stored at /Users/mschoch/Documents/research/cbsource/testrunner/logs/testrunner-17-Mar-30_09-26-33/test_1
./testrunner -i cbft3.ini -t fts.stable_topology_fts.StableTopFTS.test_sorting_of_results,items=100,sort_fields=languages_known,advanced_sort=True,sort_by=field,sort_missing=first,sort_desc=False,sort_mode=min,expected=emp10000001,emp10000071,emp10000042,cluster=D+F,D+F,F
Test Input params:
{'logs_folder': '/Users/mschoch/Documents/research/cbsource/testrunner/logs/testrunner-17-Mar-30_09-26-33/test_1', 'sort_desc': 'False', 'advanced_sort': 'True', 'items': '100', 'sort_fields': 'languages_known', 'sort_by': 'field', 'cluster_name': '
@mschoch
mschoch / gist:2168045c388f7896bfcc120e0c2cbfdf
Created March 30, 2017 12:43
./testrunner -i cbft.ini -t fts.stable_topology_fts.StableTopFTS.test_sorting_of_results,items=100,sort_fields=languages_known,advanced_sort=True,sort_by=field,sort_missing=first,sort_desc=False,sort_mode=min,expected=emp10000001,emp10000071,emp10000042,cluster=D+F
Global Test input params:
{'cluster_name': 'cbft', 'ini': 'cbft.ini', 'num_nodes': 1}
Logs will be stored at /Users/mschoch/Documents/research/cbsource/testrunner/logs/testrunner-17-Mar-30_08-38-18/test_1
./testrunner -i cbft.ini -t fts.stable_topology_fts.StableTopFTS.test_sorting_of_results,items=100,sort_fields=languages_known,advanced_sort=True,sort_by=field,sort_missing=first,sort_desc=False,sort_mode=min,expected=emp10000001,emp10000071,emp10000042,cluster=D+F
Test Input params:
{'logs_folder': '/Users/mschoch/Documents/research/cbsource/testrunner/logs/testrunner-17-Mar-30_08-38-18/test_1', 'sort_desc': 'False', 'advanced_sort': 'True', 'items': '100', 'sort_fields': 'languages_known', 'sort_by': 'field', 'cluster_name': 'cbft', 'cluste
@mschoch
mschoch / gist:c78abd9c2ac929304326c58bb7a02442
Created March 27, 2017 13:04
before:
➜ moss git:(safe) go test -run=xxx -bench=BenchmarkStore_numItems1M_keySize20_valSize100_batchSize100_ACCESSES_afterLoad_domainTo100K_ops200K_batchSize100 -benchmem
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
spec: {numItems:1000000 keySize:20 valSize:100 batchSize:100 randomLoad:false noCopyValue:true accesses:[{after:load kind:w domainFrom:0 domainTo:100000 ops:200000 random:true pctGet:0 batchSize:100} {after:iter kind:r domainFrom:0 domainTo:100000 ops:200000 random:true pctGet:1 batchSize:0}]}
open || time: 0 (ms) | 0 wop/s | 0 wkb/s | 0 rop/s | 0 rkb/s || cumulative: 0 wop/s | 0 wkb/s | 0 rop/s | 0 rkb/s
load || time: 1133 (ms) | 882612 wop/s | 103431 wkb/s | 0 rop/s | 0 rkb/s || cumulative: 882612 wop/s | 103431 wkb/s | 0 rop/s | 0 rkb/s
<<access 0: