Skip to content

Instantly share code, notes, and snippets.

View steveyen's full-sized avatar

Steve Yen steveyen

164 followers · 1 following
View GitHub Profile
@steveyen
steveyen / bleve-query.svg
Last active August 3, 2016 21:13
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@steveyen
steveyen / gist:c53027e1aff29a1d721ac19592999de7
Created August 3, 2016 18:13
Steves-MacBook-Pro:bleve steveyen$ git diff
diff --git a/index/index.go b/index/index.go
index 880c35f..77e4d46 100644
--- a/index/index.go
+++ b/index/index.go
@@ -123,7 +123,9 @@ type TermFieldDoc struct {
}
func (tfd *TermFieldDoc) Reset() *TermFieldDoc {
+ id := tfd.ID
@steveyen
steveyen / indexapiwork bleve-query experiments
Last active August 2, 2016 18:30
with bleve origin/master...
Steves-MacBook-Pro:bleve-bench steveyen$ go build ./cmd/bleve-query/ && rm cpu.pprof && ./bleve-query -cpuprofile cpu.pprof -index=/Users/steveyen/go/src/github.com/blevesearch/bleve-bench/tmp/tmp/bench.bleve book can date first http isbn last many name one see title united web year
date,queries_finished,avg_queries_per_second,queries_per_second
2016-08-02T10:59:36-07:00,0,0.000000,0.000000
2016-08-02T10:59:41-07:00,391,78.130687,78.130687
2016-08-02T10:59:46-07:00,792,79.162199,80.194556
2016-08-02T10:59:51-07:00,1191,79.399242,79.873995
2016-08-02T10:59:56-07:00,1590,79.484492,79.740053
2016-08-02T11:00:01-07:00,1990,79.584793,79.986004
@steveyen
steveyen / 20160726 perfbox moss bench store
Last active August 8, 2016 17:26
steveyen@ubu-s835:~/go/src/github.com/couchbase/moss$ go test -timeout=10h -bench=BenchmarkStore
PASS
BenchmarkStore_numItems1M_keySize20_valSize100_batchSize100-32
spec: {numItems:1000000 keySize:20 valSize:100 batchSize:100 accesses:[]}
open time: 0 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s
load time: 2521 (ms), phase 396667 wop/s, 46484 wkb/s, 0 rop/s, 0 rkb/s, cum 396667 wop/s, 46484 wkb/s, 0 rop/s, 0 rkb/s
drain time: 205 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 366837 wop/s, 42988 wkb/s, 0 rop/s, 0 rkb/s
close time: 0 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 366837 wop/s, 42988 wkb/s, 0 rop/s, 0 rkb/s
reopen time: 0 (ms), phase 0 wop/s, 0 wkb/s, 0 rop/s, 0 rkb/s, cum 366837 wop/s, 4
@steveyen
steveyen / 1about-mossStore-benchmarks.txt
Last active July 26, 2016 00:57
results from various go test -bench=BenchmarkStore
These tests were run on macbookpro, 16GB ram, SSD.
The "unsafe" test results are faster than the "safe" test results,
as the unsafe tests are able to use golang's unsafe package
to avoid additional data conversions.
@steveyen
steveyen / MB-20101.json
Created July 15, 2016 00:17
{
"type": "fulltext-index",
"name": "custom_index",
"uuid": "2f597b2acd3cb07b",
"sourceType": "couchbase",
"sourceName": "default",
"sourceUUID": "",
"planParams": {
"maxPartitionsPerPIndex": 32,
"numReplicas": 0,
@steveyen
steveyen / mossStore bleve-blast config
Created May 26, 2016 20:52
{
"index_type": "upside_down",
"kvstore": "moss",
"kvconfig": {
"mossDebug": 1,
"mossLowerLevelStoreName": "mossStore"
}
}
@steveyen
steveyen / gist:05e39749a37d319e22a1170b2b3d1ab6
Created May 23, 2016 22:50 — forked from mschoch/gist:3ffd2b42ac20425599a64e9a9c55e667
unexpected mismatch for term 'strand', dictionary 18, search hits 19
unexpected mismatch for term 'Rowling's', dictionary 4, search hits 5
unexpected mismatch for term 'honoring', dictionary 12, search hits 13
unexpected mismatch for term 'interchangeably', dictionary 13, search hits 14
unexpected mismatch for term 'es:El', dictionary 1, search hits 2
unexpected mismatch for term 'barely', dictionary 29, search hits 30
unexpected mismatch for term 'axons', dictionary 3, search hits 5
unexpected mismatch for term 'gather', dictionary 35, search hits 36
unexpected mismatch for term 'Postel', dictionary 4, search hits 5
unexpected mismatch for term 'Texans', dictionary 7, search hits 9
@steveyen
steveyen / gist:86adb43ff342e033c0ddc9c42fd9e342
Created April 28, 2016 23:34
MB-19432
2016-04-28T14:51:52-367 [email protected]_20160428-215006/ns_server.fts.log:21205304:13090 NAME [managerStats "pindexes" "default_index_1_5e171830606cf32f_0a44bddb" "bleveIndexStats" "index" "kv" "kv" "moss"] CurDirtyBytes = INT 299178
2016-04-28T14:51:52-367 [email protected]_20160428-215006/ns_server.fts.log:21205304:13090 NAME [managerStats "pindexes" "default_index_1_5e171830606cf32f_0ffd4517" "bleveIndexStats" "index" "kv" "kv" "moss"] CurDirtyBytes = INT 0
2016-04-28T14:51:52-367 [email protected]_20160428-215006/ns_server.fts.log:21205304:13090 NAME [managerStats "pindexes" "default_index_1_5e171830606cf32f_24e7ea2d" "bleveIndexStats" "index" "kv" "kv" "moss"] CurDirtyBytes = INT 443915
2016-04-28T14:51:52-367 [email protected]_20160428-215006/ns_server.fts.log:21205304:13090 NAME [managerStats "pindexes" "default_index_1_5e171830606cf32f_27184a97" "bleveIndexStats" "index" "kv" "kv" "moss"] CurDirtyBytes = INT 0
2016-04-28T1
@steveyen
steveyen / cbft n_1 goroutines
Created April 14, 2016 17:12
MB-19207
Steves-MacBook-Pro:MB-19207 steveyen$ ~/dev/couchbase-server.watson/goproj/src/github.com/couchbase/cbft/cmd/cbft_cbcollect_info_analyze extract /api/diag cbcollect_info_n_1\@10.72.57.110_20160414-154850/ | jq '.["/debug/pprof/goroutine?debug=2"] | split("\n")'
[
"goroutine 3350 [running]:",
"runtime/pprof.writeGoroutineStacks(0x7164460, 0xc823083730, 0x0, 0x0)",
"\t/Users/steveyen/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/pprof/pprof.go:516 +0x84",
"runtime/pprof.writeGoroutine(0x7164460, 0xc823083730, 0x2, 0x0, 0x0)",
"\t/Users/steveyen/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/pprof/pprof.go:505 +0x46",
"runtime/pprof.(*Profile).WriteTo(0x5342e00, 0x7164460, 0xc823083730, 0x2, 0x0, 0x0)",
"\t/Users/steveyen/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/pprof/pprof.go:236 +0xd4",
"github.com/couchbase/cbgt/rest.DiagGetPProf(0x5f83360, 0xc8231f8280, 0x4ceb060, 0x9, 0x2)",