Skip to content

Instantly share code, notes, and snippets.

@tbg

tbg/gist:0a793101e942a3e998d3967f3d68df10

Created April 8, 2020 10:46
Show Gist options
  • Save tbg/0a793101e942a3e998d3967f3d68df10 to your computer and use it in GitHub Desktop.
Save tbg/0a793101e942a3e998d3967f3d68df10 to your computer and use it in GitHub Desktop.
Download ZIP
expected latches held, found none
Raw
gistfile1.txt
mkdir -p lib
ln -sf /Users/tschottdorf/go/native/x86_64-apple-darwin19.3.0/geos/lib/lib{geos,geos_c}.dylib lib
GOFLAGS= go test -exec 'stress -p 4' -tags ' make x86_64_apple_darwin19.3.0' -ldflags '-X github.com/cockroachdb/cockroach/pkg/build.typ=development -extldflags "" -X "github.com/cockroachdb/cockroach/pkg/build.tag=v20.1.0-beta.4-452-g655c9eac1f-dirty" -X "github.com/cockroachdb/cockroach/pkg/build.rev=655c9eac1fc62379e44565188970d89e0bc8c1e7" -X "github.com/cockroachdb/cockroach/pkg/build.cgoTargetTriple=x86_64-apple-darwin19.3.0" ' -run "TestKVNemesisSingleNode" -timeout 0 ./pkg/kv/kvnemesis/ -v -args -test.timeout 30m
4 runs so far, 0 failures, over 5s
12 runs so far, 0 failures, over 10s
21 runs so far, 0 failures, over 15s
34 runs so far, 0 failures, over 20s
44 runs so far, 0 failures, over 25s
57 runs so far, 0 failures, over 30s
66 runs so far, 0 failures, over 35s
79 runs so far, 0 failures, over 40s
89 runs so far, 0 failures, over 45s
103 runs so far, 0 failures, over 50s
114 runs so far, 0 failures, over 55s
124 runs so far, 0 failures, over 1m0s
134 runs so far, 0 failures, over 1m5s
144 runs so far, 0 failures, over 1m10s
151 runs so far, 0 failures, over 1m15s
165 runs so far, 0 failures, over 1m20s
176 runs so far, 0 failures, over 1m25s
188 runs so far, 0 failures, over 1m30s
197 runs so far, 0 failures, over 1m35s
207 runs so far, 0 failures, over 1m40s
219 runs so far, 0 failures, over 1m45s
228 runs so far, 0 failures, over 1m50s
I200408 10:37:47.598571 1 rand.go:85 Random seed: 2046876650067548747
=== RUN TestKVNemesisSingleNode
I200408 10:37:47.604212 99 base/addr_validation.go:296 [n?] server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
I200408 10:37:47.604241 99 base/addr_validation.go:342 [n?] web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
W200408 10:37:47.614961 99 server/status/runtime.go:308 [n?] Could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
I200408 10:37:47.654826 99 server/server.go:1092 [n?] monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
I200408 10:37:47.661254 99 server/config.go:573 [n?] 1 storage engine initialized
I200408 10:37:47.661278 99 server/config.go:576 [n?] RocksDB cache size: 128 MiB
I200408 10:37:47.661287 99 server/config.go:576 [n?] store 0: in-memory, size 0 B
I200408 10:37:47.661592 99 server/server.go:1553 [n?] no stores bootstrapped and --join flag specified, awaiting init command or join with an already initialized node.
I200408 10:37:47.661634 99 server/server.go:1563 [n?] **** add additional nodes by specifying --join=127.0.0.1:49236
I200408 10:37:47.668236 99 server/node.go:324 [n?] **** cluster 2e8e08b0-f917-409c-9f4e-09ab2e67756f has been created
I200408 10:37:47.668571 99 gossip/gossip.go:395 [n1] NodeDescriptor set to node_id:1 address:<network_field:"tcp" address_field:"127.0.0.1:49236" > attrs:<> locality:<tiers:<key:"region" value:"test" > tiers:<key:"dc" value:"dc1" > > ServerVersion:<major_val:19 minor_val:2 patch:0 unstable:16 > build_tag:"v20.1.0-beta.4-452-g655c9eac1f-dirty" started_at:1586342267668360000 cluster_name:"" sql_address:<network_field:"tcp" address_field:"127.0.0.1:49239" >
W200408 10:37:47.676249 249 kv/kvserver/store.go:1541 [n1,s1,r6/1:/Table/{SystemCon…-11}] could not gossip system config: [NotLeaseHolderError] r6: replica (n1,s1):1 not lease holder; lease holder unknown
I200408 10:37:47.677126 99 server/node.go:425 [n1] initialized store [n1,s1]: disk (capacity=512 MiB, available=512 MiB, used=0 B, logicalBytes=16 KiB), ranges=32, leases=0, queries=0.00, writes=0.00, bytesPerReplica={p10=0.00 p25=0.00 p50=0.00 p75=0.00 p90=166.00 pMax=13314.00}, writesPerReplica={p10=0.00 p25=0.00 p50=0.00 p75=0.00 p90=0.00 pMax=0.00}
I200408 10:37:47.677363 99 kv/kvserver/stores.go:247 [n1] read 0 node addresses from persistent storage
I200408 10:37:47.677486 99 server/node.go:642 [n1] connecting to gossip network to verify cluster ID...
I200408 10:37:47.677512 99 server/node.go:662 [n1] node connected via gossip and verified as part of cluster "2e8e08b0-f917-409c-9f4e-09ab2e67756f"
I200408 10:37:47.677576 99 server/node.go:509 [n1] node=1: started with [<no-attributes>=<in-mem>] engine(s) and attributes []
I200408 10:37:47.677704 99 server/server.go:1669 [n1] starting https server at 127.0.0.1:49238 (use: 127.0.0.1:49238)
I200408 10:37:47.677735 99 server/server.go:1674 [n1] starting postgres server at 127.0.0.1:49239 (use: 127.0.0.1:49239)
I200408 10:37:47.677754 99 server/server.go:1676 [n1] starting grpc server at 127.0.0.1:49236
I200408 10:37:47.677773 99 server/server.go:1677 [n1] advertising CockroachDB node at 127.0.0.1:49236
I200408 10:37:47.677795 170 sql/temporary_schema.go:459 [n1] running temporary object cleanup background job
I200408 10:37:47.700178 278 sql/event_log.go:132 [n1,intExec=optInToDiagnosticsStatReporting] Event: "set_cluster_setting", target: 0, info: {SettingName:diagnostics.reporting.enabled Value:true User:root}
I200408 10:37:47.707051 367 sql/event_log.go:132 [n1,intExec=set-setting] Event: "set_cluster_setting", target: 0, info: {SettingName:version Value:19.2-16 User:root}
I200408 10:37:47.719359 559 sql/event_log.go:132 [n1,intExec=initializeClusterSecret] Event: "set_cluster_setting", target: 0, info: {SettingName:cluster.secret Value:d41c63db-e1c7-4d25-9e5f-41230255cf20 User:root}
I200408 10:37:47.724343 589 sql/event_log.go:132 [n1,intExec=create-default-db] Event: "create_database", target: 50, info: {DatabaseName:defaultdb Statement:CREATE DATABASE IF NOT EXISTS defaultdb User:root}
I200408 10:37:47.727684 783 sql/event_log.go:132 [n1,intExec=create-default-db] Event: "create_database", target: 51, info: {DatabaseName:postgres Statement:CREATE DATABASE IF NOT EXISTS postgres User:root}
I200408 10:37:47.741301 170 sql/temporary_schema.go:494 [n1] found 0 temporary schemas
I200408 10:37:47.741329 170 sql/temporary_schema.go:497 [n1] early exiting temporary schema cleaner as no temporary schemas were found
I200408 10:37:47.741352 170 sql/temporary_schema.go:498 [n1] completed temporary object cleanup job
I200408 10:37:47.741382 170 sql/temporary_schema.go:575 [n1] temporary object cleaner next scheduled to run at 2020-04-08 11:07:47.6777 +0000 UTC
I200408 10:37:47.747932 99 server/server.go:1810 [n1] done ensuring all necessary migrations have run
I200408 10:37:47.747963 99 server/server.go:2046 [n1] serving sql connections
I200408 10:37:47.748131 955 sqlmigrations/migrations.go:653 [n1] starting wait for upgrade finalization before schema change job migration
I200408 10:37:47.748336 955 sqlmigrations/migrations.go:685 [n1] starting schema change job migration
I200408 10:37:47.749348 99 testutils/testcluster/testcluster.go:760 WaitForFullReplication took: 3µs
I200408 10:37:47.750455 956 sql/event_log.go:132 [n1] Event: "node_join", target: 1, info: {Descriptor:{NodeID:1 Address:127.0.0.1:49236 Attrs: Locality:region=test,dc=dc1 ServerVersion:19.2-16 BuildTag:v20.1.0-beta.4-452-g655c9eac1f-dirty StartedAt:1586342267668360000 LocalityAddress:[] ClusterName: SQLAddress:127.0.0.1:49239} ClusterID:2e8e08b0-f917-409c-9f4e-09ab2e67756f StartedAt:1586342267668360000 LastUp:1586342267668360000}
I200408 10:37:47.750569 953 server/server_update.go:55 [n1] no need to upgrade, cluster already at the newest version
I200408 10:37:47.752272 955 sqlmigrations/migrations.go:897 [schema-change-job-migration] evaluating tables for creating jobs
I200408 10:37:47.752301 955 sqlmigrations/migrations.go:704 [n1] schema change job migration completed
I200408 10:37:47.772892 994 sql/event_log.go:132 [n1,client=127.0.0.1:49242,hostssl,user=root] Event: "set_cluster_setting", target: 0, info: {SettingName:kv.rangefeed.enabled Value:true User:root}
I200408 10:37:47.773714 99 kv/kvnemesis/watcher.go:134 watcher waiting for 1586342267.773681000,0
I200408 10:37:47.774860 509 kv/kvserver/replica_rangefeed.go:608 [n1,s1,r32/1:/{Table/36-Max}] RangeFeed closed timestamp is empty
I200408 10:37:47.776495 994 sql/event_log.go:132 [n1,client=127.0.0.1:49242,hostssl,user=root] Event: "set_cluster_setting", target: 0, info: {SettingName:kv.closed_timestamp.target_duration Value:00:00:00.001 User:root}
I200408 10:37:47.777392 998 kv/kvnemesis/watcher.go:200 watcher reached frontier 1586342267.776014000,0 lagging by 1.348ms
I200408 10:37:47.777412 998 kv/kvnemesis/watcher.go:206 watcher notifying 1586342267.773681000,0
I200408 10:37:47.777632 998 kv/kvnemesis/watcher.go:200 watcher reached frontier 1586342267.776286000,0 lagging by 1.334ms
I200408 10:37:47.777891 998 kv/kvnemesis/watcher.go:200 watcher reached frontier 1586342267.776563000,0 lagging by 1.316ms
I200408 10:37:47.778496 998 kv/kvnemesis/watcher.go:200 watcher reached frontier 1586342267.776839000,0 lagging by 1.644ms
I200408 10:37:47.778808 998 kv/kvnemesis/watcher.go:200 watcher reached frontier 1586342267.777434000,0 lagging by 1.362ms
I200408 10:37:47.779060 998 kv/kvnemesis/watcher.go:200 watcher reached frontier 1586342267.777726000,0 lagging by 1.323ms
I200408 10:37:47.779311 998 kv/kvnemesis/watcher.go:200 watcher reached frontier 1586342267.778009000,0 lagging by 1.291ms
I200408 10:37:47.779572 998 kv/kvnemesis/watcher.go:200 watcher reached frontier 1586342267.778257000,0 lagging by 1.303ms
I200408 10:37:47.779808 998 kv/kvnemesis/watcher.go:200 watcher reached frontier 1586342267.778519000,0 lagging by 1.278ms
I200408 10:37:47.780076 998 kv/kvnemesis/watcher.go:200 watcher reached frontier 1586342267.778754000,0 lagging by 1.31ms
I200408 10:37:47.780328 998 kv/kvnemesis/watcher.go:200 watcher reached frontier 1586342267.779021000,0 lagging by 1.296ms
I200408 10:37:47.780613 998 kv/kvnemesis/watcher.go:200 watcher reached frontier 1586342267.779280000,0 lagging by 1.321ms
I200408 10:37:47.780866 998 kv/kvnemesis/watcher.go:200 watcher reached frontier 1586342267.779538000,0 lagging by 1.318ms
I200408 10:37:47.781149 998 kv/kvnemesis/watcher.go:200 watcher reached frontier 1586342267.779814000,0 lagging by 1.325ms
I200408 10:37:47.781429 998 kv/kvnemesis/watcher.go:200 watcher reached frontier 1586342267.780092000,0 lagging by 1.326ms
I200408 10:37:47.781487 994 sql/event_log.go:132 [n1,client=127.0.0.1:49242,hostssl,user=root] Event: "set_cluster_setting", target: 0, info: {SettingName:kv.closed_timestamp.target_duration Value:DEFAULT User:root}
I200408 10:37:47.782566 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.782498000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP return nil
2 OP }) // nil txnpb:("unnamed" meta={id=af38d5d6 key=/Min pri=0.01238962 epo=0 ts=1586342267.782499000,0 min=1586342267.782499000,0 seq=0} lock=false stat=COMMITTED rts=1586342267.782499000,0 wto=false max=1586342268.282499000,0)
after: 1586342267.782507000,0
I200408 10:37:47.782666 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.782341000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP {
1 OP b := &Batch{}
1 OP b.ReverseScan(ctx, /Table/50/"b80ef4d4", /Table/50/"f469eedc", 0) // (nil, nil)
1 OP b.Scan(ctx, /Table/50/"4daca844", /Table/50/"8ace096d", 0) // (nil, nil)
1 OP b.Scan(ctx, /Table/50/"7fe296eb", /Table/50/"a662b3e7", 0) // (nil, nil)
1 OP txn.Run(ctx, b) // nil
1 OP }
1 OP return errors.New("rollback")
1 OP }) // rollback
after: 1586342267.782617000,0
I200408 10:37:47.783100 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.782764000,0 -> /BYTES/v-2 (prev /<empty>)
I200408 10:37:47.783103 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.782749000,0
1 OP db0.Put(ctx, /Table/50/"45c50601", v-2) // nil
after: 1586342267.783043000,0
I200408 10:37:47.783333 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.782652000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP txn.Put(ctx, /Table/50/"52d1b1af", v-0) // nil
2 OP {
2 OP b := &Batch{}
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP txn.Put(ctx, /Table/50/"adde72de", v-1) // nil
2 OP return nil
2 OP }) // nil txnpb:("unnamed" meta={id=e3cc05a9 key=/Table/50/"52d1b1af" pri=0.02073273 epo=0 ts=1586342267.782653000,0 min=1586342267.782653000,0 seq=3} lock=true stat=COMMITTED rts=1586342267.782653000,0 wto=false max=1586342268.282653000,0 ifw=2)
after: 1586342267.783297000,0
I200408 10:37:47.783514 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.783447000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP {
1 OP b := &Batch{}
1 OP txn.Run(ctx, b) // nil
1 OP }
1 OP return errors.New("rollback")
1 OP }) // rollback
after: 1586342267.783496000,0
I200408 10:37:47.783696 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.782653000,0 -> /BYTES/v-0 (prev /<empty>)
I200408 10:37:47.783730 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.783586000,1
2 OP db0.AdminMerge(ctx, /Table/50/"a7e32db0") // kv/kvserver/replica_command.go:777: merge failed: cannot merge final range
after: 1586342267.783706000,0
I200408 10:37:47.783763 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"adde72de" 1586342267.782653000,0 -> /BYTES/v-1 (prev /<empty>)
I200408 10:37:47.783955 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.783198000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP txn.Put(ctx, /Table/50/"45c50601", v-4) // nil
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"5124f2fd", v-5) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342267.783931000,0
I200408 10:37:47.784127 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.783708000,0 -> /BYTES/v-8 (prev /<empty>)
I200408 10:37:47.784242 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.783692000,0
1 OP db0.Put(ctx, /Table/50/"5124f2fd", v-8) // nil
after: 1586342267.784220000,0
I200408 10:37:47.784386 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.783803000,0
2 OP db0.Put(ctx, /Table/50/"5124f2fd", v-9) // nil
after: 1586342267.784371000,0
I200408 10:37:47.784499 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.784462000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP return nil
2 OP }) // nil txnpb:("unnamed" meta={id=b6d1bb08 key=/Min pri=0.00490462 epo=0 ts=1586342267.784462000,1 min=1586342267.784462000,1 seq=0} lock=false stat=COMMITTED rts=1586342267.784462000,1 wto=false max=1586342268.284462000,1)
after: 1586342267.784469000,0
I200408 10:37:47.784517 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.784320000,0
1 OP db0.Put(ctx, /Table/50/"52d1b1af", v-11) // nil
after: 1586342267.784503000,0
I200408 10:37:47.784734 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.783818000,0 -> /BYTES/v-9 (prev /BYTES/v-8)
I200408 10:37:47.784802 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.784336000,0 -> /BYTES/v-11 (prev /BYTES/v-0)
I200408 10:37:47.784936 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.782999000,0
3 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
3 OP txn.Put(ctx, /Table/50/"adde72de", v-3) // nil
3 OP {
3 OP b := &Batch{}
3 OP b.Scan(ctx, /Table/50/"1226b7a5", /Table/50/"578ba210", 1) // ("v-2", nil)
3 OP b.Scan(ctx, /Table/50/"10bf49ca", /Table/50/"7413c3d6", 1) // (nil, nil)
3 OP txn.Run(ctx, b) // nil
3 OP }
3 OP return errors.New("rollback")
3 OP }) // rollback
after: 1586342267.784904000,0
I200408 10:37:47.785042 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.785013000,0
3 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
3 OP return nil
3 OP }) // nil txnpb:("unnamed" meta={id=9bd37af6 key=/Min pri=0.03607343 epo=0 ts=1586342267.785013000,1 min=1586342267.785013000,1 seq=0} lock=false stat=COMMITTED rts=1586342267.785013000,1 wto=false max=1586342268.285013000,1)
after: 1586342267.785020000,0
I200408 10:37:47.785165 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.785114000,0
3 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
3 OP return errors.New("rollback")
3 OP }) // rollback
after: 1586342267.785155000,0
I200408 10:37:47.785399 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.784040000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP txn.Put(ctx, /Table/50/"adde72de", v-10) // nil
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342267.785381000,0
I200408 10:37:47.785504 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"adde72de" 1586342267.785250000,0 -> /BYTES/v-17 (prev /BYTES/v-1)
I200408 10:37:47.785542 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.785236000,0
3 OP db0.Put(ctx, /Table/50/"adde72de", v-17) // nil
after: 1586342267.785529000,0
I200408 10:37:47.785688 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.783354000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP txn.Put(ctx, /Table/50/"45c50601", v-6) // nil
0 OP {
0 OP b := &Batch{}
0 OP b.ReverseScan(ctx, /Table/50/"4227af26", /Table/50/"fcdd82f2", 2) // ("v-1", nil)
0 OP b.Scan(ctx, /Table/50/"00f1277b", /Table/50/"50ed604b", 0) // (nil, nil)
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP txn.Put(ctx, /Table/50/"5124f2fd", v-7) // nil
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342267.785653000,0
I200408 10:37:47.785842 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.785791000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342267.785831000,0
I200408 10:37:47.785851 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.785568000,0
4 OP db0.Put(ctx, /Table/50/"51d2130b", v-19) // nil
after: 1586342267.785835000,0
I200408 10:37:47.785898 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"51d2130b" 1586342267.785582000,0 -> /BYTES/v-19 (prev /<empty>)
I200408 10:37:47.786087 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.786051000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=1dd915b0 key=/Min pri=0.00948803 epo=0 ts=1586342267.786053000,0 min=1586342267.786053000,0 seq=0} lock=false stat=COMMITTED rts=1586342267.786053000,0 wto=false max=1586342268.286053000,0)
after: 1586342267.786060000,0
I200408 10:37:47.786118 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.784583000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP {
2 OP b := &Batch{}
2 OP b.Put(ctx, /Table/50/"85c5f880", v-12) // nil
2 OP b.Put(ctx, /Table/50/"1d02607d", v-13) // nil
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP {
2 OP b := &Batch{}
2 OP b.Put(ctx, /Table/50/"45c50601", v-14) // nil
2 OP b.Put(ctx, /Table/50/"52d1b1af", v-15) // nil
2 OP b.Put(ctx, /Table/50/"5124f2fd", v-16) // nil
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP {
2 OP b := &Batch{}
2 OP b.Scan(ctx, /Table/50/"a5994319", /Table/50/"c2439e95", 1) // ("v-1", nil)
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP return nil
2 OP }) // nil txnpb:("unnamed" meta={id=55a9adda key=/Table/50/"85c5f880" pri=0.00371630 epo=0 ts=1586342267.784584000,0 min=1586342267.784584000,0 seq=6} lock=true stat=COMMITTED rts=1586342267.784584000,0 wto=false max=1586342268.284584000,0 ifw=5)
after: 1586342267.786067000,0
I200408 10:37:47.786617 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.785956000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP {
0 OP b := &Batch{}
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP {
0 OP b := &Batch{}
0 OP b.Put(ctx, /Table/50/"adde72de", v-23) // nil
0 OP b.Put(ctx, /Table/50/"b07bb92d", v-24) // nil
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342267.786596000,0
I200408 10:37:47.786992 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"1d02607d" 1586342267.784584000,0 -> /BYTES/v-13 (prev /<empty>)
I200408 10:37:47.787062 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.784584000,0 -> /BYTES/v-14 (prev /BYTES/v-2)
I200408 10:37:47.787171 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.784584000,0 -> /BYTES/v-16 (prev /BYTES/v-9)
I200408 10:37:47.787203 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.784584000,0 -> /BYTES/v-15 (prev /BYTES/v-11)
I200408 10:37:47.787231 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"85c5f880" 1586342267.784584000,0 -> /BYTES/v-12 (prev /<empty>)
I200408 10:37:47.788149 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.785472000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP {
1 OP b := &Batch{}
1 OP b.Put(ctx, /Table/50/"52d1b1af", v-18) // nil
1 OP txn.Run(ctx, b) // nil
1 OP }
1 OP return errors.New("rollback")
1 OP }) // rollback
after: 1586342267.788115000,0
I200408 10:37:47.788765 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.786166000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP txn.Scan(ctx, /Table/50/"4e1d801f", /Table/50/"547e883d", 1) // ("v-16", nil)
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=a5dfbe21 key=/Min pri=0.01201094 epo=0 ts=1586342267.786167000,0 min=1586342267.786167000,0 seq=0} lock=false stat=COMMITTED rts=1586342267.786167000,0 wto=false max=1586342268.286167000,0)
after: 1586342267.788703000,0
I200408 10:37:47.789012 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.786267000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP txn.Put(ctx, /Table/50/"c977b30a", v-25) // nil
2 OP txn.Put(ctx, /Table/50/"5d362357", v-26) // nil
2 OP txn.Scan(ctx, /Table/50/"34d0f279", /Table/50/"7c8d0a43", 5) // ("v-14", nil)
2 OP return errors.New("rollback")
2 OP }) // rollback
after: 1586342267.788976000,0
I200408 10:37:47.789862 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.786705000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP txn.Put(ctx, /Table/50/"e56f2489", v-27) // nil
0 OP return nil
0 OP }) // nil txnpb:("unnamed" meta={id=7a4cacd9 key=/Table/50/"e56f2489" pri=0.01904056 epo=0 ts=1586342267.786705000,1 min=1586342267.786705000,1 seq=2} lock=true stat=COMMITTED rts=1586342267.786705000,1 wto=false max=1586342268.286705000,1 ifw=1)
after: 1586342267.789796000,0
I200408 10:37:47.790143 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.785690000,0
3 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
3 OP txn.Put(ctx, /Table/50/"a4731c23", v-20) // nil
3 OP {
3 OP b := &Batch{}
3 OP b.Put(ctx, /Table/50/"5d362357", v-21) // nil
3 OP b.Put(ctx, /Table/50/"45c50601", v-22) // nil
3 OP txn.Run(ctx, b) // nil
3 OP }
3 OP return nil
3 OP }) // nil txnpb:("unnamed" meta={id=f617a9ab key=/Table/50/"a4731c23" pri=0.00865823 epo=0 ts=1586342267.786268000,1 min=1586342267.785690000,1 seq=4} lock=true stat=COMMITTED rts=1586342267.786268000,1 wto=false max=1586342268.285690000,1 ifw=3)
after: 1586342267.790102000,0
I200408 10:37:47.790311 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"e56f2489" 1586342267.786705000,1 -> /BYTES/v-27 (prev /<empty>)
I200408 10:37:47.790419 1004 kv/kvserver/replica_command.go:397 [n1,s1,r32/1:/{Table/36-Max}] initiating a split of this range at key /Table/50/"be9d6183" [r33] (manual)
I200408 10:37:47.790454 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"1d02607d" 1586342267.790242000,0 -> /BYTES/v-41 (prev /BYTES/v-13)
I200408 10:37:47.790507 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.790227000,0
3 OP db0.Put(ctx, /Table/50/"1d02607d", v-41) // nil
after: 1586342267.790488000,0
I200408 10:37:47.790551 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.788945000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP txn.Put(ctx, /Table/50/"9b1286bd", v-34) // nil
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"b07bb92d", v-35) // nil
4 OP b.Put(ctx, /Table/50/"45a80a91", v-36) // nil
4 OP b.Put(ctx, /Table/50/"52d1b1af", v-37) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"a3437e3f", v-38) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342267.790522000,0
I200408 10:37:47.790667 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.786268000,1 -> /BYTES/v-22 (prev /BYTES/v-14)
I200408 10:37:47.790698 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5d362357" 1586342267.786268000,1 -> /BYTES/v-21 (prev /<empty>)
I200408 10:37:47.790721 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a4731c23" 1586342267.786268000,1 -> /BYTES/v-20 (prev /<empty>)
I200408 10:37:47.790826 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.789134000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP {
2 OP b := &Batch{}
2 OP b.Put(ctx, /Table/50/"aae8de8b", v-39) // nil
2 OP b.Put(ctx, /Table/50/"93349c91", v-40) // nil
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP return errors.New("rollback")
2 OP }) // rollback
after: 1586342267.790804000,0
I200408 10:37:47.790982 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.790910000,0
2 OP db0.ReverseScan(ctx, /Table/50/"679b5a87", /Table/50/"80d75f6a", 10) // (nil, nil)
after: 1586342267.790965000,0
I200408 10:37:47.792032 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.788279000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP {
1 OP b := &Batch{}
1 OP b.Put(ctx, /Table/50/"3cb02c3e", v-28) // nil
1 OP b.Put(ctx, /Table/50/"5d362357", v-29) // nil
1 OP b.Put(ctx, /Table/50/"a971ff7d", v-30) // nil
1 OP txn.Run(ctx, b) // nil
1 OP }
1 OP txn.ReverseScan(ctx, /Table/50/"26269979", /Table/50/"c4386028", 0) // ("v-17", nil)
1 OP {
1 OP b := &Batch{}
1 OP b.Put(ctx, /Table/50/"b07bb92d", v-31) // nil
1 OP b.Put(ctx, /Table/50/"5d362357", v-32) // nil
1 OP b.Put(ctx, /Table/50/"e85b21d5", v-33) // nil
1 OP txn.Run(ctx, b) // nil
1 OP }
1 OP return errors.New("rollback")
1 OP }) // rollback
after: 1586342267.791995000,0
I200408 10:37:47.792659 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.792129000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP {
1 OP b := &Batch{}
1 OP txn.Run(ctx, b) // nil
1 OP }
1 OP {
1 OP b := &Batch{}
1 OP b.ReverseScan(ctx, /Table/50/"6f0c091d", /Table/50/"7686e619", 11) // (nil, nil)
1 OP b.Scan(ctx, /Table/50/"584ffcc4", /Table/50/"9d689c5c", 0) // ("v-12", nil)
1 OP txn.Run(ctx, b) // nil
1 OP }
1 OP txn.Put(ctx, /Table/50/"c977b30a", v-46) // nil
1 OP return nil
1 OP }) // nil txnpb:("unnamed" meta={id=e20ea2d2 key=/Table/50/"c977b30a" pri=0.01288862 epo=0 ts=1586342267.792129000,1 min=1586342267.792129000,1 seq=2} lock=true stat=COMMITTED rts=1586342267.792129000,1 wto=false max=1586342268.292129000,1 ifw=1)
after: 1586342267.792612000,0
I200408 10:37:47.792721 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.790607000,0
3 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
3 OP {
3 OP b := &Batch{}
3 OP b.Put(ctx, /Table/50/"0af004dc", v-42) // nil
3 OP b.Put(ctx, /Table/50/"100523e9", v-43) // nil
3 OP txn.Run(ctx, b) // nil
3 OP }
3 OP {
3 OP b := &Batch{}
3 OP b.Scan(ctx, /Table/50/"37b87ee1", /Table/50/"de51fa9c", 1) // ("v-22", nil)
3 OP b.Scan(ctx, /Table/50/"48f89557", /Table/50/"77af8741", 7) // (nil, nil)
3 OP txn.Run(ctx, b) // nil
3 OP }
3 OP return nil
3 OP }) // nil txnpb:("unnamed" meta={id=c5859ee3 key=/Table/50/"0af004dc" pri=0.02116691 epo=0 ts=1586342267.790607000,1 min=1586342267.790607000,1 seq=3} lock=true stat=COMMITTED rts=1586342267.790607000,1 wto=false max=1586342268.290607000,1 ifw=2)
after: 1586342267.792676000,0
I200408 10:37:47.792851 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.792743000,0
1 OP db0.ReverseScan(ctx, /Table/50/"4637d159", /Table/50/"60739539", 5) // ("v-21", nil)
after: 1586342267.792834000,0
I200408 10:37:47.793111 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"c977b30a" 1586342267.792129000,1 -> /BYTES/v-46 (prev /<empty>)
I200408 10:37:47.793151 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"0af004dc" 1586342267.790607000,1 -> /BYTES/v-42 (prev /<empty>)
I200408 10:37:47.793174 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"100523e9" 1586342267.790607000,1 -> /BYTES/v-43 (prev /<empty>)
I200408 10:37:47.793443 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.790704000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.ReverseScan(ctx, /Table/50/"18f35180", /Table/50/"9e69ac81", 8) // ("v-12", nil)
4 OP b.ReverseScan(ctx, /Table/50/"38c38ae9", /Table/50/"76187e70", 0) // ("v-21", nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP txn.Put(ctx, /Table/50/"c6f86ca5", v-44) // nil
4 OP txn.Put(ctx, /Table/50/"8ec423de", v-45) // nil
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342267.793411000,0
I200408 10:37:47.793577 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.791057000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP txn.ReverseScan(ctx, /Table/50/"32959496", /Table/50/"ccdf3e09", 5) // ("v-17", nil)
2 OP {
2 OP b := &Batch{}
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP return errors.New("rollback")
2 OP }) // rollback
after: 1586342267.793554000,0
I200408 10:37:47.793849 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.792959000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP txn.Put(ctx, /Table/50/"1d02607d", v-47) // nil
1 OP txn.Scan(ctx, /Table/50/"4c1bc280", /Table/50/"cc052da8", 7) // ("v-16", nil)
1 OP return errors.New("rollback")
1 OP }) // rollback
after: 1586342267.793827000,0
I200408 10:37:47.795585 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.789990000,0
0 OP db0.AdminSplit(ctx, /Table/50/"be9d6183") // nil
after: 1586342267.795564000,0
I200408 10:37:47.796095 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"0af004dc" 1586342267.790607000,1 -> /BYTES/v-42 (prev /<empty>)
I200408 10:37:47.796140 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"100523e9" 1586342267.790607000,1 -> /BYTES/v-43 (prev /<empty>)
I200408 10:37:47.796162 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"1d02607d" 1586342267.784584000,0 -> /BYTES/v-13 (prev /<empty>)
I200408 10:37:47.796186 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"1d02607d" 1586342267.790242000,0 -> /BYTES/v-41 (prev /BYTES/v-13)
I200408 10:37:47.796209 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.782764000,0 -> /BYTES/v-2 (prev /<empty>)
I200408 10:37:47.796229 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.784584000,0 -> /BYTES/v-14 (prev /BYTES/v-2)
I200408 10:37:47.796250 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.786268000,1 -> /BYTES/v-22 (prev /BYTES/v-14)
I200408 10:37:47.796267 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.783708000,0 -> /BYTES/v-8 (prev /<empty>)
I200408 10:37:47.796288 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.783818000,0 -> /BYTES/v-9 (prev /BYTES/v-8)
I200408 10:37:47.796312 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.784584000,0 -> /BYTES/v-16 (prev /BYTES/v-9)
I200408 10:37:47.796336 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"51d2130b" 1586342267.785582000,0 -> /BYTES/v-19 (prev /<empty>)
I200408 10:37:47.796360 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.782653000,0 -> /BYTES/v-0 (prev /<empty>)
I200408 10:37:47.796385 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.784336000,0 -> /BYTES/v-11 (prev /BYTES/v-0)
I200408 10:37:47.796407 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.784584000,0 -> /BYTES/v-15 (prev /BYTES/v-11)
I200408 10:37:47.796428 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5d362357" 1586342267.786268000,1 -> /BYTES/v-21 (prev /<empty>)
I200408 10:37:47.796452 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"85c5f880" 1586342267.784584000,0 -> /BYTES/v-12 (prev /<empty>)
I200408 10:37:47.796476 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a4731c23" 1586342267.786268000,1 -> /BYTES/v-20 (prev /<empty>)
I200408 10:37:47.796498 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"adde72de" 1586342267.782653000,0 -> /BYTES/v-1 (prev /<empty>)
I200408 10:37:47.796521 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"adde72de" 1586342267.785250000,0 -> /BYTES/v-17 (prev /BYTES/v-1)
I200408 10:37:47.796571 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"c977b30a" 1586342267.792129000,1 -> /BYTES/v-46 (prev /<empty>)
I200408 10:37:47.796596 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"e56f2489" 1586342267.786705000,1 -> /BYTES/v-27 (prev /<empty>)
I200408 10:37:47.801777 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.801685000,0
3 OP db0.Scan(ctx, /Table/50/"c2e61037", /Table/50/"e156cc98", 5) // ("v-46", nil)
after: 1586342267.801748000,0
I200408 10:37:47.802018 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.801846000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP txn.ReverseScan(ctx, /Table/50/"782bf55f", /Table/50/"a7aa9309", 6) // ("v-20", nil)
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=558ffc2e key=/Min pri=0.02316707 epo=0 ts=1586342267.801846000,1 min=1586342267.801846000,1 seq=0} lock=false stat=COMMITTED rts=1586342267.801846000,1 wto=false max=1586342268.301846000,1)
after: 1586342267.801967000,0
I200408 10:37:47.802182 1008 kv/kvserver/replica_command.go:397 [n1,s1,r32/1:/Table/{36-50/"be9d6…}] initiating a split of this range at key /Table/50/"2d14fabc" [r34] (manual)
I200408 10:37:47.802311 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.802234000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP return errors.New("rollback")
1 OP }) // rollback
after: 1586342267.802296000,0
I200408 10:37:47.802681 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.801999000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP {
2 OP b := &Batch{}
2 OP b.Put(ctx, /Table/50/"dc8ac12d", v-48) // nil
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP return nil
2 OP }) // nil txnpb:("unnamed" meta={id=1d696aa6 key=/Table/50/"dc8ac12d" pri=0.00479873 epo=0 ts=1586342267.801999000,1 min=1586342267.801999000,1 seq=2} lock=true stat=COMMITTED rts=1586342267.801999000,1 wto=false max=1586342268.301999000,1 ifw=1)
after: 1586342267.802581000,0
I200408 10:37:47.803213 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"dc8ac12d" 1586342267.801999000,1 -> /BYTES/v-48 (prev /<empty>)
I200408 10:37:47.803705 1004 kv/kvserver/replica_command.go:397 [n1,s1,r32/1:/Table/{36-50/"be9d6…}] initiating a split of this range at key /Table/50/"2d14fabc" [r35] (manual)
I200408 10:37:47.803719 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.803684000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP return nil
1 OP }) // nil txnpb:("unnamed" meta={id=da4edd3b key=/Min pri=0.01347205 epo=0 ts=1586342267.803685000,0 min=1586342267.803685000,0 seq=0} lock=false stat=COMMITTED rts=1586342267.803685000,0 wto=false max=1586342268.303685000,0)
after: 1586342267.803692000,0
I200408 10:37:47.804920 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"3cb02c3e" 1586342267.803578000,0 -> /BYTES/v-49 (prev /<empty>)
I200408 10:37:47.804943 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.803577000,0
3 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
3 OP txn.Put(ctx, /Table/50/"3cb02c3e", v-49) // nil
3 OP txn.Scan(ctx, /Table/50/"6c170c1c", /Table/50/"d01302db", 7) // ("v-12", nil)
3 OP {
3 OP b := &Batch{}
3 OP b.ReverseScan(ctx, /Table/50/"01ba4262", /Table/50/"889ff54b", 3) // ("v-12", nil)
3 OP b.ReverseScan(ctx, /Table/50/"31668751", /Table/50/"873cc7a4", 3) // (nil, nil)
3 OP b.ReverseScan(ctx, /Table/50/"6f4dd7a5", /Table/50/"ef27c55d", 11) // ("v-27", nil)
3 OP txn.Run(ctx, b) // nil
3 OP }
3 OP return nil
3 OP }) // nil txnpb:("unnamed" meta={id=0f9080b8 key=/Table/50/"3cb02c3e" pri=0.02535246 epo=0 ts=1586342267.803578000,0 min=1586342267.803578000,0 seq=2} lock=true stat=COMMITTED rts=1586342267.803578000,0 wto=false max=1586342268.303578000,0)
after: 1586342267.804884000,0
I200408 10:37:47.805134 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.803789000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP {
2 OP b := &Batch{}
2 OP b.ReverseScan(ctx, /Table/50/"210f024d", /Table/50/"604646b8", 11) // ("v-21", nil)
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP return nil
2 OP }) // nil txnpb:("unnamed" meta={id=1808e058 key=/Min pri=0.02758098 epo=0 ts=1586342267.803789000,1 min=1586342267.803789000,1 seq=0} lock=false stat=COMMITTED rts=1586342267.803789000,1 wto=false max=1586342268.303789000,1)
after: 1586342267.805100000,0
I200408 10:37:47.807839 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.802121000,0
4 OP db0.AdminSplit(ctx, /Table/50/"2d14fabc") // nil
after: 1586342267.807820000,0
I200408 10:37:47.808419 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"0af004dc" 1586342267.790607000,1 -> /BYTES/v-42 (prev /<empty>)
I200408 10:37:47.808452 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"100523e9" 1586342267.790607000,1 -> /BYTES/v-43 (prev /<empty>)
I200408 10:37:47.808477 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"1d02607d" 1586342267.784584000,0 -> /BYTES/v-13 (prev /<empty>)
I200408 10:37:47.808506 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"1d02607d" 1586342267.790242000,0 -> /BYTES/v-41 (prev /BYTES/v-13)
I200408 10:37:47.808808 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"3cb02c3e" 1586342267.803578000,0 -> /BYTES/v-49 (prev /<empty>)
I200408 10:37:47.808844 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.782764000,0 -> /BYTES/v-2 (prev /<empty>)
I200408 10:37:47.808868 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.784584000,0 -> /BYTES/v-14 (prev /BYTES/v-2)
I200408 10:37:47.808892 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.786268000,1 -> /BYTES/v-22 (prev /BYTES/v-14)
I200408 10:37:47.808915 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.783708000,0 -> /BYTES/v-8 (prev /<empty>)
I200408 10:37:47.808941 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.783818000,0 -> /BYTES/v-9 (prev /BYTES/v-8)
I200408 10:37:47.808963 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.784584000,0 -> /BYTES/v-16 (prev /BYTES/v-9)
I200408 10:37:47.808983 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"51d2130b" 1586342267.785582000,0 -> /BYTES/v-19 (prev /<empty>)
I200408 10:37:47.809004 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.782653000,0 -> /BYTES/v-0 (prev /<empty>)
I200408 10:37:47.809024 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.784336000,0 -> /BYTES/v-11 (prev /BYTES/v-0)
I200408 10:37:47.809042 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.784584000,0 -> /BYTES/v-15 (prev /BYTES/v-11)
I200408 10:37:47.809062 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5d362357" 1586342267.786268000,1 -> /BYTES/v-21 (prev /<empty>)
I200408 10:37:47.809091 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"85c5f880" 1586342267.784584000,0 -> /BYTES/v-12 (prev /<empty>)
I200408 10:37:47.809111 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a4731c23" 1586342267.786268000,1 -> /BYTES/v-20 (prev /<empty>)
I200408 10:37:47.809131 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"adde72de" 1586342267.782653000,0 -> /BYTES/v-1 (prev /<empty>)
I200408 10:37:47.809157 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"adde72de" 1586342267.785250000,0 -> /BYTES/v-17 (prev /BYTES/v-1)
I200408 10:37:47.814083 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.814020000,0
1 OP db0.AdminSplit(ctx, /Table/50/"be9d6183") // nil
after: 1586342267.814060000,0
I200408 10:37:47.814460 1006 kv/kvserver/replica_command.go:397 [n1,s1,r34/1:/Table/50/"{2d14fab…-be9d618…}] initiating a split of this range at key /Table/50/"8f417521" [r36] (manual)
I200408 10:37:47.815114 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.814203000,0
3 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
3 OP {
3 OP b := &Batch{}
3 OP b.Put(ctx, /Table/50/"d5a5cada", v-50) // nil
3 OP txn.Run(ctx, b) // nil
3 OP }
3 OP {
3 OP b := &Batch{}
3 OP b.Scan(ctx, /Table/50/"3e2e7ecf", /Table/50/"9d57a79e", 6) // ("v-22", nil)
3 OP b.Scan(ctx, /Table/50/"4b35a4a2", /Table/50/"c14b4390", 11) // ("v-16", nil)
3 OP txn.Run(ctx, b) // nil
3 OP }
3 OP return nil
3 OP }) // nil txnpb:("unnamed" meta={id=bcc69109 key=/Table/50/"d5a5cada" pri=0.00141575 epo=0 ts=1586342267.814204000,0 min=1586342267.814204000,0 seq=2} lock=true stat=COMMITTED rts=1586342267.814204000,0 wto=false max=1586342268.314204000,0 ifw=1)
after: 1586342267.815061000,0
I200408 10:37:47.815272 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.815224000,0
3 OP db0.AdminSplit(ctx, /Table/50/"2d14fabc") // nil
after: 1586342267.815256000,0
I200408 10:37:47.816037 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.815924000,0
3 OP db0.AdminMerge(ctx, /Table/50/"be9d6183") // kv/kvserver/replica_command.go:777: merge failed: cannot merge final range
after: 1586342267.816017000,0
I200408 10:37:47.816204 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.816140000,0
3 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
3 OP return errors.New("rollback")
3 OP }) // rollback
after: 1586342267.816190000,0
I200408 10:37:47.816526 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"d5a5cada" 1586342267.814204000,0 -> /BYTES/v-50 (prev /<empty>)
I200408 10:37:47.816717 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.815575000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP {
1 OP b := &Batch{}
1 OP txn.Run(ctx, b) // nil
1 OP }
1 OP txn.Put(ctx, /Table/50/"5124f2fd", v-55) // nil
1 OP return nil
1 OP }) // nil txnpb:("unnamed" meta={id=074d50c3 key=/Table/50/"5124f2fd" pri=0.04036399 epo=0 ts=1586342267.815575000,1 min=1586342267.815575000,1 seq=2} lock=true stat=COMMITTED rts=1586342267.815575000,1 wto=false max=1586342268.315575000,1 ifw=1)
after: 1586342267.816680000,0
I200408 10:37:47.817000 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.816318000,0
3 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
3 OP txn.Put(ctx, /Table/50/"aae8de8b", v-56) // nil
3 OP {
3 OP b := &Batch{}
3 OP b.Put(ctx, /Table/50/"85fa2c1f", v-57) // nil
3 OP b.Put(ctx, /Table/50/"45a80a91", v-58) // nil
3 OP txn.Run(ctx, b) // nil
3 OP }
3 OP {
3 OP b := &Batch{}
3 OP txn.Run(ctx, b) // nil
3 OP }
3 OP return errors.New("rollback")
3 OP }) // rollback
after: 1586342267.816972000,0
I200408 10:37:47.817167 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.815575000,1 -> /BYTES/v-55 (prev /BYTES/v-16)
I200408 10:37:47.817779 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.817740000,0
3 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
3 OP return nil
3 OP }) // nil txnpb:("unnamed" meta={id=ca6e7c39 key=/Min pri=0.03891960 epo=0 ts=1586342267.817740000,1 min=1586342267.817740000,1 seq=0} lock=false stat=COMMITTED rts=1586342267.817740000,1 wto=false max=1586342268.317740000,1)
after: 1586342267.817750000,0
I200408 10:37:47.817784 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.815336000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"e09010ba", v-51) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP b.Scan(ctx, /Table/50/"8ac7ba1c", /Table/50/"bf8263da", 9) // ("v-20", nil)
4 OP b.Scan(ctx, /Table/50/"798c7c30", /Table/50/"dc0c7389", 3) // ("v-12", nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"dc8ac12d", v-52) // nil
4 OP b.Put(ctx, /Table/50/"a971ff7d", v-53) // nil
4 OP b.Put(ctx, /Table/50/"3cbd748e", v-54) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342267.817741000,0
I200408 10:37:47.818416 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.817625000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP txn.Put(ctx, /Table/50/"5cc54c7b", v-59) // nil
1 OP return errors.New("rollback")
1 OP }) // rollback
after: 1586342267.818395000,0
I200408 10:37:47.821466 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.814352000,0
2 OP db0.AdminSplit(ctx, /Table/50/"8f417521") // nil
after: 1586342267.821445000,0
I200408 10:37:47.822150 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a4731c23" 1586342267.786268000,1 -> /BYTES/v-20 (prev /<empty>)
I200408 10:37:47.822200 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"adde72de" 1586342267.782653000,0 -> /BYTES/v-1 (prev /<empty>)
I200408 10:37:47.822229 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"adde72de" 1586342267.785250000,0 -> /BYTES/v-17 (prev /BYTES/v-1)
I200408 10:37:47.822864 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"3cb02c3e" 1586342267.803578000,0 -> /BYTES/v-49 (prev /<empty>)
I200408 10:37:47.822900 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.782764000,0 -> /BYTES/v-2 (prev /<empty>)
I200408 10:37:47.822925 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.784584000,0 -> /BYTES/v-14 (prev /BYTES/v-2)
I200408 10:37:47.822948 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.786268000,1 -> /BYTES/v-22 (prev /BYTES/v-14)
I200408 10:37:47.822969 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.783708000,0 -> /BYTES/v-8 (prev /<empty>)
I200408 10:37:47.822994 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.783818000,0 -> /BYTES/v-9 (prev /BYTES/v-8)
I200408 10:37:47.823060 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.784584000,0 -> /BYTES/v-16 (prev /BYTES/v-9)
I200408 10:37:47.823120 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.815575000,1 -> /BYTES/v-55 (prev /BYTES/v-16)
I200408 10:37:47.823145 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"51d2130b" 1586342267.785582000,0 -> /BYTES/v-19 (prev /<empty>)
I200408 10:37:47.823171 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.782653000,0 -> /BYTES/v-0 (prev /<empty>)
I200408 10:37:47.823192 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.784336000,0 -> /BYTES/v-11 (prev /BYTES/v-0)
I200408 10:37:47.823214 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.784584000,0 -> /BYTES/v-15 (prev /BYTES/v-11)
I200408 10:37:47.823238 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5d362357" 1586342267.786268000,1 -> /BYTES/v-21 (prev /<empty>)
I200408 10:37:47.823259 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"85c5f880" 1586342267.784584000,0 -> /BYTES/v-12 (prev /<empty>)
I200408 10:37:47.828668 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.828300000,0
3 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
3 OP {
3 OP b := &Batch{}
3 OP b.ReverseScan(ctx, /Table/50/"1636d7fa", /Table/50/"9b7129d5", 0) // (nil, nil)
3 OP b.Scan(ctx, /Table/50/"11e74fa2", /Table/50/"d46eca2b", 3) // ("v-46", nil)
3 OP txn.Run(ctx, b) // nil
3 OP }
3 OP {
3 OP b := &Batch{}
3 OP txn.Run(ctx, b) // nil
3 OP }
3 OP txn.Scan(ctx, /Table/50/"295fb4f0", /Table/50/"62fdebdc", 1) // ("v-49", nil)
3 OP return errors.New("rollback")
3 OP }) // rollback
after: 1586342267.828633000,0
I200408 10:37:47.829426 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.828503000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"3cbd748e", v-60) // nil
4 OP b.Put(ctx, /Table/50/"5e7fd199", v-61) // nil
4 OP b.Put(ctx, /Table/50/"3cbd748e", v-62) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP b.Scan(ctx, /Table/50/"43306d85", /Table/50/"e411712c", 3) // ("v-22", nil)
4 OP b.Scan(ctx, /Table/50/"5a8c55be", /Table/50/"8b1ebe40", 7) // (nil, nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=5a487d06 key=/Table/50/"3cbd748e" pri=0.04246533 epo=0 ts=1586342267.828503000,1 min=1586342267.828503000,1 seq=4} lock=true stat=COMMITTED rts=1586342267.828503000,1 wto=false max=1586342268.328503000,1 int=1 ifw=1)
after: 1586342267.829357000,0
I200408 10:37:47.829653 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.829444000,0
2 OP db0.Put(ctx, /Table/50/"afea3da4", v-63) // nil
after: 1586342267.829633000,0
I200408 10:37:47.829828 1005 kv/kvserver/replica_command.go:663 [n1,s1,r36/1:/Table/50/"{8f41752…-be9d618…}] initiating a merge of r33:/{Table/50/"be9d6183"-Max} [(n1,s1):1, next=2, gen=1, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:47.830073 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"3cbd748e" 1586342267.828503000,1 -> /BYTES/v-62 (prev /<empty>)
I200408 10:37:47.830141 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5e7fd199" 1586342267.828503000,1 -> /BYTES/v-61 (prev /<empty>)
I200408 10:37:47.830190 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.830151000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=3d5839b1 key=/Min pri=0.00062748 epo=0 ts=1586342267.830152000,0 min=1586342267.830152000,0 seq=0} lock=false stat=COMMITTED rts=1586342267.830152000,0 wto=false max=1586342268.330152000,0)
after: 1586342267.830159000,0
I200408 10:37:47.830466 1007 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/Table/50/"{8f417521"-be9d6183"} [(n1,s1):1, next=2, gen=3, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:47.830995 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"afea3da4" 1586342267.829461000,0 -> /BYTES/v-63 (prev /<empty>)
I200408 10:37:47.831556 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.829756000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP txn.Put(ctx, /Table/50/"c8ec25eb", v-64) // nil
2 OP {
2 OP b := &Batch{}
2 OP b.Put(ctx, /Table/50/"36525187", v-65) // nil
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP {
2 OP b := &Batch{}
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP return nil
2 OP }) // nil txnpb:("unnamed" meta={id=9ccdfadd key=/Table/50/"c8ec25eb" pri=0.02583493 epo=0 ts=1586342267.829756000,1 min=1586342267.829756000,1 seq=3} lock=true stat=COMMITTED rts=1586342267.829756000,1 wto=false max=1586342268.329756000,1 ifw=2)
after: 1586342267.831511000,0
I200408 10:37:47.832478 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"c8ec25eb" 1586342267.829756000,1 -> /BYTES/v-64 (prev /<empty>)
I200408 10:37:47.832978 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.831731000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP {
2 OP b := &Batch{}
2 OP b.Put(ctx, /Table/50/"a9ef4183", v-68) // nil
2 OP b.Put(ctx, /Table/50/"c6f86ca5", v-69) // nil
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP txn.Put(ctx, /Table/50/"c6f86ca5", v-70) // nil
2 OP return errors.New("rollback")
2 OP }) // rollback
after: 1586342267.832949000,0
I200408 10:37:47.838871 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"36525187" 1586342267.829756000,1 -> /BYTES/v-65 (prev /<empty>)
I200408 10:37:47.839824 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.830301000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.Scan(ctx, /Table/50/"8aed16b1", /Table/50/"faed0758", 10) // (nil, nil)
4 OP b.Scan(ctx, /Table/50/"685f13a1", /Table/50/"f634e047", 13) // ("v-12", nil)
4 OP b.ReverseScan(ctx, /Table/50/"0c5fff3f", /Table/50/"5a19b537", 10) // ("v-43", nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"5e7fd199", v-66) // nil
4 OP b.Put(ctx, /Table/50/"2505925f", v-67) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342267.839772000,0
I200408 10:37:47.840230 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.803348000,0
0 OP db0.AdminSplit(ctx, /Table/50/"2d14fabc") // nil
after: 1586342267.840214000,0
I200408 10:37:47.840824 1005 kv/kvserver/replica_command.go:663 [n1,s1,r36/1:/Table/50/"{8f41752…-be9d618…}] initiating a merge of r33:/{Table/50/"be9d6183"-Max} [(n1,s1):1, next=2, gen=1, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:47.843669 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.842324000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP {
2 OP b := &Batch{}
2 OP b.Put(ctx, /Table/50/"5cc54c7b", v-71) // nil
2 OP b.Put(ctx, /Table/50/"36525187", v-72) // nil
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP return nil
2 OP }) // nil txnpb:("unnamed" meta={id=5f3f8cf4 key=/Table/50/"5cc54c7b" pri=0.01964490 epo=0 ts=1586342267.842325000,0 min=1586342267.842325000,0 seq=3} lock=true stat=COMMITTED rts=1586342267.842325000,0 wto=false max=1586342268.342325000,0 ifw=2)
after: 1586342267.843622000,0
I200408 10:37:47.844980 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"36525187" 1586342267.842325000,0 -> /BYTES/v-72 (prev /BYTES/v-65)
I200408 10:37:47.845028 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5cc54c7b" 1586342267.842325000,0 -> /BYTES/v-71 (prev /<empty>)
I200408 10:37:47.851285 1007 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/Table/50/"{8f417521"-be9d6183"} [(n1,s1):1, next=2, gen=3, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:47.852770 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"04b3bba3" 1586342267.852588000,0 -> /BYTES/v-75 (prev /<empty>)
I200408 10:37:47.852855 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.852567000,0
0 OP db0.Put(ctx, /Table/50/"04b3bba3", v-75) // nil
after: 1586342267.852837000,0
I200408 10:37:47.853020 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a9dc77f9" 1586342267.852770000,0 -> /BYTES/v-76 (prev /<empty>)
I200408 10:37:47.853023 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.852751000,0
2 OP db0.Put(ctx, /Table/50/"a9dc77f9", v-76) // nil
after: 1586342267.852985000,0
I200408 10:37:47.853389 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.853193000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP {
2 OP b := &Batch{}
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP {
2 OP b := &Batch{}
2 OP b.Scan(ctx, /Table/50/"a8a63abf", /Table/50/"c6961ad5", 13) // (nil, nil)
2 OP b.Scan(ctx, /Table/50/"0b1cabe7", /Table/50/"b105d955", 20) // ("v-43", nil)
2 OP b.ReverseScan(ctx, /Table/50/"bbd78474", /Table/50/"e95865d5", 2) // (nil, nil)
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP {
2 OP b := &Batch{}
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP return nil
2 OP }) // nil txnpb:("unnamed" meta={id=d8b77574 key=/Min pri=0.01914566 epo=0 ts=1586342267.853194000,0 min=1586342267.853194000,0 seq=0} lock=false stat=COMMITTED rts=1586342267.853194000,0 wto=false max=1586342268.353194000,0)
after: 1586342267.853334000,0
I200408 10:37:47.853725 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.852975000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP {
0 OP b := &Batch{}
0 OP b.Put(ctx, /Table/50/"837410f8", v-77) // nil
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP txn.Put(ctx, /Table/50/"3c9cb83d", v-78) // nil
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342267.853703000,0
I200408 10:37:47.853838 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.852357000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"dc8ac12d", v-73) // nil
4 OP b.Put(ctx, /Table/50/"e304e678", v-74) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP b.Scan(ctx, /Table/50/"2877c8cf", /Table/50/"9842e6e6", 18) // ("v-72", nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP txn.ReverseScan(ctx, /Table/50/"126ad186", /Table/50/"565567c6", 14) // ("v-15", nil)
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342267.853806000,0
I200408 10:37:47.965996 1005 kv/kvserver/replica_command.go:663 [n1,s1,r36/1:/Table/50/"{8f41752…-be9d618…}] initiating a merge of r33:/{Table/50/"be9d6183"-Max} [(n1,s1):1, next=2, gen=1, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:47.972601 1007 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/Table/50/"{8f417521"-be9d6183"} [(n1,s1):1, next=2, gen=3, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:47.973842 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.973742000,0
0 OP db0.AdminMerge(ctx, /Table/50/"dc80ebf5") // kv/kvserver/replica_command.go:777: merge failed: cannot merge final range
after: 1586342267.973818000,0
I200408 10:37:47.974141 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.973933000,0
4 OP db0.Scan(ctx, /Table/50/"b5a25549", /Table/50/"cf7bc9f3", 11) // ("v-64", nil)
after: 1586342267.974116000,0
I200408 10:37:47.974231 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.974161000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342267.974215000,0
I200408 10:37:47.974665 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.974312000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.ReverseScan(ctx, /Table/50/"6ce961cc", /Table/50/"b2437f7c", 12) // ("v-63", nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342267.974636000,0
I200408 10:37:48.083078 1005 kv/kvserver/replica_command.go:663 [n1,s1,r36/1:/Table/50/"{8f41752…-be9d618…}] initiating a merge of r33:/{Table/50/"be9d6183"-Max} [(n1,s1):1, next=2, gen=1, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.083157 1006 kv/kvserver/replica_command.go:663 [n1,s1,r36/1:/Table/50/"{8f41752…-be9d618…}] initiating a merge of r33:/{Table/50/"be9d6183"-Max} [(n1,s1):1, next=2, gen=1, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.090861 1007 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/Table/50/"{8f417521"-be9d6183"} [(n1,s1):1, next=2, gen=3, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.091629 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.091553000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342268.091613000,0
I200408 10:37:48.091816 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.091750000,0
0 OP db0.Scan(ctx, /Table/50/"ed7efa8c", /Table/50/"fb5835fd", 16) // (nil, nil)
after: 1586342268.091796000,0
I200408 10:37:48.092112 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.091661000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.ReverseScan(ctx, /Table/50/"3374623f", /Table/50/"a8e4bd10", 9) // ("v-20", nil)
4 OP b.ReverseScan(ctx, /Table/50/"a04f9431", /Table/50/"c81fd703", 8) // ("v-63", nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP b.Scan(ctx, /Table/50/"4c00e91d", /Table/50/"78d5e040", 19) // ("v-55", nil)
4 OP b.Scan(ctx, /Table/50/"ad6e6ee1", /Table/50/"de71c150", 5) // (nil, nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=e2fe5c9a key=/Min pri=0.02389876 epo=0 ts=1586342268.091661000,1 min=1586342268.091661000,1 seq=0} lock=false stat=COMMITTED rts=1586342268.091661000,1 wto=false max=1586342268.591661000,1)
after: 1586342268.092056000,0
I200408 10:37:48.092327 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.091915000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP {
0 OP b := &Batch{}
0 OP b.Put(ctx, /Table/50/"1bf4d0fd", v-79) // nil
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP return nil
0 OP }) // nil txnpb:("unnamed" meta={id=7ce53edc key=/Table/50/"1bf4d0fd" pri=0.00564009 epo=0 ts=1586342268.091915000,1 min=1586342268.091915000,1 seq=2} lock=true stat=COMMITTED rts=1586342268.091915000,1 wto=false max=1586342268.591915000,1 ifw=1)
after: 1586342268.092291000,0
I200408 10:37:48.092349 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.092217000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP txn.Scan(ctx, /Table/50/"6e8cdc76", /Table/50/"7318c382", 1) // (nil, nil)
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342268.092330000,0
I200408 10:37:48.092652 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.092587000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342268.092637000,0
I200408 10:37:48.092680 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"1bf4d0fd" 1586342268.091915000,1 -> /BYTES/v-79 (prev /<empty>)
I200408 10:37:48.099941 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.099353000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP {
0 OP b := &Batch{}
0 OP b.Put(ctx, /Table/50/"cc81ca64", v-80) // nil
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP txn.Scan(ctx, /Table/50/"51e0f040", /Table/50/"90f595f5", 11) // ("v-15", nil)
0 OP {
0 OP b := &Batch{}
0 OP b.Put(ctx, /Table/50/"6a584c4f", v-81) // nil
0 OP b.Put(ctx, /Table/50/"c869e404", v-82) // nil
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342268.099911000,0
I200408 10:37:48.118585 1006 kv/kvserver/replica_command.go:663 [n1,s1,r36/1:/Table/50/"{8f41752…-be9d618…}] initiating a merge of r33:/{Table/50/"be9d6183"-Max} [(n1,s1):1, next=2, gen=1, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.118613 1005 kv/kvserver/replica_command.go:663 [n1,s1,r36/1:/Table/50/"{8f41752…-be9d618…}] initiating a merge of r33:/{Table/50/"be9d6183"-Max} [(n1,s1):1, next=2, gen=1, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.125551 1007 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/Table/50/"{8f417521"-be9d6183"} [(n1,s1):1, next=2, gen=3, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.129776 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.129064000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"84d4b4ad", v-83) // nil
4 OP b.Put(ctx, /Table/50/"6e8a8543", v-84) // nil
4 OP b.Put(ctx, /Table/50/"856c83b2", v-85) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP txn.Put(ctx, /Table/50/"100523e9", v-86) // nil
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342268.129742000,0
I200408 10:37:48.136808 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.136396000,0
0 OP db0.ReverseScan(ctx, /Table/50/"77fce1d4", /Table/50/"da3b265d", 0) // ("v-50", nil)
after: 1586342268.136774000,0
I200408 10:37:48.137336 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.136503000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"a566e71a", v-87) // nil
4 OP b.Put(ctx, /Table/50/"e85b21d5", v-88) // nil
4 OP b.Put(ctx, /Table/50/"51d2130b", v-89) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP b.Scan(ctx, /Table/50/"ba888c6c", /Table/50/"dfb2616c", 15) // ("v-64", nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=321a8066 key=/Table/50/"a566e71a" pri=0.00500064 epo=0 ts=1586342268.136504000,0 min=1586342268.136504000,0 seq=4} lock=true stat=COMMITTED rts=1586342268.136504000,0 wto=false max=1586342268.636504000,0 ifw=3)
after: 1586342268.137292000,1
I200408 10:37:48.137618 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a566e71a" 1586342268.136504000,0 -> /BYTES/v-87 (prev /<empty>)
I200408 10:37:48.143088 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"51d2130b" 1586342268.136504000,0 -> /BYTES/v-89 (prev /BYTES/v-19)
I200408 10:37:48.143138 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"e85b21d5" 1586342268.136504000,0 -> /BYTES/v-88 (prev /<empty>)
I200408 10:37:48.143977 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.136984000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP {
0 OP b := &Batch{}
0 OP b.Put(ctx, /Table/50/"64c9cc0c", v-90) // nil
0 OP b.Put(ctx, /Table/50/"45c50601", v-91) // nil
0 OP b.Put(ctx, /Table/50/"5327400d", v-92) // nil
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP {
0 OP b := &Batch{}
0 OP b.ReverseScan(ctx, /Table/50/"16faa8f1", /Table/50/"63c5d95a", 25) // ("v-61", nil)
0 OP b.ReverseScan(ctx, /Table/50/"0048c1ff", /Table/50/"3a7f9b5f", 0) // ("v-72", nil)
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP {
0 OP b := &Batch{}
0 OP b.Put(ctx, /Table/50/"7a61ef82", v-93) // nil
0 OP b.Put(ctx, /Table/50/"596e6b77", v-94) // nil
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP return nil
0 OP }) // nil txnpb:("unnamed" meta={id=48d43f10 key=/Table/50/"64c9cc0c" pri=0.00068443 epo=0 ts=1586342268.136984000,1 min=1586342268.136984000,1 seq=6} lock=true stat=COMMITTED rts=1586342268.136984000,1 wto=false max=1586342268.636984000,1 int=2 ifw=3)
after: 1586342268.143919000,0
I200408 10:37:48.144396 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342268.136984000,1 -> /BYTES/v-91 (prev /BYTES/v-22)
I200408 10:37:48.144450 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5327400d" 1586342268.136984000,1 -> /BYTES/v-92 (prev /<empty>)
I200408 10:37:48.144516 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"596e6b77" 1586342268.136984000,1 -> /BYTES/v-94 (prev /<empty>)
I200408 10:37:48.144579 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"64c9cc0c" 1586342268.136984000,1 -> /BYTES/v-90 (prev /<empty>)
I200408 10:37:48.144637 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"7a61ef82" 1586342268.136984000,1 -> /BYTES/v-93 (prev /<empty>)
I200408 10:37:48.163121 1007 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/Table/50/"{8f417521"-be9d6183"} [(n1,s1):1, next=2, gen=3, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.163143 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.163111000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=39e33efa key=/Min pri=0.00346955 epo=0 ts=1586342268.163111000,1 min=1586342268.163111000,1 seq=0} lock=false stat=COMMITTED rts=1586342268.163111000,1 wto=false max=1586342268.663111000,1)
after: 1586342268.163119000,0
I200408 10:37:48.172669 1005 kv/kvserver/replica_command.go:663 [n1,s1,r36/1:/Table/50/"{8f41752…-be9d618…}] initiating a merge of r33:/{Table/50/"be9d6183"-Max} [(n1,s1):1, next=2, gen=1, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.172871 1006 kv/kvserver/replica_command.go:663 [n1,s1,r36/1:/Table/50/"{8f41752…-be9d618…}] initiating a merge of r33:/{Table/50/"be9d6183"-Max} [(n1,s1):1, next=2, gen=1, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.172965 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.172907000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP return nil
0 OP }) // nil txnpb:("unnamed" meta={id=24e703d8 key=/Min pri=0.01831166 epo=0 ts=1586342268.172908000,0 min=1586342268.172908000,0 seq=0} lock=false stat=COMMITTED rts=1586342268.172908000,0 wto=false max=1586342268.672908000,0)
after: 1586342268.172928000,0
I200408 10:37:48.173334 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.172416000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP txn.Put(ctx, /Table/50/"64c9cc0c", v-95) // nil
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342268.173313000,0
I200408 10:37:48.180069 1007 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/Table/50/"{8f417521"-be9d6183"} [(n1,s1):1, next=2, gen=3, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.180084 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.180005000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP {
0 OP b := &Batch{}
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP {
0 OP b := &Batch{}
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342268.180067000,0
I200408 10:37:48.180461 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.180118000,0
4 OP db0.ReverseScan(ctx, /Table/50/"03562e73", /Table/50/"803fc9aa", 17) // ("v-93", nil)
after: 1586342268.180424000,0
I200408 10:37:48.180591 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.180561000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=9f4c7a58 key=/Min pri=0.02848580 epo=0 ts=1586342268.180561000,1 min=1586342268.180561000,1 seq=0} lock=false stat=COMMITTED rts=1586342268.180561000,1 wto=false max=1586342268.680561000,1)
after: 1586342268.180568000,0
I200408 10:37:48.180600 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.180222000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP txn.Put(ctx, /Table/50/"7d53824e", v-96) // nil
0 OP return nil
0 OP }) // nil txnpb:("unnamed" meta={id=6ba275e5 key=/Table/50/"7d53824e" pri=0.01649535 epo=0 ts=1586342268.180223000,0 min=1586342268.180223000,0 seq=2} lock=true stat=COMMITTED rts=1586342268.180223000,0 wto=false max=1586342268.680223000,0 ifw=1)
after: 1586342268.180562000,0
I200408 10:37:48.180771 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.180703000,0
4 OP db0.AdminSplit(ctx, /Table/50/"2d14fabc") // nil
after: 1586342268.180745000,0
I200408 10:37:48.181110 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.181046000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342268.181097000,0
I200408 10:37:48.181218 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.181189000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=a74788e7 key=/Min pri=0.00136252 epo=0 ts=1586342268.181189000,1 min=1586342268.181189000,1 seq=0} lock=false stat=COMMITTED rts=1586342268.181189000,1 wto=false max=1586342268.681189000,1)
after: 1586342268.181195000,0
I200408 10:37:48.181684 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"7d53824e" 1586342268.180223000,0 -> /BYTES/v-96 (prev /<empty>)
I200408 10:37:48.182259 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.181305000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.ReverseScan(ctx, /Table/50/"09712b76", /Table/50/"0b718b3e", 22) // ("v-42", nil)
4 OP b.Scan(ctx, /Table/50/"cd9ecb27", /Table/50/"e1bb5e16", 22) // ("v-48", nil)
4 OP b.Scan(ctx, /Table/50/"330a8420", /Table/50/"b27680c0", 25) // ("v-63", nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP b.Scan(ctx, /Table/50/"60e1f58b", /Table/50/"7fc8941b", 18) // ("v-90", nil)
4 OP b.Scan(ctx, /Table/50/"037dc166", /Table/50/"967f47a4", 9) // ("v-75", nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=c3081d21 key=/Min pri=0.02988540 epo=0 ts=1586342268.181305000,1 min=1586342268.181305000,1 seq=0} lock=false stat=COMMITTED rts=1586342268.181305000,1 wto=false max=1586342268.681305000,1)
after: 1586342268.182211000,0
I200408 10:37:48.189657 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.188554000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.ReverseScan(ctx, /Table/50/"626cc0f7", /Table/50/"fd80e7ba", 9) // ("v-88", nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"6e8a8543", v-97) // nil
4 OP b.Put(ctx, /Table/50/"167c7663", v-98) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342268.189623000,0
I200408 10:37:48.195539 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.189764000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP txn.Scan(ctx, /Table/50/"0e0fb147", /Table/50/"764eda92", 3) // ("v-43", nil)
4 OP txn.Put(ctx, /Table/50/"3ba1b142", v-99) // nil
4 OP {
4 OP b := &Batch{}
4 OP b.ReverseScan(ctx, /Table/50/"b3502655", /Table/50/"db627eb1", 2) // ("v-50", nil)
4 OP b.Scan(ctx, /Table/50/"6085ea0b", /Table/50/"e5ebeed2", 7) // ("v-27", nil)
4 OP b.ReverseScan(ctx, /Table/50/"329bb745", /Table/50/"ef2c023e", 8) // (nil, nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342268.195482000,0
I200408 10:37:48.209700 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.208243000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.ReverseScan(ctx, /Table/50/"f6ecf3e1", /Table/50/"f7bb9b54", 0) // (nil, nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP b.ReverseScan(ctx, /Table/50/"07a548d3", /Table/50/"30c54b42", 2) // ("v-41", nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"837410f8", v-100) // nil
4 OP b.Put(ctx, /Table/50/"0a673113", v-101) // nil
4 OP b.Put(ctx, /Table/50/"16c8007f", v-102) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=86eb93a1 key=/Table/50/"837410f8" pri=0.00051693 epo=0 ts=1586342268.208243000,1 min=1586342268.208243000,1 seq=4} lock=true stat=COMMITTED rts=1586342268.208243000,1 wto=false max=1586342268.708243000,1 ifw=3)
after: 1586342268.209617000,0
I200408 10:37:48.209873 1007 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/Table/50/"{8f417521"-be9d6183"} [(n1,s1):1, next=2, gen=3, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.210018 1004 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/Table/50/"{8f417521"-be9d6183"} [(n1,s1):1, next=2, gen=3, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.210148 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"837410f8" 1586342268.208243000,1 -> /BYTES/v-100 (prev /<empty>)
I200408 10:37:48.216417 1006 kv/kvserver/replica_command.go:663 [n1,s1,r36/1:/Table/50/"{8f41752…-be9d618…}] initiating a merge of r33:/{Table/50/"be9d6183"-Max} [(n1,s1):1, next=2, gen=1, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.216625 1005 kv/kvserver/replica_command.go:663 [n1,s1,r36/1:/Table/50/"{8f41752…-be9d618…}] initiating a merge of r33:/{Table/50/"be9d6183"-Max} [(n1,s1):1, next=2, gen=1, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.217257 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"0a673113" 1586342268.208243000,1 -> /BYTES/v-101 (prev /<empty>)
I200408 10:37:48.217701 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"16c8007f" 1586342268.208243000,1 -> /BYTES/v-102 (prev /<empty>)
I200408 10:37:48.219145 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.217977000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP txn.Scan(ctx, /Table/50/"1e8a1c58", /Table/50/"9c2747bd", 11) // ("v-72", nil)
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"1ac7d594", v-103) // nil
4 OP b.Put(ctx, /Table/50/"3ad2f113", v-104) // nil
4 OP b.Put(ctx, /Table/50/"3ba1b142", v-105) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=8243f6fe key=/Table/50/"1ac7d594" pri=0.01069368 epo=0 ts=1586342268.217978000,0 min=1586342268.217978000,0 seq=4} lock=true stat=COMMITTED rts=1586342268.217978000,0 wto=false max=1586342268.717978000,0 ifw=3)
after: 1586342268.219082000,0
I200408 10:37:48.219557 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"1ac7d594" 1586342268.217978000,0 -> /BYTES/v-103 (prev /<empty>)
I200408 10:37:48.225740 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"3ad2f113" 1586342268.217978000,0 -> /BYTES/v-104 (prev /<empty>)
I200408 10:37:48.225805 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"3ba1b142" 1586342268.217978000,0 -> /BYTES/v-105 (prev /<empty>)
I200408 10:37:48.225923 1007 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/Table/50/"{8f417521"-be9d6183"} [(n1,s1):1, next=2, gen=3, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.226425 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.225761000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"abedffe4", v-106) // nil
4 OP b.Put(ctx, /Table/50/"3ba1b142", v-107) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342268.226403000,0
I200408 10:37:48.336414 1006 kv/kvserver/replica_command.go:663 [n1,s1,r36/1:/Table/50/"{8f41752…-be9d618…}] initiating a merge of r33:/{Table/50/"be9d6183"-Max} [(n1,s1):1, next=2, gen=1, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.360607 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.360049000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"85fa2c1f", v-108) // nil
4 OP b.Put(ctx, /Table/50/"a566e71a", v-109) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=3db33861 key=/Table/50/"85fa2c1f" pri=0.02722200 epo=0 ts=1586342268.360049000,1 min=1586342268.360049000,1 seq=3} lock=true stat=COMMITTED rts=1586342268.360049000,1 wto=false max=1586342268.860049000,1 ifw=2)
after: 1586342268.360555000,0
I200408 10:37:48.360906 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"85fa2c1f" 1586342268.360049000,1 -> /BYTES/v-108 (prev /<empty>)
I200408 10:37:48.367583 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a566e71a" 1586342268.360049000,1 -> /BYTES/v-109 (prev /BYTES/v-87)
I200408 10:37:48.367994 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342268.367847000,0 -> /BYTES/v-110 (prev /BYTES/v-15)
I200408 10:37:48.367997 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.367833000,0
4 OP db0.Put(ctx, /Table/50/"52d1b1af", v-110) // nil
after: 1586342268.367978000,0
I200408 10:37:48.474571 197 kv/kvserver/store_remove_replica.go:122 [n1,s1,r36/1:/Table/50/"{8f41752…-be9d618…}] removing replica r33/1
I200408 10:37:48.474740 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.973567000,0
2 OP db0.AdminMerge(ctx, /Table/50/"ae4cb1f0") // nil
after: 1586342268.474724000,0
I200408 10:37:48.475267 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a4731c23" 1586342267.786268000,1 -> /BYTES/v-20 (prev /<empty>)
I200408 10:37:48.475300 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a566e71a" 1586342268.136504000,0 -> /BYTES/v-87 (prev /<empty>)
I200408 10:37:48.475323 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a566e71a" 1586342268.360049000,1 -> /BYTES/v-109 (prev /BYTES/v-87)
I200408 10:37:48.475358 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a9dc77f9" 1586342267.852770000,0 -> /BYTES/v-76 (prev /<empty>)
I200408 10:37:48.475390 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"adde72de" 1586342267.782653000,0 -> /BYTES/v-1 (prev /<empty>)
I200408 10:37:48.475414 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"adde72de" 1586342267.785250000,0 -> /BYTES/v-17 (prev /BYTES/v-1)
I200408 10:37:48.475436 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"afea3da4" 1586342267.829461000,0 -> /BYTES/v-63 (prev /<empty>)
I200408 10:37:48.480428 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.829114000,0
1 OP db0.AdminMerge(ctx, /Table/50/"8f417521") // kv/kvserver/replica_command.go:777: merge failed: unexpected value: raw_bytes:"\241\230\343|\003\010$\022\014\272\0228f417521\000\001\032\002\377\377\"\006\010\001\020\001\030\001(\0020\004:\020\010\377\377\377\377\377\377\377\377\177\020\377\377\377\377\007@\001" timestamp:<wall_time:1586342268329816000 >
after: 1586342268.480405000,0
I200408 10:37:48.480592 1004 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/{Table/50/"8f417521"-Max} [(n1,s1):1, next=2, gen=4, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.495815 1007 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/{Table/50/"8f417521"-Max} [(n1,s1):1, next=2, gen=4, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.495815 1004 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/{Table/50/"8f417521"-Max} [(n1,s1):1, next=2, gen=4, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.496214 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.496093000,0
1 OP db0.AdminMerge(ctx, /Table/50/"e81229fd") // kv/kvserver/replica_command.go:777: merge failed: cannot merge final range
after: 1586342268.496168000,0
I200408 10:37:48.496623 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"03485b33" 1586342268.496374000,0 -> /BYTES/v-117 (prev /<empty>)
I200408 10:37:48.496626 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.495989000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP {
2 OP b := &Batch{}
2 OP b.ReverseScan(ctx, /Table/50/"240d42e6", /Table/50/"570e542d", 7) // ("v-92", nil)
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP {
2 OP b := &Batch{}
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP txn.Put(ctx, /Table/50/"2a5c4fc8", v-116) // nil
2 OP return nil
2 OP }) // nil txnpb:("unnamed" meta={id=2b9eabec key=/Table/50/"2a5c4fc8" pri=0.01080995 epo=0 ts=1586342268.495989000,1 min=1586342268.495989000,1 seq=2} lock=true stat=COMMITTED rts=1586342268.495989000,1 wto=false max=1586342268.995989000,1 ifw=1)
after: 1586342268.496561000,0
I200408 10:37:48.496627 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.496349000,0
1 OP db0.Put(ctx, /Table/50/"03485b33", v-117) // nil
after: 1586342268.496611000,0
I200408 10:37:48.496760 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.495886000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.Scan(ctx, /Table/50/"0412ead8", /Table/50/"4b8f5f68", 10) // ("v-75", nil)
4 OP b.Scan(ctx, /Table/50/"11d930a9", /Table/50/"b5c8c4d8", 30) // ("v-102", nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"7a61ef82", v-111) // nil
4 OP b.Put(ctx, /Table/50/"5c8e84f4", v-112) // nil
4 OP b.Put(ctx, /Table/50/"3cb02c3e", v-113) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"c869e404", v-114) // nil
4 OP b.Put(ctx, /Table/50/"1d02607d", v-115) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342268.496716000,0
I200408 10:37:48.496818 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.496746000,0
2 OP db0.AdminMerge(ctx, /Table/50/"e8926b60") // kv/kvserver/replica_command.go:777: merge failed: cannot merge final range
after: 1586342268.496802000,0
I200408 10:37:48.496978 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"2a5c4fc8" 1586342268.495989000,1 -> /BYTES/v-116 (prev /<empty>)
I200408 10:37:48.496986 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.496940000,0
4 OP db0.AdminSplit(ctx, /Table/50/"8f417521") // nil
after: 1586342268.496974000,0
I200408 10:37:48.497081 1006 kv/kvserver/replica_command.go:397 [n1,s1,r36/1:/{Table/50/"8f…-Max}] initiating a split of this range at key /Table/50/"be9d6183" [r37] (manual)
I200408 10:37:48.497088 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.496840000,0
1 OP db0.Put(ctx, /Table/50/"4565330e", v-118) // nil
after: 1586342268.497075000,0
I200408 10:37:48.497147 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"4565330e" 1586342268.496856000,0 -> /BYTES/v-118 (prev /<empty>)
I200408 10:37:48.497208 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.497174000,0
4 OP db0.AdminSplit(ctx, /Table/50/"8f417521") // nil
after: 1586342268.497196000,0
I200408 10:37:48.512599 1007 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/{Table/50/"8f417521"-Max} [(n1,s1):1, next=2, gen=4, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.512620 1004 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/{Table/50/"8f417521"-Max} [(n1,s1):1, next=2, gen=4, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.512777 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.512640000,0
1 OP db0.AdminMerge(ctx, /Table/50/"8f417521") // kv/kvserver/replica_command.go:777: merge failed: cannot merge final range
after: 1586342268.512753000,0
I200408 10:37:48.512900 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.512823000,0
4 OP db0.AdminMerge(ctx, /Table/50/"e848f980") // kv/kvserver/replica_command.go:777: merge failed: cannot merge final range
after: 1586342268.512882000,0
I200408 10:37:48.513120 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.513044000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP {
1 OP b := &Batch{}
1 OP txn.Run(ctx, b) // nil
1 OP }
1 OP {
1 OP b := &Batch{}
1 OP txn.Run(ctx, b) // nil
1 OP }
1 OP return nil
1 OP }) // nil txnpb:("unnamed" meta={id=d2e16623 key=/Min pri=0.00278899 epo=0 ts=1586342268.513045000,0 min=1586342268.513045000,0 seq=0} lock=false stat=COMMITTED rts=1586342268.513045000,0 wto=false max=1586342269.013045000,0)
after: 1586342268.513082000,0
I200408 10:37:48.513276 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.513200000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342268.513261000,0
I200408 10:37:48.513654 1008 kv/kvserver/replica_command.go:397 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a split of this range at key /Table/50/"2ec95baf" [r38] (manual)
I200408 10:37:48.517139 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.497037000,0
2 OP db0.AdminSplit(ctx, /Table/50/"be9d6183") // nil
after: 1586342268.517119000,0
I200408 10:37:48.517440 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a4731c23" 1586342267.786268000,1 -> /BYTES/v-20 (prev /<empty>)
I200408 10:37:48.517498 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a566e71a" 1586342268.136504000,0 -> /BYTES/v-87 (prev /<empty>)
I200408 10:37:48.517533 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a566e71a" 1586342268.360049000,1 -> /BYTES/v-109 (prev /BYTES/v-87)
I200408 10:37:48.517559 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a9dc77f9" 1586342267.852770000,0 -> /BYTES/v-76 (prev /<empty>)
I200408 10:37:48.517581 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"adde72de" 1586342267.782653000,0 -> /BYTES/v-1 (prev /<empty>)
I200408 10:37:48.517605 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"adde72de" 1586342267.785250000,0 -> /BYTES/v-17 (prev /BYTES/v-1)
I200408 10:37:48.517628 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"afea3da4" 1586342267.829461000,0 -> /BYTES/v-63 (prev /<empty>)
I200408 10:37:48.525016 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.524363000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP txn.Put(ctx, /Table/50/"9d53224a", v-119) // nil
2 OP txn.Put(ctx, /Table/50/"3ad2f113", v-120) // nil
2 OP return errors.New("rollback")
2 OP }) // rollback
after: 1586342268.524984000,0
I200408 10:37:48.525544 1005 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/{Table/50/"8f417521"-Max} [(n1,s1):1, next=2, gen=4, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.525626 1007 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/Table/50/"{8f417521"-be9d6183"} [(n1,s1):1, next=2, gen=5, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.526304 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"c8ec25eb" 1586342267.829756000,1 -> /BYTES/v-64 (prev /<empty>)
I200408 10:37:48.526349 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"c977b30a" 1586342267.792129000,1 -> /BYTES/v-46 (prev /<empty>)
I200408 10:37:48.526377 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"d5a5cada" 1586342267.814204000,0 -> /BYTES/v-50 (prev /<empty>)
I200408 10:37:48.526402 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"dc8ac12d" 1586342267.801999000,1 -> /BYTES/v-48 (prev /<empty>)
I200408 10:37:48.526424 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"e56f2489" 1586342267.786705000,1 -> /BYTES/v-27 (prev /<empty>)
I200408 10:37:48.526446 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"e85b21d5" 1586342268.136504000,0 -> /BYTES/v-88 (prev /<empty>)
I200408 10:37:48.533599 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.532697000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP txn.Put(ctx, /Table/50/"60a140d7", v-121) // nil
2 OP txn.ReverseScan(ctx, /Table/50/"905c04da", /Table/50/"cd5f6813", 28) // ("v-46", nil)
2 OP return errors.New("rollback")
2 OP }) // rollback
after: 1586342268.533566000,0
I200408 10:37:48.534530 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.533721000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP txn.Put(ctx, /Table/50/"6e8a8543", v-122) // nil
2 OP {
2 OP b := &Batch{}
2 OP b.ReverseScan(ctx, /Table/50/"1fea2011", /Table/50/"3dec24db", 28) // ("v-62", nil)
2 OP b.ReverseScan(ctx, /Table/50/"b1fb4264", /Table/50/"b2359a04", 1) // (nil, nil)
2 OP b.ReverseScan(ctx, /Table/50/"02ceb9a2", /Table/50/"487f478d", 13) // ("v-91", nil)
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP return errors.New("rollback")
2 OP }) // rollback
after: 1586342268.534491000,0
I200408 10:37:48.542510 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"f9096aa3" 1586342268.542231000,0 -> /BYTES/v-123 (prev /<empty>)
I200408 10:37:48.542522 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.542200000,0
2 OP db0.Put(ctx, /Table/50/"f9096aa3", v-123) // nil
after: 1586342268.542498000,0
I200408 10:37:48.544587 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.513589000,0
4 OP db0.AdminSplit(ctx, /Table/50/"2ec95baf") // nil
after: 1586342268.544552000,0
I200408 10:37:48.544687 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.181507000,0
0 OP db0.AdminMerge(ctx, /Table/50/"3097069c") // kv/kvserver/replica_command.go:777: merge failed: unexpected value: raw_bytes:"\371\300\362\022\003\010\"\022\014\272\0222d14fabc\000\001\032\014\272\0222ec95baf\000\001\"\006\010\001\020\001\030\001(\0020\004:\020\010\377\377\377\377\377\377\377\377\177\020\377\377\377\377\007@\001" timestamp:<wall_time:1586342268533635000 logical:1 >
after: 1586342268.544664000,0
I200408 10:37:48.545641 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"36525187" 1586342267.829756000,1 -> /BYTES/v-65 (prev /<empty>)
I200408 10:37:48.545701 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"36525187" 1586342267.842325000,0 -> /BYTES/v-72 (prev /BYTES/v-65)
I200408 10:37:48.545726 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"3ad2f113" 1586342268.217978000,0 -> /BYTES/v-104 (prev /<empty>)
I200408 10:37:48.545742 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"3ba1b142" 1586342268.217978000,0 -> /BYTES/v-105 (prev /<empty>)
I200408 10:37:48.545759 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"3cb02c3e" 1586342267.803578000,0 -> /BYTES/v-49 (prev /<empty>)
I200408 10:37:48.545769 1005 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"2{d14fab…-ec95ba…}] initiating a merge of r38:/Table/50/"{2ec95baf"-8f417521"} [(n1,s1):1, next=2, gen=4, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.545774 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"3cbd748e" 1586342267.828503000,1 -> /BYTES/v-62 (prev /<empty>)
I200408 10:37:48.545783 1007 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"2{d14fab…-ec95ba…}] initiating a merge of r38:/Table/50/"{2ec95baf"-8f417521"} [(n1,s1):1, next=2, gen=4, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.545805 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"4565330e" 1586342268.496856000,0 -> /BYTES/v-118 (prev /<empty>)
I200408 10:37:48.545820 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.782764000,0 -> /BYTES/v-2 (prev /<empty>)
I200408 10:37:48.545832 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.784584000,0 -> /BYTES/v-14 (prev /BYTES/v-2)
I200408 10:37:48.545849 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.786268000,1 -> /BYTES/v-22 (prev /BYTES/v-14)
I200408 10:37:48.545865 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342268.136984000,1 -> /BYTES/v-91 (prev /BYTES/v-22)
I200408 10:37:48.545878 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.783708000,0 -> /BYTES/v-8 (prev /<empty>)
I200408 10:37:48.545898 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.783818000,0 -> /BYTES/v-9 (prev /BYTES/v-8)
I200408 10:37:48.545920 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.784584000,0 -> /BYTES/v-16 (prev /BYTES/v-9)
I200408 10:37:48.545934 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.815575000,1 -> /BYTES/v-55 (prev /BYTES/v-16)
I200408 10:37:48.545950 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"51d2130b" 1586342267.785582000,0 -> /BYTES/v-19 (prev /<empty>)
I200408 10:37:48.545966 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"51d2130b" 1586342268.136504000,0 -> /BYTES/v-89 (prev /BYTES/v-19)
I200408 10:37:48.545981 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.782653000,0 -> /BYTES/v-0 (prev /<empty>)
I200408 10:37:48.545997 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.784336000,0 -> /BYTES/v-11 (prev /BYTES/v-0)
I200408 10:37:48.546028 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.784584000,0 -> /BYTES/v-15 (prev /BYTES/v-11)
I200408 10:37:48.546046 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342268.367847000,0 -> /BYTES/v-110 (prev /BYTES/v-15)
I200408 10:37:48.546062 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5327400d" 1586342268.136984000,1 -> /BYTES/v-92 (prev /<empty>)
I200408 10:37:48.546076 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"596e6b77" 1586342268.136984000,1 -> /BYTES/v-94 (prev /<empty>)
I200408 10:37:48.546091 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5cc54c7b" 1586342267.842325000,0 -> /BYTES/v-71 (prev /<empty>)
I200408 10:37:48.546106 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5d362357" 1586342267.786268000,1 -> /BYTES/v-21 (prev /<empty>)
I200408 10:37:48.546121 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5e7fd199" 1586342267.828503000,1 -> /BYTES/v-61 (prev /<empty>)
I200408 10:37:48.546136 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"64c9cc0c" 1586342268.136984000,1 -> /BYTES/v-90 (prev /<empty>)
I200408 10:37:48.546151 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"7a61ef82" 1586342268.136984000,1 -> /BYTES/v-93 (prev /<empty>)
I200408 10:37:48.546166 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"7d53824e" 1586342268.180223000,0 -> /BYTES/v-96 (prev /<empty>)
I200408 10:37:48.546182 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"837410f8" 1586342268.208243000,1 -> /BYTES/v-100 (prev /<empty>)
I200408 10:37:48.546199 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"85c5f880" 1586342267.784584000,0 -> /BYTES/v-12 (prev /<empty>)
I200408 10:37:48.546214 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"85fa2c1f" 1586342268.360049000,1 -> /BYTES/v-108 (prev /<empty>)
I200408 10:37:48.551759 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.551650000,0
2 OP db0.AdminSplit(ctx, /Table/50/"be9d6183") // nil
after: 1586342268.551722000,1
I200408 10:37:48.551985 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.551859000,0
4 OP db0.AdminSplit(ctx, /Table/50/"2d14fabc") // nil
after: 1586342268.551931000,0
I200408 10:37:48.553170 230 kv/kvserver/store_remove_replica.go:122 [n1,s1,r34/1:/Table/50/"2{d14fab…-ec95ba…}] removing replica r38/1
I200408 10:37:48.553354 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.513418000,0
1 OP db0.AdminMerge(ctx, /Table/50/"2d14fabc") // nil
after: 1586342268.553336000,0
I200408 10:37:48.557156 1007 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] initiating a merge of r36:/Table/50/"{8f417521"-be9d6183"} [(n1,s1):1, next=2, gen=5, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.559948 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.559515000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP txn.Put(ctx, /Table/50/"0185da34", v-124) // nil
0 OP txn.Scan(ctx, /Table/50/"b5e6554f", /Table/50/"c8bba6ef", 23) // (nil, nil)
0 OP {
0 OP b := &Batch{}
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP return nil
0 OP }) // nil txnpb:("unnamed" meta={id=c39fadff key=/Table/50/"0185da34" pri=0.00166125 epo=0 ts=1586342268.559515000,1 min=1586342268.559515000,1 seq=2} lock=true stat=COMMITTED rts=1586342268.559515000,1 wto=false max=1586342269.059515000,1 ifw=1)
after: 1586342268.559891000,0
I200408 10:37:48.560165 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"0185da34" 1586342268.559515000,1 -> /BYTES/v-124 (prev /<empty>)
I200408 10:37:48.560522 231 kv/kvserver/store_remove_replica.go:122 [n1,s1,r34/1:/Table/50/"{2d14fab…-8f41752…}] removing replica r36/1
I200408 10:37:48.560683 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342267.828818000,0
3 OP db0.AdminMerge(ctx, /Table/50/"2d14fabc") // nil
after: 1586342268.560666000,0
I200408 10:37:48.566594 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.566558000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP return nil
1 OP }) // nil txnpb:("unnamed" meta={id=40fe866e key=/Min pri=0.04348243 epo=0 ts=1586342268.566559000,0 min=1586342268.566559000,0 seq=0} lock=false stat=COMMITTED rts=1586342268.566559000,0 wto=false max=1586342269.066559000,0)
after: 1586342268.566566000,0
I200408 10:37:48.566779 1004 kv/kvserver/replica_command.go:397 [n1,s1,r37/1:/{Table/50/"be…-Max}] initiating a split of this range at key /Table/50/"df345931" [r39] (manual)
I200408 10:37:48.566810 1006 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-be9d618…}] initiating a merge of r37:/{Table/50/"be9d6183"-Max} [(n1,s1):1, next=2, gen=5, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.566951 1007 kv/kvserver/replica_command.go:397 [n1,s1,r32/1:/Table/{36-50/"2d14f…}] initiating a split of this range at key /Table/50/"1c13ab1f" [r40] (manual)
I200408 10:37:48.567100 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.567064000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP return nil
1 OP }) // nil txnpb:("unnamed" meta={id=c405d659 key=/Min pri=0.02137078 epo=0 ts=1586342268.567065000,0 min=1586342268.567065000,0 seq=0} lock=false stat=COMMITTED rts=1586342268.567065000,0 wto=false max=1586342269.067065000,0)
after: 1586342268.567072000,0
I200408 10:37:48.567314 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.566425000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.ReverseScan(ctx, /Table/50/"2d0a95f6", /Table/50/"edab70f5", 11) // ("v-88", nil)
4 OP b.Scan(ctx, /Table/50/"32982543", /Table/50/"b191b31d", 18) // (nil, nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=619c3ef2 key=/Min pri=0.01394274 epo=0 ts=1586342268.566426000,0 min=1586342268.566426000,0 seq=0} lock=false stat=COMMITTED rts=1586342268.566426000,0 wto=false max=1586342269.066426000,0)
after: 1586342268.567272000,0
I200408 10:37:48.567801 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.567238000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP txn.Put(ctx, /Table/50/"45c50601", v-125) // nil
1 OP return errors.New("rollback")
1 OP }) // rollback
after: 1586342268.567780000,0
I200408 10:37:48.568089 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.567912000,0
1 OP db0.Put(ctx, /Table/50/"294bca1d", v-128) // nil
after: 1586342268.568077000,0
I200408 10:37:48.568093 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"294bca1d" 1586342268.567927000,0 -> /BYTES/v-128 (prev /<empty>)
I200408 10:37:48.568487 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.567416000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"781a9505", v-126) // nil
4 OP b.Put(ctx, /Table/50/"f9096aa3", v-127) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP txn.ReverseScan(ctx, /Table/50/"13afdf26", /Table/50/"611ec716", 35) // ("v-61", nil)
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=a0b95724 key=/Table/50/"781a9505" pri=0.03438764 epo=0 ts=1586342268.567417000,0 min=1586342268.567417000,0 seq=3} lock=true stat=COMMITTED rts=1586342268.567417000,0 wto=false max=1586342269.067417000,0 ifw=2)
after: 1586342268.568427000,0
I200408 10:37:48.568887 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.568188000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP txn.ReverseScan(ctx, /Table/50/"84af59f6", /Table/50/"e8d297a7", 31) // ("v-88", nil)
1 OP txn.Put(ctx, /Table/50/"58460eca", v-129) // nil
1 OP return nil
1 OP }) // nil txnpb:("unnamed" meta={id=ebb7d893 key=/Table/50/"58460eca" pri=0.00950447 epo=0 ts=1586342268.568189000,0 min=1586342268.568189000,0 seq=2} lock=true stat=COMMITTED rts=1586342268.568189000,0 wto=false max=1586342269.068189000,0 ifw=1)
after: 1586342268.568858000,0
I200408 10:37:48.569840 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.566885000,0
3 OP db0.AdminSplit(ctx, /Table/50/"1c13ab1f") // nil
after: 1586342268.569824000,0
I200408 10:37:48.570326 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.566711000,0
0 OP db0.AdminSplit(ctx, /Table/50/"df345931") // nil
after: 1586342268.570309000,0
I200408 10:37:48.570396 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"0185da34" 1586342268.559515000,1 -> /BYTES/v-124 (prev /<empty>)
I200408 10:37:48.570434 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"03485b33" 1586342268.496374000,0 -> /BYTES/v-117 (prev /<empty>)
I200408 10:37:48.570458 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"04b3bba3" 1586342267.852588000,0 -> /BYTES/v-75 (prev /<empty>)
I200408 10:37:48.570476 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"0a673113" 1586342268.208243000,1 -> /BYTES/v-101 (prev /<empty>)
I200408 10:37:48.570495 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"0af004dc" 1586342267.790607000,1 -> /BYTES/v-42 (prev /<empty>)
I200408 10:37:48.570511 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"100523e9" 1586342267.790607000,1 -> /BYTES/v-43 (prev /<empty>)
I200408 10:37:48.570542 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"16c8007f" 1586342268.208243000,1 -> /BYTES/v-102 (prev /<empty>)
I200408 10:37:48.570563 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"1ac7d594" 1586342268.217978000,0 -> /BYTES/v-103 (prev /<empty>)
I200408 10:37:48.570585 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"1bf4d0fd" 1586342268.091915000,1 -> /BYTES/v-79 (prev /<empty>)
I200408 10:37:48.570653 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"1d02607d" 1586342267.784584000,0 -> /BYTES/v-13 (prev /<empty>)
I200408 10:37:48.570680 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"1d02607d" 1586342267.790242000,0 -> /BYTES/v-41 (prev /BYTES/v-13)
I200408 10:37:48.570705 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"294bca1d" 1586342268.567927000,0 -> /BYTES/v-128 (prev /<empty>)
I200408 10:37:48.570727 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"2a5c4fc8" 1586342268.495989000,1 -> /BYTES/v-116 (prev /<empty>)
I200408 10:37:48.570901 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"c8ec25eb" 1586342267.829756000,1 -> /BYTES/v-64 (prev /<empty>)
I200408 10:37:48.570928 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"c977b30a" 1586342267.792129000,1 -> /BYTES/v-46 (prev /<empty>)
I200408 10:37:48.570947 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"d5a5cada" 1586342267.814204000,0 -> /BYTES/v-50 (prev /<empty>)
I200408 10:37:48.570971 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"dc8ac12d" 1586342267.801999000,1 -> /BYTES/v-48 (prev /<empty>)
I200408 10:37:48.571279 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"e56f2489" 1586342267.786705000,1 -> /BYTES/v-27 (prev /<empty>)
I200408 10:37:48.571301 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"e85b21d5" 1586342268.136504000,0 -> /BYTES/v-88 (prev /<empty>)
I200408 10:37:48.571319 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"f9096aa3" 1586342268.542231000,0 -> /BYTES/v-123 (prev /<empty>)
I200408 10:37:48.574572 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"f9096aa3" 1586342268.567417000,0 -> /BYTES/v-127 (prev /BYTES/v-123)
I200408 10:37:48.576854 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.576602000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP txn.ReverseScan(ctx, /Table/50/"8a756376", /Table/50/"b7ac2213", 9) // ("v-63", nil)
4 OP {
4 OP b := &Batch{}
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return nil
4 OP }) // nil txnpb:("unnamed" meta={id=848f9992 key=/Min pri=0.01115594 epo=0 ts=1586342268.576603000,0 min=1586342268.576603000,0 seq=0} lock=false stat=COMMITTED rts=1586342268.576603000,0 wto=false max=1586342269.076603000,0)
after: 1586342268.576806000,0
I200408 10:37:48.577664 1006 kv/kvserver/replica_command.go:663 [n1,s1,r34/1:/Table/50/"{2d14fab…-be9d618…}] initiating a merge of r37:/Table/50/"{be9d6183"-df345931"} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.583153 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.582922000,0
1 OP db0.Put(ctx, /Table/50/"5d14eb93", v-130) // nil
after: 1586342268.583127000,0
I200408 10:37:48.583409 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.583054000,0
3 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
3 OP {
3 OP b := &Batch{}
3 OP b.Scan(ctx, /Table/50/"6b996a3d", /Table/50/"a5ed969a", 24) // ("v-126", nil)
3 OP b.Scan(ctx, /Table/50/"1267f7a8", /Table/50/"fe04e89d", 9) // ("v-102", nil)
3 OP b.ReverseScan(ctx, /Table/50/"1d9e110e", /Table/50/"7866f94f", 15) // ("v-128", nil)
3 OP txn.Run(ctx, b) // nil
3 OP }
3 OP return errors.New("rollback")
3 OP }) // rollback
after: 1586342268.583373000,0
I200408 10:37:48.584061 199 kv/kvserver/store_remove_replica.go:122 [n1,s1,r34/1:/Table/50/"{2d14fab…-be9d618…}] removing replica r37/1
I200408 10:37:48.584285 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.566224000,0
2 OP db0.AdminMerge(ctx, /Table/50/"2d14fabc") // nil
after: 1586342268.584268000,0
I200408 10:37:48.591774 1008 kv/kvserver/replica_command.go:397 [n1,s1,r34/1:/Table/50/"{2d14fab…-df34593…}] initiating a split of this range at key /Table/50/"2ec95baf" [r41] (manual)
I200408 10:37:48.592453 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.592110000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP {
1 OP b := &Batch{}
1 OP b.Scan(ctx, /Table/50/"28c01dfa", /Table/50/"d196fd44", 23) // ("v-128", nil)
1 OP b.ReverseScan(ctx, /Table/50/"74b06013", /Table/50/"b3a22b19", 36) // (nil, nil)
1 OP b.ReverseScan(ctx, /Table/50/"113d27fc", /Table/50/"3a7e010f", 6) // ("v-102", nil)
1 OP txn.Run(ctx, b) // nil
1 OP }
1 OP txn.ReverseScan(ctx, /Table/50/"3b0ba8e4", /Table/50/"630e97b0", 4) // ("v-61", nil)
1 OP return nil
1 OP }) // nil txnpb:("unnamed" meta={id=dfebfc8d key=/Min pri=0.05589933 epo=0 ts=1586342268.592110000,1 min=1586342268.592110000,1 seq=0} lock=false stat=COMMITTED rts=1586342268.592110000,1 wto=false max=1586342269.092110000,1)
after: 1586342268.592391000,0
I200408 10:37:48.593014 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.592539000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP {
1 OP b := &Batch{}
1 OP b.ReverseScan(ctx, /Table/50/"2c6eedb8", /Table/50/"679e00aa", 24) // ("v-90", nil)
1 OP b.Scan(ctx, /Table/50/"344f1a6f", /Table/50/"e484a3f3", 27) // ("v-48", nil)
1 OP b.ReverseScan(ctx, /Table/50/"7b1efd3e", /Table/50/"95ac11b2", 22) // (nil, nil)
1 OP txn.Run(ctx, b) // nil
1 OP }
1 OP {
1 OP b := &Batch{}
1 OP txn.Run(ctx, b) // nil
1 OP }
1 OP return nil
1 OP }) // nil txnpb:("unnamed" meta={id=b333e6ad key=/Min pri=0.01404569 epo=0 ts=1586342268.592539000,1 min=1586342268.592539000,1 seq=0} lock=false stat=COMMITTED rts=1586342268.592539000,1 wto=false max=1586342269.092539000,1)
after: 1586342268.592973000,0
I200408 10:37:48.594309 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.593230000,0
1 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
1 OP {
1 OP b := &Batch{}
1 OP b.Put(ctx, /Table/50/"612ff8ce", v-132) // nil
1 OP b.Put(ctx, /Table/50/"f9096aa3", v-133) // nil
1 OP b.Put(ctx, /Table/50/"d0ec26d6", v-134) // nil
1 OP txn.Run(ctx, b) // nil
1 OP }
1 OP {
1 OP b := &Batch{}
1 OP b.Put(ctx, /Table/50/"47126a1f", v-135) // nil
1 OP txn.Run(ctx, b) // nil
1 OP }
1 OP {
1 OP b := &Batch{}
1 OP b.Put(ctx, /Table/50/"5d14eb93", v-136) // nil
1 OP b.Put(ctx, /Table/50/"adde72de", v-137) // nil
1 OP txn.Run(ctx, b) // nil
1 OP }
1 OP return errors.New("rollback")
1 OP }) // rollback
after: 1586342268.594279000,0
I200408 10:37:48.595602 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.591709000,0
4 OP db0.AdminSplit(ctx, /Table/50/"2ec95baf") // nil
after: 1586342268.595586000,0
I200408 10:37:48.601914 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.601782000,0
3 OP db0.AdminMerge(ctx, /Table/50/"df345931") // kv/kvserver/replica_command.go:777: merge failed: cannot merge final range
after: 1586342268.601888000,0
I200408 10:37:48.602438 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.602365000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342268.602421000,0
I200408 10:37:48.602445 1005 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.602187000,0
1 OP db0.Put(ctx, /Table/50/"5d14eb93", v-140) // nil
after: 1586342268.602425000,1
I200408 10:37:48.602586 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.602530000,0
3 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
3 OP return errors.New("rollback")
3 OP }) // rollback
after: 1586342268.602575000,0
I200408 10:37:48.602834 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.602017000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP txn.Put(ctx, /Table/50/"a99a52f1", v-138) // nil
2 OP {
2 OP b := &Batch{}
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP txn.Put(ctx, /Table/50/"6a584c4f", v-139) // nil
2 OP return errors.New("rollback")
2 OP }) // rollback
after: 1586342268.602812000,0
I200408 10:37:48.603050 1007 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.603006000,0
3 OP db0.AdminSplit(ctx, /Table/50/"1c13ab1f") // nil
after: 1586342268.603036000,0
I200408 10:37:48.603360 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.602707000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"fadb4ddd", v-141) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP b.Put(ctx, /Table/50/"7a61ef82", v-142) // nil
4 OP b.Put(ctx, /Table/50/"3ba1b142", v-143) // nil
4 OP b.Put(ctx, /Table/50/"29a1315d", v-144) // nil
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342268.603332000,0
I200408 10:37:48.603442 1005 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.603544 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.603484000,0
4 OP db0.AdminSplit(ctx, /Table/50/"1c13ab1f") // nil
after: 1586342268.603528000,0
I200408 10:37:48.603685 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.603637000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342268.603676000,0
I200408 10:37:48.603744 1007 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.603850 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.603146000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP {
2 OP b := &Batch{}
2 OP b.ReverseScan(ctx, /Table/50/"250fe10a", /Table/50/"d398593d", 4) // ("v-46", nil)
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP {
2 OP b := &Batch{}
2 OP b.Put(ctx, /Table/50/"659d06ac", v-145) // nil
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP {
2 OP b := &Batch{}
2 OP b.ReverseScan(ctx, /Table/50/"87668a4f", /Table/50/"dcae3116", 24) // ("v-48", nil)
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP return nil
2 OP }) // nil txnpb:("unnamed" meta={id=7f233dfc key=/Table/50/"659d06ac" pri=0.01792279 epo=0 ts=1586342268.603147000,0 min=1586342268.603147000,0 seq=2} lock=true stat=COMMITTED rts=1586342268.603147000,0 wto=false max=1586342269.103147000,0 ifw=1)
after: 1586342268.603807000,0
I200408 10:37:48.604005 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"152a069f" 1586342268.603830000,0 -> /BYTES/v-146 (prev /<empty>)
I200408 10:37:48.604018 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.603813000,0
4 OP db0.Put(ctx, /Table/50/"152a069f", v-146) // nil
after: 1586342268.604002000,0
I200408 10:37:48.604504 1008 kv/kvserver/replica_command.go:663 [n1,s1,r40/1:/Table/50/"{1c13ab1…-2d14fab…}] initiating a merge of r34:/Table/50/"2{d14fabc"-ec95baf"} [(n1,s1):1, next=2, gen=8, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.606275 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"36525187" 1586342267.829756000,1 -> /BYTES/v-65 (prev /<empty>)
I200408 10:37:48.606355 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"36525187" 1586342267.842325000,0 -> /BYTES/v-72 (prev /BYTES/v-65)
I200408 10:37:48.606391 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"3ad2f113" 1586342268.217978000,0 -> /BYTES/v-104 (prev /<empty>)
I200408 10:37:48.606422 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"3ba1b142" 1586342268.217978000,0 -> /BYTES/v-105 (prev /<empty>)
I200408 10:37:48.606452 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"3cb02c3e" 1586342267.803578000,0 -> /BYTES/v-49 (prev /<empty>)
I200408 10:37:48.606476 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"3cbd748e" 1586342267.828503000,1 -> /BYTES/v-62 (prev /<empty>)
I200408 10:37:48.606504 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"4565330e" 1586342268.496856000,0 -> /BYTES/v-118 (prev /<empty>)
I200408 10:37:48.606530 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.782764000,0 -> /BYTES/v-2 (prev /<empty>)
I200408 10:37:48.606555 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.784584000,0 -> /BYTES/v-14 (prev /BYTES/v-2)
I200408 10:37:48.606584 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342267.786268000,1 -> /BYTES/v-22 (prev /BYTES/v-14)
I200408 10:37:48.606628 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"45c50601" 1586342268.136984000,1 -> /BYTES/v-91 (prev /BYTES/v-22)
I200408 10:37:48.606663 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.783708000,0 -> /BYTES/v-8 (prev /<empty>)
I200408 10:37:48.606694 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.783818000,0 -> /BYTES/v-9 (prev /BYTES/v-8)
I200408 10:37:48.606720 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.784584000,0 -> /BYTES/v-16 (prev /BYTES/v-9)
I200408 10:37:48.606744 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5124f2fd" 1586342267.815575000,1 -> /BYTES/v-55 (prev /BYTES/v-16)
I200408 10:37:48.606767 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"51d2130b" 1586342267.785582000,0 -> /BYTES/v-19 (prev /<empty>)
I200408 10:37:48.606790 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"51d2130b" 1586342268.136504000,0 -> /BYTES/v-89 (prev /BYTES/v-19)
I200408 10:37:48.606813 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.782653000,0 -> /BYTES/v-0 (prev /<empty>)
I200408 10:37:48.606837 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.784336000,0 -> /BYTES/v-11 (prev /BYTES/v-0)
I200408 10:37:48.606861 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342267.784584000,0 -> /BYTES/v-15 (prev /BYTES/v-11)
I200408 10:37:48.606886 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"52d1b1af" 1586342268.367847000,0 -> /BYTES/v-110 (prev /BYTES/v-15)
I200408 10:37:48.606910 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5327400d" 1586342268.136984000,1 -> /BYTES/v-92 (prev /<empty>)
I200408 10:37:48.606935 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"58460eca" 1586342268.568189000,0 -> /BYTES/v-129 (prev /<empty>)
I200408 10:37:48.606957 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"596e6b77" 1586342268.136984000,1 -> /BYTES/v-94 (prev /<empty>)
I200408 10:37:48.606978 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5cc54c7b" 1586342267.842325000,0 -> /BYTES/v-71 (prev /<empty>)
I200408 10:37:48.607004 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5d14eb93" 1586342268.582950000,0 -> /BYTES/v-130 (prev /<empty>)
I200408 10:37:48.607029 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5d14eb93" 1586342268.602208000,0 -> /BYTES/v-140 (prev /BYTES/v-130)
I200408 10:37:48.607051 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5d362357" 1586342267.786268000,1 -> /BYTES/v-21 (prev /<empty>)
I200408 10:37:48.607070 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"5e7fd199" 1586342267.828503000,1 -> /BYTES/v-61 (prev /<empty>)
I200408 10:37:48.607094 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"64c9cc0c" 1586342268.136984000,1 -> /BYTES/v-90 (prev /<empty>)
I200408 10:37:48.607116 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"659d06ac" 1586342268.603147000,0 -> /BYTES/v-145 (prev /<empty>)
I200408 10:37:48.607141 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"781a9505" 1586342268.567417000,0 -> /BYTES/v-126 (prev /<empty>)
I200408 10:37:48.607166 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"7a61ef82" 1586342268.136984000,1 -> /BYTES/v-93 (prev /<empty>)
I200408 10:37:48.607174 243 kv/kvserver/store_remove_replica.go:122 [n1,s1,r40/1:/Table/50/"{1c13ab1…-2d14fab…}] removing replica r34/1
I200408 10:37:48.607196 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"7d53824e" 1586342268.180223000,0 -> /BYTES/v-96 (prev /<empty>)
I200408 10:37:48.607220 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"837410f8" 1586342268.208243000,1 -> /BYTES/v-100 (prev /<empty>)
I200408 10:37:48.607242 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"85c5f880" 1586342267.784584000,0 -> /BYTES/v-12 (prev /<empty>)
I200408 10:37:48.607264 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"85fa2c1f" 1586342268.360049000,1 -> /BYTES/v-108 (prev /<empty>)
I200408 10:37:48.607373 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.604101000,0
4 OP db0.AdminMerge(ctx, /Table/50/"1c13ab1f") // nil
after: 1586342268.607355000,0
I200408 10:37:48.607560 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a4731c23" 1586342267.786268000,1 -> /BYTES/v-20 (prev /<empty>)
I200408 10:37:48.607656 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a566e71a" 1586342268.136504000,0 -> /BYTES/v-87 (prev /<empty>)
I200408 10:37:48.607703 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a566e71a" 1586342268.360049000,1 -> /BYTES/v-109 (prev /BYTES/v-87)
I200408 10:37:48.607754 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a9dc77f9" 1586342267.852770000,0 -> /BYTES/v-76 (prev /<empty>)
I200408 10:37:48.607882 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"adde72de" 1586342267.782653000,0 -> /BYTES/v-1 (prev /<empty>)
I200408 10:37:48.607937 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"adde72de" 1586342267.785250000,0 -> /BYTES/v-17 (prev /BYTES/v-1)
I200408 10:37:48.607965 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"afea3da4" 1586342267.829461000,0 -> /BYTES/v-63 (prev /<empty>)
I200408 10:37:48.607994 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"1d02607d" 1586342267.784584000,0 -> /BYTES/v-13 (prev /<empty>)
I200408 10:37:48.608014 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"1d02607d" 1586342267.790242000,0 -> /BYTES/v-41 (prev /BYTES/v-13)
I200408 10:37:48.608033 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"294bca1d" 1586342268.567927000,0 -> /BYTES/v-128 (prev /<empty>)
I200408 10:37:48.608073 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"2a5c4fc8" 1586342268.495989000,1 -> /BYTES/v-116 (prev /<empty>)
I200408 10:37:48.609773 1006 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.603927000,0
2 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
2 OP {
2 OP b := &Batch{}
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP {
2 OP b := &Batch{}
2 OP b.Scan(ctx, /Table/50/"554a656b", /Table/50/"c4c1dbbe", 39) // ("v-129", nil)
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP {
2 OP b := &Batch{}
2 OP txn.Run(ctx, b) // nil
2 OP }
2 OP return errors.New("rollback")
2 OP }) // rollback
after: 1586342268.609746000,0
I200408 10:37:48.613641 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.613581000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342268.613626000,0
I200408 10:37:48.621890 1005 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.621895 1007 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.622614 1008 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.622167000,0
4 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
4 OP {
4 OP b := &Batch{}
4 OP b.ReverseScan(ctx, /Table/50/"20df6144", /Table/50/"6c71f549", 17) // ("v-145", nil)
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP {
4 OP b := &Batch{}
4 OP txn.Run(ctx, b) // nil
4 OP }
4 OP return errors.New("rollback")
4 OP }) // rollback
after: 1586342268.622587000,0
I200408 10:37:48.631490 1006 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.631545 1008 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.631494 1005 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.640497 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.583286000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP {
0 OP b := &Batch{}
0 OP b.ReverseScan(ctx, /Table/50/"4cda91b1", /Table/50/"c30215c1", 12) // ("v-63", nil)
0 OP b.ReverseScan(ctx, /Table/50/"0af3b5d9", /Table/50/"48bf7bae", 16) // (nil, nil)
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP {
0 OP b := &Batch{}
0 OP b.ReverseScan(ctx, /Table/50/"4ef03a54", /Table/50/"96fa1fe1", 5) // ("v-108", nil)
0 OP b.ReverseScan(ctx, /Table/50/"160857e5", /Table/50/"7229e788", 13) // ("v-90", nil)
0 OP b.ReverseScan(ctx, /Table/50/"255cb230", /Table/50/"4be9de4f", 20) // (nil, nil)
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP txn.Put(ctx, /Table/50/"01620abe", v-131) // nil
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342268.640461000,0
I200408 10:37:48.641316 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"c8ec25eb" 1586342267.829756000,1 -> /BYTES/v-64 (prev /<empty>)
I200408 10:37:48.641363 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"c977b30a" 1586342267.792129000,1 -> /BYTES/v-46 (prev /<empty>)
I200408 10:37:48.641409 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"d5a5cada" 1586342267.814204000,0 -> /BYTES/v-50 (prev /<empty>)
I200408 10:37:48.641430 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"dc8ac12d" 1586342267.801999000,1 -> /BYTES/v-48 (prev /<empty>)
I200408 10:37:48.645288 1007 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.659696 1005 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.659730 1006 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.661394 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.660018000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP {
0 OP b := &Batch{}
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP txn.Put(ctx, /Table/50/"e304e678", v-147) // nil
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342268.661374000,0
I200408 10:37:48.666926 1007 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.666936 1008 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.667165 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.667083000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342268.667150000,0
I200408 10:37:48.674635 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"c977b30a" 1586342268.674429000,0 -> /BYTES/v-148 (prev /BYTES/v-46)
I200408 10:37:48.674662 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.674410000,0
0 OP db0.Put(ctx, /Table/50/"c977b30a", v-148) // nil
after: 1586342268.674644000,0
I200408 10:37:48.684177 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.683468000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP {
0 OP b := &Batch{}
0 OP b.ReverseScan(ctx, /Table/50/"07764bc7", /Table/50/"1991ffee", 5) // ("v-102", nil)
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP txn.Put(ctx, /Table/50/"a9445e6b", v-149) // nil
0 OP return nil
0 OP }) // nil txnpb:("unnamed" meta={id=27df6598 key=/Table/50/"a9445e6b" pri=0.01632562 epo=0 ts=1586342268.683469000,0 min=1586342268.683469000,0 seq=2} lock=true stat=COMMITTED rts=1586342268.683469000,0 wto=false max=1586342269.183469000,0 ifw=1)
after: 1586342268.684094000,0
I200408 10:37:48.684511 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a9445e6b" 1586342268.683469000,0 -> /BYTES/v-149 (prev /<empty>)
I200408 10:37:48.691237 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"ac4c4c88" 1586342268.690817000,0 -> /BYTES/v-150 (prev /<empty>)
I200408 10:37:48.691349 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.690794000,0
0 OP db0.Put(ctx, /Table/50/"ac4c4c88", v-150) // nil
after: 1586342268.691309000,0
I200408 10:37:48.698789 1008 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.698847 1007 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.698851 1005 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.698960 1006 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.699538 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.699078000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP {
0 OP b := &Batch{}
0 OP b.Put(ctx, /Table/50/"a9dc77f9", v-151) // nil
0 OP b.Put(ctx, /Table/50/"85fa2c1f", v-152) // nil
0 OP b.Put(ctx, /Table/50/"93349c91", v-153) // nil
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP return nil
0 OP }) // nil txnpb:("unnamed" meta={id=534e8efb key=/Table/50/"a9dc77f9" pri=0.00274340 epo=0 ts=1586342268.699079000,0 min=1586342268.699079000,0 seq=4} lock=true stat=COMMITTED rts=1586342268.699079000,0 wto=false max=1586342269.199079000,0 ifw=3)
after: 1586342268.699489000,0
I200408 10:37:48.699823 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"93349c91" 1586342268.699079000,0 -> /BYTES/v-153 (prev /<empty>)
I200408 10:37:48.699891 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a9dc77f9" 1586342268.699079000,0 -> /BYTES/v-151 (prev /BYTES/v-76)
I200408 10:37:48.699955 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"85fa2c1f" 1586342268.699079000,0 -> /BYTES/v-152 (prev /BYTES/v-108)
I200408 10:37:48.699993 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"294bca1d" 1586342268.699703000,0 -> /BYTES/v-154 (prev /BYTES/v-128)
I200408 10:37:48.700008 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.699689000,0
0 OP db0.Put(ctx, /Table/50/"294bca1d", v-154) // nil
after: 1586342268.699988000,0
I200408 10:37:48.700238 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.700177000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342268.700227000,0
I200408 10:37:48.701677 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.700424000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP {
0 OP b := &Batch{}
0 OP b.Put(ctx, /Table/50/"6683d9a8", v-155) // nil
0 OP b.Put(ctx, /Table/50/"9a1490b6", v-156) // nil
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP {
0 OP b := &Batch{}
0 OP b.Put(ctx, /Table/50/"45c50601", v-157) // nil
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342268.701644000,0
I200408 10:37:48.716981 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.716483000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP {
0 OP b := &Batch{}
0 OP b.Put(ctx, /Table/50/"8ec423de", v-158) // nil
0 OP b.Put(ctx, /Table/50/"a5e42545", v-159) // nil
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP {
0 OP b := &Batch{}
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP return nil
0 OP }) // nil txnpb:("unnamed" meta={id=8732d5dd key=/Table/50/"8ec423de" pri=0.03143982 epo=0 ts=1586342268.716484000,0 min=1586342268.716484000,0 seq=3} lock=true stat=COMMITTED rts=1586342268.716484000,0 wto=false max=1586342269.216484000,0 ifw=2)
after: 1586342268.716924000,0
I200408 10:37:48.717492 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"a5e42545" 1586342268.716484000,0 -> /BYTES/v-159 (prev /<empty>)
I200408 10:37:48.717536 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"8ec423de" 1586342268.716484000,0 -> /BYTES/v-158 (prev /<empty>)
I200408 10:37:48.723524 1005 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.723542 1008 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.723524 1007 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.723939 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.723848000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP return nil
0 OP }) // nil txnpb:("unnamed" meta={id=b24dfaab key=/Min pri=0.00001602 epo=0 ts=1586342268.723850000,0 min=1586342268.723850000,0 seq=0} lock=false stat=COMMITTED rts=1586342268.723850000,0 wto=false max=1586342269.223850000,0)
after: 1586342268.723876000,0
I200408 10:37:48.732245 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.732162000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342268.732225000,0
I200408 10:37:48.742213 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.740490000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP txn.Put(ctx, /Table/50/"b07bb92d", v-160) // nil
0 OP {
0 OP b := &Batch{}
0 OP b.Scan(ctx, /Table/50/"b8e30ec1", /Table/50/"e8c7953b", 21) // ("v-64", nil)
0 OP b.ReverseScan(ctx, /Table/50/"f436831a", /Table/50/"f5144c79", 13) // (nil, nil)
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP {
0 OP b := &Batch{}
0 OP b.Put(ctx, /Table/50/"1d02607d", v-161) // nil
0 OP b.Put(ctx, /Table/50/"d4dd2e4b", v-162) // nil
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP return nil
0 OP }) // nil txnpb:("unnamed" meta={id=00c23124 key=/Table/50/"b07bb92d" pri=0.01723678 epo=0 ts=1586342268.740491000,0 min=1586342268.740491000,0 seq=4} lock=true stat=COMMITTED rts=1586342268.740491000,0 wto=false max=1586342269.240491000,0 ifw=3)
after: 1586342268.742137000,0
I200408 10:37:48.742552 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"d4dd2e4b" 1586342268.740491000,0 -> /BYTES/v-162 (prev /<empty>)
I200408 10:37:48.742602 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"b07bb92d" 1586342268.740491000,0 -> /BYTES/v-160 (prev /<empty>)
I200408 10:37:48.751134 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"1d02607d" 1586342268.740491000,0 -> /BYTES/v-161 (prev /BYTES/v-41)
I200408 10:37:48.751423 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.751267000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP {
0 OP b := &Batch{}
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP {
0 OP b := &Batch{}
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP txn.Scan(ctx, /Table/50/"00e424ae", /Table/50/"13c0611f", 10) // ("v-124", nil)
0 OP return nil
0 OP }) // nil txnpb:("unnamed" meta={id=d0cbd73f key=/Min pri=0.04325230 epo=0 ts=1586342268.751268000,0 min=1586342268.751268000,0 seq=0} lock=false stat=COMMITTED rts=1586342268.751268000,0 wto=false max=1586342269.251268000,0)
after: 1586342268.751395000,0
I200408 10:37:48.759095 1005 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.759111 1007 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.759121 1006 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.759121 1008 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.759145 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.759076000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342268.759130000,0
I200408 10:37:48.759334 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.759295000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP return errors.New("rollback")
0 OP }) // rollback
after: 1586342268.759326000,0
I200408 10:37:48.759731 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.759409000,0
0 OP db0.Txn(ctx, func(ctx context.Context, txn *kv.Txn) error {
0 OP txn.ReverseScan(ctx, /Table/50/"0218934e", /Table/50/"c12a3bc7", 22) // ("v-160", nil)
0 OP {
0 OP b := &Batch{}
0 OP b.ReverseScan(ctx, /Table/50/"023f97ad", /Table/50/"15d82f6e", 32) // ("v-146", nil)
0 OP txn.Run(ctx, b) // nil
0 OP }
0 OP return nil
0 OP }) // nil txnpb:("unnamed" meta={id=c80cd9cc key=/Min pri=0.02869158 epo=0 ts=1586342268.759410000,0 min=1586342268.759410000,0 seq=0} lock=false stat=COMMITTED rts=1586342268.759410000,0 wto=false max=1586342269.259410000,0)
after: 1586342268.759702000,0
I200408 10:37:48.759980 1004 kv/kvnemesis/kvnemesis.go:65
before: 1586342268.759803000,0
0 OP db0.Put(ctx, /Table/50/"f88c2c9f", v-163) // nil
after: 1586342268.759967000,0
I200408 10:37:48.759992 998 kv/kvnemesis/watcher.go:165 rangefeed Put /Table/50/"f88c2c9f" 1586342268.759815000,0 -> /BYTES/v-163 (prev /<empty>)
I200408 10:37:48.768035 1004 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
I200408 10:37:48.768036 1007 kv/kvserver/replica_command.go:663 [n1,s1,r41/1:/Table/50/"{2ec95ba…-df34593…}] initiating a merge of r39:/{Table/50/"df345931"-Max} [(n1,s1):1, next=2, gen=6, sticky=9223372036.854775807,2147483647] into this range (manual)
panic: expected latches held, found none [recovered]
panic: expected latches held, found none [recovered]
panic: expected latches held, found none
goroutine 2534 [running]:
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).Recover(0xc0002cea20, 0x7e00c80, 0xc0013a09f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:183 +0x11f
panic(0x6fd0c60, 0x7d37080)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/panic.go:679 +0x1b2
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send.func1(0xc0010a56b8, 0xc0010a5740, 0xc0010a5738, 0xc000579c00, 0x1603d1e37e88ee18, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:115 +0x1f9
panic(0x6fd0c60, 0x7d37080)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/panic.go:679 +0x1b2
github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*Guard).AssertLatches(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/concurrency_manager.go:469
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries(0xc00057a300, 0x7e00c80, 0xc0013a0a80, 0xc001743d00, 0x76f24f0, 0x0, 0xc0013b2e60)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:249 +0xdec
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithRangeID(0xc00057a300, 0x7e00c80, 0xc0013a0a50, 0x1, 0xc001743d00, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:98 +0x2f3
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send(0xc00057a300, 0x7e00c80, 0xc0013a0a50, 0x1603d1e37e7b5d70, 0x0, 0x100000001, 0x1, 0x0, 0x1, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:36 +0x91
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send(0xc000579c00, 0x7e00c80, 0xc0013a09f0, 0x1603d1e37e7b5d70, 0x0, 0x100000001, 0x1, 0x0, 0x1, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:202 +0x606
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send(0xc00027dea0, 0x7e00c80, 0xc0013a09f0, 0x1603d1e37e7b5d70, 0x0, 0x100000001, 0x1, 0x0, 0x1, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:188 +0xed
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1(0x7e00c80, 0xc0013a09f0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:922 +0x201
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0002cea20, 0x7e00c80, 0xc0013a09f0, 0x75970dd, 0x10, 0xc001007b88, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:302 +0x140
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal(0xc000108a00, 0x7e00c80, 0xc0013a09f0, 0xc001743c80, 0xc0013a09f0, 0x80, 0x80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:910 +0x194
github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch(0xc000108a00, 0x7e00c80, 0xc0013a09c0, 0xc001743c80, 0xc0013a0960, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:948 +0x9f
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:537
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch(0xc0015fa1c0, 0x7e00c80, 0xc0013a09c0, 0x1, 0x7dc7ac0, 0xc0002e4e10, 0x1603d1e37e7b5d70, 0x0, 0x100000001, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:199 +0x127
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext(0xc0015fa1c0, 0x7e00c80, 0xc0013a0960, 0x1603d1e37e7b5d70, 0x0, 0x100000001, 0x1, 0x0, 0x1, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:168 +0x160
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas(0xc0003225a0, 0x7e00c80, 0xc0013a0960, 0x1603d1e37e7b5d70, 0x0, 0x0, 0x0, 0x0, 0x1, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1625 +0x2a2
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendRPC(0xc0003225a0, 0x7e00c80, 0xc0013a0960, 0x1603d1e37e7b5d70, 0x0, 0x0, 0x0, 0x0, 0x1, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:456 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendSingleRange(0xc0003225a0, 0x7e00c80, 0xc0013a0960, 0x1603d1e37e7b5d70, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:538 +0x2ee
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch(0xc0003225a0, 0x7e00c80, 0xc0013a0960, 0x1603d1e37e7b5d70, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1394 +0x3cf
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges(0xc0003225a0, 0x7e00c80, 0xc0013a0960, 0x1603d1e37e7b5d70, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1079 +0x164a
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send(0xc0003225a0, 0x7e00c80, 0xc0013a0960, 0x1603d1e37e7b5d70, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:730 +0x785
github.com/cockroachdb/cockroach/pkg/kv.lookupRangeFwdScan(0x7e00c80, 0xc0013a0960, 0x7d87bc0, 0xc0003225a0, 0xc00032c6d0, 0xc, 0x10, 0x1, 0x8, 0x1dcd6500, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/range_lookup.go:328 +0x404
github.com/cockroachdb/cockroach/pkg/kv.RangeLookup(0x7e00c80, 0xc0013a0960, 0x7d87bc0, 0xc0003225a0, 0xc00032c6d0, 0xc, 0x10, 0x1, 0x8, 0x456ee00, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/range_lookup.go:198 +0x8c5
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeLookup(0xc0003225a0, 0x7e00c80, 0xc0013a0960, 0xc00032c6d0, 0xc, 0x10, 0x7e00c00, 0xc0013a0960, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:379 +0xd4
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*RangeDescriptorCache).performRangeLookup(0xc0002b08c0, 0x7e00c80, 0xc0013a0960, 0xc00032c6d0, 0xc, 0x10, 0x7e67200, 0xc00023a1c0, 0xc000668574, 0x3, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/range_cache.go:449 +0x285
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*RangeDescriptorCache).lookupRangeDescriptorInternal.func3(0x0, 0x0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/range_cache.go:322 +0x14a
github.com/cockroachdb/cockroach/pkg/util/syncutil/singleflight.(*Group).doCall(0xc0002b08f8, 0xc0013b2dc0, 0xc0002f9520, 0x12, 0xc001b05fc0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/syncutil/singleflight/singleflight.go:128 +0x2e
created by github.com/cockroachdb/cockroach/pkg/util/syncutil/singleflight.(*Group).DoChan
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/syncutil/singleflight/singleflight.go:121 +0x2bc
goroutine 1 [chan receive]:
testing.(*T).Run(0xc00049e300, 0x75a819f, 0x17, 0x76f23c8, 0x40c6901)
/usr/local/Cellar/go/1.13.4/libexec/src/testing/testing.go:961 +0x377
testing.runTests.func1(0xc00049e200)
/usr/local/Cellar/go/1.13.4/libexec/src/testing/testing.go:1202 +0x78
testing.tRunner(0xc00049e200, 0xc0006cdda0)
/usr/local/Cellar/go/1.13.4/libexec/src/testing/testing.go:909 +0xc9
testing.runTests(0xc000245700, 0x9cfa320, 0x7, 0x7, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/testing/testing.go:1200 +0x2a7
testing.(*M).Run(0xc0001e6200, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/testing/testing.go:1117 +0x176
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.TestMain(0xc0001e6200)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/main_test.go:30 +0xb6
main.main()
_testmain.go:54 +0x135
goroutine 7 [syscall]:
os/signal.signal_recv(0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sigqueue.go:144 +0x96
os/signal.loop()
/usr/local/Cellar/go/1.13.4/libexec/src/os/signal/signal_unix.go:23 +0x22
created by os/signal.init.0
/usr/local/Cellar/go/1.13.4/libexec/src/os/signal/signal_unix.go:29 +0x41
goroutine 8 [chan receive]:
github.com/cockroachdb/cockroach/pkg/util/log.flushDaemon()
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/log/log_flush.go:73 +0x73
created by github.com/cockroachdb/cockroach/pkg/util/log.init.7
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/log/log_flush.go:45 +0x35
goroutine 9 [chan receive]:
github.com/cockroachdb/cockroach/pkg/util/log.signalFlusher()
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/log/log_flush.go:100 +0x124
created by github.com/cockroachdb/cockroach/pkg/util/log.init.7
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/log/log_flush.go:46 +0x4d
goroutine 21 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1(0x7e00c80, 0xc00065a930)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:100 +0x13f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e42d0, 0xc0002cea20, 0xc0002e42c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 15 [select]:
github.com/cockroachdb/cockroach/vendor/go.opencensus.io/stats/view.(*worker).start(0xc0005e1200)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/go.opencensus.io/stats/view/worker.go:152 +0xdd
created by github.com/cockroachdb/cockroach/vendor/go.opencensus.io/stats/view.init.0
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/go.opencensus.io/stats/view/worker.go:29 +0x57
goroutine 53 [chan receive]:
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc000aa8580)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/clientconn.go:1107 +0x656
created by github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc.(*addrConn).connect
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/clientconn.go:767 +0x120
goroutine 99 [semacquire]:
sync.runtime_Semacquire(0xc0019d5900)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:56 +0x42
sync.(*WaitGroup).Wait(0xc0019d58f8)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/waitgroup.go:130 +0x64
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Wait(0xc0019d58f0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:40 +0x31
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait(0xc0019d58f0, 0x7e00bc0, 0xc001aed900, 0xc000365fc0, 0xc001aed900)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:142 +0x57
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.GroupWorkers(0x7e00c00, 0xc000052110, 0x5, 0xc001aed8c0, 0x1, 0x7dc79c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:177 +0x114
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.RunNemesis(0x7e00c00, 0xc000052110, 0xc001a39800, 0x7dc79c0, 0xc000364460, 0x1, 0x0, 0x0, 0x1, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/kvnemesis.go:70 +0x35c
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.TestKVNemesisSingleNode(0xc00049e300)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/kvnemesis_test.go:44 +0x38a
testing.tRunner(0xc00049e300, 0x76f23c8)
/usr/local/Cellar/go/1.13.4/libexec/src/testing/testing.go:909 +0xc9
created by testing.(*T).Run
/usr/local/Cellar/go/1.13.4/libexec/src/testing/testing.go:960 +0x350
goroutine 100 [select]:
github.com/cockroachdb/cockroach/pkg/security.(*CertificateManager).RegisterSignalHandler.func1(0xc0002cea20, 0xc00057c6e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/security/certificate_manager.go:175 +0x148
created by github.com/cockroachdb/cockroach/pkg/security.(*CertificateManager).RegisterSignalHandler
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/security/certificate_manager.go:172 +0x49
goroutine 101 [chan receive]:
github.com/cockroachdb/cockroach/pkg/rpc.NewContextWithTestingKnobs.func1(0x7e00c80, 0xc0005c68d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:475 +0x51
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e58d0, 0xc0002cea20, 0xc000230da0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 102 [select]:
github.com/cockroachdb/cockroach/pkg/gossip.newInfoStore.func1(0x7e00c80, 0xc0004b6210)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/gossip/infostore.go:190 +0x169
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e59a0, 0xc0002cea20, 0xc0002e5990)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 103 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc0004db4a8, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc0004db498)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/storage.(*RocksDB).syncLoop(0xc0004db380)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/storage/rocksdb.go:678 +0x80
created by github.com/cockroachdb/cockroach/pkg/storage.(*RocksDB).open
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/storage/rocksdb.go:665 +0x316
goroutine 2080 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc001a6d560, 0x0, 0x1, 0xc000e04f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc0013ea5a0, 0x0, 0xc0000b4800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000561d40, 0x33, 0x0, 0x0, 0xc00197f830)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 115 [chan receive]:
github.com/cockroachdb/cockroach/pkg/util/netutil.MakeServer.func2(0x7e00c80, 0xc000872210)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/netutil/net.go:107 +0x64
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002c82e0, 0xc0002cea20, 0xc0002f00c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 22 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1(0x7e00c80, 0xc0005c6cc0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:100 +0x13f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e42f0, 0xc0002cea20, 0xc0002e42e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 23 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1(0x7e00c80, 0xc0004b62d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:100 +0x13f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4310, 0xc0002cea20, 0xc0002e4300)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 24 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1(0x7e00c80, 0xc0001a9260)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:100 +0x13f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4330, 0xc0002cea20, 0xc0002e4320)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 25 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1(0x7e00c80, 0xc0004ba1b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:100 +0x13f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4350, 0xc0002cea20, 0xc0002e4340)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 26 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1(0x7e00c80, 0xc0004b40c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:100 +0x13f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4380, 0xc0002cea20, 0xc0002e4360)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 27 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1(0x7e00c80, 0xc00065a8d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:100 +0x13f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e43b0, 0xc0002cea20, 0xc0002e4390)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 28 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1(0x7e00c80, 0xc0004ba000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:100 +0x13f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e43e0, 0xc0002cea20, 0xc0002e43c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 29 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1(0x7e00c80, 0xc0004b6300)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:100 +0x13f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4400, 0xc0002cea20, 0xc0002e43f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 30 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1(0x7e00c80, 0xc00065a9f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:100 +0x13f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4430, 0xc0002cea20, 0xc0002e4420)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 31 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1(0x7e00c80, 0xc0002d6330)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:100 +0x13f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4460, 0xc0002cea20, 0xc0002e4450)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 32 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1(0x7e00c80, 0xc0004b6240)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:100 +0x13f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e44d0, 0xc0002cea20, 0xc0002e44c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 33 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1(0x7e00c80, 0xc00048c000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:100 +0x13f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4500, 0xc0002cea20, 0xc0002e44e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 130 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1(0x7e00c80, 0xc0005ca150)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:100 +0x13f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4520, 0xc0002cea20, 0xc0002e4510)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 131 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1(0x7e00c80, 0xc0004b6270)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:100 +0x13f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4550, 0xc0002cea20, 0xc0002e4540)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 132 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1(0x7e00c80, 0xc0004b62a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:100 +0x13f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4580, 0xc0002cea20, 0xc0002e4570)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 133 [select]:
github.com/cockroachdb/cockroach/pkg/util/log.(*loggerT).gcDaemon(0xc0002f2c40, 0x7e00bc0, 0xc000ae2a80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/log/log_gc.go:44 +0xcc
created by github.com/cockroachdb/cockroach/pkg/util/log.NewSecondaryLogger
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/log/secondary_log.go:87 +0x2b6
goroutine 134 [select]:
github.com/cockroachdb/cockroach/pkg/util/log.(*loggerT).gcDaemon(0xc0002f2cb0, 0x7e00bc0, 0xc000ae2a80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/log/log_gc.go:44 +0xcc
created by github.com/cockroachdb/cockroach/pkg/util/log.NewSecondaryLogger
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/log/secondary_log.go:87 +0x2b6
goroutine 135 [select]:
github.com/cockroachdb/cockroach/pkg/util/log.(*loggerT).gcDaemon(0xc0002f2d20, 0x7e00bc0, 0xc000ae2a80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/log/log_gc.go:44 +0xcc
created by github.com/cockroachdb/cockroach/pkg/util/log.NewSecondaryLogger
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/log/secondary_log.go:87 +0x2b6
goroutine 136 [select]:
github.com/cockroachdb/cockroach/pkg/util/log.(*loggerT).gcDaemon(0xc0002f2d90, 0x7e00bc0, 0xc000ae2a80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/log/log_gc.go:44 +0xcc
created by github.com/cockroachdb/cockroach/pkg/util/log.NewSecondaryLogger
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/log/secondary_log.go:87 +0x2b6
goroutine 137 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*LeaseManager).RefreshLeases.func1(0x7e00c80, 0xc00065b560)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/lease.go:1776 +0x369
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4ba0, 0xc0002cea20, 0xc0004f06c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 138 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*LeaseManager).PeriodicallyRefreshSomeLeases.func1(0x7e00c80, 0xc000872000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/lease.go:1857 +0x275
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4bc0, 0xc0002cea20, 0xc0002e4bb0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 139 [select]:
github.com/cockroachdb/cockroach/pkg/util/hlc.(*Clock).StartMonitoringForwardClockJumps.func1(0x76f8eb8, 0xc0002922d0, 0xc00005f570, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/hlc/hlc.go:181 +0x11a
created by github.com/cockroachdb/cockroach/pkg/util/hlc.(*Clock).StartMonitoringForwardClockJumps
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/hlc/hlc.go:174 +0x104
goroutine 140 [chan receive]:
github.com/cockroachdb/cockroach/pkg/util/netutil.MakeServer.func2(0x7e00c80, 0xc00048c060)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/netutil/net.go:107 +0x64
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4e70, 0xc0002cea20, 0xc0002e9ec0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 141 [chan receive]:
github.com/cockroachdb/cockroach/pkg/server.(*Server).startServeUI.func1(0x7e00c80, 0xc00048c030)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:1997 +0x53
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4ec0, 0xc0002cea20, 0xc0002e9f00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 142 [IO wait]:
internal/poll.runtime_pollWait(0xb350d68, 0x72, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/netpoll.go:184 +0x55
internal/poll.(*pollDesc).wait(0xc000abeb98, 0x72, 0x0, 0x0, 0x757fe30)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Accept(0xc000abeb80, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_unix.go:384 +0x1f8
net.(*netFD).accept(0xc000abeb80, 0xc0004d9c00, 0xb3021f0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/net/fd_unix.go:238 +0x42
net.(*TCPListener).accept(0xc0002e9ee0, 0x400f088, 0x10, 0x403063a)
/usr/local/Cellar/go/1.13.4/libexec/src/net/tcpsock_posix.go:139 +0x32
net.(*TCPListener).Accept(0xc0002e9ee0, 0xc0000522c0, 0x30, 0xc000872030, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/net/tcpsock.go:261 +0x47
github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/cmux.(*cMux).Serve(0xc000ae2c80, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:124 +0xaf
github.com/cockroachdb/cockroach/pkg/server.(*Server).startServeUI.func2(0x7e00c80, 0xc000872030)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:2010 +0x2f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4ed0, 0xc0002cea20, 0xc0002e9f60)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 143 [chan receive]:
github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/cmux.muxListener.Accept(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:184
net/http.(*Server).Serve(0xc0001ae620, 0x7ded700, 0xc0002e9f20, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/net/http/server.go:2896 +0x286
github.com/cockroachdb/cockroach/pkg/server.(*Server).startServeUI.func3(0x7e00c80, 0xc000872090)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:2026 +0x127
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4ee0, 0xc0002cea20, 0xc0004f0960)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 144 [chan receive]:
github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/cmux.muxListener.Accept(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:184
crypto/tls.(*listener).Accept(0xc0002e9f80, 0x7369680, 0xc0008722d0, 0x70b2d60, 0x9cd7c60)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/tls.go:59 +0x37
net/http.(*Server).Serve(0xc000264380, 0x7dd6200, 0xc0002e9f80, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/net/http/server.go:2896 +0x286
github.com/cockroachdb/cockroach/pkg/server.(*Server).startServeUI.func4(0x7e00c80, 0xc000872240)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:2037 +0x3f
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4ef0, 0xc0002cea20, 0xc0002e9fa0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 145 [chan receive]:
github.com/cockroachdb/cockroach/pkg/server.(*Server).startListenRPCAndSQL.func1(0x7e00c80, 0xc000872060)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:1895 +0x53
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4f20, 0xc0002cea20, 0xc0002e9fe0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 146 [chan receive]:
github.com/cockroachdb/cockroach/pkg/server.(*Server).startListenRPCAndSQL.func3(0x7e00c80, 0xc0002d63c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:1952 +0x7c
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4f40, 0xc0002cea20, 0xc000ae2d00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 147 [chan receive]:
github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/cmux.muxListener.Accept(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:184
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc.(*Server).Serve(0xc0004be480, 0x7ded700, 0xc000245740, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/server.go:587 +0x22e
github.com/cockroachdb/cockroach/pkg/server.(*Server).startListenRPCAndSQL.func4(0x7e00c80, 0xc0002d63f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:1967 +0x46
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4f50, 0xc0002cea20, 0xc000245e00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 148 [chan receive]:
github.com/cockroachdb/cockroach/pkg/server.(*Server).Start.func1(0x7e00c80, 0xc0002d6360)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:1385 +0x7c
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4f90, 0xc0002cea20, 0xc0004f0c30)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 70 [select]:
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00061e000, 0x1, 0x0, 0x0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:317 +0x11a
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0008a60c0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:435 +0x1e3
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc000988000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:330 +0x7b
created by github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:328 +0xee5
goroutine 150 [select]:
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000ae2f00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:115 +0x10f
created by github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc.newCCBalancerWrapper
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:106 +0x169
goroutine 151 [chan receive]:
github.com/cockroachdb/cockroach/pkg/server.(*Server).Start.func4(0x7e00c80, 0xc00065b890)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:1415 +0x53
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e5080, 0xc0002cea20, 0xc00023a4c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 69 [select]:
net.(*pipe).read(0xc000abed00, 0xc0000e4900, 0x888, 0x888, 0x203000, 0x0, 0x883)
/usr/local/Cellar/go/1.13.4/libexec/src/net/pipe.go:164 +0x19b
net.(*pipe).Read(0xc000abed00, 0xc0000e4900, 0x888, 0x888, 0xc0000e4905, 0xa, 0x10)
/usr/local/Cellar/go/1.13.4/libexec/src/net/pipe.go:147 +0x4d
crypto/tls.(*atLeastReader).Read(0xc00025ede0, 0xc0000e4900, 0x888, 0x888, 0x1f, 0x7d879a0, 0xc000712a50)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:780 +0x60
bytes.(*Buffer).ReadFrom(0xc0008ac258, 0x7d876e0, 0xc00025ede0, 0x400c725, 0x711ba60, 0x73b4320)
/usr/local/Cellar/go/1.13.4/libexec/src/bytes/buffer.go:204 +0xb4
crypto/tls.(*Conn).readFromUntil(0xc0008ac000, 0x12212060, 0xc000abed00, 0x5, 0xc000abed00, 0x9)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:802 +0xec
crypto/tls.(*Conn).readRecordOrCCS(0xc0008ac000, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:609 +0x124
crypto/tls.(*Conn).readRecord(...)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:577
crypto/tls.(*Conn).Read(0xc0008ac000, 0xc000cbe000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:1255 +0x161
bufio.(*Reader).Read(0xc00088e780, 0xc000330ff8, 0x9, 0x9, 0xc0004a8400, 0xb3028b8, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/bufio/bufio.go:226 +0x26a
io.ReadAtLeast(0x7d87520, 0xc00088e780, 0xc000330ff8, 0x9, 0x9, 0x9, 0x4642038, 0xc00065bb00, 0xc000650004)
/usr/local/Cellar/go/1.13.4/libexec/src/io/io.go:310 +0x87
io.ReadFull(...)
/usr/local/Cellar/go/1.13.4/libexec/src/io/io.go:329
github.com/cockroachdb/cockroach/vendor/golang.org/x/net/http2.readFrameHeader(0xc000330ff8, 0x9, 0x9, 0x7d87520, 0xc00088e780, 0x0, 0x0, 0xc00065bb00, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/net/http2/frame.go:237 +0x87
github.com/cockroachdb/cockroach/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc000330fc0, 0xc00065bb00, 0xc00065bb00, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/net/http2/frame.go:492 +0xa1
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000988000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1237 +0x17e
created by github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:286 +0xd48
goroutine 152 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc0004957a8, 0x36c)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000495798)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/storage.(*RocksDB).syncLoop(0xc000495680)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/storage/rocksdb.go:678 +0x80
created by github.com/cockroachdb/cockroach/pkg/storage.(*RocksDB).open
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/storage/rocksdb.go:665 +0x316
goroutine 153 [select]:
github.com/cockroachdb/cockroach/pkg/server.(*Node).startAssertEngineHealth.func1(0x7e00c80, 0xc0002d6480)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node_engine_health.go:43 +0x17a
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e5290, 0xc0002cea20, 0xc0004f0e10)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 154 [chan receive]:
github.com/cockroachdb/cockroach/pkg/gossip.(*server).start.func3(0x7e00c80, 0xc0002d64b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/gossip/server.go:383 +0x5a
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e5300, 0xc0002cea20, 0xc000287fa0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 155 [select]:
github.com/cockroachdb/cockroach/pkg/gossip.(*Gossip).bootstrap.func1(0x7e00c80, 0xc0002d6510)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/gossip/gossip.go:1361 +0x3f7
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e5320, 0xc0002cea20, 0xc0002e5310)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 156 [select]:
github.com/cockroachdb/cockroach/pkg/gossip.(*Gossip).manage.func1(0x7e00c80, 0xc000872300)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/gossip/gossip.go:1396 +0x3a2
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e5360, 0xc0002cea20, 0xc0002e5350)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 157 [IO wait]:
internal/poll.runtime_pollWait(0xb350e38, 0x72, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/netpoll.go:184 +0x55
internal/poll.(*pollDesc).wait(0xc0001e6318, 0x72, 0x0, 0x0, 0x757fe30)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Accept(0xc0001e6300, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_unix.go:384 +0x1f8
net.(*netFD).accept(0xc0001e6300, 0x37e11d600, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/net/fd_unix.go:238 +0x42
net.(*TCPListener).accept(0xc00023a160, 0xc000cb5d50, 0xc000cb5d58, 0x28)
/usr/local/Cellar/go/1.13.4/libexec/src/net/tcpsock_posix.go:139 +0x32
net.(*TCPListener).Accept(0xc00023a160, 0x76f5cf0, 0xc000ae2cc0, 0x7e4f060, 0xc0000100e0)
/usr/local/Cellar/go/1.13.4/libexec/src/net/tcpsock.go:261 +0x47
github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/cmux.(*cMux).Serve(0xc000ae2cc0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:124 +0xaf
github.com/cockroachdb/cockroach/pkg/server.(*Server).startListenRPCAndSQL.func5.1.1()
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:1977 +0x2f
sync.(*Once).doSlow(0xc00059ea30, 0xc00066b6d0)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/once.go:66 +0xe3
sync.(*Once).Do(...)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/once.go:57
github.com/cockroachdb/cockroach/pkg/server.(*Server).startListenRPCAndSQL.func5.1(0x7e00c80, 0xc00065ba10)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:1976 +0x73
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e5370, 0xc0002cea20, 0xc000287fc0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 55 [select]:
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00036adc0, 0x1, 0x0, 0x0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:317 +0x11a
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000a6e000, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:435 +0x1e3
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc00041d500)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:276 +0xcb
created by github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:273 +0xfa4
goroutine 56 [select]:
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc00041d500)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:935 +0x218
created by github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:282 +0xfc9
goroutine 57 [select]:
net.(*pipe).read(0xc000abec80, 0xc00030e800, 0x775, 0x775, 0x203000, 0xb3477a8, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/net/pipe.go:164 +0x19b
net.(*pipe).Read(0xc000abec80, 0xc00030e800, 0x775, 0x775, 0xc00030e801, 0x100000000000a, 0x10)
/usr/local/Cellar/go/1.13.4/libexec/src/net/pipe.go:147 +0x4d
crypto/tls.(*atLeastReader).Read(0xc0002c0000, 0xc00030e800, 0x775, 0x775, 0x1f, 0x7d879a0, 0xc0009a19a8)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:780 +0x60
bytes.(*Buffer).ReadFrom(0xc00067c5d8, 0x7d876e0, 0xc0002c0000, 0x400c725, 0x711ba60, 0x73b4320)
/usr/local/Cellar/go/1.13.4/libexec/src/bytes/buffer.go:204 +0xb4
crypto/tls.(*Conn).readFromUntil(0xc00067c380, 0x12212060, 0xc000abec80, 0x5, 0xc000abec80, 0x9)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:802 +0xec
crypto/tls.(*Conn).readRecordOrCCS(0xc00067c380, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:609 +0x124
crypto/tls.(*Conn).readRecord(...)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:577
crypto/tls.(*Conn).Read(0xc00067c380, 0xc000cde000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:1255 +0x161
bufio.(*Reader).Read(0xc0009765a0, 0xc0002c4c78, 0x9, 0x9, 0xc00067e000, 0xb300d98, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/bufio/bufio.go:226 +0x26a
io.ReadAtLeast(0x7d87520, 0xc0009765a0, 0xc0002c4c78, 0x9, 0x9, 0x9, 0x4642038, 0xc000a74030, 0xc000a70004)
/usr/local/Cellar/go/1.13.4/libexec/src/io/io.go:310 +0x87
io.ReadFull(...)
/usr/local/Cellar/go/1.13.4/libexec/src/io/io.go:329
github.com/cockroachdb/cockroach/vendor/golang.org/x/net/http2.readFrameHeader(0xc0002c4c78, 0x9, 0x9, 0x7d87520, 0xc0009765a0, 0x0, 0x0, 0xc000a74030, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/net/http2/frame.go:237 +0x87
github.com/cockroachdb/cockroach/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0002c4c40, 0xc000a74030, 0xc000a74030, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/net/http2/frame.go:492 +0xa1
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc00041d500, 0xc00048ce40, 0x76f7ae0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:431 +0x86
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc0004be480, 0x7e54460, 0xc00041d500)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/server.go:713 +0xf3
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc0004be480, 0x7e54460, 0xc00041d500)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/server.go:675 +0x43
created by github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc.(*Server).handleRawConn
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/server.go:674 +0x5e0
goroutine 158 [semacquire]:
sync.runtime_SemacquireMutex(0xc00059ea38, 0x0, 0x1)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:71 +0x47
sync.(*Mutex).lockSlow(0xc00059ea34)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/mutex.go:138 +0xfc
sync.(*Mutex).Lock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/mutex.go:81
sync.(*Once).doSlow(0xc00059ea30, 0xc00073ced0)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/once.go:62 +0x122
sync.(*Once).Do(...)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/once.go:57
github.com/cockroachdb/cockroach/pkg/server.(*Server).startListenRPCAndSQL.func5.1(0x7e00c80, 0xc0005c6d50)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:1976 +0x73
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e56f0, 0xc0002cea20, 0xc0002ca100)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 159 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/closedts/provider.(*Provider).runCloser(0xc00024cd90, 0x7e00c80, 0xc00065bb30)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/closedts/provider/provider.go:136 +0x375
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e5850, 0xc0002cea20, 0xc0002e5840)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 163 [chan receive]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/closedts/provider.(*Provider).Notify.func1(0x7e00c80, 0xc00065bb60)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/closedts/provider/provider.go:220 +0x147
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00022a510, 0xc0002cea20, 0xc00025ee00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 160 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).run(0xc000503680, 0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:464 +0x390
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0005a0810, 0x22, 0x0, 0x0, 0xc0002e5f90)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 161 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).run(0xc0005037a0, 0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:464 +0x390
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0005a08d0, 0x22, 0x0, 0x0, 0xc0002e5fa0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 178 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).run(0xc000503b00, 0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:464 +0x390
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0005a0990, 0x28, 0x0, 0x0, 0xc0002e5fd0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 179 [chan receive]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func1(0x7e00c80, 0xc00048ce70)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:156 +0x4d
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a24a0, 0xc0002cea20, 0xc0002d4ba0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 180 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x382)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d6690)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d6690)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a24c0, 0xc0002cea20, 0xc0002a24b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 181 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x381)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d66c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d66c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a24e0, 0xc0002cea20, 0xc0002a24d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 182 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x37e)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048ced0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048ced0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2500, 0xc0002cea20, 0xc0002a24f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 183 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x38d)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048cf00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048cf00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2520, 0xc0002cea20, 0xc0002a2510)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 184 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x383)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048cea0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048cea0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2550, 0xc0002cea20, 0xc0002a2530)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 185 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x384)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048cf60)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048cf60)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2570, 0xc0002cea20, 0xc0002a2560)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 186 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x388)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048cf90)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048cf90)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a25a0, 0xc0002cea20, 0xc0002a2590)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 187 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x386)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048cf30)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048cf30)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2650, 0xc0002cea20, 0xc0002a2630)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 188 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x38a)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d66f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d66f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2670, 0xc0002cea20, 0xc0002a2660)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 189 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x389)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048cfc0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048cfc0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a26a0, 0xc0002cea20, 0xc0002a2690)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 190 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x385)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048cff0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048cff0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a26d0, 0xc0002cea20, 0xc0002a26c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 191 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x38c)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048d050)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048d050)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2b00, 0xc0002cea20, 0xc0002a26f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 192 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x38b)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048d080)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048d080)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2b30, 0xc0002cea20, 0xc0002a2b20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 193 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x387)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048d020)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048d020)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2b60, 0xc0002cea20, 0xc0002a2b50)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 194 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x34e)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d67b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d67b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2b90, 0xc0002cea20, 0xc0002a2b80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 195 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x353)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d6780)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d6780)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2c20, 0xc0002cea20, 0xc0002a2c10)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 196 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x352)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048d0b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048d0b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2c40, 0xc0002cea20, 0xc0002a2c30)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 197 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x351)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d67e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d67e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2c60, 0xc0002cea20, 0xc0002a2c50)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 198 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x34f)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74060)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74060)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2c80, 0xc0002cea20, 0xc0002a2c70)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 199 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x358)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048d110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048d110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2ca0, 0xc0002cea20, 0xc0002a2c90)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 200 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x356)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048d140)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048d140)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2cc0, 0xc0002cea20, 0xc0002a2cb0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 201 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x354)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048d170)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048d170)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2ce0, 0xc0002cea20, 0xc0002a2cd0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 202 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x359)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048d1a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048d1a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2d00, 0xc0002cea20, 0xc0002a2cf0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 203 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x357)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048d1d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048d1d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2d20, 0xc0002cea20, 0xc0002a2d10)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 204 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x35e)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048d200)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048d200)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2d40, 0xc0002cea20, 0xc0002a2d30)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 205 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x350)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc00048d0e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc00048d0e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2d60, 0xc0002cea20, 0xc0002a2d50)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 206 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x35a)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a740c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a740c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2d80, 0xc0002cea20, 0xc0002a2d70)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 207 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x35c)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a740f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a740f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2da0, 0xc0002cea20, 0xc0002a2d90)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 208 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x35f)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74120)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74120)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2dc0, 0xc0002cea20, 0xc0002a2db0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 209 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x355)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74090)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74090)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2de0, 0xc0002cea20, 0xc0002a2dd0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 210 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x368)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d6810)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d6810)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2e00, 0xc0002cea20, 0xc0002a2df0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 211 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x364)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74150)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74150)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2e30, 0xc0002cea20, 0xc0002a2e10)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 212 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x35b)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74180)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74180)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2e60, 0xc0002cea20, 0xc0002a2e40)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 213 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x36d)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a741b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a741b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a2e90, 0xc0002cea20, 0xc0002a2e70)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 214 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x369)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a741e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a741e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a3060, 0xc0002cea20, 0xc0002a3050)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 215 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x35d)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d6840)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d6840)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a3300, 0xc0002cea20, 0xc0002a3270)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 216 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x370)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d6870)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d6870)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a3320, 0xc0002cea20, 0xc0002a3310)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 217 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x371)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74210)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74210)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a3340, 0xc0002cea20, 0xc0002a3330)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 218 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x36e)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74240)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74240)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a3360, 0xc0002cea20, 0xc0002a3350)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 219 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x374)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d6900)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d6900)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a3380, 0xc0002cea20, 0xc0002a3370)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 220 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x36f)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74270)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74270)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a33a0, 0xc0002cea20, 0xc0002a3390)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 221 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x36b)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a742a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a742a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a3840, 0xc0002cea20, 0xc0002a3810)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 222 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x360)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a742d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a742d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002a38a0, 0xc0002cea20, 0xc0002a3870)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 223 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x363)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d6930)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d6930)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310010, 0xc0002cea20, 0xc000310000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 224 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x36c)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d6960)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d6960)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310040, 0xc0002cea20, 0xc000310030)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 225 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x361)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d6990)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d6990)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310070, 0xc0002cea20, 0xc000310050)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 226 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x366)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d69c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d69c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310090, 0xc0002cea20, 0xc000310080)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 227 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x365)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d69f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d69f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0003100c0, 0xc0002cea20, 0xc0003100b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 228 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x36a)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d6a80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d6a80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0003100e0, 0xc0002cea20, 0xc0003100d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 229 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x377)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d6ab0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d6ab0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310100, 0xc0002cea20, 0xc0003100f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 230 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x367)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74300)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74300)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310120, 0xc0002cea20, 0xc000310110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 231 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x375)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74330)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74330)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310140, 0xc0002cea20, 0xc000310130)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 232 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x378)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74360)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74360)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310160, 0xc0002cea20, 0xc000310150)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 233 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x373)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74390)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74390)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310180, 0xc0002cea20, 0xc000310170)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 234 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x362)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a743c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a743c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0003101a0, 0xc0002cea20, 0xc000310190)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 235 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x379)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc0002d6ae0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc0002d6ae0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0003101c0, 0xc0002cea20, 0xc0003101b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 236 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x380)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a743f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a743f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0003101e0, 0xc0002cea20, 0xc0003101d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 237 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x37c)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74420)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74420)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310200, 0xc0002cea20, 0xc0003101f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 238 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x372)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74450)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74450)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310220, 0xc0002cea20, 0xc000310210)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 239 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x37a)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74480)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74480)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310240, 0xc0002cea20, 0xc000310230)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 240 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x376)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a744b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a744b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310260, 0xc0002cea20, 0xc000310250)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 241 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x37d)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a744e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a744e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310280, 0xc0002cea20, 0xc000310270)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 242 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x37b)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74540)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74540)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0003102a0, 0xc0002cea20, 0xc000310290)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 243 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000d10090, 0x37f)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000d10080)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000abf300, 0x7e00c80, 0xc000a74510)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:197 +0xaa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2(0x7e00c80, 0xc000a74510)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:166 +0x3e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0003102c0, 0xc0002cea20, 0xc0003102b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 244 [semacquire]:
sync.runtime_Semacquire(0xc000abf378)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:56 +0x42
sync.(*WaitGroup).Wait(0xc000abf370)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/waitgroup.go:130 +0x64
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Wait(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scheduler.go:172
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0003102e0, 0xc0002cea20, 0xc0003102d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 245 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).raftTickLoop(0xc000579c00, 0x7e00c80, 0xc000a74570)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_raft.go:591 +0x26e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310310, 0xc0002cea20, 0xc000310300)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 246 [runnable]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).coalescedHeartbeatsLoop(0xc000579c00, 0x7e00c80, 0xc0002d6b70)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_raft.go:647 +0x13b
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310340, 0xc0002cea20, 0xc000310320)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 247 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Start.func2(0x7e00c80, 0xc0002d6b40)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store.go:1412 +0xe5
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0003103b0, 0xc0002cea20, 0xc0002d4bc0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 248 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).startGossip.func4(0x7e00c80, 0xc00065bb90)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store.go:1553 +0x364
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0003103d0, 0xc0002cea20, 0xc000d84910)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 249 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).startGossip.func4(0x7e00c80, 0xc00048d230)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store.go:1553 +0x364
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0003103e0, 0xc0002cea20, 0xc000d84960)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 250 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).startGossip.func4(0x7e00c80, 0xc00048d3e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store.go:1553 +0x364
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0003103f0, 0xc0002cea20, 0xc000d849b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 252 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).startLeaseRenewer.func1(0x7e00c80, 0xc0002d6c00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store.go:1602 +0x2fe
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310450, 0xc0002cea20, 0xc000310440)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 253 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc000ae3fd0, 0x11)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc000ae3fc0)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/kv/kvserver/closedts/provider.(*Provider).Subscribe(0xc00024cd90, 0x7e00c80, 0xc000d54360, 0xc000d52c00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/closedts/provider/provider.go:293 +0x455
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).startClosedTimestampRangefeedSubscriber.func1(0x7e00c80, 0xc000d54360)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store.go:1623 +0x57
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c80, 0xc000d54360, 0xc0005a6a80, 0x25, 0x0, 0x0, 0xc0002d4be0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 254 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).startClosedTimestampRangefeedSubscriber.func2(0x7e00c80, 0xc0002d6c90)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store.go:1631 +0x300
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310470, 0xc0002cea20, 0xc0002d4c00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 255 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*StoreRebalancer).Start.func1(0x7e00c80, 0xc0004b6390)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_rebalancer.go:186 +0x19a
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310480, 0xc0002cea20, 0xc0002d4c20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 36 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func1(0x7e00c80, 0xc000872360)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/queue.go:808 +0x176
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000240330, 0xc0002cea20, 0xc0002c0080)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 37 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func1(0x7e00c80, 0xc0004b6360)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/queue.go:808 +0x176
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000240340, 0xc0002cea20, 0xc0002c00a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 256 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/compactor.(*Compactor).Start.func1.1(0x7e00c80, 0xc000d83aa0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/compactor/compactor.go:123 +0x166
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000310500, 0xc0002cea20, 0xc0002d4c40)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 38 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func1(0x7e00c80, 0xc0004b6330)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/queue.go:808 +0x176
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000240350, 0xc0002cea20, 0xc0002c00c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 39 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func1(0x7e00c80, 0xc000872390)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/queue.go:808 +0x176
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000240360, 0xc0002cea20, 0xc0002c00e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 40 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func1(0x7e00c80, 0xc000872330)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/queue.go:808 +0x176
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000240370, 0xc0002cea20, 0xc0002c0100)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 41 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func1(0x7e00c80, 0xc0002d6c60)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/queue.go:808 +0x176
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000240380, 0xc0002cea20, 0xc0002c0120)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 42 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func1(0x7e00c80, 0xc0002d6c30)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/queue.go:808 +0x176
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc000240390, 0xc0002cea20, 0xc0002c0140)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 43 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func1(0x7e00c80, 0xc0008723f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/queue.go:808 +0x176
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002403a0, 0xc0002cea20, 0xc0002c0160)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 44 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func1(0x7e00c80, 0xc000872420)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/queue.go:808 +0x176
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002403b0, 0xc0002cea20, 0xc0002c0180)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 45 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*replicaScanner).waitAndProcess(0xc0005cec30, 0x7e00c80, 0xc000a745d0, 0xc0002cea20, 0x28540150, 0xed61fa07b, 0x0, 0xc000d66e00, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scanner.go:217 +0x1dc
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*replicaScanner).scanLoop.func1.1(0xc000d66e00, 0xc000a3be01)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scanner.go:279 +0x81
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*storeReplicaVisitor).Visit(0xc000a3bef0, 0xc000a4c0c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store.go:345 +0x154
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*replicaScanner).scanLoop.func1(0x7e00c80, 0xc000a745d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/scanner.go:277 +0x1da
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002403c0, 0xc0002cea20, 0xc0002c01a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 166 [select]:
github.com/cockroachdb/cockroach/pkg/server.(*Node).startComputePeriodicMetrics.func1(0x7e00c80, 0xc000d83b00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:725 +0x13b
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00022a730, 0xc0002cea20, 0xc000308ee0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 293 [select]:
github.com/cockroachdb/cockroach/pkg/server.(*Node).startWriteNodeStatus.func1(0x7e00c80, 0xc0004f0600)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:787 +0x125
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4bb0, 0xc0002cea20, 0xc0003035a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 167 [select]:
github.com/cockroachdb/cockroach/pkg/server.(*Node).startGossip.func1(0x7e00c80, 0xc000a74630)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:690 +0x275
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00022a770, 0xc0002cea20, 0xc000308f20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 168 [select]:
github.com/cockroachdb/cockroach/pkg/server.periodicallyPersistHLCUpperBound(0xc0002922d0, 0xc000e200e0, 0xc00022a7f0, 0x76f8eb8, 0xc0003fc600, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:1191 +0x18b
github.com/cockroachdb/cockroach/pkg/server.(*Server).startPersistingHLCUpperBound.func2(0x7e00c80, 0xc0008725d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:1265 +0x6a
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00022a800, 0xc0002cea20, 0xc000dee5a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 169 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/reports.(*Reporter).Start.func2(0x7e00c80, 0xc000d83b30)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/reports/reporter.go:150 +0x41d
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00022a830, 0xc0002cea20, 0xc000308fc0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 170 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*TemporaryObjectCleaner).Start.func1(0x7e00c80, 0xc000872600)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/temporary_schema.go:561 +0x318
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00022a850, 0xc0002cea20, 0xc000308fe0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 171 [select]:
github.com/cockroachdb/cockroach/pkg/server.(*Server).refreshSettings.func2(0x7e00c80, 0xc000d83cb0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/settingsworker.go:110 +0x106
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00022a860, 0xc0002cea20, 0xc000309000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 172 [select]:
github.com/cockroachdb/cockroach/pkg/server.(*Server).startSampleEnvironment.func1(0x7e00c80, 0xc0004b63c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:2287 +0x216
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00022aa10, 0xc0002cea20, 0xc000dee630)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 173 [select]:
github.com/cockroachdb/cockroach/pkg/ts.(*poller).start.func1(0x7e00c80, 0xc00048df50)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/ts/db.go:166 +0x124
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00022aa30, 0xc0002cea20, 0xc00022aa20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 174 [select]:
github.com/cockroachdb/cockroach/pkg/sql/flowinfra.(*FlowScheduler).Start.func1(0x7e00c80, 0xc000872630)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/flowinfra/flow_scheduler.go:149 +0x15d
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00022aa60, 0xc0002cea20, 0xc00022aa50)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 175 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*Server).Start.func1(0x7e00c80, 0xc000d83d40)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:324 +0xf9
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00022aa70, 0xc0002cea20, 0xc000309080)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 176 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*Server).PeriodicallyClearSQLStats.func1(0x7e00c80, 0xc000d83d70)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:762 +0x248
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00022aa90, 0xc0002cea20, 0xc000dee690)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 177 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*Server).PeriodicallyClearSQLStats.func1(0x7e00c80, 0xc0004b63f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:762 +0x248
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00022aaa0, 0xc0002cea20, 0xc000dee6c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 258 [select]:
github.com/cockroachdb/cockroach/pkg/sql.(*Server).PeriodicallyClearSQLStats.func1(0x7e00c80, 0xc000872660)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:762 +0x248
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00022aab0, 0xc0002cea20, 0xc000dee6f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 259 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*NodeLiveness).StartHeartbeat.func1(0x7e00c80, 0xc000a74690)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/node_liveness.go:475 +0x4ce
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00022ac10, 0xc0002cea20, 0xc0003ca9b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 294 [select]:
github.com/cockroachdb/cockroach/pkg/sql/stats.(*Refresher).Start.func1(0x7e00c80, 0xc000a3a000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/stats/automatic_stats.go:254 +0x1ae
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4bc0, 0xc0002cea20, 0xc0003035c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 295 [select]:
github.com/cockroachdb/cockroach/pkg/sql/stmtdiagnostics.(*Registry).poll(0xc000314aa0, 0x7e00bc0, 0xc0005e1180)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/stmtdiagnostics/statement_diagnostics.go:133 +0x2ca
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00bc0, 0xc0005e1180, 0xc00027ae20, 0x16, 0x0, 0x0, 0xc0002e4d80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 296 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts/ptcache.(*Cache).periodicallyRefreshProtectedtsCache(0xc00057c840, 0x7e00c80, 0xc0005cab40)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts/ptcache/cache.go:160 +0x278
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c80, 0xc0005cab40, 0xc0006d0f00, 0x2e, 0x0, 0x0, 0xc0002e4e70)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 297 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts/ptreconcile.(*Reconciler).run(0xc0005775c0, 0x7e00c80, 0xc0005cab40, 0xc0002cea20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts/ptreconcile/reconciler.go:119 +0x2ad
github.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts/ptreconcile.(*Reconciler).Start.func1(0x7e00c80, 0xc0005cab40)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts/ptreconcile/reconciler.go:98 +0x47
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c80, 0xc0005cab40, 0xc0006d0f30, 0x22, 0x0, 0x0, 0xc0003035e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 298 [select]:
github.com/cockroachdb/cockroach/pkg/server.(*Server).startSystemLogsGC.func1(0x7e00c80, 0xc000a745a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server_systemlog_gc.go:177 +0x553
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4e90, 0xc0002cea20, 0xc000303680)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 299 [select]:
github.com/cockroachdb/cockroach/pkg/jobs.(*Registry).Start.func1(0x7e00c80, 0xc000a3a030)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/jobs/registry.go:471 +0x142
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4ed0, 0xc0002cea20, 0xc00048ca80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 300 [select]:
github.com/cockroachdb/cockroach/pkg/jobs.(*Registry).Start.func2(0x7e00c80, 0xc0002d72f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/jobs/registry.go:482 +0xe9
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4ee0, 0xc0002cea20, 0xc0003036e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 301 [select]:
github.com/cockroachdb/cockroach/pkg/jobs.(*Registry).Start.func4(0x7e00c80, 0xc0004f0630)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/jobs/registry.go:506 +0x12d
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002e4ef0, 0xc0002cea20, 0xc00048cab0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 2426 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc002262060, 0x0, 0x1, 0xc0000ce000, 0xc000272c20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc001ed0d80, 0x7dc7a00, 0xc000a758f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc001ab4300, 0x33, 0x0, 0x0, 0xc002038d50)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2282 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc0015f97a0, 0x0, 0x1, 0xc000462530, 0x4050302)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc0021f4b40, 0x54bc4e6, 0x76f25b8)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00053d580, 0x33, 0x0, 0x0, 0xc00160ebd0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2074 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x25, 0x7e5ee20, 0xc0011e0c00, 0x0, 0x1, 0xc001b40290, 0xc)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x25, 0xc0018f8b40, 0xc0017487a0, 0xc00067e800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000560a00, 0x33, 0x0, 0x0, 0xc0015ab050)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2310 [chan receive]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(0xc0015b0700, 0xc002416820, 0x7e42b80, 0xc001b9dc80, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_rangefeed.go:233 +0x53f
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000579c00, 0xc002416820, 0x7e42b80, 0xc001b9dc80, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store.go:2219 +0x116
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc00027dea0, 0xc002416820, 0x7e42b80, 0xc001b9dc80, 0xc000db0f70)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:213 +0x12a
github.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0xc000108a00, 0xc002416820, 0x7e42b80, 0xc001b9dc80, 0x76f5800, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1030 +0x59
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed.func1(0xc000fc15c0, 0x7dc3240, 0xc000108a00, 0xc002416820, 0x7e00bc0, 0xc0017a7240, 0xc0013ca840, 0xc0013ca8a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:605 +0xe8
created by github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:603 +0x11d
goroutine 2107 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc001451260, 0x0, 0x1, 0xc00036aa10, 0xc0004a8000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc001369200, 0x20, 0xc00035ce20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0017d8b40, 0x33, 0x0, 0x0, 0xc001871080)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2275 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc0019535c0, 0x0, 0x1, 0xc000dac738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc001447680, 0x0, 0xc0000b4800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00053ca00, 0x33, 0x0, 0x0, 0xc0014848a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1726 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc001f82180, 0x0, 0x1, 0xc000496f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc001383e60, 0x1603d1e365ce70a0, 0xc001706400)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0017d9100, 0x33, 0x0, 0x0, 0xc001f805a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2199 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc00154ac00, 0x0, 0x1, 0xbf9b883f21cecce8, 0x3f5c91e2)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc0016b9680, 0x0, 0xc000e046c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00055f040, 0x33, 0x0, 0x0, 0xc001705a10)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1898 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc002079980, 0x0, 0x1, 0xc001236f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc0020af320, 0xc001236ea8, 0xc0004d9c00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc001a74e80, 0x33, 0x0, 0x0, 0xc00214c150)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2228 [chan receive]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(0xc000d8c700, 0xc0018f5c20, 0x7e42b80, 0xc0002f1640, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_rangefeed.go:233 +0x53f
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000579c00, 0xc0018f5c20, 0x7e42b80, 0xc0002f1640, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store.go:2219 +0x116
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc00027dea0, 0xc0018f5c20, 0x7e42b80, 0xc0002f1640, 0xc000e03f70)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:213 +0x12a
github.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0xc000108a00, 0xc0018f5c20, 0x7e42b80, 0xc0002f1640, 0x76f5800, 0xc000e03f48)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1030 +0x59
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed.func1(0xc0002b5760, 0x7dc3240, 0xc000108a00, 0xc0018f5c20, 0x7e00bc0, 0xc00061f9c0, 0xc0011e2060, 0xc0011e21e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:605 +0xe8
created by github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:603 +0x11d
goroutine 1822 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0022120c0, 0x0, 0x1, 0xc000dad738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc002220a20, 0xc0003fc540, 0xc0004a8000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc001b6a8c0, 0x33, 0x0, 0x0, 0xc002031290)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1008 [runnable]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*lockTableWaiterImpl).WaitOn(0xc001869d10, 0x7e00c80, 0xc001988150, 0xc0017b2900, 0x1603d1e37c118960, 0x0, 0x0, 0x0, 0xc001489200, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/lock_table_waiter.go:120 +0x19f
github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*managerImpl).sequenceReqWithGuard(0xc001b77cc0, 0x7e00c80, 0xc001988150, 0xc0005d4e00, 0xc0017b2900, 0x1603d1e37c118960, 0x0, 0x0, 0x0, 0xc001489200, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/concurrency_manager.go:170 +0x43e
github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*managerImpl).SequenceReq(0xc001b77cc0, 0x7e00c80, 0xc001988150, 0x0, 0xc0017b2900, 0x1603d1e37c118960, 0x0, 0x0, 0x0, 0xc001489200, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/concurrency_manager.go:121 +0xfb
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries(0xc0015b0700, 0x7e00c80, 0xc001988150, 0xc001489300, 0x76f2508, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:219 +0x326
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithRangeID(0xc0015b0700, 0x7e00c80, 0xc001988120, 0x29, 0xc001489300, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:94 +0x68a
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send(0xc0015b0700, 0x7e00c80, 0xc001988120, 0x1603d1e37c118960, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:36 +0x91
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send(0xc000579c00, 0x7e00c80, 0xc0019880c0, 0x1603d1e37c118960, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:202 +0x606
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send(0xc00027dea0, 0x7e00c80, 0xc0019880c0, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:188 +0xed
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1(0x7e00c80, 0xc0019880c0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:922 +0x201
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0002cea20, 0x7e00c80, 0xc0019880c0, 0x75970dd, 0x10, 0xc001be14b0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:302 +0x140
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal(0xc000108a00, 0x7e00c80, 0xc0019880c0, 0xc001489280, 0xc0019880c0, 0xc000f51c50, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:910 +0x194
github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch(0xc000108a00, 0x7e00c80, 0xc001988090, 0xc001489280, 0xc0020abfb0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:948 +0x9f
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:537
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch(0xc001b69880, 0x7e00c80, 0xc001988090, 0x1, 0x7dc7ac0, 0xc0002e4e10, 0x0, 0x0, 0x100000001, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:199 +0x127
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext(0xc001b69880, 0x7e00c80, 0xc0020abfb0, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:168 +0x160
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas(0xc0003225a0, 0x7e00c80, 0xc0020abfb0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1625 +0x2a2
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendRPC(0xc0003225a0, 0x7e00c80, 0xc0020abfb0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:456 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendSingleRange(0xc0003225a0, 0x7e00c80, 0xc0020abfb0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:538 +0x2ee
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch(0xc0003225a0, 0x7e00c80, 0xc0020abfb0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1394 +0x3cf
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges(0xc0003225a0, 0x7e00c80, 0xc0020abfb0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1079 +0x164a
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send(0xc0003225a0, 0x7e00c80, 0xc0020abfb0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:730 +0x785
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnLockGatekeeper).SendLocked(0xc0008b91c8, 0x7e00c80, 0xc0020abfb0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_lock_gatekeeper.go:86 +0x10b
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnMetricRecorder).SendLocked(0xc0008b9190, 0x7e00c80, 0xc0020abfb0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_metric_recorder.go:46 +0x8d
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnCommitter).SendLocked(0xc0008b9160, 0x7e00c80, 0xc0020abfb0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_committer.go:126 +0x874
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSpanRefresher).sendLockedWithRefreshAttempts(0xc0008b90c8, 0x7e00c80, 0xc0020abfb0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_span_refresher.go:247 +0x9b
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSpanRefresher).SendLocked(0xc0008b90c8, 0x7e00c80, 0xc0020abfb0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_span_refresher.go:182 +0x180
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnPipeliner).SendLocked(0xc0008b9008, 0x7e00c80, 0xc0020abfb0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_pipeliner.go:252 +0x159
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSeqNumAllocator).SendLocked(0xc0008b8fe8, 0x7e00c80, 0xc0020abfb0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_seq_num_allocator.go:105 +0x20c
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnHeartbeater).SendLocked(0xc0008b8f48, 0x7e00c80, 0xc0020abfb0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_heartbeater.go:172 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*TxnCoordSender).Send(0xc0008b8d80, 0x7e00c80, 0xc0020abfb0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_coord_sender.go:503 +0x406
github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender(0xc0001e6700, 0x7e00c80, 0xc000f51d40, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:739 +0x122
github.com/cockroachdb/cockroach/pkg/kv.(*Txn).Send(0xc0006cee10, 0x7e00c80, 0xc000f51d40, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:907 +0x11e
github.com/cockroachdb/cockroach/pkg/kv.sendAndFill(0x7e00c80, 0xc000f51d40, 0xc001be4240, 0xc00103b180, 0xc001ac6840, 0xc00241eba0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:657 +0xf7
github.com/cockroachdb/cockroach/pkg/kv.(*Txn).Run(0xc0006cee10, 0x7e00c80, 0xc000f51d40, 0xc00103b180, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:575 +0xfa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).AdminMerge.func1(0xc0006cee10, 0xc000f51d40, 0xc0001e6700)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_command.go:680 +0x91c
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).AdminMerge(0xc0015b0700, 0x7e00c80, 0xc000f51d40, 0xc00032dfa0, 0xc, 0x10, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_command.go:771 +0x130
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeAdminBatch(0xc0015b0700, 0x7e00c80, 0xc000f51d40, 0xc0013d5000, 0xa, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:424 +0x9f3
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithRangeID(0xc0015b0700, 0x7e00c80, 0xc000f51ce0, 0x29, 0xc0013d5000, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:101 +0x5eb
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send(0xc0015b0700, 0x7e00c80, 0xc000f51ce0, 0x1603d1e375732f78, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:36 +0x91
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send(0xc000579c00, 0x7e00c80, 0xc000f51c80, 0x1603d1e375732f78, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:202 +0x606
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send(0xc00027dea0, 0x7e00c80, 0xc000f51c80, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:188 +0xed
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1(0x7e00c80, 0xc000f51c80, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:922 +0x201
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0002cea20, 0x7e00c80, 0xc000f51c80, 0x75970dd, 0x10, 0xc001be5b38, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:302 +0x140
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal(0xc000108a00, 0x7e00c80, 0xc000f51c80, 0xc0013d4f80, 0xc000f51c80, 0x80, 0x80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:910 +0x194
github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch(0xc000108a00, 0x7e00c80, 0xc000f51c50, 0xc0013d4f80, 0xc000f51bf0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:948 +0x9f
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:537
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch(0xc001874140, 0x7e00c80, 0xc000f51c50, 0x1, 0x7dc7ac0, 0xc0002e4e10, 0x0, 0x0, 0x100000001, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:199 +0x127
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext(0xc001874140, 0x7e00c80, 0xc000f51bf0, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:168 +0x160
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas(0xc0003225a0, 0x7e00c80, 0xc000f51bf0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1625 +0x2a2
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendRPC(0xc0003225a0, 0x7e00c80, 0xc000f51bf0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:456 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendSingleRange(0xc0003225a0, 0x7e00c80, 0xc000f51bf0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:538 +0x2ee
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch(0xc0003225a0, 0x7e00c80, 0xc000f51bf0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1394 +0x3cf
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges(0xc0003225a0, 0x7e00c80, 0xc000f51bf0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1079 +0x164a
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send(0xc0003225a0, 0x7e00bc0, 0xc001aed900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:730 +0x785
github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send(0xc0001e6760, 0x7e00bc0, 0xc001aed900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:223 +0x95
github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender(0xc0001e6700, 0x7e00bc0, 0xc001aed900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:739 +0x122
github.com/cockroachdb/cockroach/pkg/kv.(*DB).send(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:721
github.com/cockroachdb/cockroach/pkg/kv.sendAndFill(0x7e00bc0, 0xc001aed900, 0xc001be7920, 0xc001364b00, 0x10, 0xc00032dfa0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:657 +0xf7
github.com/cockroachdb/cockroach/pkg/kv.(*DB).Run(0xc0001e6700, 0x7e00bc0, 0xc001aed900, 0xc001364b00, 0x704d980, 0x4063201)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:680 +0x9c
github.com/cockroachdb/cockroach/pkg/kv.(*DB).AdminMerge(0xc0001e6700, 0x7e00bc0, 0xc001aed900, 0x6f9d460, 0xc000321a40, 0x251f0d4000000000, 0x5e8da97c)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:510 +0x84
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.applyOp(0x7e00bc0, 0xc001aed900, 0xc0001e6700, 0xc0014b5ce0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/applier.go:78 +0x651
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.(*Applier).Apply(0xc001a398f0, 0x7e00bc0, 0xc001aed900, 0xc0014b5ce0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/applier.go:58 +0xf2
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.RunNemesis.func2(0x7e00bc0, 0xc001aed900, 0x4, 0x4ab7df0, 0x76f5800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/kvnemesis.go:55 +0x1f5
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.GroupWorkers.func1(0x7e00bc0, 0xc001aed900, 0x15, 0xe202000000000018)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:175 +0x42
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1(0xc001236f68, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:166 +0x3a
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0019d58f0, 0xc0019d59e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x64
created by github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
goroutine 1736 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc0016322a0, 0x0, 0x1, 0xc000db1f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc0015c0360, 0x1, 0xc000446000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0005453c0, 0x33, 0x0, 0x0, 0xc001784810)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2198 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc00154ab40, 0x0, 0x1, 0xbf9b883f21cecce8, 0x3f5c91e2)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc0016b8a20, 0x0, 0xc000e046c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00055efc0, 0x33, 0x0, 0x0, 0xc001705980)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1581 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc00154b6e0, 0x0, 0x1, 0xc000e05530, 0x4050302)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc001bac360, 0x54bc4e6, 0x76f25b8)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00177e0c0, 0x33, 0x0, 0x0, 0xc0017fbbf0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1674 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0016df920, 0x0, 0x1, 0xc001110f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc0017db0e0, 0x0, 0xc00067e000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000561000, 0x33, 0x0, 0x0, 0xc0012ba7e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2362 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc002238960, 0x0, 0x1, 0xc000db8738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc001ba2b40, 0x0, 0xc00067e800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000557f00, 0x33, 0x0, 0x0, 0xc002031fb0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2352 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc002150ea0, 0x0, 0x1, 0xc000db1e20, 0xc000db1d38)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc0020af560, 0xc0003fc540, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000556480, 0x33, 0x0, 0x0, 0xc00241eb10)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1519 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x21, 0x7e5ee20, 0xc0015cfb00, 0x0, 0x1, 0xc000db2f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x21, 0xc0013ebc20, 0x3, 0xc00069a000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000558480, 0x33, 0x0, 0x0, 0xc0012e3b90)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2481 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnHeartbeater).heartbeatLoop(0xc0008b81c8, 0x7e00bc0, 0xc00190ef80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_heartbeater.go:257 +0x19c
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00bc0, 0xc00190ef80, 0xc0005a7ef0, 0x29, 0x7e67220, 0xc00023a1c0, 0xc0020b0d20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2406 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc001f82d20, 0x0, 0x1, 0xc000e06f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc001699c20, 0x3, 0xc000446400)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc001944980, 0x33, 0x0, 0x0, 0xc00205f3e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1006 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*lockTableWaiterImpl).WaitOn(0xc0016d76b0, 0x7e00c80, 0xc00139d890, 0xc0014e4d80, 0x1603d1e37b8c8698, 0x0, 0x0, 0x0, 0xc0002b5a50, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/lock_table_waiter.go:120 +0x19f
github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*managerImpl).sequenceReqWithGuard(0xc001138100, 0x7e00c80, 0xc00139d890, 0xc0005ccd20, 0xc0014e4d80, 0x1603d1e37b8c8698, 0x0, 0x0, 0x0, 0xc0002b5a50, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/concurrency_manager.go:170 +0x43e
github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*managerImpl).SequenceReq(0xc001138100, 0x7e00c80, 0xc00139d890, 0x0, 0xc0014e4d80, 0x1603d1e37b8c8698, 0x0, 0x0, 0x0, 0xc0002b5a50, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/concurrency_manager.go:121 +0xfb
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries(0xc001575500, 0x7e00c80, 0xc00139d890, 0xc001611600, 0x76f2508, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:219 +0x326
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithRangeID(0xc001575500, 0x7e00c80, 0xc00139d860, 0x27, 0xc001611600, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:94 +0x68a
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send(0xc001575500, 0x7e00c80, 0xc00139d860, 0x1603d1e37b8c8698, 0x0, 0x100000001, 0x1, 0x0, 0x27, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:36 +0x91
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send(0xc000579c00, 0x7e00c80, 0xc00139d800, 0x1603d1e37b8c8698, 0x0, 0x100000001, 0x1, 0x0, 0x27, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:202 +0x606
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send(0xc00027dea0, 0x7e00c80, 0xc00139d800, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x27, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:188 +0xed
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1(0x7e00c80, 0xc00139d800, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:922 +0x201
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0002cea20, 0x7e00c80, 0xc00139d800, 0x75970dd, 0x10, 0xc00252b4b0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:302 +0x140
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal(0xc000108a00, 0x7e00c80, 0xc00139d800, 0xc001611580, 0xc00139d800, 0xc000def890, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:910 +0x194
github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch(0xc000108a00, 0x7e00c80, 0xc00139d7d0, 0xc001611580, 0xc00139d6b0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:948 +0x9f
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:537
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch(0xc001711b80, 0x7e00c80, 0xc00139d7d0, 0x1, 0x7dc7ac0, 0xc0002e4e10, 0x0, 0x0, 0x100000001, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:199 +0x127
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext(0xc001711b80, 0x7e00c80, 0xc00139d6b0, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x27, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:168 +0x160
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas(0xc0003225a0, 0x7e00c80, 0xc00139d6b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x27, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1625 +0x2a2
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendRPC(0xc0003225a0, 0x7e00c80, 0xc00139d6b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x27, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:456 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendSingleRange(0xc0003225a0, 0x7e00c80, 0xc00139d6b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:538 +0x2ee
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch(0xc0003225a0, 0x7e00c80, 0xc00139d6b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1394 +0x3cf
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges(0xc0003225a0, 0x7e00c80, 0xc00139d6b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1223 +0x931
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send(0xc0003225a0, 0x7e00c80, 0xc00139d6b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:730 +0x785
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnLockGatekeeper).SendLocked(0xc0008b8448, 0x7e00c80, 0xc00139d6b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_lock_gatekeeper.go:86 +0x10b
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnMetricRecorder).SendLocked(0xc0008b8410, 0x7e00c80, 0xc00139d6b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_metric_recorder.go:46 +0x8d
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnCommitter).SendLocked(0xc0008b83e0, 0x7e00c80, 0xc00139d6b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_committer.go:126 +0x874
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSpanRefresher).sendLockedWithRefreshAttempts(0xc0008b8348, 0x7e00c80, 0xc00139d6b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_span_refresher.go:247 +0x9b
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSpanRefresher).SendLocked(0xc0008b8348, 0x7e00c80, 0xc00139d6b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_span_refresher.go:182 +0x180
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnPipeliner).SendLocked(0xc0008b8288, 0x7e00c80, 0xc00139d6b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_pipeliner.go:252 +0x159
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSeqNumAllocator).SendLocked(0xc0008b8268, 0x7e00c80, 0xc00139d6b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_seq_num_allocator.go:105 +0x20c
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnHeartbeater).SendLocked(0xc0008b81c8, 0x7e00c80, 0xc00139d6b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_heartbeater.go:172 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*TxnCoordSender).Send(0xc0008b8000, 0x7e00c80, 0xc00139d6b0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_coord_sender.go:503 +0x406
github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender(0xc0001e6700, 0x7e00c80, 0xc000def950, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:739 +0x122
github.com/cockroachdb/cockroach/pkg/kv.(*Txn).Send(0xc0006ce510, 0x7e00c80, 0xc000def950, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:907 +0x11e
github.com/cockroachdb/cockroach/pkg/kv.sendAndFill(0x7e00c80, 0xc000def950, 0xc00252e240, 0xc00106f600, 0x0, 0xc001a8a4b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:657 +0xf7
github.com/cockroachdb/cockroach/pkg/kv.(*Txn).Run(0xc0006ce510, 0x7e00c80, 0xc000def950, 0xc00106f600, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:575 +0xfa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).AdminMerge.func1(0xc0006ce510, 0xc000def950, 0xc0001e6700)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_command.go:710 +0xb12
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).AdminMerge(0xc0015b0700, 0x7e00c80, 0xc000def950, 0xc001a59f00, 0xc, 0x10, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_command.go:771 +0x130
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeAdminBatch(0xc0015b0700, 0x7e00c80, 0xc000def950, 0xc000a71500, 0xa, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:424 +0x9f3
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithRangeID(0xc0015b0700, 0x7e00c80, 0xc000def920, 0x29, 0xc000a71500, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:101 +0x5eb
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send(0xc0015b0700, 0x7e00c80, 0xc000def920, 0x1603d1e37566df20, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:36 +0x91
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send(0xc000579c00, 0x7e00c80, 0xc000def8c0, 0x1603d1e37566df20, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:202 +0x606
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send(0xc00027dea0, 0x7e00c80, 0xc000def8c0, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:188 +0xed
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1(0x7e00c80, 0xc000def8c0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:922 +0x201
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0002cea20, 0x7e00c80, 0xc000def8c0, 0x75970dd, 0x10, 0xc00252fb38, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:302 +0x140
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal(0xc000108a00, 0x7e00c80, 0xc000def8c0, 0xc000a71400, 0xc000def8c0, 0x80, 0x80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:910 +0x194
github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch(0xc000108a00, 0x7e00c80, 0xc000def890, 0xc000a71400, 0xc000def830, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:948 +0x9f
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:537
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch(0xc001808f80, 0x7e00c80, 0xc000def890, 0x1, 0x7dc7ac0, 0xc0002e4e10, 0x0, 0x0, 0x100000001, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:199 +0x127
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext(0xc001808f80, 0x7e00c80, 0xc000def830, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:168 +0x160
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas(0xc0003225a0, 0x7e00c80, 0xc000def830, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1625 +0x2a2
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendRPC(0xc0003225a0, 0x7e00c80, 0xc000def830, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:456 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendSingleRange(0xc0003225a0, 0x7e00c80, 0xc000def830, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:538 +0x2ee
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch(0xc0003225a0, 0x7e00c80, 0xc000def830, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1394 +0x3cf
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges(0xc0003225a0, 0x7e00c80, 0xc000def830, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1079 +0x164a
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send(0xc0003225a0, 0x7e00bc0, 0xc001aed900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:730 +0x785
github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send(0xc0001e6760, 0x7e00bc0, 0xc001aed900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:223 +0x95
github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender(0xc0001e6700, 0x7e00bc0, 0xc001aed900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:739 +0x122
github.com/cockroachdb/cockroach/pkg/kv.(*DB).send(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:721
github.com/cockroachdb/cockroach/pkg/kv.sendAndFill(0x7e00bc0, 0xc001aed900, 0xc002531920, 0xc001030000, 0x10, 0xc001a59f00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:657 +0xf7
github.com/cockroachdb/cockroach/pkg/kv.(*DB).Run(0xc0001e6700, 0x7e00bc0, 0xc001aed900, 0xc001030000, 0x704d980, 0x4063201)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:680 +0x9c
github.com/cockroachdb/cockroach/pkg/kv.(*DB).AdminMerge(0xc0001e6700, 0x7e00bc0, 0xc001aed900, 0x6f9d460, 0xc0002b37c0, 0x2512055000000000, 0x5e8da97c)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:510 +0x84
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.applyOp(0x7e00bc0, 0xc001aed900, 0xc0001e6700, 0xc0003d1dc0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/applier.go:78 +0x651
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.(*Applier).Apply(0xc001a398f0, 0x7e00bc0, 0xc001aed900, 0xc0003d1dc0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/applier.go:58 +0xf2
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.RunNemesis.func2(0x7e00bc0, 0xc001aed900, 0x2, 0x4ab7df0, 0x76f5800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/kvnemesis.go:55 +0x1f5
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.GroupWorkers.func1(0x7e00bc0, 0xc001aed900, 0x15, 0x18)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:175 +0x42
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1(0xc001110768, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:166 +0x3a
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0019d58f0, 0xc0019d5980)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x64
created by github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
goroutine 2192 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc0019bf020, 0x0, 0x1, 0x9d42d60, 0xc0004dbe00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc00173b200, 0x7dc7a00, 0xc0003c9540)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00177f880, 0x33, 0x0, 0x0, 0xc001a8bce0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2311 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc0001af500, 0x7e00bc0, 0xc0017a7380, 0xc0017a7380, 0xc000fc1600)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/registry.go:256 +0x1f8
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc0001af500, 0x7e00bc0, 0xc0017a7380)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/registry.go:273 +0xc2
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).Start.func1.1(0x7e00bc0, 0xc00036aa00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/processor.go:223 +0x64
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00bc0, 0xc00036aa00, 0xc0003a8d40, 0x1e, 0x0, 0x0, 0xc001b9dd40)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1112 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0015d4ba0, 0x0, 0x1, 0xc00073c530, 0x4050302)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc001212ea0, 0x7dc7a00, 0xc0003c9540)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000574800, 0x33, 0x0, 0x0, 0xc0018f1050)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1809 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0019bed20, 0x0, 0x1, 0xc000e03f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc0018d50e0, 0x20, 0xc0004d9c00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0018faa00, 0x33, 0x0, 0x0, 0xc001989200)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 366 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).addToPurgatoryLocked.func2(0x7e00c80, 0xc000deef90)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/queue.go:1148 +0x33e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00020c920, 0xc0002cea20, 0xc0002b2140)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 2021 [select]:
github.com/cockroachdb/cockroach/pkg/rpc.rangeFeedClientAdapter.Recv(0x7e00bc0, 0xc001138540, 0xc001451080, 0xc0014510e0, 0xc0022c4a60, 0xc001808090, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:551 +0xd1
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc0003225a0, 0x7e00bc0, 0xc001808080, 0xc0002fbec0, 0xc, 0x10, 0xc000340310, 0xc, 0x10, 0x1603d1e343385060, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:266 +0x516
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc0003225a0, 0x7e00bc0, 0xc001808080, 0xc00200abe0, 0x1, 0xc001952120, 0xc001895500, 0xc000742ea8, 0x4ab7bb4)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:151 +0x298
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1(0x7e00bc0, 0xc001808080, 0xc0002de440, 0x16)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:73 +0x61
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1(0xc000742f68, 0x76f57c8)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:166 +0x3a
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0018181b0, 0xc0020aba40)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x64
created by github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
goroutine 1362 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x20, 0x7e5ee20, 0xc000ac3da0, 0x0, 0x1, 0xc000db0f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x20, 0xc00151bb00, 0xc00037b420, 0xc0000b4800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000556a40, 0x33, 0x0, 0x0, 0xc0016c80f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1005 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*lockTableWaiterImpl).WaitOn(0xc001869d10, 0x7e00c80, 0xc0017ce720, 0xc0015407e0, 0x1603d1e37e2eaca0, 0x0, 0x0, 0x0, 0xc0012e6380, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/lock_table_waiter.go:120 +0x19f
github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*managerImpl).sequenceReqWithGuard(0xc001b77cc0, 0x7e00c80, 0xc0017ce720, 0xc00046a4d0, 0xc0015407e0, 0x1603d1e37e2eaca0, 0x0, 0x0, 0x0, 0xc0012e6380, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/concurrency_manager.go:170 +0x43e
github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*managerImpl).SequenceReq(0xc001b77cc0, 0x7e00c80, 0xc0017ce720, 0x0, 0xc0015407e0, 0x1603d1e37e2eaca0, 0x0, 0x0, 0x0, 0xc0012e6380, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/concurrency_manager.go:121 +0xfb
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries(0xc0015b0700, 0x7e00c80, 0xc0017ce720, 0xc0012e6480, 0x76f24f0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:219 +0x326
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithRangeID(0xc0015b0700, 0x7e00c80, 0xc0017ce6f0, 0x29, 0xc0012e6480, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:98 +0x2f3
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send(0xc0015b0700, 0x7e00c80, 0xc0017ce6f0, 0x1603d1e37e2eaca0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:36 +0x91
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send(0xc000579c00, 0x7e00c80, 0xc0017ce690, 0x1603d1e37e2eaca0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:202 +0x606
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send(0xc00027dea0, 0x7e00c80, 0xc0017ce690, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:188 +0xed
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1(0x7e00c80, 0xc0017ce690, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:922 +0x201
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0002cea20, 0x7e00c80, 0xc0017ce690, 0x75970dd, 0x10, 0xc00253b270, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:302 +0x140
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal(0xc000108a00, 0x7e00c80, 0xc0017ce690, 0xc0012e6400, 0xc0017ce690, 0xc001818ba0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:910 +0x194
github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch(0xc000108a00, 0x7e00c80, 0xc0017ce660, 0xc0012e6400, 0xc0017ce600, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:948 +0x9f
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:537
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch(0xc00130c7c0, 0x7e00c80, 0xc0017ce660, 0x1, 0x7dc7ac0, 0xc0002e4e10, 0x0, 0x0, 0x100000001, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:199 +0x127
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext(0xc00130c7c0, 0x7e00c80, 0xc0017ce600, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:168 +0x160
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas(0xc0003225a0, 0x7e00c80, 0xc0017ce600, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1625 +0x2a2
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendRPC(0xc0003225a0, 0x7e00c80, 0xc0017ce600, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:456 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendSingleRange(0xc0003225a0, 0x7e00c80, 0xc0017ce600, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:538 +0x2ee
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch(0xc0003225a0, 0x7e00c80, 0xc0017ce600, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1394 +0x3cf
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges(0xc0003225a0, 0x7e00c80, 0xc0017ce600, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1079 +0x164a
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send(0xc0003225a0, 0x7e00c80, 0xc0017ce600, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:730 +0x785
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnLockGatekeeper).SendLocked(0xc0008b9ac8, 0x7e00c80, 0xc0017ce600, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_lock_gatekeeper.go:86 +0x10b
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnMetricRecorder).SendLocked(0xc0008b9a90, 0x7e00c80, 0xc0017ce600, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_metric_recorder.go:46 +0x8d
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnCommitter).SendLocked(0xc0008b9a60, 0x7e00c80, 0xc0017ce600, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_committer.go:126 +0x874
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSpanRefresher).sendLockedWithRefreshAttempts(0xc0008b99c8, 0x7e00c80, 0xc0017ce600, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_span_refresher.go:247 +0x9b
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSpanRefresher).SendLocked(0xc0008b99c8, 0x7e00c80, 0xc0017ce600, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_span_refresher.go:182 +0x180
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnPipeliner).SendLocked(0xc0008b9908, 0x7e00c80, 0xc0017ce600, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_pipeliner.go:252 +0x159
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSeqNumAllocator).SendLocked(0xc0008b98e8, 0x7e00c80, 0xc0017ce600, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_seq_num_allocator.go:105 +0x20c
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnHeartbeater).SendLocked(0xc0008b9848, 0x7e00c80, 0xc0017ce600, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_heartbeater.go:172 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*TxnCoordSender).Send(0xc0008b9680, 0x7e00c80, 0xc0017ce600, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_coord_sender.go:503 +0x406
github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender(0xc0001e6700, 0x7e00c80, 0xc001818c90, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:739 +0x122
github.com/cockroachdb/cockroach/pkg/kv.(*Txn).Send(0xc0006cf8c0, 0x7e00c80, 0xc001818c90, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:907 +0x11e
github.com/cockroachdb/cockroach/pkg/kv.sendAndFill(0x7e00c80, 0xc001818c90, 0xc00253e000, 0xc001fd1b80, 0x1, 0x1)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:657 +0xf7
github.com/cockroachdb/cockroach/pkg/kv.(*Txn).Run(0xc0006cf8c0, 0x7e00c80, 0xc001818c90, 0xc001fd1b80, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:575 +0xfa
github.com/cockroachdb/cockroach/pkg/kv.(*Txn).Get(0xc0006cf8c0, 0x7e00c80, 0xc001818c90, 0x7335680, 0xc0019bb920, 0x4, 0x0, 0x0, 0x0, 0xc0005de380, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:361 +0xbc
github.com/cockroachdb/cockroach/pkg/kv/kvserver.conditionalGetDescValueFromDB(0x7e00c80, 0xc001818c90, 0xc0006cf8c0, 0xc00186be60, 0xc, 0x10, 0xc0020b1350, 0x0, 0xc0008b99c8, 0x7e526c0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_command.go:1964 +0xf2
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).AdminMerge.func1(0xc0006cf8c0, 0xc001818c90, 0xc0001e6700)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_command.go:596 +0x24a
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).AdminMerge(0xc0015b0700, 0x7e00c80, 0xc001818c90, 0xc0003bbe20, 0xc, 0x10, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_command.go:771 +0x130
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeAdminBatch(0xc0015b0700, 0x7e00c80, 0xc001818c90, 0xc000abe200, 0xa, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:424 +0x9f3
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithRangeID(0xc0015b0700, 0x7e00c80, 0xc001818c60, 0x29, 0xc000abe200, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:101 +0x5eb
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send(0xc0015b0700, 0x7e00c80, 0xc001818c60, 0x1603d1e374437590, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:36 +0x91
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send(0xc000579c00, 0x7e00c80, 0xc001818c00, 0x1603d1e374437590, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:202 +0x606
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send(0xc00027dea0, 0x7e00c80, 0xc001818c00, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:188 +0xed
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1(0x7e00c80, 0xc001818c00, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:922 +0x201
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0002cea20, 0x7e00c80, 0xc001818c00, 0x75970dd, 0x10, 0xc00253fb38, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:302 +0x140
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal(0xc000108a00, 0x7e00c80, 0xc001818c00, 0xc000abe180, 0xc001818c00, 0x80, 0x80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:910 +0x194
github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch(0xc000108a00, 0x7e00c80, 0xc001818ba0, 0xc000abe180, 0xc001818990, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:948 +0x9f
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:537
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch(0xc0016a5d80, 0x7e00c80, 0xc001818ba0, 0x1, 0x7dc7ac0, 0xc0002e4e10, 0x0, 0x0, 0x100000001, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:199 +0x127
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext(0xc0016a5d80, 0x7e00c80, 0xc001818990, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:168 +0x160
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas(0xc0003225a0, 0x7e00c80, 0xc001818990, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1625 +0x2a2
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendRPC(0xc0003225a0, 0x7e00c80, 0xc001818990, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:456 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendSingleRange(0xc0003225a0, 0x7e00c80, 0xc001818990, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:538 +0x2ee
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch(0xc0003225a0, 0x7e00c80, 0xc001818990, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1394 +0x3cf
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges(0xc0003225a0, 0x7e00c80, 0xc001818990, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1079 +0x164a
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send(0xc0003225a0, 0x7e00bc0, 0xc001aed900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:730 +0x785
github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send(0xc0001e6760, 0x7e00bc0, 0xc001aed900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:223 +0x95
github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender(0xc0001e6700, 0x7e00bc0, 0xc001aed900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:739 +0x122
github.com/cockroachdb/cockroach/pkg/kv.(*DB).send(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:721
github.com/cockroachdb/cockroach/pkg/kv.sendAndFill(0x7e00bc0, 0xc001aed900, 0xc002541920, 0xc001039600, 0x10, 0xc0003bbe20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:657 +0xf7
github.com/cockroachdb/cockroach/pkg/kv.(*DB).Run(0xc0001e6700, 0x7e00bc0, 0xc001aed900, 0xc001039600, 0x704d980, 0x4063201)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:680 +0x9c
github.com/cockroachdb/cockroach/pkg/kv.(*DB).AdminMerge(0xc0001e6700, 0x7e00bc0, 0xc001aed900, 0x6f9d460, 0xc00037bbc0, 0x23ef4b8800000000, 0x5e8da97c)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:510 +0x84
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.applyOp(0x7e00bc0, 0xc001aed900, 0xc0001e6700, 0xc00031d490)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/applier.go:78 +0x651
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.(*Applier).Apply(0xc001a398f0, 0x7e00bc0, 0xc001aed900, 0xc00031d490, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/applier.go:58 +0xf2
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.RunNemesis.func2(0x7e00bc0, 0xc001aed900, 0x1, 0x4ab7df0, 0x76f5800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/kvnemesis.go:55 +0x1f5
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.GroupWorkers.func1(0x7e00bc0, 0xc001aed900, 0x15, 0x18)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:175 +0x42
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1(0xc0010da768, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:166 +0x3a
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0019d58f0, 0xc0019d5950)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x64
created by github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
goroutine 1552 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc001894b40, 0x0, 0x1, 0xc0000ce000, 0xc000272c20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc00184eb40, 0x0, 0xc000db2688)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000574400, 0x33, 0x0, 0x0, 0xc001a1c0c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2399 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc002147aa0, 0x0, 0x1, 0x4030e91, 0x76f2350)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc0022597a0, 0xc000db1ea8, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00053c200, 0x33, 0x0, 0x0, 0xc002039b00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1610 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc000976240, 0x0, 0x1, 0xc000e03f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc00162b560, 0xc000def0b0, 0xc00069a000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0003b1f80, 0x33, 0x0, 0x0, 0xc000a74b70)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1512 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0015ce060, 0x0, 0x1, 0x18, 0xc0004624d8)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc0017da120, 0x7dc7a00, 0xc0003c9540)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000056440, 0x33, 0x0, 0x0, 0xc0012e2030)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1397 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc001452600, 0x0, 0x1, 0xc00110f738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc001268d80, 0xc000308300, 0xc0000b4800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00054c540, 0x33, 0x0, 0x0, 0xc0004b7b30)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1708 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x20, 0x7e5ee20, 0xc0013cb8c0, 0x0, 0x1, 0xc000e04738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x20, 0xc00137a5a0, 0x0, 0xc000446000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00177ee40, 0x33, 0x0, 0x0, 0xc0017835c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2229 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).Start.func1(0x7e00c80, 0xc0004b6a20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/processor.go:202 +0x44a
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002b57b0, 0xc0002cea20, 0xc0004b69f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 1667 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc0016de120, 0x0, 0x1, 0x4f82f19, 0xc0014ea268)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc00138e900, 0x0, 0xc001a24360)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000560180, 0x33, 0x0, 0x0, 0xc001bc0d20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2016 [chan receive]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(0xc001575500, 0xc00157c1e0, 0x7e42b80, 0xc001748720, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_rangefeed.go:233 +0x53f
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000579c00, 0xc00157c1e0, 0x7e42b80, 0xc001748720, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store.go:2219 +0x116
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc00027dea0, 0xc00157c1e0, 0x7e42b80, 0xc001748720, 0xc000db3770)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:213 +0x12a
github.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0xc000108a00, 0xc00157c1e0, 0x7e42b80, 0xc001748720, 0x4ab7bb4, 0xc000db3748)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1030 +0x59
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed.func1(0xc0003a6a40, 0x7dc3240, 0xc000108a00, 0xc00157c1e0, 0x7e00bc0, 0xc001304c40, 0xc00176ef00, 0xc00176ef60)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:605 +0xe8
created by github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:603 +0x11d
goroutine 2501 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc0019bf3e0, 0x0, 0x1, 0xc0000ce000, 0xc000272c20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc001720360, 0x3, 0xc000a758f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00053c540, 0x33, 0x0, 0x0, 0xc00205eed0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1775 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc001980c00, 0x0, 0x1, 0xc000db1f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc001a4c6c0, 0x0, 0xc000446400)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc001a74200, 0x33, 0x0, 0x0, 0xc0019710b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 958 [select]:
database/sql.(*DB).connectionOpener(0xc000acc900, 0x7e00bc0, 0xc00159c900)
/usr/local/Cellar/go/1.13.4/libexec/src/database/sql/sql.go:1052 +0xe8
created by database/sql.OpenDB
/usr/local/Cellar/go/1.13.4/libexec/src/database/sql/sql.go:722 +0x15d
goroutine 1007 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*lockTableWaiterImpl).WaitOn(0xc001869d10, 0x7e00c80, 0xc0013a03c0, 0xc0018d5c20, 0x1603d1e37db6b5b0, 0x0, 0x0, 0x0, 0xc001743600, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/lock_table_waiter.go:120 +0x19f
github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*managerImpl).sequenceReqWithGuard(0xc001b77cc0, 0x7e00c80, 0xc0013a03c0, 0xc0002f3960, 0xc0018d5c20, 0x1603d1e37db6b5b0, 0x0, 0x0, 0x0, 0xc001743600, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/concurrency_manager.go:170 +0x43e
github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*managerImpl).SequenceReq(0xc001b77cc0, 0x7e00c80, 0xc0013a03c0, 0x0, 0xc0018d5c20, 0x1603d1e37db6b5b0, 0x0, 0x0, 0x0, 0xc001743600, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/concurrency_manager.go:121 +0xfb
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries(0xc0015b0700, 0x7e00c80, 0xc0013a03c0, 0xc001743700, 0x76f2508, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:219 +0x326
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithRangeID(0xc0015b0700, 0x7e00c80, 0xc0013a0390, 0x29, 0xc001743700, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:94 +0x68a
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send(0xc0015b0700, 0x7e00c80, 0xc0013a0390, 0x1603d1e37db6b5b0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:36 +0x91
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send(0xc000579c00, 0x7e00c80, 0xc0013a0330, 0x1603d1e37db6b5b0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:202 +0x606
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send(0xc00027dea0, 0x7e00c80, 0xc0013a0330, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:188 +0xed
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1(0x7e00c80, 0xc0013a0330, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:922 +0x201
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0002cea20, 0x7e00c80, 0xc0013a0330, 0x75970dd, 0x10, 0xc0013574b0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:302 +0x140
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal(0xc000108a00, 0x7e00c80, 0xc0013a0330, 0xc001743680, 0xc0013a0330, 0xc001819b30, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:910 +0x194
github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch(0xc000108a00, 0x7e00c80, 0xc0013a0300, 0xc001743680, 0xc0013a0240, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:948 +0x9f
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:537
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch(0xc001b05a40, 0x7e00c80, 0xc0013a0300, 0x1, 0x7dc7ac0, 0xc0002e4e10, 0x0, 0x0, 0x100000001, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:199 +0x127
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext(0xc001b05a40, 0x7e00c80, 0xc0013a0240, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:168 +0x160
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas(0xc0003225a0, 0x7e00c80, 0xc0013a0240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1625 +0x2a2
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendRPC(0xc0003225a0, 0x7e00c80, 0xc0013a0240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:456 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendSingleRange(0xc0003225a0, 0x7e00c80, 0xc0013a0240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:538 +0x2ee
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch(0xc0003225a0, 0x7e00c80, 0xc0013a0240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1394 +0x3cf
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges(0xc0003225a0, 0x7e00c80, 0xc0013a0240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1079 +0x164a
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send(0xc0003225a0, 0x7e00c80, 0xc0013a0240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:730 +0x785
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnLockGatekeeper).SendLocked(0xc0008b9648, 0x7e00c80, 0xc0013a0240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_lock_gatekeeper.go:86 +0x10b
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnMetricRecorder).SendLocked(0xc0008b9610, 0x7e00c80, 0xc0013a0240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_metric_recorder.go:46 +0x8d
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnCommitter).SendLocked(0xc0008b95e0, 0x7e00c80, 0xc0013a0240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_committer.go:126 +0x874
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSpanRefresher).sendLockedWithRefreshAttempts(0xc0008b9548, 0x7e00c80, 0xc0013a0240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_span_refresher.go:247 +0x9b
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSpanRefresher).SendLocked(0xc0008b9548, 0x7e00c80, 0xc0013a0240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_span_refresher.go:182 +0x180
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnPipeliner).SendLocked(0xc0008b9488, 0x7e00c80, 0xc0013a0240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_pipeliner.go:252 +0x159
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSeqNumAllocator).SendLocked(0xc0008b9468, 0x7e00c80, 0xc0013a0240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_seq_num_allocator.go:105 +0x20c
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnHeartbeater).SendLocked(0xc0008b93c8, 0x7e00c80, 0xc0013a0240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_heartbeater.go:172 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*TxnCoordSender).Send(0xc0008b9200, 0x7e00c80, 0xc0013a0240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_coord_sender.go:503 +0x406
github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender(0xc0001e6700, 0x7e00c80, 0xc001819bf0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:739 +0x122
github.com/cockroachdb/cockroach/pkg/kv.(*Txn).Send(0xc0006cf4d0, 0x7e00c80, 0xc001819bf0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:907 +0x11e
github.com/cockroachdb/cockroach/pkg/kv.sendAndFill(0x7e00c80, 0xc001819bf0, 0xc00135a240, 0xc001367700, 0xc001b43580, 0xc001a8b080)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:657 +0xf7
github.com/cockroachdb/cockroach/pkg/kv.(*Txn).Run(0xc0006cf4d0, 0x7e00c80, 0xc001819bf0, 0xc001367700, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:575 +0xfa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).AdminMerge.func1(0xc0006cf4d0, 0xc001819bf0, 0xc0001e6700)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_command.go:680 +0x91c
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).AdminMerge(0xc0015b0700, 0x7e00c80, 0xc001819bf0, 0xc00029c0d0, 0xc, 0x10, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_command.go:771 +0x130
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeAdminBatch(0xc0015b0700, 0x7e00c80, 0xc001819bf0, 0xc000abe880, 0xa, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:424 +0x9f3
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithRangeID(0xc0015b0700, 0x7e00c80, 0xc001819bc0, 0x29, 0xc000abe880, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:101 +0x5eb
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send(0xc0015b0700, 0x7e00c80, 0xc001819bc0, 0x1603d1e374494da8, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:36 +0x91
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send(0xc000579c00, 0x7e00c80, 0xc001819b60, 0x1603d1e374494da8, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:202 +0x606
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send(0xc00027dea0, 0x7e00c80, 0xc001819b60, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:188 +0xed
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1(0x7e00c80, 0xc001819b60, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:922 +0x201
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0002cea20, 0x7e00c80, 0xc001819b60, 0x75970dd, 0x10, 0xc00135bb38, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:302 +0x140
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal(0xc000108a00, 0x7e00c80, 0xc001819b60, 0xc000abe800, 0xc001819b60, 0x80, 0x80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:910 +0x194
github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch(0xc000108a00, 0x7e00c80, 0xc001819b30, 0xc000abe800, 0xc001819ad0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:948 +0x9f
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:537
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch(0xc001620580, 0x7e00c80, 0xc001819b30, 0x1, 0x7dc7ac0, 0xc0002e4e10, 0x0, 0x0, 0x100000001, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:199 +0x127
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext(0xc001620580, 0x7e00c80, 0xc001819ad0, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:168 +0x160
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas(0xc0003225a0, 0x7e00c80, 0xc001819ad0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1625 +0x2a2
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendRPC(0xc0003225a0, 0x7e00c80, 0xc001819ad0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:456 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendSingleRange(0xc0003225a0, 0x7e00c80, 0xc001819ad0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:538 +0x2ee
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch(0xc0003225a0, 0x7e00c80, 0xc001819ad0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1394 +0x3cf
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges(0xc0003225a0, 0x7e00c80, 0xc001819ad0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1079 +0x164a
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send(0xc0003225a0, 0x7e00bc0, 0xc001aed900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:730 +0x785
github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send(0xc0001e6760, 0x7e00bc0, 0xc001aed900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:223 +0x95
github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender(0xc0001e6700, 0x7e00bc0, 0xc001aed900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:739 +0x122
github.com/cockroachdb/cockroach/pkg/kv.(*DB).send(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:721
github.com/cockroachdb/cockroach/pkg/kv.sendAndFill(0x7e00bc0, 0xc001aed900, 0xc00135d920, 0xc00103a100, 0x10, 0xc00029c0d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:657 +0xf7
github.com/cockroachdb/cockroach/pkg/kv.(*DB).Run(0xc0001e6700, 0x7e00bc0, 0xc001aed900, 0xc00103a100, 0x704d980, 0x4063201)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:680 +0x9c
github.com/cockroachdb/cockroach/pkg/kv.(*DB).AdminMerge(0xc0001e6700, 0x7e00bc0, 0xc001aed900, 0x6f9d460, 0xc0002a4100, 0x23f53b1000000000, 0x5e8da97c)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:510 +0x84
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.applyOp(0x7e00bc0, 0xc001aed900, 0xc0001e6700, 0xc0001b8000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/applier.go:78 +0x651
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.(*Applier).Apply(0xc001a398f0, 0x7e00bc0, 0xc001aed900, 0xc0001b8000, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/applier.go:58 +0xf2
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.RunNemesis.func2(0x7e00bc0, 0xc001aed900, 0x3, 0x4ab7df0, 0x76f5800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/kvnemesis.go:55 +0x1f5
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.GroupWorkers.func1(0x7e00bc0, 0xc001aed900, 0x15, 0x18)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:175 +0x42
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1(0xc000e02f68, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:166 +0x3a
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0019d58f0, 0xc0019d59b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x64
created by github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
goroutine 1760 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0018d0300, 0x0, 0x1, 0xf04e61fe828f8e61, 0x7e786b7db53000ba)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc001721320, 0xc00049d6a8, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00055f240, 0x33, 0x0, 0x0, 0xc0013a11a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 960 [select]:
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc00159cb80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:115 +0x10f
created by github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc.newCCBalancerWrapper
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:106 +0x169
goroutine 1598 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0015d5b60, 0x0, 0x1, 0xc000462738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc001977440, 0xc0004626a8, 0xc0004d9c00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000559ac0, 0x33, 0x0, 0x0, 0xc00048ddd0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1945 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc002150fc0, 0x0, 0x1, 0xc000db2f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc002156120, 0xc000a758f0, 0xc0004a8000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc001a75540, 0x33, 0x0, 0x0, 0xc00214dfb0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1248 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0019b5f80, 0x0, 0x1, 0x4030e91, 0x76f2350)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc00126b0e0, 0x0, 0xc000dad6c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000558b00, 0x33, 0x0, 0x0, 0xc001b7eba0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1715 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0012cc7e0, 0x0, 0x1, 0xc000497738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc0017dbc20, 0x0, 0xc0004d9c00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0017d8340, 0x33, 0x0, 0x0, 0xc0016d6c60)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1772 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc001980180, 0x0, 0x1, 0xc000db1f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc001857320, 0x1, 0xc000446000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00177ff00, 0x33, 0x0, 0x0, 0xc0019707b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2414 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc0022393e0, 0x0, 0x1, 0xb1422294251cb44e, 0x3b22cef5ab5809be)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc001aeed80, 0x1603d1e37b8e47d0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0003b0e00, 0x33, 0x0, 0x0, 0xc0022cd4a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 971 [select]:
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00179ec80, 0x1, 0x0, 0x0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:317 +0x11a
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc00175b620, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:435 +0x1e3
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0016ec180)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:276 +0xcb
created by github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:273 +0xfa4
goroutine 2396 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc0021463c0, 0x0, 0x1, 0xc00110a738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc001fdf560, 0xc0003fc540, 0xc0000b4800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000057d40, 0x33, 0x0, 0x0, 0xc0020383f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1716 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc0012cc8a0, 0x0, 0x1, 0xc000497738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc001370900, 0x0, 0xc0004d9c00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0017d83c0, 0x33, 0x0, 0x0, 0xc0016d6cf0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1516 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc0015cef60, 0x0, 0x1, 0xc000db2f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc000edcfc0, 0x3, 0xc00069a000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000057e00, 0x33, 0x0, 0x0, 0xc0012e2e10)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 997 [semacquire]:
sync.runtime_Semacquire(0xc0018181c0)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:56 +0x42
sync.(*WaitGroup).Wait(0xc0018181b8)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/waitgroup.go:130 +0x64
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Wait(0xc0018181b0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:40 +0x31
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait(0xc0018181b0, 0x7e00bc0, 0xc001808080, 0xc001952180, 0xc001808080)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:142 +0x57
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc0003225a0, 0x7e00c80, 0xc001818150, 0xc0002ed358, 0x1, 0x8, 0xc0002ed360, 0x1, 0x8, 0x1603d1e342d67d68, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:86 +0x413
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.Watch.func1(0x7e00bc0, 0xc0016a3940, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/watcher.go:87 +0x1cb
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1(0xc001111768, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:166 +0x3a
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0019d40f0, 0xc0019d4120)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x64
created by github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
goroutine 1794 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc00155fc20, 0x0, 0x1, 0xc0000ce000, 0xc000272c20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc00137f8c0, 0x0, 0xc00049d688)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00054da80, 0x33, 0x0, 0x0, 0xc00139c0f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1738 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc001632de0, 0x0, 0x1, 0xc000db1f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc0018d4000, 0x1, 0xc000446000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000545b00, 0x33, 0x0, 0x0, 0xc001784fc0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1441 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc001952a20, 0x0, 0x1, 0xc000462738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc0009550e0, 0x3, 0xc000446000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0003b13c0, 0x33, 0x0, 0x0, 0xc001484bd0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 996 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc00007b488, 0x100)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc00007b478)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/pebble/internal/record.(*flusherCond).Wait(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/pebble/internal/record/log_writer.go:193
github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/pebble/internal/record.(*LogWriter).flushLoop(0xc00007b400, 0x7e00c80, 0xc0018180f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/pebble/internal/record/log_writer.go:385 +0xd2
runtime/pprof.Do(0x7e00c80, 0xc0018180f0, 0xc00000ebc0, 0x1, 0x1, 0xc001110fb8)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/pprof/runtime.go:37 +0xf8
github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/pebble/internal/record.NewLogWriter.func2(0xc00007b400)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/pebble/internal/record/log_writer.go:308 +0x89
created by github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/pebble/internal/record.NewLogWriter
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/pebble/internal/record/log_writer.go:307 +0x29c
goroutine 973 [IO wait]:
internal/poll.runtime_pollWait(0xb350af8, 0x72, 0xffffffffffffffff)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/netpoll.go:184 +0x55
internal/poll.(*pollDesc).wait(0xc0015a0b18, 0x72, 0x700, 0x775, 0xffffffffffffffff)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc0015a0b00, 0xc00030f000, 0x775, 0x775, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_unix.go:169 +0x22b
net.(*netFD).Read(0xc0015a0b00, 0xc00030f000, 0x775, 0x775, 0x4d, 0x294a5294a5, 0x37)
/usr/local/Cellar/go/1.13.4/libexec/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0000100e0, 0xc00030f000, 0x775, 0x775, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/net/net.go:184 +0x68
github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/cmux.(*MuxConn).Read(0xc00088fbc0, 0xc00030f000, 0x775, 0x775, 0xc0002b5201, 0x10, 0x10)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:218 +0x10f
crypto/tls.(*atLeastReader).Read(0xc0002e83a0, 0xc00030f000, 0x775, 0x775, 0x0, 0x0, 0xc000ded9a8)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:780 +0x60
bytes.(*Buffer).ReadFrom(0xc000956258, 0x7d876e0, 0xc0002e83a0, 0x400c725, 0x711ba60, 0x7363f00)
/usr/local/Cellar/go/1.13.4/libexec/src/bytes/buffer.go:204 +0xb4
crypto/tls.(*Conn).readFromUntil(0xc000956000, 0x12213308, 0xc00088fbc0, 0x5, 0xc00088fbc0, 0x48)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:802 +0xec
crypto/tls.(*Conn).readRecordOrCCS(0xc000956000, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:609 +0x124
crypto/tls.(*Conn).readRecord(...)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:577
crypto/tls.(*Conn).Read(0xc000956000, 0xc000eac000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:1255 +0x161
bufio.(*Reader).Read(0xc00175b500, 0xc000391998, 0x9, 0x9, 0xc001710948, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/bufio/bufio.go:226 +0x26a
io.ReadAtLeast(0x7d87520, 0xc00175b500, 0xc000391998, 0x9, 0x9, 0x9, 0x5748a0e36082001, 0x500000000000000, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/io/io.go:310 +0x87
io.ReadFull(...)
/usr/local/Cellar/go/1.13.4/libexec/src/io/io.go:329
github.com/cockroachdb/cockroach/vendor/golang.org/x/net/http2.readFrameHeader(0xc000391998, 0x9, 0x9, 0x7d87520, 0xc00175b500, 0x0, 0xd500000000, 0xc0016c7f00, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/net/http2/frame.go:237 +0x87
github.com/cockroachdb/cockroach/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc000391960, 0xc0017775f0, 0xc0017775f0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/net/http2/frame.go:492 +0xa1
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0016ec180, 0xc001777710, 0x76f7ae0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:431 +0x86
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc0004be480, 0x7e54460, 0xc0016ec180)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/server.go:713 +0xf3
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc0004be480, 0x7e54460, 0xc0016ec180)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/server.go:675 +0x43
created by github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc.(*Server).handleRawConn
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/server.go:674 +0x5e0
goroutine 1817 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc001fd8a80, 0x0, 0x1, 0xc000e05738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc001fd5680, 0x0, 0xc0000b4800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc001b6a400, 0x33, 0x0, 0x0, 0xc002030000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2008 [select]:
github.com/cockroachdb/cockroach/pkg/rpc.rangeFeedClientAdapter.Recv(0x7e00bc0, 0xc001985fc0, 0xc00088e600, 0xc00088f7a0, 0xc002450900, 0xc001808090, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:551 +0xd1
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc0003225a0, 0x7e00bc0, 0xc001808080, 0xc001a3f970, 0xc, 0x10, 0xc0002fbec0, 0xc, 0x10, 0x1603d1e343385060, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:266 +0x516
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc0003225a0, 0x7e00bc0, 0xc001808080, 0xc00200b2c0, 0x1, 0xc001952120, 0xc001895500, 0x4ab7df0, 0x76f5800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:151 +0x298
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1(0x7e00bc0, 0xc001808080, 0x14, 0x18)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:73 +0x61
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1(0xc000e00768, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:166 +0x3a
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0018181b0, 0xc0022ca930)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x64
created by github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
goroutine 994 [sync.Cond.Wait]:
runtime.goparkunlock(...)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/proc.go:310
sync.runtime_notifyListWait(0xc0016a3450, 0x3)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/sema.go:510 +0xf8
sync.(*Cond).Wait(0xc0016a3440)
/usr/local/Cellar/go/1.13.4/libexec/src/sync/cond.go:56 +0x9d
github.com/cockroachdb/cockroach/pkg/sql.(*StmtBuf).CurCmd(0xc001a17820, 0x0, 0x0, 0x0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_io.go:439 +0xaa
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd(0xc001054000, 0x7e00bc0, 0xc0016a3480, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1321 +0x52
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).run(0xc001054000, 0x7e00bc0, 0xc0016a3480, 0xc0005e2340, 0x5400, 0x15000, 0xc0005e23d8, 0xc000fc0b90, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1297 +0x1f2
github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn(0xc000b0c680, 0x7e00bc0, 0xc0016a3480, 0xc001054000, 0x5400, 0x15000, 0xc0005e23d8, 0xc000fc0b90, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:476 +0x104
github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).processCommandsAsync.func1(0xc0002ed16d, 0xc0003640e0, 0x7e00bc0, 0xc0016a3480, 0xc000fc0b90, 0xc000b0c680, 0xc001a17200, 0x7e22b00, 0xc001a392c0, 0xc001894de0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/conn.go:594 +0x2e8
created by github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).processCommandsAsync
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/conn.go:526 +0x17e
goroutine 1612 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc000977920, 0x0, 0x1, 0xc0001b8cb0, 0xc000ae2900)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc0017eafc0, 0x1, 0x8)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0005440c0, 0x33, 0x0, 0x0, 0xc000a75800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 942 [chan receive]:
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc000658b00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/clientconn.go:1107 +0x656
created by github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc.(*addrConn).connect
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/clientconn.go:767 +0x120
goroutine 1678 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc0016a0480, 0x0, 0x1, 0xd741ec0ffef64382, 0xc2b4e77051d5d4bd)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc0014fb9e0, 0x0, 0xc000496ec0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000561240, 0x33, 0x0, 0x0, 0xc0012bb380)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 972 [select]:
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0016ec180)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:935 +0x218
created by github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:282 +0xfc9
goroutine 2015 [select]:
github.com/cockroachdb/cockroach/pkg/rpc.rangeFeedClientAdapter.Recv(0x7e00bc0, 0xc001304c40, 0xc00176ef00, 0xc00176ef60, 0xc001a959d4, 0x2, 0x2)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:551 +0xd1
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc0003225a0, 0x7e00bc0, 0xc001808080, 0xc001b40290, 0xc, 0x10, 0xc0002ed360, 0x1, 0x8, 0x1603d1e343385060, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:266 +0x516
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc0003225a0, 0x7e00bc0, 0xc001808080, 0xc001746550, 0x1, 0xc001952120, 0xc001895500, 0xc000db36a8, 0x4ab7bb4)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:151 +0x298
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1(0x7e00bc0, 0xc001808080, 0xc000570cc0, 0x23)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:73 +0x61
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1(0xc000db3768, 0x76f57c8)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:166 +0x3a
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0018181b0, 0xc0016baf30)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x64
created by github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
goroutine 1375 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x21, 0x7e5ee20, 0xc001376ae0, 0x0, 0x1, 0xc000fd0ee0, 0xc001616280)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x21, 0xc000edcb40, 0x2, 0x2)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000557800, 0x33, 0x0, 0x0, 0xc000d55080)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 979 [select]:
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001660c40)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1288 +0x113
created by github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:281 +0x1695
goroutine 1718 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0012cd1a0, 0x0, 0x1, 0xc000db0f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc00143f680, 0x0, 0xc0004d9c00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0017d8800, 0x33, 0x0, 0x0, 0xc0016d7410)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1561 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0011e3380, 0x0, 0x1, 0xc000db1f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc000cf6d80, 0x1603d1e357703f70, 0xc00069a000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00053f2c0, 0x33, 0x0, 0x0, 0xc000fd75c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2264 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc001ba93e0, 0x0, 0x1, 0xc000daef38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc001c09200, 0x1603d1e37254d490, 0xc0004d9c00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000545e40, 0x33, 0x0, 0x0, 0xc001277470)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 998 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.(*Watcher).processEvents(0xc001a36410, 0x7e00bc0, 0xc0016a3940, 0xc001895500, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/watcher.go:157 +0xee
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.Watch.func2(0x7e00bc0, 0xc0016a3940, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/watcher.go:96 +0x47
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1(0xc001111f68, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:166 +0x3a
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0019d40f0, 0xc0019d4150)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x64
created by github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
goroutine 2204 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc000390ee0, 0x7e00bc0, 0xc00036ac40, 0xc00036ac40, 0xc0010578a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/registry.go:256 +0x1f8
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc000390ee0, 0x7e00bc0, 0xc00036ac40)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/registry.go:273 +0xc2
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).Start.func1.1(0x7e00bc0, 0xc00036aa00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/processor.go:223 +0x64
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00bc0, 0xc00036aa00, 0xc00194f100, 0x1e, 0x0, 0x0, 0xc000333a20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 718 [runnable]:
internal/poll.runtime_pollWait(0xb350958, 0x72, 0xffffffffffffffff)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/netpoll.go:184 +0x55
internal/poll.(*pollDesc).wait(0xc000a70918, 0x72, 0x700, 0x733, 0xffffffffffffffff)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc000a70900, 0xc001902800, 0x733, 0x733, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_unix.go:169 +0x22b
net.(*netFD).Read(0xc000a70900, 0xc001902800, 0x733, 0x733, 0x203000, 0x924924924924, 0x36)
/usr/local/Cellar/go/1.13.4/libexec/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0000120a0, 0xc001902800, 0x733, 0x733, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/net/net.go:184 +0x68
crypto/tls.(*atLeastReader).Read(0xc000393200, 0xc001902800, 0x733, 0x733, 0x7, 0xe06c, 0xc001063428)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:780 +0x60
bytes.(*Buffer).ReadFrom(0xc0008c4958, 0x7d876e0, 0xc000393200, 0x400c725, 0x711ba60, 0x74dd0c0)
/usr/local/Cellar/go/1.13.4/libexec/src/bytes/buffer.go:204 +0xb4
crypto/tls.(*Conn).readFromUntil(0xc0008c4700, 0x122132e8, 0xc0000120a0, 0x5, 0xc0000120a0, 0x6)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:802 +0xec
crypto/tls.(*Conn).readRecordOrCCS(0xc0008c4700, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:609 +0x124
crypto/tls.(*Conn).readRecord(...)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:577
crypto/tls.(*Conn).Read(0xc0008c4700, 0xc000916000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:1255 +0x161
github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*readTimeoutConn).Read(0xc000364060, 0xc000916000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/conn.go:1567 +0x13d
bufio.(*Reader).fill(0xc001a17248)
/usr/local/Cellar/go/1.13.4/libexec/src/bufio/bufio.go:100 +0x103
bufio.(*Reader).ReadByte(0xc001a17248, 0xc0010637a0, 0x651e701, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/bufio/bufio.go:252 +0x39
github.com/cockroachdb/cockroach/pkg/sql/pgwire/pgwirebase.(*ReadBuffer).ReadTypedMsg(0xc001a179d0, 0x7dd6040, 0xc001a17248, 0x7dc7dc0, 0x9d74330, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/pgwirebase/encoding.go:118 +0x35
github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).serveImpl(0xc001a17200, 0x7e00c80, 0xc001a391a0, 0xc000fc0b60, 0xc000b0c680, 0x5400, 0x15000, 0xc0005e23d8, 0x0, 0x4, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/conn.go:326 +0x537
github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*Server).serveConn(0xc0005e2240, 0x7e00c80, 0xc001a391a0, 0x7e4e2e0, 0xc0008c4700, 0xc00167d009, 0x4, 0xc001a391d0, 0x7dc68c0, 0xc0012c8c90, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/conn.go:156 +0x1dd
github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*Server).ServeConn(0xc0005e2240, 0x7e00c80, 0xc001a391a0, 0x7e4e2e0, 0xc0008c4700, 0xc000240401, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/server.go:559 +0x812
github.com/cockroachdb/cockroach/pkg/server.(*Server).startServeSQL.func1.1(0x7e4f060, 0xc0000120a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:2059 +0x16a
github.com/cockroachdb/cockroach/pkg/util/netutil.(*Server).ServeWith.func1(0xc0002cea20, 0x7e00c80, 0xc0012c81e0, 0xc0005d83c0, 0x7e4f060, 0xc0000120a0, 0xc0012c8210)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/netutil/net.go:147 +0xc8
created by github.com/cockroachdb/cockroach/pkg/util/netutil.(*Server).ServeWith
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/netutil/net.go:144 +0x22b
goroutine 2073 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0011e0b40, 0x0, 0x1, 0xc001b40290, 0xc)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc001a24360, 0xc0017487a0, 0xc00067e800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000560940, 0x33, 0x0, 0x0, 0xc0015aaf60)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2207 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc0011f42a0, 0x0, 0x1, 0xbf9b883f21cecce8, 0x3f5c91e2)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc0015c1d40, 0x0, 0xc000e046c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00055f8c0, 0x33, 0x0, 0x0, 0xc0016c9da0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 959 [select]:
database/sql.(*DB).connectionResetter(0xc000acc900, 0x7e00bc0, 0xc00159c900)
/usr/local/Cellar/go/1.13.4/libexec/src/database/sql/sql.go:1065 +0xfb
created by database/sql.OpenDB
/usr/local/Cellar/go/1.13.4/libexec/src/database/sql/sql.go:723 +0x193
goroutine 980 [IO wait]:
internal/poll.runtime_pollWait(0xb350bc8, 0x72, 0xffffffffffffffff)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/netpoll.go:184 +0x55
internal/poll.(*pollDesc).wait(0xc0015a0a98, 0x72, 0x2100, 0x21c8, 0xffffffffffffffff)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc0015a0a80, 0xc000138f00, 0x21c8, 0x21c8, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_unix.go:169 +0x22b
net.(*netFD).Read(0xc0015a0a80, 0xc000138f00, 0x21c8, 0x21c8, 0x203000, 0x0, 0x21c3)
/usr/local/Cellar/go/1.13.4/libexec/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0005d84f0, 0xc000138f00, 0x21c8, 0x21c8, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/net/net.go:184 +0x68
crypto/tls.(*atLeastReader).Read(0xc0019bb5c0, 0xc000138f00, 0x21c8, 0x21c8, 0x3b, 0xc0000b4800, 0xc000cb2a08)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:780 +0x60
bytes.(*Buffer).ReadFrom(0xc00184acd8, 0x7d876e0, 0xc0019bb5c0, 0x400c725, 0x711ba60, 0x74dd0c0)
/usr/local/Cellar/go/1.13.4/libexec/src/bytes/buffer.go:204 +0xb4
crypto/tls.(*Conn).readFromUntil(0xc00184aa80, 0x122132e8, 0xc0005d84f0, 0x5, 0xc0005d84f0, 0x8)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:802 +0xec
crypto/tls.(*Conn).readRecordOrCCS(0xc00184aa80, 0x0, 0x0, 0xc000d576d8)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:609 +0x124
crypto/tls.(*Conn).readRecord(...)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:577
crypto/tls.(*Conn).Read(0xc00184aa80, 0xc000ea4000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/crypto/tls/conn.go:1255 +0x161
bufio.(*Reader).Read(0xc0019cd440, 0xc000fc4038, 0x9, 0x9, 0x20, 0xc000cb2d18, 0x468476e)
/usr/local/Cellar/go/1.13.4/libexec/src/bufio/bufio.go:226 +0x26a
io.ReadAtLeast(0x7d87520, 0xc0019cd440, 0xc000fc4038, 0x9, 0x9, 0x9, 0x8616f27709502901, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/io/io.go:310 +0x87
io.ReadFull(...)
/usr/local/Cellar/go/1.13.4/libexec/src/io/io.go:329
github.com/cockroachdb/cockroach/vendor/golang.org/x/net/http2.readFrameHeader(0xc000fc4038, 0x9, 0x9, 0x7d87520, 0xc0019cd440, 0x0, 0x0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/net/http2/frame.go:237 +0x87
github.com/cockroachdb/cockroach/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc000fc4000, 0xc0017ce0c0, 0xc0017ce0c0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/net/http2/frame.go:492 +0xa1
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001660c40)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1237 +0x17e
created by github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:286 +0xd48
goroutine 961 [select]:
github.com/cockroachdb/cockroach/pkg/rpc.(*Context).runHeartbeat(0xc0000ce000, 0xc000a7d270, 0xc0002430d0, 0xf, 0xc000e328a0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:1054 +0x30b
github.com/cockroachdb/cockroach/pkg/rpc.(*Context).grpcDialNodeInternal.func1.1.1(0x7e00c80, 0xc0004f1ef0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:989 +0x79
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002b4be0, 0xc0002cea20, 0xc000a7d2c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 1458 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc0013c5380, 0x0, 0x1, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc00109dc20, 0x0, 0xc00066e6c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0005504c0, 0x33, 0x0, 0x0, 0xc0012e36b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 981 [select]:
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00159cd80, 0x1, 0x0, 0x0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:317 +0x11a
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0019cd500, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:435 +0x1e3
github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc001660c40)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:330 +0x7b
created by github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:328 +0xee5
goroutine 2054 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x20, 0x7e5ee20, 0xc0011482a0, 0x0, 0x1, 0xc000740738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x20, 0xc001a54c60, 0x1603d1e372587e10, 0xc00067e800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000550c40, 0x33, 0x0, 0x0, 0xc0018682a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1004 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*lockTableWaiterImpl).WaitOn(0xc001869d10, 0x7e00c80, 0xc001971230, 0xc001370360, 0x1603d1e37da1ce20, 0x0, 0x0, 0x0, 0xc0018ada80, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/lock_table_waiter.go:120 +0x19f
github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*managerImpl).sequenceReqWithGuard(0xc001b77cc0, 0x7e00c80, 0xc001971230, 0xc00046a150, 0xc001370360, 0x1603d1e37da1ce20, 0x0, 0x0, 0x0, 0xc0018ada80, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/concurrency_manager.go:170 +0x43e
github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*managerImpl).SequenceReq(0xc001b77cc0, 0x7e00c80, 0xc001971230, 0x0, 0xc001370360, 0x1603d1e37da1ce20, 0x0, 0x0, 0x0, 0xc0018ada80, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/concurrency_manager.go:121 +0xfb
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries(0xc0015b0700, 0x7e00c80, 0xc001971230, 0xc0018adb80, 0x76f2508, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:219 +0x326
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithRangeID(0xc0015b0700, 0x7e00c80, 0xc001971200, 0x29, 0xc0018adb80, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:94 +0x68a
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send(0xc0015b0700, 0x7e00c80, 0xc001971200, 0x1603d1e37da1ce20, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:36 +0x91
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send(0xc000579c00, 0x7e00c80, 0xc0019711a0, 0x1603d1e37da1ce20, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:202 +0x606
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send(0xc00027dea0, 0x7e00c80, 0xc0019711a0, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:188 +0xed
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1(0x7e00c80, 0xc0019711a0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:922 +0x201
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0002cea20, 0x7e00c80, 0xc0019711a0, 0x75970dd, 0x10, 0xc0024454b0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:302 +0x140
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal(0xc000108a00, 0x7e00c80, 0xc0019711a0, 0xc0018adb00, 0xc0019711a0, 0xc001970060, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:910 +0x194
github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch(0xc000108a00, 0x7e00c80, 0xc001971170, 0xc0018adb00, 0xc001971050, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:948 +0x9f
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:537
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch(0xc0017a6440, 0x7e00c80, 0xc001971170, 0x1, 0x7dc7ac0, 0xc0002e4e10, 0x0, 0x0, 0x100000001, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:199 +0x127
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext(0xc0017a6440, 0x7e00c80, 0xc001971050, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:168 +0x160
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas(0xc0003225a0, 0x7e00c80, 0xc001971050, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1625 +0x2a2
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendRPC(0xc0003225a0, 0x7e00c80, 0xc001971050, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:456 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendSingleRange(0xc0003225a0, 0x7e00c80, 0xc001971050, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:538 +0x2ee
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch(0xc0003225a0, 0x7e00c80, 0xc001971050, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1394 +0x3cf
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges(0xc0003225a0, 0x7e00c80, 0xc001971050, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1079 +0x164a
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send(0xc0003225a0, 0x7e00c80, 0xc001971050, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:730 +0x785
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnLockGatekeeper).SendLocked(0xc001695ac8, 0x7e00c80, 0xc001971050, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_lock_gatekeeper.go:86 +0x10b
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnMetricRecorder).SendLocked(0xc001695a90, 0x7e00c80, 0xc001971050, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_metric_recorder.go:46 +0x8d
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnCommitter).SendLocked(0xc001695a60, 0x7e00c80, 0xc001971050, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_committer.go:126 +0x874
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSpanRefresher).sendLockedWithRefreshAttempts(0xc0016959c8, 0x7e00c80, 0xc001971050, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_span_refresher.go:247 +0x9b
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSpanRefresher).SendLocked(0xc0016959c8, 0x7e00c80, 0xc001971050, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_span_refresher.go:182 +0x180
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnPipeliner).SendLocked(0xc001695908, 0x7e00c80, 0xc001971050, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_pipeliner.go:252 +0x159
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnSeqNumAllocator).SendLocked(0xc0016958e8, 0x7e00c80, 0xc001971050, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_seq_num_allocator.go:105 +0x20c
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnHeartbeater).SendLocked(0xc001695848, 0x7e00c80, 0xc001971050, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_heartbeater.go:172 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*TxnCoordSender).Send(0xc001695680, 0x7e00c80, 0xc001971050, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_coord_sender.go:503 +0x406
github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender(0xc0001e6700, 0x7e00c80, 0xc001970120, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:739 +0x122
github.com/cockroachdb/cockroach/pkg/kv.(*Txn).Send(0xc0017ff9e0, 0x7e00c80, 0xc001970120, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:907 +0x11e
github.com/cockroachdb/cockroach/pkg/kv.sendAndFill(0x7e00c80, 0xc001970120, 0xc002448240, 0xc000e8a580, 0xc00190d400, 0xc001ff3920)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:657 +0xf7
github.com/cockroachdb/cockroach/pkg/kv.(*Txn).Run(0xc0017ff9e0, 0x7e00c80, 0xc001970120, 0xc000e8a580, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:575 +0xfa
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).AdminMerge.func1(0xc0017ff9e0, 0xc001970120, 0xc0001e6700)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_command.go:680 +0x91c
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).AdminMerge(0xc0015b0700, 0x7e00c80, 0xc001970120, 0xc001a03c00, 0xc, 0x10, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_command.go:771 +0x130
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeAdminBatch(0xc0015b0700, 0x7e00c80, 0xc001970120, 0xc0018ad280, 0xa, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:424 +0x9f3
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithRangeID(0xc0015b0700, 0x7e00c80, 0xc0019700f0, 0x29, 0xc0018ad280, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:101 +0x5eb
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send(0xc0015b0700, 0x7e00c80, 0xc0019700f0, 0x1603d1e37da1be80, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:36 +0x91
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send(0xc000579c00, 0x7e00c80, 0xc001970090, 0x1603d1e37da1be80, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:202 +0x606
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send(0xc00027dea0, 0x7e00c80, 0xc001970090, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:188 +0xed
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1(0x7e00c80, 0xc001970090, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:922 +0x201
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0002cea20, 0x7e00c80, 0xc001970090, 0x75970dd, 0x10, 0xc002449b38, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:302 +0x140
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal(0xc000108a00, 0x7e00c80, 0xc001970090, 0xc0018ad200, 0xc001970090, 0x80, 0x80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:910 +0x194
github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch(0xc000108a00, 0x7e00c80, 0xc001970060, 0xc0018ad200, 0xc001970000, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:948 +0x9f
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:537
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch(0xc001b754c0, 0x7e00c80, 0xc001970060, 0x1, 0x7dc7ac0, 0xc0002e4e10, 0x0, 0x0, 0x100000001, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:199 +0x127
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext(0xc001b754c0, 0x7e00c80, 0xc001970000, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:168 +0x160
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas(0xc0003225a0, 0x7e00c80, 0xc001970000, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1625 +0x2a2
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendRPC(0xc0003225a0, 0x7e00c80, 0xc001970000, 0x0, 0x0, 0x0, 0x0, 0x0, 0x29, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:456 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendSingleRange(0xc0003225a0, 0x7e00c80, 0xc001970000, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:538 +0x2ee
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch(0xc0003225a0, 0x7e00c80, 0xc001970000, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1394 +0x3cf
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges(0xc0003225a0, 0x7e00c80, 0xc001970000, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1079 +0x164a
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send(0xc0003225a0, 0x7e00bc0, 0xc001aed900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:730 +0x785
github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send(0xc0001e6760, 0x7e00bc0, 0xc001aed900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:223 +0x95
github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender(0xc0001e6700, 0x7e00bc0, 0xc001aed900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:739 +0x122
github.com/cockroachdb/cockroach/pkg/kv.(*DB).send(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:721
github.com/cockroachdb/cockroach/pkg/kv.sendAndFill(0x7e00bc0, 0xc001aed900, 0xc00244b920, 0xc001033700, 0x10, 0xc001a03c00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:657 +0xf7
github.com/cockroachdb/cockroach/pkg/kv.(*DB).Run(0xc0001e6700, 0x7e00bc0, 0xc001aed900, 0xc001033700, 0x704d980, 0x4063201)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:680 +0x9c
github.com/cockroachdb/cockroach/pkg/kv.(*DB).AdminMerge(0xc0001e6700, 0x7e00bc0, 0xc001aed900, 0x6f9d460, 0xc00190c960, 0x2d4dbb8800000000, 0x5e8da97c)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:510 +0x84
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.applyOp(0x7e00bc0, 0xc001aed900, 0xc0001e6700, 0xc00024c540)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/applier.go:78 +0x651
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.(*Applier).Apply(0xc001a398f0, 0x7e00bc0, 0xc001aed900, 0xc00024c540, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/applier.go:58 +0xf2
github.com/cockroachdb/cockroach/pkg/kv/kvnemesis.RunNemesis.func2(0x7e00bc0, 0xc001aed900, 0x0, 0x4ab7df0, 0x76f5800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvnemesis/kvnemesis.go:55 +0x1f5
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.GroupWorkers.func1(0x7e00bc0, 0xc001aed900, 0x15, 0x18)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:175 +0x42
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1(0xc000db6f68, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:166 +0x3a
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0019d58f0, 0xc0019d5920)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x64
created by github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
goroutine 1591 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc000a6f080, 0x0, 0x1, 0xc000464f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc001247c20, 0x1603d1e355e6f3d8, 0xc0004d9c00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000559280, 0x33, 0x0, 0x0, 0xc0004b6d80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1541 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0011f5260, 0x0, 0x1, 0xc000db2738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc0017c5c20, 0xc000db26a8, 0xc0004d9c00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0002d9540, 0x33, 0x0, 0x0, 0xc001276ea0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 506 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1(0x7e00bc0, 0xc001808080, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:69 +0x13f
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1(0xc001111768, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:166 +0x3a
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0018181b0, 0xc0018181e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x64
created by github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
goroutine 1121 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc001651080, 0x0, 0x1, 0x4f82f19, 0xc0013ae6e8)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc00138ec60, 0x0, 0xc00138e240)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000575480, 0x33, 0x0, 0x0, 0xc0015aaea0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2567 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).ResolveIntents(0xc000264700, 0x7e00bc0, 0xc0022189c0, 0xc001010000, 0x9, 0x9, 0xc00031f400, 0x1603d1e37d2ba420, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:834 +0x5b2
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc001540000, 0xc001010000, 0x9, 0x9, 0x1603d1e37e2e81a8, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:731 +0xfc
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).CleanupTxnIntentsAsync.func1(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:538 +0x1a9
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunLimitedAsyncTask.func2(0xc0002cea20, 0x7e00c00, 0xc000052110, 0x75ec841, 0x2a, 0xc001fdca90, 0x0, 0x0, 0xc0017ce5d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:382 +0x19b
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunLimitedAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:376 +0x274
goroutine 954 [IO wait]:
internal/poll.runtime_pollWait(0xb350c98, 0x72, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/runtime/netpoll.go:184 +0x55
internal/poll.(*pollDesc).wait(0xc000abec18, 0x72, 0x0, 0x0, 0x757fe30)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Accept(0xc000abec00, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/internal/poll/fd_unix.go:384 +0x1f8
net.(*netFD).accept(0xc000abec00, 0x37e11d600, 0x0, 0x0)
/usr/local/Cellar/go/1.13.4/libexec/src/net/fd_unix.go:238 +0x42
net.(*TCPListener).accept(0xc0002e9fc0, 0xc000caede8, 0xc000caedf0, 0x38)
/usr/local/Cellar/go/1.13.4/libexec/src/net/tcpsock_posix.go:139 +0x32
net.(*TCPListener).Accept(0xc0002e9fc0, 0x76f5708, 0xc0002cea20, 0x7e00c80, 0xc0012c81e0)
/usr/local/Cellar/go/1.13.4/libexec/src/net/tcpsock.go:261 +0x47
github.com/cockroachdb/cockroach/pkg/util/netutil.(*Server).ServeWith(0xc0005d83c0, 0x7e00c80, 0xc0012c81e0, 0xc0002cea20, 0x7dec800, 0xc0002e9fc0, 0xc0012c8210, 0xc0012c81e0, 0xc000db36e8)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/netutil/net.go:126 +0x50
github.com/cockroachdb/cockroach/pkg/server.(*Server).startServeSQL.func1(0x7e00c80, 0xc0012c81e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:2055 +0xdd
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002b4910, 0xc0002cea20, 0xc0004f1860)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 1257 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0015e0180, 0x0, 0x1, 0xc0005d4ee0, 0xc0013b48c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc00164ed80, 0x3, 0x8)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000056680, 0x33, 0x0, 0x0, 0xc001869ec0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1254 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/idalloc.(*Allocator).start.func1(0x7e00c80, 0xc0012c8870)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/idalloc/id_alloc.go:119 +0x442
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00032e420, 0xc0002cea20, 0xc00032e3e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 2214 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*RangeDescriptorCache).lookupRangeDescriptorInternal(0xc0002b08c0, 0x7e00bc0, 0xc001808080, 0xc00032c6d0, 0xc, 0x10, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/range_cache.go:392 +0x5a0
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*RangeDescriptorCache).LookupRangeDescriptorWithEvictionToken(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/range_cache.go:266
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).getDescriptor(0xc0003225a0, 0x7e00bc0, 0xc001808080, 0xc00032c6d0, 0xc, 0x10, 0x0, 0x0, 0x10, 0x1603d1e343385060, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:500 +0x99
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc0003225a0, 0x7e00bc0, 0xc001808080, 0xc00169dea0, 0xc000108a01, 0xc001952120, 0xc001895500, 0xc0022c47c0, 0x76f5800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:143 +0xa3d
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1(0x7e00bc0, 0xc001808080, 0x4c40ff2, 0xc001fdcb00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:73 +0x61
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1(0xc000e00768, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:166 +0x3a
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0018181b0, 0xc0016e97a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x64
created by github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
goroutine 1690 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc00176f920, 0x0, 0x1, 0xc000db2738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc00179c480, 0xc0017fb8c0, 0xc00067e000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000575880, 0x33, 0x0, 0x0, 0xc000a3a450)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1812 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0015e1ec0, 0x0, 0x1, 0xc000272c20, 0xf)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc001c085a0, 0xc000a758f0, 0xc000e05688)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc001b6a180, 0x33, 0x0, 0x0, 0xc0016baff0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2106 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc0001af260, 0x7e00bc0, 0xc001138680, 0xc001138680, 0xc000fc0cc0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/registry.go:256 +0x1f8
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc0001af260, 0x7e00bc0, 0xc001138680)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/registry.go:273 +0xc2
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).Start.func1.1(0x7e00bc0, 0xc00036aa00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/processor.go:223 +0x64
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00bc0, 0xc00036aa00, 0xc0018ff8a0, 0x1e, 0x0, 0x0, 0xc00035cf80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2023 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0015e0300, 0x0, 0x1, 0xc000db2f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc00126a5a0, 0xc00169a660, 0xc0000b4800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000350740, 0x33, 0x0, 0x0, 0xc0020abd70)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1430 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x21, 0x7e5ee20, 0xc0011e1680, 0x0, 0x1, 0xc540c5e41b431dee, 0x59ca313a8c515ca1)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x21, 0xc001134a20, 0x0, 0xc00110ce88)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00054d7c0, 0x33, 0x0, 0x0, 0xc00145e990)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1343 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0013c4d20, 0x0, 0x1, 0x3d46f721ddfacd9c, 0x3ec9a8fbfb396ca5)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc001447560, 0x3, 0x8)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0005500c0, 0x33, 0x0, 0x0, 0xc0012e2ff0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2227 [select]:
github.com/cockroachdb/cockroach/pkg/rpc.rangeFeedClientAdapter.Recv(0x7e00bc0, 0xc00061f9c0, 0xc0011e2060, 0xc0011e21e0, 0xc001a989d4, 0x2, 0x2)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:551 +0xd1
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc0003225a0, 0x7e00bc0, 0xc001808080, 0xc002351af0, 0xc, 0x10, 0xc00032c6d0, 0xc, 0x10, 0x1603d1e343385060, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:266 +0x516
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc0003225a0, 0x7e00bc0, 0xc001808080, 0xc0003caf50, 0xc00023a101, 0xc001952120, 0xc001895500, 0x4ab7df0, 0x76f5800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:151 +0x298
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1(0x7e00bc0, 0xc001808080, 0x24, 0x18)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:73 +0x61
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1(0xc000e03f68, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:166 +0x3a
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0018181b0, 0xc0004b68d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x64
created by github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
goroutine 1459 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc0013c5440, 0x0, 0x1, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc0012265a0, 0x0, 0xc00066e6c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000550540, 0x33, 0x0, 0x0, 0xc0012e3740)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1024 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x20, 0x7e5ee20, 0xc001a6cea0, 0x0, 0x1, 0xc000e01f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x20, 0xc00180c7e0, 0xc0003921a0, 0xc00067e000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0003b01c0, 0x33, 0x0, 0x0, 0xc001a39170)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1969 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0018946c0, 0x0, 0x1, 0xc000dace48, 0xc000dacd38)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc0017ea000, 0xc0003fc540, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000574e80, 0x33, 0x0, 0x0, 0xc000a3b2c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1454 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x24, 0x7e5ee20, 0xc0016a0780, 0x0, 0x1, 0xc00110f738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x24, 0xc00179ca20, 0xc00110f6a8, 0xc000088c00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000560bc0, 0x33, 0x0, 0x0, 0xc001677a70)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2505 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnHeartbeater).heartbeatLoop(0xc001695848, 0x7e00bc0, 0xc0017a6340)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_heartbeater.go:257 +0x19c
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00bc0, 0xc0017a6340, 0xc000571500, 0x29, 0x7e67220, 0xc00023a1c0, 0xc00020cad0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1882 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc002146cc0, 0x0, 0x1, 0xc000daef38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc002068ea0, 0x1603d1e36fad8e08, 0xc0000b4800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0017d9e40, 0x33, 0x0, 0x0, 0xc00200d470)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2142 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x28, 0x7e5ee20, 0xc00124ec60, 0x0, 0x1, 0xc000dac738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x28, 0xc0011e9c20, 0x1603d1e3748a61d0, 0xc0004d9c00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000545580, 0x33, 0x0, 0x0, 0xc000dee870)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2232 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x27, 0x7e5ee20, 0xc0011e28a0, 0x0, 0x1, 0x748de40, 0xc0000b4800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x27, 0xc00094c360, 0x1603d1e370cbdb00, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00053e240, 0x33, 0x0, 0x0, 0xc0004b6b10)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2223 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc0013c4cc0, 0x0, 0x1, 0xc000db2738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc0018d4360, 0x7dc7a00, 0xc00067e000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000057080, 0x33, 0x0, 0x0, 0xc0017ce7b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1872 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0012de1e0, 0x0, 0x1, 0xc0005d4ee0, 0xc001b74e40)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc00222d9e0, 0x3, 0x8)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00055e000, 0x33, 0x0, 0x0, 0xc0015180f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 1979 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc00241c480, 0x0, 0x1, 0xc000db3738, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc0022590e0, 0x7dc7a00, 0xc0004a8000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc001945b80, 0x33, 0x0, 0x0, 0xc002412180)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2321 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc0018549c0, 0x0, 0x1, 0xc00049df38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc0022219e0, 0x0, 0xc0004a8000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0017d9bc0, 0x33, 0x0, 0x0, 0xc001988ea0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2201 [chan receive]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(0xc0015b0700, 0xc000ecafa0, 0x7e42b80, 0xc0003335e0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_rangefeed.go:233 +0x53f
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000579c00, 0xc000ecafa0, 0x7e42b80, 0xc0003335e0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store.go:2219 +0x116
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc00027dea0, 0xc000ecafa0, 0x7e42b80, 0xc0003335e0, 0xc000e06770)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:213 +0x12a
github.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0xc000108a00, 0xc000ecafa0, 0x7e42b80, 0xc0003335e0, 0x4ab7bb4, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1030 +0x59
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed.func1(0xc001057830, 0x7dc3240, 0xc000108a00, 0xc000ecafa0, 0x7e00bc0, 0xc001985fc0, 0xc00088e600, 0xc00088f7a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:605 +0xe8
created by github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:603 +0x11d
goroutine 2131 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc001b8a000, 0x7e00bc0, 0xc001304dc0, 0xc001304dc0, 0xc0003a6ad0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/registry.go:256 +0x1f8
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc001b8a000, 0x7e00bc0, 0xc001304dc0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/registry.go:273 +0xc2
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).Start.func1.1(0x7e00bc0, 0xc001304c80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/processor.go:223 +0x64
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00bc0, 0xc001304c80, 0xc0018724a0, 0x1e, 0x0, 0x0, 0xc001748860)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2202 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).Start.func1(0x7e00c80, 0xc0016c9020)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/processor.go:202 +0x44a
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc001057870, 0xc0002cea20, 0xc0016c8ff0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 1964 [select]:
github.com/cockroachdb/cockroach/pkg/rpc.rangeFeedClientAdapter.Recv(0x7e00bc0, 0xc00131f780, 0xc0016df860, 0xc0016df8c0, 0xc000ab49d4, 0x2, 0x2)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:551 +0xd1
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc0003225a0, 0x7e00bc0, 0xc001808080, 0xc0002ed358, 0x1, 0x8, 0xc002351af0, 0xc, 0x10, 0x1603d1e343385060, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:266 +0x516
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc0003225a0, 0x7e00bc0, 0xc001808080, 0xc00175eff0, 0x1, 0xc001952120, 0xc001895500, 0x4ab7df0, 0x76f5800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:151 +0x298
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1(0x7e00bc0, 0xc001808080, 0x15, 0x18)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:73 +0x61
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1(0xc000e02768, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:166 +0x3a
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0018181b0, 0xc000a3ab70)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x64
created by github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
goroutine 1965 [chan receive]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(0xc000d8c000, 0xc0016ceaa0, 0x7e42b80, 0xc00171b3e0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_rangefeed.go:233 +0x53f
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000579c00, 0xc0016ceaa0, 0x7e42b80, 0xc00171b3e0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store.go:2219 +0x116
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc00027dea0, 0xc0016ceaa0, 0x7e42b80, 0xc00171b3e0, 0xc000e02770)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:213 +0x12a
github.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0xc000108a00, 0xc0016ceaa0, 0x7e42b80, 0xc00171b3e0, 0x76f5800, 0xc000e02748)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1030 +0x59
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed.func1(0xc0003b8b70, 0x7dc3240, 0xc000108a00, 0xc0016ceaa0, 0x7e00bc0, 0xc00131f780, 0xc0016df860, 0xc0016df8c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:605 +0xe8
created by github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:603 +0x11d
goroutine 1966 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).Start.func1(0x7e00c80, 0xc000a3acc0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/processor.go:202 +0x44a
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0003b8c00, 0xc0002cea20, 0xc000a3ac90)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 1968 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc000331260, 0x7e00bc0, 0xc00131f900, 0xc00131f900, 0xc0003b8c40)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/registry.go:256 +0x1f8
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc000331260, 0x7e00bc0, 0xc00131f900)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/registry.go:273 +0xc2
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).Start.func1.1(0x7e00bc0, 0xc00131f7c0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/processor.go:223 +0x64
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00bc0, 0xc00131f7c0, 0xc0017b8ac0, 0x1e, 0x0, 0x0, 0xc00171b520)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2129 [select]:
github.com/cockroachdb/cockroach/pkg/rpc.rangeFeedClientAdapter.Recv(0x7e00bc0, 0xc0017a7240, 0xc0013ca840, 0xc0013ca8a0, 0xc001b539d4, 0x2, 0x2)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:551 +0xd1
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc0003225a0, 0x7e00bc0, 0xc001808080, 0xc000340310, 0xc, 0x10, 0xc001b40290, 0xc, 0x10, 0x1603d1e343385060, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:266 +0x516
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc0003225a0, 0x7e00bc0, 0xc001808080, 0xc000e46a00, 0x4ab7901, 0xc001952120, 0xc001895500, 0x70e79c0, 0x9d74330)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:151 +0x298
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1(0x7e00bc0, 0xc001808080, 0x8, 0xc00073fef8)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:73 +0x61
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1(0xc00073ff68, 0xc00073ff70)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:166 +0x3a
github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1(0xc0018181b0, 0xc001b7f1a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x64
created by github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x66
goroutine 2147 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x22, 0x7e5ee20, 0xc0019b5440, 0x0, 0x1, 0xc000340310, 0xc)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x22, 0xc00183d680, 0x20, 0xc0003930e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0005587c0, 0x33, 0x0, 0x0, 0xc001b7f590)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2105 [chan receive]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(0xc0015b0700, 0xc001251400, 0x7e42b80, 0xc00035ce20, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_rangefeed.go:233 +0x53f
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000579c00, 0xc001251400, 0x7e42b80, 0xc00035ce20, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store.go:2219 +0x116
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc00027dea0, 0xc001251400, 0x7e42b80, 0xc00035ce20, 0xc000e05f70)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:213 +0x12a
github.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0xc000108a00, 0xc001251400, 0x7e42b80, 0xc00035ce20, 0x4ab7bb4, 0x76f5800)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1030 +0x59
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed.func1(0xc000fc0c80, 0x7dc3240, 0xc000108a00, 0xc001251400, 0x7e00bc0, 0xc001138540, 0xc001451080, 0xc0014510e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:605 +0xe8
created by github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:603 +0x11d
goroutine 2017 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).Start.func1(0x7e00c80, 0xc0016bb0e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/processor.go:202 +0x44a
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0003a6a90, 0xc0002cea20, 0xc0016bb0b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 2231 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc0019a6e00, 0x7e00bc0, 0xc00061fb40, 0xc00061fb40, 0xc0002b57e0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/registry.go:256 +0x1f8
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc0019a6e00, 0x7e00bc0, 0xc00061fb40)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/registry.go:273 +0xc2
github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).Start.func1.1(0x7e00bc0, 0xc00061fa00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed/processor.go:223 +0x64
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00bc0, 0xc00061fa00, 0xc0003bc660, 0x1e, 0x0, 0x0, 0xc0002f1880)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2319 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc001854540, 0x0, 0x1, 0xc0000ce000, 0xc000272c20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc00240f7a0, 0x0, 0xc00049de88)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0017d9b00, 0x33, 0x0, 0x0, 0xc001988b70)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2440 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc002150060, 0x0, 0x1, 0xc000462d38, 0x40c4708)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc00194a900, 0x0, 0xc000462e88)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc0018fa980, 0x33, 0x0, 0x0, 0xc0022d4810)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2455 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc001854840, 0x0, 0x1, 0xc000467f38, 0xc0005037a0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc001a4c360, 0x3, 0xc0004a8000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc000544240, 0x33, 0x0, 0x0, 0xc001ff2540)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2566 [select]:
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).Send(0xc000503680, 0x7e00c00, 0xc000052110, 0x29, 0x7e5ee20, 0xc00173f1a0, 0x0, 0x1, 0xc0000ce000, 0xc000272c20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:248 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).gcTxnRecord(0xc000264700, 0x7e00c00, 0xc000052110, 0x29, 0xc0015c17a0, 0x0, 0xc00110ee88)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:700 +0x364
github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver.(*IntentResolver).cleanupFinishedTxnIntents.func2(0x7e00c00, 0xc000052110)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver/intent_resolver.go:739 +0x68
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00c00, 0xc000052110, 0xc00177e780, 0x33, 0x0, 0x0, 0xc001a8bf20)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2517 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnHeartbeater).heartbeatLoop(0xc0008b8f48, 0x7e00bc0, 0xc001b69780)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_heartbeater.go:257 +0x19c
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00bc0, 0xc001b69780, 0xc000509350, 0x29, 0x7e67220, 0xc00023a1c0, 0xc0002412b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2547 [runnable]:
github.com/cockroachdb/cockroach/pkg/storage._Cfunc_DBNewIter(0x158192a0, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
_cgo_gotypes.go:1205 +0xf4
github.com/cockroachdb/cockroach/pkg/storage.(*rocksDBIterator).init.func1(0x158192a0, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/storage/rocksdb.go:2217 +0xd4
github.com/cockroachdb/cockroach/pkg/storage.(*rocksDBIterator).init(0xc00164a928, 0x158192a0, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/storage/rocksdb.go:2217 +0x82
github.com/cockroachdb/cockroach/pkg/storage.(*rocksDBBatch).NewIterator(0xc00164a900, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/storage/rocksdb.go:1898 +0x266
github.com/cockroachdb/cockroach/pkg/storage.MVCCResolveWriteIntent(0x7e00c80, 0xc00241f770, 0x122554c8, 0xc002151800, 0xc00202a4d0, 0xc001324300, 0x17, 0x30, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/storage/mvcc.go:2630 +0x6e
github.com/cockroachdb/cockroach/pkg/kv/kvserver/batcheval.ResolveIntent(0x7e00c80, 0xc00241f770, 0x122554c8, 0xc002151800, 0x7e7fa80, 0xc000d67c00, 0x1603d1e37e8bf770, 0x0, 0x100000001, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/batcheval/cmd_resolve_intent.go:90 +0x30a
github.com/cockroachdb/cockroach/pkg/kv/kvserver.evaluateCommand(0x7e00c80, 0xc00241f770, 0xc002350658, 0x8, 0x0, 0x122554c8, 0xc002151800, 0x7e7fa80, 0xc000d67c00, 0xc00202a4d0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_evaluate.go:462 +0x235
github.com/cockroachdb/cockroach/pkg/kv/kvserver.evaluateBatch(0x7e00c80, 0xc00241f770, 0xc002350658, 0x8, 0x122554c8, 0xc002151800, 0x7e7fa80, 0xc000d67c00, 0xc00202a4d0, 0xc002244e80, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_evaluate.go:241 +0x3c0
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evaluateWriteBatchWrapper(0xc000d67c00, 0x7e00c80, 0xc00241f770, 0xc002350658, 0x8, 0x7e7fa80, 0xc000d67c00, 0xc00202a4d0, 0xc002244e80, 0xc002151740, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:553 +0x144
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evaluateWriteBatchWithServersideRefreshes(0xc000d67c00, 0x7e00c80, 0xc00241f770, 0xc002350658, 0x8, 0x7e7fa80, 0xc000d67c00, 0xc00202a4d0, 0xc002244e80, 0xc002151740, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:522 +0x135
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evaluateWriteBatch(0xc000d67c00, 0x7e00c80, 0xc00241f770, 0xc002350658, 0x8, 0xc002244e80, 0xc002151740, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:345 +0x1df
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evaluateProposal(0xc000d67c00, 0x7e00c80, 0xc00241f770, 0xc002350658, 0x8, 0xc002244e80, 0xc002151740, 0x0, 0xc0010a8500, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:719 +0x114
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).requestToProposal(0xc000d67c00, 0x7e00c80, 0xc00241f770, 0xc002350658, 0x8, 0xc002244e80, 0xc002151740, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:841 +0x8e
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose(0xc000d67c00, 0x7e00c80, 0xc00241f770, 0xc002244e80, 0xc000427490, 0xc001129198, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:70 +0xdf
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch(0xc000d67c00, 0x7e00c80, 0xc00241f770, 0xc002244e80, 0x0, 0x0, 0x0, 0x100000001, 0x1, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:133 +0x768
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries(0xc000d67c00, 0x7e00c80, 0xc00241f770, 0xc002244e80, 0x76f2508, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:242 +0x3ef
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithRangeID(0xc000d67c00, 0x7e00c80, 0xc00241f740, 0x9, 0xc002244e80, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:94 +0x68a
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send(0xc000d67c00, 0x7e00c80, 0xc00241f740, 0x1603d1e37e8bf770, 0x0, 0x100000001, 0x1, 0x0, 0x9, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:36 +0x91
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send(0xc000579c00, 0x7e00c80, 0xc00241f6e0, 0x1603d1e37e8bf770, 0x0, 0x100000001, 0x1, 0x0, 0x9, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:202 +0x606
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send(0xc00027dea0, 0x7e00c80, 0xc00241f6e0, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x9, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:188 +0xed
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1(0x7e00c80, 0xc00241f6e0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:922 +0x201
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0002cea20, 0x7e00c80, 0xc00241f6e0, 0x75970dd, 0x10, 0xc0010aa0a8, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:302 +0x140
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal(0xc000108a00, 0x7e00c80, 0xc00241f6e0, 0xc002244e00, 0xc00241f6e0, 0x80, 0x80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:910 +0x194
github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch(0xc000108a00, 0x7e00c80, 0xc00241f6b0, 0xc002244e00, 0xc00241f650, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:948 +0x9f
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:537
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch(0xc002218f80, 0x7e00c80, 0xc00241f6b0, 0x1, 0x7dc7ac0, 0xc0002e4e10, 0x0, 0x0, 0x100000001, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:199 +0x127
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext(0xc002218f80, 0x7e00c80, 0xc00241f650, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x9, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:168 +0x160
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas(0xc0003225a0, 0x7e00c80, 0xc00241f650, 0x0, 0x0, 0x0, 0x0, 0x0, 0x9, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1625 +0x2a2
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendRPC(0xc0003225a0, 0x7e00c80, 0xc00241f650, 0x0, 0x0, 0x0, 0x0, 0x0, 0x9, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:456 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendSingleRange(0xc0003225a0, 0x7e00c80, 0xc00241f650, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:538 +0x2ee
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch(0xc0003225a0, 0x7e00c80, 0xc00241f650, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1394 +0x3cf
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges(0xc0003225a0, 0x7e00c80, 0xc00241f650, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1079 +0x164a
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send(0xc0003225a0, 0x7e00c80, 0xc00241f5f0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:730 +0x785
github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send(0xc0001e6760, 0x7e00c80, 0xc00241f5f0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:223 +0x95
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).sendBatch.func1.1(0x7e00c80, 0xc00241f5f0, 0xc0010582d8, 0xc0004a8000)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:275 +0xdc
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).sendBatch.func1(0x7e00c80, 0xc00241f5f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:306 +0x88d
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc0002c9020, 0xc0002cea20, 0xc002142d00)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
goroutine 2533 [select]:
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*txnHeartbeater).heartbeatLoop(0xc0008b93c8, 0x7e00bc0, 0xc001b05940)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/txn_interceptor_heartbeater.go:257 +0x19c
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1(0xc0002cea20, 0x7e00bc0, 0xc001b05940, 0xc00114e5a0, 0x29, 0x7e67220, 0xc00023a1c0, 0xc0003447d0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:323 +0x152
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:318 +0x131
goroutine 2507 [runnable]:
github.com/cockroachdb/cockroach/pkg/storage.(*rocksDBIterator).SeekGE.func2(0xc0019bcc28, 0xc00031eea0, 0x16, 0x20, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/storage/rocksdb.go:2278 +0x136
github.com/cockroachdb/cockroach/pkg/storage.(*rocksDBIterator).SeekGE(0xc0019bcc28, 0xc00031eea0, 0x16, 0x20, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/storage/rocksdb.go:2278 +0xbd
github.com/cockroachdb/cockroach/pkg/storage.(*batchIterator).SeekGE(0xc0019bcc28, 0xc00031eea0, 0x16, 0x20, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/storage/rocksdb.go:1541 +0x5b
github.com/cockroachdb/cockroach/pkg/storage.mvccGetMetadata(0x7e72e20, 0xc0019bcc28, 0xc00031eea0, 0x16, 0x20, 0x0, 0x0, 0xc0016c6b00, 0x0, 0x16a, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/storage/mvcc.go:871 +0x7c
github.com/cockroachdb/cockroach/pkg/storage.mvccResolveWriteIntent(0x7e00c80, 0xc00139da70, 0x122554c8, 0xc0015f8240, 0x7e72e20, 0xc0019bcc28, 0xc000e20ee0, 0xc00031eea0, 0x16, 0x20, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/storage/mvcc.go:2685 +0x105
github.com/cockroachdb/cockroach/pkg/storage.MVCCResolveWriteIntentUsingIter(0x7e00c80, 0xc00139da70, 0x122554c8, 0xc0015f8240, 0xc0016c6b00, 0x7e72e20, 0xc0019bcc28, 0xc000e20ee0, 0xc00031eea0, 0x16, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/storage/mvcc.go:2652 +0x140
github.com/cockroachdb/cockroach/pkg/storage.MVCCResolveWriteIntent(0x7e00c80, 0xc00139da70, 0x122554c8, 0xc0015f8240, 0xc000e20ee0, 0xc00031eea0, 0x16, 0x20, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/storage/mvcc.go:2631 +0x13f
github.com/cockroachdb/cockroach/pkg/kv/kvserver/batcheval.ResolveIntent(0x7e00c80, 0xc00139da70, 0x122554c8, 0xc0015f8240, 0x7e7fa80, 0xc001575500, 0x1603d1e37e8c9b80, 0x0, 0x100000001, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/batcheval/cmd_resolve_intent.go:90 +0x30a
github.com/cockroachdb/cockroach/pkg/kv/kvserver.evaluateCommand(0x7e00c80, 0xc00139da70, 0xc000273b60, 0x8, 0x0, 0x122554c8, 0xc0015f8240, 0x7e7fa80, 0xc001575500, 0xc000e20ee0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_evaluate.go:462 +0x235
github.com/cockroachdb/cockroach/pkg/kv/kvserver.evaluateBatch(0x7e00c80, 0xc00139da70, 0xc000273b60, 0x8, 0x122554c8, 0xc0015f8240, 0x7e7fa80, 0xc001575500, 0xc000e20ee0, 0xc001611700, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_evaluate.go:241 +0x3c0
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evaluateWriteBatchWrapper(0xc001575500, 0x7e00c80, 0xc00139da70, 0xc000273b60, 0x8, 0x7e7fa80, 0xc001575500, 0xc000e20ee0, 0xc001611700, 0xc0013c5f80, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:553 +0x144
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evaluateWriteBatchWithServersideRefreshes(0xc001575500, 0x7e00c80, 0xc00139da70, 0xc000273b60, 0x8, 0x7e7fa80, 0xc001575500, 0xc000e20ee0, 0xc001611700, 0xc0013c5f80, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:522 +0x135
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evaluateWriteBatch(0xc001575500, 0x7e00c80, 0xc00139da70, 0xc000273b60, 0x8, 0xc001611700, 0xc0013c5f80, 0x19, 0x30, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:345 +0x1df
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evaluateProposal(0xc001575500, 0x7e00c80, 0xc00139da70, 0xc000273b60, 0x8, 0xc001611700, 0xc0013c5f80, 0x0, 0xc001014500, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:719 +0x114
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).requestToProposal(0xc001575500, 0x7e00c80, 0xc00139da70, 0xc000273b60, 0x8, 0xc001611700, 0xc0013c5f80, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:841 +0x8e
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose(0xc001575500, 0x7e00c80, 0xc00139da70, 0xc001611700, 0xc0004267e0, 0xc001097198, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:70 +0xdf
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch(0xc001575500, 0x7e00c80, 0xc00139da70, 0xc001611700, 0x0, 0x0, 0x0, 0x100000001, 0x1, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:133 +0x768
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries(0xc001575500, 0x7e00c80, 0xc00139da70, 0xc001611700, 0x76f2508, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:242 +0x3ef
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithRangeID(0xc001575500, 0x7e00c80, 0xc00139da40, 0x27, 0xc001611700, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:94 +0x68a
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send(0xc001575500, 0x7e00c80, 0xc00139da40, 0x1603d1e37e8c9b80, 0x0, 0x100000001, 0x1, 0x0, 0x27, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:36 +0x91
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send(0xc000579c00, 0x7e00c80, 0xc00139d9e0, 0x1603d1e37e8c9b80, 0x0, 0x100000001, 0x1, 0x0, 0x27, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:202 +0x606
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send(0xc00027dea0, 0x7e00c80, 0xc00139d9e0, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x27, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:188 +0xed
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1(0x7e00c80, 0xc00139d9e0, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:922 +0x201
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0002cea20, 0x7e00c80, 0xc00139d9e0, 0x75970dd, 0x10, 0xc0010160a8, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:302 +0x140
github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal(0xc000108a00, 0x7e00c80, 0xc00139d9e0, 0xc001611680, 0xc00139d9e0, 0x80, 0x80)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:910 +0x194
github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch(0xc000108a00, 0x7e00c80, 0xc00139d9b0, 0xc001611680, 0xc00139d950, 0x0, 0x0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:948 +0x9f
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch(...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:537
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch(0xc001711d80, 0x7e00c80, 0xc00139d9b0, 0x1, 0x7dc7ac0, 0xc0002e4e10, 0x0, 0x0, 0x100000001, 0x1, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:199 +0x127
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext(0xc001711d80, 0x7e00c80, 0xc00139d950, 0x0, 0x0, 0x100000001, 0x1, 0x0, 0x27, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:168 +0x160
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas(0xc0003225a0, 0x7e00c80, 0xc00139d950, 0x0, 0x0, 0x0, 0x0, 0x0, 0x27, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1625 +0x2a2
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendRPC(0xc0003225a0, 0x7e00c80, 0xc00139d950, 0x0, 0x0, 0x0, 0x0, 0x0, 0x27, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:456 +0x1a9
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendSingleRange(0xc0003225a0, 0x7e00c80, 0xc00139d950, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:538 +0x2ee
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch(0xc0003225a0, 0x7e00c80, 0xc00139d950, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1394 +0x3cf
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges(0xc0003225a0, 0x7e00c80, 0xc00139d950, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1079 +0x164a
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send(0xc0003225a0, 0x7e00c80, 0xc00139d8f0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:730 +0x785
github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send(0xc0001e6760, 0x7e00c80, 0xc00139d8f0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:223 +0x95
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).sendBatch.func1.1(0x7e00c80, 0xc00139d8f0, 0x7e00c80, 0xc00139d6b0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:275 +0xdc
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).sendBatch.func1(0x7e00c80, 0xc00139d8f0)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher/batcher.go:306 +0x88d
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc00020cca0, 0xc0002cea20, 0xc00190d700)
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:198 +0x13e
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker
/Users/tschottdorf/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:191 +0xa8
ERROR: exit status 2
231 runs completed, 1 failures, over 1m51s
context canceled
FAIL
FAIL github.com/cockroachdb/cockroach/pkg/kv/kvnemesis 111.374s
FAIL
make: *** [stress] Error 1
[tschottdorf@toblerone cockroach (kvnemeses)]$
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment