tbg

606 runs so far, 0 failures, over 7m55s

I190926 08:20:24.755171 1 rand.go:85  Random seed: -5921895135148740340
=== RUN   TestSystemZoneConfigs
I190926 08:20:24.759000 37 base/addr_validation.go:296  [n?] server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
I190926 08:20:24.759024 37 base/addr_validation.go:342  [n?] web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
W190926 08:20:24.870324 37 server/status/runtime.go:308  [n?] Could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
I190926 08:20:24.932987 37 server/server.go:919  [n?] monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
I190926 08:20:24.997079 37 server/config.go:502  [n?] 1 storage engine initialized
I190926 08:20:24.997106 37 server/config.go:505  [n?] RocksDB cache size: 128 MiB

tbg

=== RUN   TestChangefeedTruncateRenameDrop/enterprise
I190905 09:05:00.441771 56743 base/addr_validation.go:296  [n?] server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
I190905 09:05:00.464265 56743 base/addr_validation.go:342  [n?] web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
W190905 09:05:00.492022 56743 server/status/runtime.go:308  [n?] Could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
I190905 09:05:00.747582 56743 server/server.go:911  [n?] monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
I190905 09:05:00.818570 56743 server/config.go:502  [n?] 1 storage engine initialized
I190905 09:05:00.818756 56743 server/config.go:505  [n?] RocksDB cache size: 128 MiB
I190905 09:05:00.818849 56743 server/config.go:505  [n?] store 0: in-memory, size 0 B
I190905 09:05:00.830177 56743 server/server.go:1359  [n?] no stores bootstrapped and --join flag specified, awaiting init co

tbg

n2 (19.2)

1567451503.753313123,0 /Local/Range/Table/58/1/108/1/-2158/9/RangeDescriptor (0x016b12c289f48986f792910001726473630015c0b4d683de3b6309): [/Table/58/1/108/1/-2158/9, /Table/58/1/108/1/-2158/9/0)
	Raw:r204:/Table/58/1/108/1/-2158/9{-/0} [(n2,s2):1, (n3,s3):2, (n4,s4):3, (n1,s1):4, next=5, gen=19?]

1567451503.738022868,0 /Local/Range/Table/58/1/108/1/-2158/9/RangeDescriptor (0x016b12c289f48986f792910001726473630015c0b4d682f4ebd409): [/Table/58/1/108/1/-2158/9, /Table/58/1/108/1/-2158/9/0)
	Raw:r204:/Table/58/1/108/1/-2158/9{-/0} [(n2,s2):1, (n3,s3):2, (n4,s4):3, next=4, gen=19?]

1567451465.975792722,0 /Local/Range/Table/58/1/108/1/-2158/9/RangeDescriptor (0x016b12c289f48986f792910001726473630015c0b4cdb827045209): [/Table/58/1/108/1/-2158/9, /Table/58/1/108/1/-2158/9/0)
	Raw:r204:/Table/58/1/108/1/-2158/9{-/0} [(n2,s2):1, (n3,s3):2, (n4,s4):3, next=4, gen=19?]

tbg

tschottdorf@gceworker-tschottdorf:~/go/src/github.com/cockroachdb/cockroach$ cat /tmp/go-stress424629117
I190826 16:11:05.990501 1 rand.go:83  Random seed: -9038532868249249912
=== RUN   TestNodeLivenessSetDecommissioning
W190826 16:11:06.469746 279 storage/store.go:1546  [s1,r6/1:/Table/{SystemCon…-11}] could not gossip system config: [NotLeaseHolderError] r6: replica (n1,s1):1 not lease holder; lease holder unknown
I190826 16:11:06.470826 52 vendor/go.etcd.io/etcd/raft/raft.go:1495  [s1,r1/1:/{Min-System/NodeL…}] 1 switched to configuration voters=(1)
I190826 16:11:06.471126 52 vendor/go.etcd.io/etcd/raft/raft.go:700  [s1,r1/1:/{Min-System/NodeL…}] 1 became follower at term 5
I190826 16:11:06.471459 52 vendor/go.etcd.io/etcd/raft/raft.go:382  [s1,r1/1:/{Min-System/NodeL…}] newRaft 1 [peers: [1], term: 5, commit: 10, applied: 10, lastindex: 10, lastterm: 5]
I190826 16:11:06.471665 52 vendor/go.etcd.io/etcd/raft/raft.go:914  [s1,r1/1:/{Min-System/NodeL…}] 1 is starting a new election at term 5
I190826 16:11:0

tbg

make stress PKG=./pkg/sql/distsqlplan/ STRESSFLAGS='-maxruns 3000 -stderr=false' TESTS=TestSpanResolverUsesCaches

tschottdorf@gceworker-tschottdorf:~$ cat /tmp/go-stress093573368
I190822 08:54:55.324581 1 rand.go:83  Random seed: -5098855079789502367
=== RUN   TestSpanResolverUsesCaches
I190822 08:54:55.335859 56 base/addr_validation.go:296  [n?] server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
I190822 08:54:55.335891 56 base/addr_validation.go:342  [n?] web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
W190822 08:54:55.346974 56 server/status/runtime.go:308  [n?] Could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
I190822 08:54:55.380399 56 server/server.go:902  [n?] monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
I190822 08:54:55.391610 56 server/config.go:502  [n?] 1 storage engine initialized

tbg

=== RUN   TestInitialPartitioning
I190809 23:48:42.845451 2683 base/addr_validation.go:296  [n?] server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
I190809 23:48:42.845482 2683 base/addr_validation.go:342  [n?] web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
W190809 23:48:42.859288 2683 server/status/runtime.go:308  [n?] Could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
I190809 23:48:42.867836 2683 server/server.go:897  [n?] monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
I190809 23:48:42.901773 2683 server/config.go:502  [n?] 1 storage engine initialized
I190809 23:48:42.901806 2683 server/config.go:505  [n?] RocksDB cache size: 128 MiB
I190809 23:48:42.901817 2683 server/config.go:505  [n?] store 0: in-memory, size 0 B
I190809 23:48:42.901948 2683 server/server.go:1345  [n?] no stores bootstrapped and --join flag specified, awaiting init command or join with an alread

tbg

$ rg -A 3 --no-line-number --no-filename 'tracing.FinishSpan' artifacts/kv/contention/nodes\=4/run_*/*.logs/cockroach.log
github.com/cockroachdb/cockroach/pkg/util/tracing.FinishSpan(...)
	/go/src/github.com/cockroachdb/cockroach/pkg/util/tracing/tracer.go:625
github.com/cockroachdb/cockroach/pkg/sql/distsqlrun.(*ProcessorBase).InternalClose(0xc006a0c000, 0x2581b36)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsqlrun/processors.go:891 +0x140
--
github.com/cockroachdb/cockroach/pkg/util/tracing.FinishSpan(0x45d7760, 0xc008066b60)
	/go/src/github.com/cockroachdb/cockroach/pkg/util/tracing/tracer.go:625 +0x40
github.com/cockroachdb/cockroach/pkg/sql/distsqlrun.(*sampleAggregator).Run(0xc006a0c000, 0x4586000, 0xc0068ab170)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsqlrun/sample_aggregator.go:149 +0x13e

tbg

cockroach debug merge-logs --file-pattern '.*' $(find . -name '*.log') | grep r2341

> I190723 18:15:30.818975 1788 storage/replica_proposal.go:203  [n3,s3,r2341/1:/System/tsd/cr.store.queue.re…] new range lease repl=(n3,s3):1 seq=14 start=1563905730.636478708,0 epo=16 pro=1563905730.636510880,0 following repl=(n18,s18):2 seq=13 start=1556848765.477804796,0 epo=41 pro=1556848765.477815713,0
> I190723 18:15:30.820499 1182924775 storage/replica_raftstorage.go:525  [replicate,n3,s3,r2341/1:/System/tsd/cr.store.queue.re…] generated preemptive snapshot 62034e73 at index 1948794
> I190723 18:15:30.821581 1182924775 storage/store.go:3904  [replicate,n3,s3,r2341/1:/System/tsd/cr.store.queue.re…] streamed snapshot to (n19,s19):?: kv pairs: 11, log entries: 22, rate-limit: 8.0 MiB/sec, 1ms
> I190723 18:15:30.851971 1182924775 storage/replica_command.go:1814  [replicate,n3,s3,r2341/1:/System/tsd/cr.store.queue.re…] change replicas (ADD_REPLICA (n19,s19):4): read existing descriptor r2341:/System/tsd/cr.store.queue.repli

tbg

Printing keys /Local/RangeID/1514/u/RaftLog -> /Local/RangeID/1514/u"rftm" (RocksDB keys: 0x0169f705ea757266746c00 - 0x0169f705ea757266746d00 )
0.000000000,0 /Local/RangeID/1514/u/RaftLog/logIndex:11 (0x0169f705ea757266746c000000000000000b00): Term:6 Index:11 : EMPTY

0.000000000,0 /Local/RangeID/1514/u/RaftLog/logIndex:12 (0x0169f705ea757266746c000000000000000c00): Term:6 Index:12  by lease #8
proposer_replica:<node_id:2 store_id:2 replica_id:3 > proposer_lease_sequence:8 max_lease_index:1 replicated_eval_result:<timestamp:<wall_time:1564097442353663370 > delta:<contains_estimates:true last_update_nanos:1564097442353663370 live_bytes:34906052 live_count:103964 key_bytes:2321309 key_count:103964 val_bytes:32584743 val_count:103964 > add_sstable:<crc32:3928426975 > > write_batch:<data:"\000\000\000\000\000\000\000\000\000\000\000\000" >
write batch:

0.000000000,0 /Local/RangeID/1514/u/RaftLog/logIndex:13 (0x0169f705ea757266746c000000000000000d00): Term:6 Index:13  by lease #8
proposer_replica:<node_id:2 store

tbg

To play with the closed timestamp duration in the simplest possible way:

Start an insecure single-node instance, `set cluster setting kv.closed_timestamp.target_duration='2s';`, and then

```
$ cat slowq.sql
begin; select cluster_logical_timestamp(); upsert into foo values(1, clock_timestamp()::string); select pg_sleep(4); upsert into foo values(1, clock_timestamp()::string); commit;

./cockroach sql --insecure < slowq.sql
```