Skip to content

Instantly share code, notes, and snippets.

View DikangGu's full-sized avatar

Dikang Gu DikangGu

50 followers · 27 following
  • Facebook
  • Bay Area.
View GitHub Profile
@DikangGu
DikangGu / gist:bf7f490d3be58cd3ad905e78054e5cd7
Created November 9, 2016 19:20
response
Headers
Connection: keep-alive
Content-Length: 339
Content-Type: text/html
Date: Wed, 09 Nov 2016 19:17:45 GMT
Server: nginx/1.6.2
Body
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN">
<title>401 Unauthorized</title>
<h1>Unauthorized</h1>
@DikangGu
DikangGu / gist:19e14a73cf1260dd5ac00b30c7d01a14
Created November 14, 2016 21:47
dikang@Dikangs-MacBook-Pro ~/Projects/cassandra-ig/cassandra (trunk)$ git push apache cassandra-3.X trunk --atomic [ruby-2.0.0p648]
Username for 'https://github.com': DikangGu
Password for 'https://[email protected]':
remote: Permission to apache/cassandra.git denied to DikangGu.
fatal: unable to access 'https://github.com/apache/cassandra.git/': The requested URL returned error: 403
@DikangGu
DikangGu / gist:d63101436a7602ad251a82968e0093d6
Created January 23, 2017 18:20
Percentile SSTables Write Latency Read Latency Partition Size Cell Count
(micros) (micros) (bytes)
50% 1.00 29.52 315.85 86 1
75% 2.00 35.43 654.95 2299 7
95% 3.00 51.01 1955.67 35425 72
98% 3.00 51.01 5839.59 73457 310
99% 3.00 61.21 10090.81 88148 924
Min 0.00 3.97 17.09 61 0
Max 6.00 223875.79 14831182.99 1955666 42510
@DikangGu
DikangGu / 200M operations
Created April 18, 2017 17:41
Cassandra:
Results:
Op rate : 149,124 op/s [insert: 99,404 op/s, singlepost: 49,720 op/s]
Partition rate : 125,425 pk/s [insert: 99,404 pk/s, singlepost: 26,021 pk/s]
Row rate : 125,425 row/s [insert: 99,404 row/s, singlepost: 26,021 row/s]
Latency mean : 0.7 ms [insert: 0.7 ms, singlepost: 0.7 ms]
Latency median : 0.4 ms [insert: 0.4 ms, singlepost: 0.5 ms]
Latency 95th percentile : 1.5 ms [insert: 1.4 ms, singlepost: 1.6 ms]
Latency 99th percentile : 2.7 ms [insert: 2.6 ms, singlepost: 2.8 ms]
Latency 99.9th percentile : 5.5 ms [insert: 5.4 ms, singlepost: 5.7 ms]
@DikangGu
DikangGu / 2 hour operations
Created April 18, 2017 17:42
Cassandra:
Results:
Op rate : 409,767 op/s [insert: 273,166 op/s, singlepost: 136,601 op/s]
Partition rate : 409,767 pk/s [insert: 273,166 pk/s, singlepost: 136,601 pk/s]
Row rate : 409,767 row/s [insert: 273,166 row/s, singlepost: 136,601 row/s]
Latency mean : 0.2 ms [insert: 0.2 ms, singlepost: 0.3 ms]
Latency median : 0.2 ms [insert: 0.2 ms, singlepost: 0.2 ms]
Latency 95th percentile : 0.3 ms [insert: 0.3 ms, singlepost: 0.3 ms]
Latency 99th percentile : 0.5 ms [insert: 0.4 ms, singlepost: 0.5 ms]
@DikangGu
DikangGu / RocksDB settings
Created April 18, 2017 17:45
final long writeBufferSize = 8 * 512 * 1024 * 1024L;
final long softPendingCompactionBytesLimit = 100 * 64 * 1073741824L;
options.setAllowConcurrentMemtableWrite(true);
options.setEnableWriteThreadAdaptiveYield(true);
options.setBytesPerSync(1024*1024);
options.setWalBytesPerSync(1024*1024);
options.setMaxBackgroundCompactions(20);
options.setBaseBackgroundCompactions(20);
options.setMaxSubcompactions(8);
@DikangGu
DikangGu / gist:2d47e2e8816f68a25104f67763aec87e
Created April 18, 2017 17:48
CREATE TABLE shadow3x.thriftkv (
key bigint,
column1 blob,
value blob,
PRIMARY KEY (key, column1)
) WITH COMPACT STORAGE
AND CLUSTERING ORDER BY (column1 ASC)
AND bloom_filter_fp_chance = 0.01
AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
AND comment = ''
@DikangGu
DikangGu / gist:1b79a59cf2def031ce0f775eb90af40d
Created April 19, 2017 16:20
Cassandra
Results:
Op rate : 324,557 op/s [insert: 216,382 op/s, singlepost: 108,176 op/s]
Partition rate : 324,557 pk/s [insert: 216,382 pk/s, singlepost: 108,176 pk/s]
Row rate : 324,557 row/s [insert: 216,382 row/s, singlepost: 108,176 row/s]
Latency mean : 0.3 ms [insert: 0.2 ms, singlepost: 0.4 ms]
Latency median : 0.2 ms [insert: 0.2 ms, singlepost: 0.3 ms]
Latency 95th percentile : 0.6 ms [insert: 0.4 ms, singlepost: 0.8 ms]
Latency 99th percentile : 1.1 ms [insert: 0.9 ms, singlepost: 1.4 ms]
@DikangGu
DikangGu / gist:cc59a846f6fb90120193fa08ef18fe1b
Created April 27, 2017 04:30
diff --git a/src/java/org/apache/cassandra/service/CassandraDaemon.java b/src/java/org/apache/cassandra/service/CassandraDaemon.java
index 6f38545..d312f32 100644
--- a/src/java/org/apache/cassandra/service/CassandraDaemon.java
+++ b/src/java/org/apache/cassandra/service/CassandraDaemon.java
@@ -45,6 +45,7 @@ import com.google.common.annotations.VisibleForTesting;
import com.google.common.util.concurrent.Futures;
import com.google.common.util.concurrent.ListenableFuture;
import com.google.common.util.concurrent.Uninterruptibles;
+import org.apache.cassandra.gms.Gossiper;
import org.apache.cassandra.metrics.DefaultNameFactory;
@DikangGu
DikangGu / ComparisonTest.java
Created July 13, 2018 21:37
Cql query returns different results in 2.2 and 3.0
package org.apache.cassandra.cql3;
import org.junit.BeforeClass;
import org.junit.Test;
import org.apache.cassandra.config.DatabaseDescriptor;
import org.apache.cassandra.dht.ByteOrderedPartitioner;
import org.apache.cassandra.transport.Server;
public class ComparisonTest extends CQLTester