Skip to content

Instantly share code, notes, and snippets.

View qix's full-sized avatar

Josh Yudaken qix

33 followers · 2 following
View GitHub Profile
@qix
qix / gist:074cda2f595e6f5883af
Created July 27, 2015 23:17
2015-07-27 23:16:09 =ERROR REPORT====
** Generic server <0.17476.23> terminating
** Last message in was {'EXIT',<0.17475.23>,{{badmatch,{reply,{riak_kv_w1c_put_reply_v1,ok,primary},{state,132734035421654268938420595158803047683595436032,riak_kv_multi_backend,false,{state,[{<<"leveldb_mult">>,riak_kv_eleveldb_backend,{state,<<>>,"/var/lib/riak/leveldb/132734035421654268938420595158803047683595436032",[{block_cache_threshold,33554432},{block_restart_interval,16},{block_size_steps,16},{compression,true},{create_if_missing,true},{delete_threshold,1000},{eleveldb_threads,71},{fadvise_willneed,false},{limited_developer_mem,false},{sst_block_size,4096},{tiered_slow_level,0},{total_leveldb_mem_percent,35},{use_bloomfilter,true},{write_buffer_size,21073168}],[{block_cache_threshold,33554432},{block_restart_interval,16},{block_size_steps,16},{compression,true},{create_if_missing,true},{data_root,"/var/lib/riak/leveldb"},{delete_threshold,1000},{eleveldb_threads,71},{fadvise_willneed,false},{included_applications,[]},{
@qix
qix / gist:7b8122539c9b4969c35b
Last active August 29, 2015 14:21

== Simple cluster setup ==

  • One druid broker: druid-broker1
  • One historical node: druid-historical3
  • One realtime node: druid-realtime2

Configuration details at the bottom

== Running against druid-broker1 value occassionally changes by 300000 ==

@qix
qix / gist:5a38e4533b25484bc1f7
Created May 20, 2015 00:40
[
{
"dataSchema": {
"dataSource": "allFeedFeatures",
"granularitySpec": {
"queryGranularity": "NONE",
"segmentGranularity": "DAY",
"type": "uniform"
},
"metricsSpec": [
@qix
qix / gist:63419f4e88d2128da105
Created May 20, 2015 00:11
Sample `query all`
[{"timestamp":"2015-01-22T14:25:34.000Z","result":{"count":2319567}}]
[{"timestamp":"2015-01-22T14:25:34.000Z","result":{"count":2319572}}]
[{"timestamp":"2015-01-22T14:25:34.000Z","result":{"count":2319573}}]
[{"timestamp":"2015-01-22T14:25:34.000Z","result":{"count":2319574}}]
[{"timestamp":"2015-01-22T14:25:34.000Z","result":{"count":2037649}}]
[{"timestamp":"2015-01-22T14:25:34.000Z","result":{"count":2319579}}]
[{"timestamp":"2015-01-22T14:25:34.000Z","result":{"count":2319582}}]
[{"timestamp":"2015-01-22T14:25:34.000Z","result":{"count":2319587}}]
[{"timestamp":"2015-01-22T14:25:34.000Z","result":{"count":2037660}}]
[{"timestamp":"2015-01-22T14:25:34.000Z","result":{"count":2319590}}]
@qix
qix / gist:b4f478205f8114b2e0ac
Created April 29, 2015 22:52
```
ItemName: [ForeignFeature.fromFeatureGraph, 'CampaignGraph', {
outputType: 'String',
remoteFeatureName: 'ItemName',
}],
*/
// = String.fromGraphAndFeature
ItemName: ['String', 'CampaignGraph', 'Feature("ItemName")'],
@qix
qix / gist:035556db5ffbf9415550
Created April 29, 2015 19:45
```
mysql> SHOW AGGREGATORS;
+----------------+------+--------+--------------------+------------------------------+-------------------+
| Host | Port | State | Opened_Connections | Average_Roundtrip_Latency_ms | Master_Aggregator |
+----------------+------+--------+--------------------+------------------------------+-------------------+
| 127.0.0.1 | 3306 | online | 0 | NULL | 1 |
| 10.240.76.251 | 3306 | online | 2 | 1.184 | 0 |
| 10.240.194.230 | 3306 | online | 2 | 1.175 | 0 |
+----------------+------+--------+--------------------+------------------------------+-------------------+
@qix
qix / gist:781c4bc417f7deb0b1d1
Created April 29, 2015 00:35
```
root@k8s-node3:/home/josh# route -n
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
0.0.0.0 10.240.0.1 0.0.0.0 UG 0 0 0 eth0
10.16.4.0 0.0.0.0 255.255.255.0 U 0 0 0 docker0
10.240.0.1 0.0.0.0 255.255.255.255 UH 0 0 0 eth0
root@consumer-statsd-tyy21:/authbox/apps/consumer-statsd# ifconfig
eth0 Link encap:Ethernet HWaddr 02:42:0a:10:04:46
@qix
qix / gist:5cd8573968da4c4760e7
Created April 10, 2015 21:06
mysql> SHOW LEAVES;
+---------------+------+--------------------+---------------+-----------+---------+--------------------+------------------------------+
| Host | Port | Availability_Group | Pair_Host | Pair_Port | State | Opened_Connections | Average_Roundtrip_Latency_ms |
+---------------+------+--------------------+---------------+-----------+---------+--------------------+------------------------------+
| memsql-leaf7 | 3306 | 1 | memsql-leaf8 | 3306 | online | 131 | 1.448 |
| memsql-leaf8 | 3306 | 2 | memsql-leaf7 | 3306 | offline | 1 | NULL |
| memsql-leaf9 | 3306 | 1 | memsql-leaf10 | 3306 | online | 66 | 1.205 |
| memsql-leaf10 | 3306 | 2 | memsql-leaf9 | 3306 | offline | 9 | NULL |
+---------------+------+--------------------+-------
@qix
qix / gist:8daf3affc16c92abcddb
Created April 1, 2015 18:20
Pipelined queries
#!/usr/bin/env node
'use strict';
var mysql = require('mysql2');
var connection = mysql.createConnection({ user: 'root', database: 'memsql'});
var request = 0;
setInterval(function() {
var thisRequest = 'Request #' + (request++);
console.time(thisRequest);
@qix
qix / gist:f0e3ecb18e4183978850
Created March 31, 2015 17:53
<?hh
function printResult($result) {
var_dump($result->vectorRowsTyped());
}
async function genMain() {
$conn = await AsyncMysqlClient::connect(
'127.0.0.1',
3306,