Skip to content

Instantly share code, notes, and snippets.

View PeterCorless's full-sized avatar

Peter Corless PeterCorless

View GitHub Profile
@PeterCorless
PeterCorless / 1-streaming-populate-node.yaml
Last active January 22, 2019 17:03
Improved Performance in Scylla Open Source 3.0: Streaming and Hinted Handoffs
for i=0 to 3:
cassandra-stress write no-warmup n=175000000 cl=ALL
-rate threads=500
-schema 'replication(factor=2) keyspace=keyspace'
-col 'size=FIXED(4000) n=FIXED(1)'
-mode cql3 native connectionsPerHost=66
-pop 'seq=((i*n)+1)..((i+1)*n)' # where n=175000000
-node node2
-errors ignore
@PeterCorless
PeterCorless / 01-tar-confluent.sh
Last active May 16, 2019 21:29
scylla-kafka-akka-mqtt-blog
tar -xzf confluent-5.0.0-2.11.tar.gz
cd confluent-5.0.0/
@PeterCorless
PeterCorless / IEX-batch-quote.json
Last active October 22, 2018 23:07
Hooking up Spark and ScyllaDB: Part 4
{
"AAPL": {
"quote": {
"latestPrice": 221.43,
"latestSource": "IEX real time price",
"latestUpdate": 1537455071032,
"latestVolume": 18919004,
"previousClose": 218.37,
"symbol": "AAPL"
}
@PeterCorless
PeterCorless / DataFrameWriter.scala
Last active October 8, 2018 16:26
Hooking up Spark and ScyllaDB: Part 3
val writer = df.write.cassandraFormat(table = "test", keyspace = "test")
// writer: org.apache.spark.sql.DataFrameWriter[org.apache.spark.sql.Row] = org.apache.spark.sql.DataFrameWriter@6cf47d05