- Geek Feminism: http://geekfeminism.org/
- Philip Guo's writing: http://www.pgbovine.net/writings.htm
- Mel Chua: http://blog.melchua.com/
- Pointers Gone Wild (by Maxime Chevalier): http://pointersgonewild.wordpress.com/ (compiler fun!)
- Sumana's blog: http://www.harihareswara.net/ces.shtml
- Lindsey Kuper's great research blog: http://composition.al/
- Kelly Sommers is so inquisitive and thoughtful and amazing: http://kellabyte.com/
- Selena Deckelmann: http://www.chesnok.com/daily/
- Dan Luu: http://danluu.com/
- http://planet.mozillaopennews.org/
- Probabilistic Data Structures for Web Analytics and Data Mining : A great overview of the space of probabilistic data structures and how they are used in approximation algorithm implementation.
- Models and Issues in Data Stream Systems
- Philippe Flajolet’s contribution to streaming algorithms : A presentation by Jérémie Lumbroso that visits some of the hostorical perspectives and how it all began with Flajolet
- Approximate Frequency Counts over Data Streams by Gurmeet Singh Manku & Rajeev Motwani : One of the early papers on the subject.
- [Methods for Finding Frequent Items in Data Streams](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.187.9800&rep=rep1&t
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# client install | |
sudo apt-get install libcurl4-gnutls-dev ruby cmake openjdk-7-jdk openjdk-7-source libgcrypt11-dev python-dev git | |
# server install | |
sudo apt-get install libcurl4-gnutls-dev ruby cmake openjdk-7-source libgcrypt11-dev librrd4 librrd-dev | |
# install yajl | |
git clone git://github.com/lloyd/yajl | |
cd yajl | |
./configure |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Chef Server Setup | |
============= | |
- Ubuntu 12.04 x86_64 (only other option is RHEL 5 or 6) | |
- Hostname setup: | |
echo "parabola" > /etc/hostname | |
hostname -F /etc/hostname | |
```/etc/hosts | |
127.0.0.1 fqdn hostname localhost | |
# (e.g., 127.0.0.1 parabola.tylercipriani.com parabola localhost) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# -*- mode: ruby -*- | |
# vi: set ft=ruby : | |
# Vagrant plug-ins in use: | |
# vagrant-vbguest to ensure all VirtualBox VMs have guest additions | |
# vagrant-hostmanager to manipulate /etc/hosts on the guest VMs and host machine. | |
# vagrant-proxyconf to configure an HTTP proxy for apt [requires instructor VM to be booted on an accessible IP] | |
# | |
# If vagrant-hostmanager isn't installed edit /etc/hosts on your laptop and place these entries in it. | |
# 172.16.1.10 web |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
ssh -p 2222 -R 2204:192.168.7.176:2204 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o LogLevel=ERROR -o IdentitiesOnly=yes -i ~/.vagrant.d/insecure_private_key [email protected] |
We need 3 things from our monitoring systems: Log aggregation and analysis tools for (deep-dive info) Data visualization tools (at-a-glace information, data correlation/causation, pattern identification, easier anomaly detection) non-simple error reporting (To let us know when things are actually going wrong. e.g. rollups, multi-variable alerts, alerts that include more data than 'I passed a threshold')
If I were starting from scratch, this is the architecture I'd build for monitoring.
Logstash -> Reimann and/or Flapjack-> (dataviz) Statsd -> Graphite -> Tasseo & Descarte
|
|--> (alerting) Sensu -> Pagerduty
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/env ruby | |
if ARGV.length < 2 | |
puts "usage: #{$0} databag.json new_encrypted_databag.json [encrypted_data_bag_secret]" | |
exit(1) | |
end | |
databag_file = ARGV[0] | |
out_file = ARGV[1] | |
if ARGV.length >= 3 |
- https://dancres.github.io/Pages/
- https://ferd.ca/a-distributed-systems-reading-list.html
- http://the-paper-trail.org/blog/distributed-systems-theory-for-the-distributed-systems-engineer/
- https://github.com/palvaro/CMPS290S-Winter16/blob/master/readings.md
- http://muratbuffalo.blogspot.com/2015/12/my-distributed-systems-seminars-reading.html
- http://christophermeiklejohn.com/distributed/systems/2013/07/12/readings-in-distributed-systems.html
- http://michaelrbernste.in/2013/11/06/distributed-systems-archaeology-works-cited.html
- http://rxin.github.io/db-readings/
- http://research.microsoft.com/en-us/um/people/lamport/pubs/pubs.html
- http://pdos.csail.mit.edu/dsrg/papers/
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
def namedlist(typename, field_names): | |
"""Returns a new subclass of list with named fields. | |
>>> Point = namedlist('Point', ('x', 'y')) | |
>>> Point.__doc__ # docstring for the new class | |
'Point(x, y)' | |
>>> p = Point(11, y=22) # instantiate with positional args or keywords | |
>>> p[0] + p[1] # indexable like a plain list | |
33 | |
>>> x, y = p # unpack like a regular list |