Skip to content

Instantly share code, notes, and snippets.

@smothiki
smothiki / shell session output
Last active March 21, 2016 22:56
test log session output
=== RUN TestTests
Running Suite: Deis Workflow
============================
Random Seed: 1458595389
Will run 112 of 114 specs
$ deis register http://deis.10.3.0.198.xip.io --username=admin --password=admin [email protected]
Registered admin
Logged in as admin
$ deis users:list
// Package cleaner is a background process that compares the kubernetes namespace list with the folders in the local git home directory, deleting what's not in the namespace list
package cleaner
import (
"fmt"
"log"
"os"
"k8s.io/kubernetes/pkg/api"
@smothiki
smothiki / gist:a9f7bc40f21646c0718b
Created February 18, 2016 17:06
S3 Object Storage testing
1. Test with AWS
a) Builder was able to pass the helth check but no success creating buckets. Reason : might be an issue with my credentials.
- will be trying out with different credentials and permissions.
2. Test with Google Cloud
a) Builder was not passing health checks at all. Outside storage url - https://storage.googleapis.com
3. Ceph backend not yet tested.
deis.com
deis.io
http://kubernetes.io/
https://github.com/deis/deis/tree/v2
Deis (pronounced DAY-iss) is an open source PaaS that makes it easy to deploy and manage applications on your own servers.
PAAS mean platform as a service - something like Amazon apollo.
Deis v2 is powered by kubernetes and has lot of sub projects in it .
I would like you to create few designs for the follwoing projects
@smothiki
smothiki / initals.py
Created September 21, 2015 23:13
inita
# -*- coding: utf-8 -*-
from south.utils import datetime_utils as datetime
from south.db import db
from south.v2 import SchemaMigration
from django.db import models
class Migration(SchemaMigration):
def forwards(self, orm):
11:00 - 11:40 Immutable Data Science with Datomic, Spark and Kafka
1:40 - 2:20 "All In" With Determinism for Performance and Testing in Distributed Systems
3:40 - 4:20 Apache Kafka and the Next 700 Stream Processing Systems
sept 26
10:10 - 10:50 Streams: The data structure we need / One weird trick to lose five bugs off your distributed system instantly!
12:50 - 1:30 any talk that might interest me
3:40 - 4:20 Architectural Patterns of Resilient Distributed Systems
package docker
import (
"archive/tar"
"bytes"
"fmt"
"io"
"os"
"os/exec"
"path"
@smothiki
smothiki / isue1.md
Created August 12, 2015 23:26
ceph issues : my understanding
docker run --privileged=true --net host -v /var/lib/deis/store:/var/lib/deis/store -it busybox

here host /var/lib/deis/store and container /var/lib/deis/store are same docker makes things easy in reality container /var/lib/deis/store is some random directory() on the host which docker creates and does mount -bind /var/lib/deis/store <randdir>

but from inside container if we run mount -t ceph <ips>/: /var/lib/deis/store we are overriding the bind mount option and /var/lib/deis/store of container is no longer related to /var/lib/deis/store of host.

@smothiki
smothiki / sample.md
Last active November 10, 2017 03:48
Cpeh on Kubernetes

Ceph replication controllers

kubectl get rc
CONTROLLER   CONTAINER(S)   IMAGE(S)                                              SELECTOR                           REPLICAS
ceph-mds     ceph-mds       192.168.59.103:5000/deis/store-metadata:git-3016328   name=ceph-mds,type=cmd,version=1   3
ceph-mon     ceph-mon       192.168.59.103:5000/deis/store-monitor:git-27dcc99    name=ceph-mon,type=cmd,version=1   3
ceph-osd     ceph-osd       192.168.59.103:5000/deis/store-daemon:git-dc53ff2     name=ceph-osd,type=cmd,version=1   3

Ceph health

2015-08-06 00:27:14.792965 7f3060149700 0 -- :/1000127 >> 10.244.7.10:6789/0 pipe(0x7f305c02e010 sd=4 :0 s=1 pgs=0 cs=0 l=1 c=0x7f305c024ad0).fault
2015-08-06 00:27:14.792965 7f3060149700 0 -- :/1000127 >> 10.244.7.10:6789/0 pipe(0x7f305c02e010 sd=4 :0 s=1 pgs=0 cs=0 l=1 c=0x7f305c024ad0).fault
2015-08-06 00:27:17.792944 7f304bfff700 0 -- :/1000127 >> 10.244.84.8:6789/0 pipe(0x7f3050000c00 sd=4 :0 s=1 pgs=0 cs=0 l=1 c=0x7f3050004ea0).fault
2015-08-06 00:27:17.792944 7f304bfff700 0 -- :/1000127 >> 10.244.84.8:6789/0 pipe(0x7f3050000c00 sd=4 :0 s=1 pgs=0 cs=0 l=1 c=0x7f3050004ea0).fault
2015-08-06 00:27:20.795325 7f3060149700 0 -- :/1000127 >> 10.244.7.10:6789/0 pipe(0x7f30500080e0 sd=4 :0 s=1 pgs=0 cs=0 l=1 c=0x7f305000c380).fault
2015-08-06 00:27:20.795325 7f3060149700 0 -- :/1000127 >> 10.244.7.10:6789/0 pipe(0x7f30500080e0 sd=4 :0 s=1 pgs=0 cs=0 l=1 c=0x7f305000c380).fault
2015-08-06 00:27:23.795745 7f304bfff700 0 -- :/1000127 >> 10.244.1.10:6789/0 pipe(0x7f3050000c00 sd=4 :0 s=1 pgs=0 cs=0 l=1 c=0x7