Skip to content

Instantly share code, notes, and snippets.

t=2016-08-09T22:41:26+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2"
t=2016-08-09T22:41:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2"
t=2016-08-09T22:41:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2"
t=2016-08-09T22:41:27+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2"
t=2016-08-09T22:41:27+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1"
t=2016-08-09T22:41:27+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4"
t=2016-08-09T22:41:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1"
t=2016-08-09T22:41:27+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2"
t=2016-08-09T22:41:27+0000 lvl=info msg="Executing migration" logger=migrator id="crea
@smothiki
smothiki / proposal.md
Created August 9, 2016 22:35
Test E2E

After working on the test suite for a good amount of time and getting help from fellow folks. These are some issues I'm thinking of proposing to make the suite better. During our last retro, we have already talked about running smoke tests.

Some Proposals about proceeding further with current CI/CD infrastructure.

view of the current Deis architecture

The control Plane:

  • Controller, Builder, Registry, Database, Minio Any changes made to these components or Deis Cli or controller-sdk-go repository will affect workflow functionality and should run the full test suite.
@smothiki
smothiki / change.md
Last active July 22, 2016 16:24
changelog release v2.2.0

v2.1.0 -> v2.2.0

Features

  • 4ea46e7 (builder) - registry: use registry proxy to talk to the internal registry
  • b59bbbc (fluentd) - fluentd: Adding sumologic plugin support
  • b23f272 (dockerbuilder) - registry: use registry proxy to talk to the internal registry
  • 424523c (logger) - storage: Add redis storage adapter
  • 2da72a5 (logger) - redis: Optimize with more aggresive pipelining
type cluster struct {
[] nodes
any metadata
}
get cluster() returns cluster
type node struct {
platform stirng
metrics cpu , memory etc..,
events for n time

Configuring Object Storage

A variety of Deis Workflow components rely on an object storage system to do their work including storing application slugs, Docker images and database logs.

Deis Workflow ships with [Minio][minio] by default, which provides in-cluster, ephemeral object storage. This means that if the Minio server crashes, all data will be lost. Therefore, Minio should be used for development or testing only.

Configuring off-cluster Object Storage

Every component that relies on object storage uses two inputs for configuration:

@smothiki
smothiki / generate.go
Last active May 12, 2016 23:25
generate params
package main
import (
"fmt"
"os"
"strings"
"text/template"
)
type generate struct {
@smothiki
smothiki / read.md
Last active May 10, 2016 23:34
Upgrade story with deployments
  1. Deployments are not available in v1 or server version 1.2, they are available as a part of v1extensions, basically we can't do it now
  2. Replicaiton controllers are not compatible with deployments. only replica sets
  3. Deployments support releases and rollbacks, canary and rolling updates
  4. Horizontal pod scalar again works on replica sets but scales the pods according to CPU utilization
  • Deployments are good only if you are thinking of doing a roll back.
  • For our usecase where every thing is an RC1 and just thinking about updating the exiting image for an RC , kubectl apply/edit RC is sufficient, unless we are not looking for kubectl rollback --release=<>
  • Coming to Apps, thoerically deployments adds features like releases to an App. Also if we can treat every build as a release then basically let the builder deploy an App as deployment,
  1. creates user, adds keys
  2. Deploys build pack , dockerfile and deis pull apps
  3. Uninstall workflow-dev chart
  4. install workflow-dev chart
  5. tries to login with the existing user
  6. Does deis apps:list
  7. Curls through all apps
@smothiki
smothiki / nodes.md
Created April 15, 2016 21:58
kubectl describe nodes
$ kubectl describe nodes
Name:			ip-172-20-0-245.us-west-1.compute.internal
Labels:			beta.kubernetes.io/instance-type=m3.medium,failure-domain.beta.kubernetes.io/region=us-west-1,failure-domain.beta.kubernetes.io/zone=us-west-1a,kubernetes.io/hostname=ip-172-20-0-245.us-west-1.compute.internal
CreationTimestamp:	Fri, 15 Apr 2016 15:22:08 -0600
Phase:			
Conditions:
  Type		Status	LastHeartbeatTime			LastTransitionTime			Reason			Message
  ----		------	-----------------			------------------			------			-------
  OutOfDisk 	False 	Fri, 15 Apr 2016 15:57:32 -0600 	Fri, 15 Apr 2016 15:57:22 -0600 	KubeletHasSufficientDisk 	kubelet has sufficient disk space available
curl 10.3.0.144:9200/_search?pretty=true -d '{"query":{"query_string":{"fields" : ["kubernetes",".*"],"query": "august-barbecue"}}}'