Skip to content

Instantly share code, notes, and snippets.

@ksatchit
ksatchit / Tasks_High_Level_List.md
Last active July 18, 2017 08:42
A list of tasks and goals to be achieved in Q3 2017-2018
# First Priority
- [ ] Get Automated CI to working state
- [ ] Get Automated CI to be triggered on changes into any branch/not just master
- [ ] Creation of separate slack channel for notification
- [ ] Integrate performance benchmark suite into CI
- [ ] Refactor the vdbench code in test-storage in following stages:
- [ ] Create container to run the workload simulation
- [ ] Introduce plot code into runner
- [ ] Structure YAML to hold relevant data
- [ ] Enhance runner to consume YAML
@ksatchit
ksatchit / Jeffry_Feedback.md
Last active August 23, 2017 12:07
Feedback from Jeffry on QA and CI practices for ElastiStor and OpenEBS
ElastiStor
- Need dedicated setups to run production-like load constantly with frequent upgrades
- Need a "quick-build" based automation in addition to existing reinstall with pre-configured ISO (i.e., automate upgrade)
- Need to develop automation suite to perform multiple-component failure/fault-injection tests (i.e., current system test suite)
- Need to simulate disk issues and test resiliency using hadrware-assisted automation (disk pullers)
- Need to ensure pass of compliance suites (with relevant tests decided) like libiscsi, cthon & nfstest as build criteria
- Need to ensure pass of unit test suites like ztest, zfstest
- Try and run SMB torture kind of workloads (fstest, dbench etc.,) on a more frequent basis
OpenEBS CI

Sprints : 31st July, 15th Aug, 30th Aug, 15th Sept, 30th Sept, 15th Oct, 31st Oct, 15th Nov, 30th Nov

Deliverables for the sprints will be derived from : Tasks_High_Level_List.md (https://gist.github.com/ksatchit/49b5d24a25ef8c3b7f2ac6b2dae8c7b7)

Sprint 1 - 31st july

  • [] Add vdbench based PBM suite as a pipeline task in jenkins on a separate slave machine - PARTIALLY DONE
  • Integrate libiscsi ISCSI compliance test playbooks as part of CI - DONE
  • Perform log capture and upload to archive for failed tests
  • Start - Container test strategy and get it reviewed - DONE
@ksatchit
ksatchit / PBM framework Action Items.md
Last active August 29, 2017 07:41
Gist to talk about TODO items in the OpenEBS performance benchmark project

GENERAL LIST (Not in priority order)

  • Create the input YAMLs for standard application workloads

  • Specify template to do param based test : perf v/s workers, perf v/s QD, perf v/s xfersize, perf v/s numfiles, perf v/s data reduction(comp, dedupe ratios) (Refer the eBAY/Groupware's test scripts also to check which were the params that were iterated)

  • Check usefulness of niche workloads like rewrites, sparse file creates-writes-deletes, locks, writes with thinktimes, extending/appending a file,

apiVersion: openebs.io/v1alpha1
kind: StoragePool
metadata:
    name: sp-mntdir
    type: hostdir
spec:
    path: "/mnt/openebs"
---
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
   name: openebs-custom
provisioner: openebs.io/provisioner-iscsi
parameters:
  openebs.io/storage-pool: "sp-mntdir"
 openebs.io/jiva-replica-count: "3"
---
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
  name: demo-vol1-claim
spec:
  storageClassName: openebs-custom
  accessModes:
 - ReadWriteOnce
karthik_s@strong-eon-153112:~$ kubectl get pv
NAME                                       CAPACITY   ACCESS MODES   RECLAIM POLICY   STATUS    CLAIM                     STORAGECLASS     REASON    AGE
pvc-556e7ab7-3ed9-11e8-8e6a-42010a800216   5G         RWO            Delete           Bound     default/demo-vol1-claim   openebs-custom             59m
root@gke-oebs-staging-default-pool-7cc7e313-0xs4:~# ls /mnt/openebs/
lost+found  pvc-556e7ab7-3ed9-11e8-8e6a-42010a800216
apiVersion: litmuschaos.io/v1alpha1
kind: ChaosEngine
metadata:
name: engine-nginx
spec:
appinfo:
appns: default
applabel: "app=nginx"
experiments:
- name: pod-delete
apiVersion: litmuschaos.io/v1alpha1
description:
message: |
Deletes a pod belonging to a deployment/statefulset/daemonset
kind: ChaosExperiment
metadata:
labels:
helm.sh/chart: k8sChaos-0.1.0
litmuschaos.io/instance: dealing-butterfly
litmuschaos.io/name: k8sChaos