Skip to content

Instantly share code, notes, and snippets.

View bugcy013's full-sized avatar
🪄
Focusing

Dhanasekaran Anbalagan bugcy013

🪄
Focusing
View GitHub Profile
@bugcy013
bugcy013 / What features do you think are missing from Mesos?
Last active August 29, 2015 14:06 — forked from davelester/gist:b40e3b5d0347540abf36
What features do you think are missing from Mesos?
### What features do you think are missing from Mesos?
* Being able to run inside Docker. Problem is that you cannot define public ip address. When Mesos startups in Docker container it only see a private ip address. But it have different public ip address.
* Stronger containerisation (Docker as first class citizen).
Documentation - HA setup - Writing custom scheduler and executors - examples in mesos/frameworks are out of date - samples in mesos/src/examples are too simple Docker integration (I know this has been merged recently). I am using custom Docker executor and am looking forward to using Deimos. Better packaging - Mesosphere requires custom egg installation. - Mesos slave and master should be separate packages - Java dependency should be optional
* None :)
* Dynamicly update role weight. Task Preemption. Framework resource limitation.
Mostly ease of use features for EC2 The mesos master should be dead simple to point an ELB at. It is not. Another feature I found missing was in the mesos-spark integra
@bugcy013
bugcy013 / migrate scm database from PostgreSQL to MySQL
Last active August 29, 2015 14:06 — forked from gwenshap/gist:7044525
migrate scm database from PostgreSQL to MySQL
These are the steps that you need to follow in order to migrate scm database from PostgreSQL to MySQL - let me know if you need assistance or have any further questions.
1. Stop all cluster services including the Cloudera Manager monitoring services and Agents on all hosts, using the Cloudera Manager UI.
2. Invoke the API call to /api/v4/cm/deployment. Example that directs the resulting output to a file for later use:
$ curl -v -u admin:password http://your_cloudera_manager_host:7180/api/v4/cm/deployment > path/to/file
Note: It is critical this file be retained and protected as it will be needed to re-import the functional configuration into the new database.
3. Take a fail-safe database backup from the embedded postgres database or make a tarball (or other copy) of the /var/lib/cloudera-scm-server-db/ directory to a safe location. Either will accomplish the needed outcome, just pick the most convenient for your environment. And backup contents of the directory /etc/cloudera-scm-server/*
4. On the serv
#!/bin/sh
# Converts a mysqldump file into a Sqlite 3 compatible file. It also extracts the MySQL `KEY xxxxx` from the
# CREATE block and create them in separate commands _after_ all the INSERTs.
# Awk is choosen because it's fast and portable. You can use gawk, original awk or even the lightning fast mawk.
# The mysqldump file is traversed only once.
# Usage: $ ./mysql2sqlite mysqldump-opts db-name | sqlite3 database.sqlite
# Example: $ ./mysql2sqlite --no-data -u root -pMySecretPassWord myDbase | sqlite3 database.sqlite
@bugcy013
bugcy013 / mysql5
Last active August 29, 2015 14:06 — forked from IngmarBoddington/mysql5
Notes made initially whilst studying for the MySQL 5 Certified Associate Exam (and then expanded)
EXAM DETAILS
Main MySQL Website: http://www.mysql.com/
Certification Webpage: http://education.oracle.com/
Exam Name: MySQL 5 Certified Associate Exam
Exam Number: 1Z0-870
=========================================================================================================
EXAM TOPICS
Section 1: Theory, Terminology and Concepts (10%)
Client/Server Concepts
FROM ubuntu:precise
MAINTAINER Bohdan Mushkevych
# Installing Oracle JDK
RUN apt-get -y install python-software-properties ;\
add-apt-repository ppa:webupd8team/java ;\
apt-get update && apt-get -y upgrade ;\
echo oracle-java7-installer shared/accepted-oracle-license-v1-1 select true | /usr/bin/debconf-set-selections ;\
apt-get -y install oracle-java7-installer && apt-get clean ;\
update-alternatives --display java ;\
FROM ubuntu:12.04
MAINTAINER Sergey Melnik "[email protected]"
RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -yq curl
#add CDH repo
RUN curl http://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/archive.key | apt-key add -
RUN curl http://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/cloudera.list > /etc/apt/sources.list.d/cloudera.list
# add CM repo
RUN curl http://archive.cloudera.com/cm5/ubuntu/precise/amd64/cm/archive.key | apt-key add -
############################################################
# ___ _ _ ____ _____ ____ ___ _ _____
# / _ \| | | |/ ___| ____| |___ \ / _ \/ |___ /
# | | | | | | | | | _| __) | | | | | |_ \
# | |_| | |_| | |___| |___ / __/| |_| | |___) |
# \___/ \___/ \____|_____| |_____|\___/|_|____/
#
# Rule Based Event Management
# Workshop 2013-03-12
# Runbook
#Predepends
apt-get install libnuma-dev
#Download pf_ring
#http://sourceforge.net/projects/ntop/files/PF_RING/
#--Version 5.6.1--
#wget http://freefr.dl.sourceforge.net/project/ntop/PF_RING/PF_RING-5.6.1.tar.gz
#tar -xzf PF_RING-5.6.1.tar.gz
#cd PF_RING-5.6.1
#--Version 5.6.2--
{
"title": "VPN Logins",
"services": {
"query": {
"list": {
"0": {
"query": "\"VPN zone remote user login allowed\"",
"alias": "",
"color": "#7EB26D",
"id": 0,
Use tcpdump to monitor mysql
# Capture the packets
sudo tcpdump -i eth0 port 3306 -s 65535 -x -n -q -tttt > tcpdump.out
# analyze all the requests from a given host
pt-query-digest --type=tcpdump --filter '($event->{host} || $event->{ip} || "") =~ m/192.168.248.64/' tcpdump.out