Skip to content

Instantly share code, notes, and snippets.

@myloginid
myloginid / 0_reuse_code.js
Created August 19, 2017 12:23
Here are some things you can do with Gists in GistBox.
// Use Gists to store code you would like to remember later on
console.log(window); // log the "window" object to the console
cd /opt && mkdir -p /opt/cloudera/parcels/
yum -y group install "Development Tools"
yum -y install git maven gcc gcc-c++ wget curl curl-devel
yum -y install openssl openssl-devel epel-release
yum -y install gtest gtest-devel
wget https://cmake.org/files/v3.11/cmake-3.11.0-rc4-Linux-x86_64.sh
chmod 744 cmake-3.11.0-rc4-Linux-x86_64.sh
mv cmake-3.11.0-rc4-Linux-x86_64.sh /opt
cd /opt && echo y Y | sh /opt/cmake-3.11.0-rc4-Linux-x86_64.sh
PATH=/opt/cmake-3.11.0-rc4-Linux-x86_64/bin:${PATH}
@myloginid
myloginid / scaling.adoc
Created November 1, 2018 03:05 — forked from wdberkeley/scaling.adoc
Apache Kudu Scaling Doc

Apache Kudu Scaling

@myloginid
myloginid / Kube-dns.md
Created November 22, 2018 10:36 — forked from mcastelino/Kube-dns.md
kubernetes kube-dns components, debugging

Summary

  • dnsmasq front ends the requests and sends them on to kube-dns

    dnsmasq
      --cache-size=1000
      --no-resolv
      --server=127.0.0.1#10053
    

--log-facility=-

Offline Python Package Install Notes

Two common cases which make the install of Python packages harder due to networking issues are: a) Install behind a Proxy b) Install without access to the internet

(a) Install behind a Proxy

In the case where the target machine connects to the internet over a network proxy, export the following environment vars, as appropriate - http_proxy and https_proxy. Eg:

@myloginid
myloginid / xgb-demo.R
Created March 3, 2020 09:37
xgb-demo
install.packages(c("zoo","data.table","FeatureHashing","xgboost","Matrix","dplyr","smbinning","ROCR"))
install.packages(c("xgboost","DiagrammeR"))
data(agaricus.train, package='xgboost')
library(xgboost)
bst <- xgboost(data = agaricus.train$data, label = agaricus.train$label, max_depth = 3,
eta = 1, nthread = 2, nrounds = 2,objective = "binary:logistic")
set hive.auto.convert.join.noconditionaltask.size=200M;
set hive.auto.convert.join.noconditionaltask=true;
set hive.compute.query.using.stats=false;
set hive.exec.compress.intermediate=true;
set hive.exec.compress.output=true;
set hive.exec.dynamic.partition.mode=strict;
set hive.exec.dynamic.partition=true;
set hive.exec.max.created.files=100000;
# Example EFM Config
# Web UI users authenticate using Knox SSO
# MiNiFi Agents authenticate using two-way TLS with client certificates
# Web Server TLS Properties
efm.server.ssl.enabled=true
efm.server.ssl.keyStore=./conf/keystore.jks
efm.server.ssl.keyStoreType=jks
efm.server.ssl.keyStorePassword=yourKeyStorePasswordHere
efm.server.ssl.keyPassword=yourKeyPasswordHere