Tsonglew tsonglew

How to install Hadoop on your local Kubernetes cluster

Okey this is not the easiest way of running Hadoop on your local computer and probably you should instead just install it locally.

However if you really insist doing this here's how:

Install kubectl, minikube and Docker if you don't already have it. I recommend using package-manager like Chocolatey. Minikube should install with VirtualBox as default driver which I recommend. When starting minikube we should increase its memory limit since our Hadoop node's pods need at least 2GB: minikube --memory 4096 --cpus 2 start (minikube's default is 1GB). NOTE: actually the Hadoop cluster by default uses about 10GB in memory limits and about 3GB running memory. From what I looked my k8s will overprovision to 300% of its capacity limits but use far less.
Install helm. Then run helm init.
Now you

Project Title

One Paragraph of project description goes here

Getting Started

These instructions will get you a copy of the project up and running on your local machine for development and testing purposes. See deployment for notes on how to deploy the project on a live system.

Prerequisites

To remove a submodule you need to:

Delete the relevant section from the .gitmodules file.
Stage the .gitmodules changes git add .gitmodules
Delete the relevant section from .git/config.
Run git rm --cached path_to_submodule (no trailing slash).
Run rm -rf .git/modules/path_to_submodule (no trailing slash).
Commit git commit -m "Removed submodule "
Delete the now untracked submodule files rm -rf path_to_submodule

The introduction to Reactive Programming you've been missing

(by @andrestaltz)

This tutorial as a series of videos

If you prefer to watch video tutorials with live-coding, then check out this series I recorded with the same contents as in this article: Egghead.io - Introduction to Reactive Programming.

	## Install perf in docker container
	### ubuntu 18.4
	### kernel 4.14.173-137.229.amzn2.x86_64

	docker exec -it {containerid} sh
	wget https://cdn.kernel.org/pub/linux/kernel/v4.x/linux-4.14.173.tar.xz && tar -xf ./linux-4.14.173.tar.xz && cd linux-4.14.173/tools/perf/ && apt -y install flex bison && make -C . && make install
	./perf
	./perf list
	./perf bench mem all

	package main
	// More info on Getwd()
	// https://golang.org/src/os/getwd.go
	//
	import(
	"os"
	"fmt"
	"log"
	)

	package main

	import (
	"bufio"
	"fmt"
	"io"
	"os"
	"os/exec"
	"strings"
	)

	local arg = "your_key*"
	local cKeys = redis.call("KEYS",arg);
	local cValues = redis.call("MGET",unpack(cKeys));
	local cSet = {};
	for key,value in pairs(cKeys) do
	cSet[key] = {cKeys[key],cValues[key]};
	end

	return cSet

	<?xml version="1.1" encoding="UTF-8"?>
	<!DOCTYPE keyboard SYSTEM "file://localhost/System/Library/DTDs/KeyboardLayout.dtd">
	<!--

	Data generated Wed Mar 23 01:35:41 2022

	Generated by kluchrtoxml_64 build 203

	-->
	<!--Last edited by Ukelele version 351 on 2022-03-23 at 01:45 (GMT+8)-->