Dao Huy Hoang hoangdh

Install instaloader

pip3 install --user instaloader

Download all video from masukiye_bungalov channel

instaloader --post-filter="is_video" --no-video-thumbnails --no-metadata-json --filename-pattern={date_utc:%Y}/{shortcode} masukiye_bungalov

When run apt update,

root@hadoop123:~# apt-get update
Get:5 https://repo.saltproject.io/py3/ubuntu/20.04/amd64/archive/3005 focal InRelease [2125 B]
Err:5 https://repo.saltproject.io/py3/ubuntu/20.04/amd64/archive/3005 focal InRelease
  The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 0E08A149DE57BFBE
Reading package lists... Done
W: GPG error: https://repo.saltproject.io/py3/ubuntu/20.04/amd64/archive/3005 focal InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 0E08A149DE57BFBE
E: The repository 'https://repo.saltproject.io/py3/ubuntu/20.04/amd64/archive/3005 focal InRelease' is not signed.

Fixed Log4j RCE Dec 10 2021 for Hadoop Cluster using CDH

Info:

Code: CVE-2021-44228
https://nvd.nist.gov/vuln/detail/CVE-2021-44228
https://bishopfox.com/blog/log4j-zero-day-cve-2021-44228-
Cheatsheet: https://gist.github.com/SwitHak/b66db3a06c2955a9cb71a8718970c592

Show log4j version on Namenode, Datanode, Resource Manager, NodeManager

Webhook Example

#!/usr/bin/python3
# -*- coding: utf-8 -*-

from flask import Flask, request

app = Flask(__name__)

Setup Hortonwork Registry Schema

Ref: https://registry-project.readthedocs.io/en/latest/install.html#centos-redhat

systemd

vi /etc/systemd/system/registry-schema.service

[Unit]

How to compile atop from source code on Ubuntu

1. Download atop source code from homepage

https://www.atoptool.nl/downloadatop.php

OR using wget command

	echo "vm.zone_reclaim_mode=0
	vm.swappiness=1
	vm.max_map_count=102400" >> /etc/sysctl.conf
	sysctl -p /etc/sysctl.conf

	apt-get install gnupg curl -y
	wget http://archive.ubuntu.com/ubuntu/pool/main/o/openssl/libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb -P /tmp
	dpkg -i /tmp/libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb && rm /tmp/libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb
	curl -fsSL https://pgp.mongodb.com/server-6.0.asc \| gpg -o /usr/share/keyrings/mongodb-server-6.0.gpg --dearmor
	echo "deb [ arch=amd64,arm64 signed-by=/usr/share/keyrings/mongodb-server-6.0.gpg ] https://repo.mongodb.org/apt/ubuntu focal/mongodb-org/6.0 multiverse" \| sudo tee /etc/apt/sources.list.d/mongodb-org-6.0.list

	#!/bin/bash

	fallocate -l 1G /swapfile;
	chmod 600 /swapfile; mkswap /swapfile;
	cp /etc/fstab /etc/fstab.bk;
	echo '/swapfile none swap sw 0 0' \| sudo tee -a /etc/fstab;
	swapon -a;
	sysctl vm.swappiness=15;
	sysctl vm.vfs_cache_pressure=50

	#!/bin/bash

	if [ "$1" == "on" ]
	then
	synclient TouchpadOff=0
	echo "$(date '+%F %T') - INFO: Touchpad is enabled."
	elif [ "$1" == "off" ]
	then
	echo "$(date '+%F %T') - INFO: Touchpad is disabled."
	synclient TouchpadOff=1

	Mon Jun 8 21:53:10 +07 2020 Starting master on sysadmin-hbase-compact-test-50-61
	core file size (blocks, -c) 0
	data seg size (kbytes, -d) unlimited
	scheduling priority (-e) 0
	file size (blocks, -f) unlimited
	pending signals (-i) 63983
	max locked memory (kbytes, -l) 16384
	max memory size (kbytes, -m) unlimited
	open files (-n) 32000
	pipe size (512 bytes, -p) 8