Skip to content

Instantly share code, notes, and snippets.

View racheliurui's full-sized avatar

Rachel Rui Liu racheliurui

View GitHub Profile
@racheliurui
racheliurui / CDK-Construct.md
Last active November 14, 2023 07:39
CDK Construct Cookie Cutter

Readme

CDK cookie cutter to accelerate development.

Init the construct

  • construct should be in root folder to support smooth npm install git+ssh
  • cdk init must run from an empty folder

Step 1, create construct template locally first

@racheliurui
racheliurui / site-to-site.md
Created November 10, 2022 05:12 — forked from kosyfrances/site-to-site.md
Steps to set up one tunnel IPSec Site to site VPN on AWS and a VM on another cloud provider (Packet) running Strongswan
@racheliurui
racheliurui / BrewBindInstallAndSetupMacOS.sh
Created April 26, 2022 06:09 — forked from Ikkyusan1/BrewBindInstallAndSetupMacOS.sh
Install and setup bind (named) on MacOS 11 Big Sur with brew
#!/bin/bash
# MacOS 11 Big Sur
# Homebrew 3.3.9
# bind: stable 9.16.24
# Local caching NS server
# 1) INSTALL BIND
@racheliurui
racheliurui / cidr.py
Created September 13, 2020 11:12 — forked from islander/cidr.py
Merge CIDR blocks into super blocks if possible
#!/usr/bin/env python
#
# Example 1: All blocks in list.txt, one CIDR per line
# cat list.txt | cidr.py
#
# Example 2: Echo CIDR blocks to stdout
# echo 1.2.3.0/25 1.2.3.128/25 | cidr.py
import sys
from netaddr import *
@racheliurui
racheliurui / multiple_ssh_setting.md
Created December 26, 2019 09:30 — forked from jexchan/multiple_ssh_setting.md
Multiple SSH keys for different github accounts

Multiple SSH Keys settings for different github account

create different public key

create different ssh key according the article Mac Set-Up Git

$ ssh-keygen -t rsa -C "[email protected]"
@racheliurui
racheliurui / HDF2.1.2InstallationConfig.md
Created July 3, 2017 04:02
HDF Cluster installation and configuration #hortonworks #hdf2.1.2 #hdf #cluster #configuration

HDF Cluster installation and configuration

Overview

This wiki documented how to install and configure Hortonworks HDF Cluster.

  • HDF 2.1.2
  • Ambari 2.4.2.0
  • Kafka 0.10.1
  • NiFi 1.1.0
  • Ranger 0.6.2
@racheliurui
racheliurui / NifiNKafkaClusterTestCases.md
Last active April 5, 2021 11:20
Nifi & Kafka Cluster Test Cases #hortonworks #kafka #nifi #cluster

Nifi Kafka Cluster Test Cases

Topology

Due to environment limitation, the test environment are two Linux servers creating an Ambari cluster with,

  • A zookeeper cluster shared by nifi and Kafka cluster,
  • A nifi cluster with two nodes,
  • A Kafka cluster

Message Sequencing Tests

@racheliurui
racheliurui / KafkaCluster
Last active June 19, 2017 01:09
Kafka Cluster
Conclusion,
Zookeeper need at least 2 instances to function as cluster coordinator.
When start a new publisher, we need to specify the publish-brokers,
• if all publish-brokers are down but there’s other broker(s) in same replica is up and zookeeper is in function, then the published message will be cached somewhere and re-published when one of the publish-brokers is up
• if all publish-brokers are down and zookeeper is not in function, then we can’t publish
For an existing function publisher, when we bring down some of publish-brokers,
• If all publish-brokers are down and we need to switch to other alive brokers , we need to count on zookeeper
@racheliurui
racheliurui / Hortonworks-HDF.md
Last active June 29, 2017 03:44
Hortonworks-HDF