daniel lee khun84

Playbook to setup physical replication in Postgresql 13

Install the postgresql 13 for replica on another instance. sudo apt-get install postgresql-13. Install binary extension if theres any, ie sudo apt-get install postgresql-13-postgis-3
Create a user in master server for replication connection. create user replica with password <password>
Change the following postgres config in the master server

# in /etc/postgresql/13/main/postgres.conf

max_wal_senders = 5
synchronous_standby_names = 'pgslave001' # or any other you prefer

Put tlskeylogger.plist at ~/Library/LaunchAgents/tlskeylogger.plist
launchctl load ~/Library/LaunchAgents/tlskeylogger.plist, so it will load on the next restart
launchctl start ~/Library/LaunchAgents/tlskeylogger.plist, so it will load the environment variable immediately
Restart your browser(s)
See how TLS keys are being written to ~/.tlskeyfile via tail -f ~/.tlskeyfile

The main point is to save the SSL/TLS keys those used by the web browser (SSLKEYLOGFILE=/tmp/tmp-google/.ssl-key.log).
In the example below we run brand new instance of Google Chrome (--user-data-dir=/tmp/tmp-google do the trick):
SSLKEYLOGFILE=/tmp/tmp-google/.ssl-key.log /Applications/Google\ Chrome.app/Contents/MacOS/Google\ Chrome --user-data-dir=/tmp/tmp-google
Then run the Wireshark and open the Preferences -> Protocols -> SSL, where we put the path to the SSL keys log file into the (Pre)-Master-Secret log filename field.
Now all SSL/TLS traffic from this browser instance will be decrypted.

require 'kafka'
require 'avro_turf/messaging'

kaf_broker = "from-ur-credentials"
kaf_api_key = "from-ur-credentials"
kaf_api_secret = "from-ur-credentials"
schema_url = "from-ur-credentials"
schema_api_key = "from-ur-credentials"
schema_api_secret = "from-ur-credentials"

Basically we just need to do the following

# 1. Install v8 ourselves
$ brew install v8-315
# 2. Install libv8 using the v8 binary we just installed
$ gem install libv8 -v '3.16.14.19' -- --with-system-v8
# 3. Install therubyracer using the v8 binary we just installed
$ gem install therubyracer -- --with-v8-dir=/usr/local/opt/v8@315 # your path could be different, e.g. /usr/local/opt/[email protected]
# 4. Install the remaining dependencies

	require 'json'
	require 'csv'

	data = `pbpaste`
	data = JSON.parse(data);nil
	data = data.select{\|d\| d.dig('schedule', 'paused') == false && d['source_type'] == 'dbtable' };nil
	keys = [
	'title',
	'description',
	'src_db', # from_ds_name

	- sleep
	- pipeline
	- parallel task