Yatharth Ranjan yatharthranjan

To sync files from remote to local

rsync -avz --stats --dry-run --relative -e "ssh -i path/to/somekey" "[email protected]:/remote/path/./data/*/datatype/" ~/local/path/data/datatype/

Replace the local and remote path as per your requirements. This is for getting data from the datatype folder for all folders within the data folder. Put path to your ssh key in place of path/to/somekey and replace [email protected] with your connection string for your remote machine.

This does the following-

--stats shows the progress and other statistics
--dry-run performs a check run but does not tranfer any data. Remove it to actually intiate the data transfer

	#!/usr/bin/env bash

	# Ask for GitHub organization name
	read -p "Enter GitHub organization name: " org

	# Ask for GitHub token
	read -sp "Enter GitHub token: " token
	echo

	# Set the number of repositories to fetch per page

	#!/usr/bin/env bash

	# Ask for user input
	read -p "Enter the source organization: " source_org
	read -p "Enter the destination organization: " dest_org
	read -p "Enter the GitHub token: " gh_token
	read -p "Enter the repositories to exclude (comma-separated): " excluded_repos_input

	# Convert comma-separated excluded repositories to an array
	IFS=',' read -r -a excluded_repos <<< "$excluded_repos_input"

	def get_top_correlations_blog(df, threshold=0.4):
	"""
	df: the dataframe to get correlations from
	threshold: the maximum and minimum value to include for correlations. For eg, if this is 0.4, only pairs haveing a correlation coefficient greater than 0.4 or less than -0.4 will be included in the results.
	"""
	orig_corr = df.corr()
	c = orig_corr.abs()

	so = c.unstack()