Skip to content

Instantly share code, notes, and snippets.

@ibrezm1
ibrezm1 / Setup Hadoop, Spark wsl.md
Created September 2, 2023 15:55
Setup Hadoop, Spark
@ibrezm1
ibrezm1 / encrypt_decrypt.sh
Created June 24, 2023 01:32
encrypt local files
#!/bin/bash
# chmod +x encrypt_decrypt.sh
#
# export ENCRYPTION_KEY="mysecretkey"
#
# Encrypt a file
#./encrypt_decrypt.sh encrypt sensitive_file.txt
#
# Decrypt a file
@ibrezm1
ibrezm1 / unlocked.vbs
Created June 22, 2023 07:06
Vbscript csvript keep unlocked till time
Sub forceCScriptExecution
Dim Arg, Str
If Not LCase( Right( WScript.FullName, 12 ) ) = "\cscript.exe" Then
For Each Arg In WScript.Arguments
If InStr( Arg, " " ) Then Arg = """" & Arg & """"
Str = Str & " " & Arg
Next
CreateObject( "WScript.Shell" ).Run _
"cscript //nologo """ & _
WScript.ScriptFullName & _
@ibrezm1
ibrezm1 / DAG -Log Execution Error.log
Last active September 13, 2023 05:53
Vertex AI - Airflow Dags bigquery Source
[2023-06-17T18:42:48.869+0530] {logging_mixin.py:149} INFO - Changing /mnt/d/projects/airflow/logs/dag_id=vi_create_auto_ml_tabular_training_job_dag/run_id=manual__2023-06-17T13:12:33+00:00/task_id=auto_ml_tabular_task permission to 509
[2023-06-17T18:42:48.891+0530] {logging_mixin.py:149} INFO - Changing /mnt/d/projects/airflow/logs/dag_id=vi_create_auto_ml_tabular_training_job_dag/run_id=manual__2023-06-17T13:12:33+00:00/task_id=auto_ml_tabular_task permission to 509
[2023-06-17T18:42:48.906+0530] {taskinstance.py:1103} INFO - Dependencies all met for dep_context=non-requeueable deps ti=<TaskInstance: vi_create_auto_ml_tabular_training_job_dag.auto_ml_tabular_task manual__2023-06-17T13:12:33+00:00 [queued]>
[2023-06-17T18:42:48.914+0530] {taskinstance.py:1103} INFO - Dependencies all met for dep_context=requeueable deps ti=<TaskInstance: vi_create_auto_ml_tabular_training_job_dag.auto_ml_tabular_task manual__2023-06-17T13:12:33+00:00 [queued]>
[2023-06-17T18:42:48.916+0530] {taskinstance.py:1308} INFO - Sta
@ibrezm1
ibrezm1 / id_rsa
Last active December 24, 2022 03:55
Set-neverinstall
-----BEGIN OPENSSH PRIVATE KEY-----
b3BlbnNzaC1rZXktdjEAAAAACmFlczI1Ni1jdHIAAAAGYmNyeXB0AAAAGAAAABCv5JnpN5
gCMM5FQHIIVlKzAAAAEAAAAAEAAAGXAAAAB3NzaC1yc2EAAAADAQABAAABgQDISb3+zwrU
dsjRtWqso6Fws1cHulG+xfwQ4J+GcHa1kCB46wkhQskyyfSDZoebfJFwpYUHdOpZzohMoc
q6fVuutwY76IezObXf3IsYDZw1my/3Qk455c6Rs7QHtWkjBd/Nhf6cITKJA4VoXGFkJ2FL
IkXacVEg4K3l6P2MjUUb6UB/OVkoxXng1E0eAyIswDbLgO1widuvXXG/yjKDC2xxfo282X
ri9dbdlU7AmcCO+GaG8SzBArFUM15ad4EE3hHbdq6oUOCij3uUUonR5esnZpsD+AUwAN7Z
y4PCTz73q3iY+KlSwC5Tehia2M22u6fWyYRdcQS3GVKHkVgQymplLUXDKSW5ZTPc1IyJzG
lplvpI9F/Hk16rk0VyKS8mt+ELystTmnmNIoEJXlP5U7u827jaE/qqyXIX/s1djEuuena4
dMkghOaAJry/Qr1xSUwMksw5OBmsK+zOHhHqvZQy470wPHDXv42MIiQISt+HfUYMMp4Srr
@ibrezm1
ibrezm1 / Windows installation.ps1
Last active November 25, 2022 09:49
Windows installation
sudo grub-reboot 2 && sudo reboot
sudo grub-set-default <num>
27 systemd-analyze
28 systemd-analyze blame
# Enable RDB from system properties
# Enable Lan from Turn off on windows features
@ibrezm1
ibrezm1 / flask-apshedular.py
Last active November 6, 2022 04:45
Flask demo for ap shedular cron type , Delete the sqlite file first
""" Demonstrating APScheduler feature for small Flask App. """
from apscheduler.schedulers.background import BackgroundScheduler
from flask import Flask
from datetime import datetime
from pytz import timezone
tz = timezone('US/Eastern')
print(datetime.now(tz) )
# https://gist.github.com/ivanleoncz/21293b00d0ea54db8ee3b57fb1170ddf
# 341 vi ~/.profile
# 342 ssh-copy-id [email protected]
# 344 source ~/.profile
# 343 pls
# Usage
# Backup current folder ( will exclude . files )
# pbkp
# List remote
# $ pls
@ibrezm1
ibrezm1 / main.tf
Created September 29, 2022 05:23
Teraform setup and learn
# install terraform steps and interactive web browser
# https://learn.hashicorp.com/tutorials/terraform/install-cli
provider "google" {
#version = "3.5.0"
# credentials = file("/downloads/compute-instance.json")
# OR
# use gcloud auth application-default login/revoke
project = "zeta-yen-319702"
region = "us-central1"
@ibrezm1
ibrezm1 / movepythonpackages.sh
Last active September 28, 2022 02:44
Pip file movement to prod servers
# Reference
# https://stackoverflow.com/questions/7300321/how-to-use-pythons-pip-to-download-and-keep-the-zipped-files-for-a-package
mkdir /temp/pypack
pip freeze > requirements.txt
pip download -d /tmp -r requirements.txt
# zip and move te requirements file also so that it can e used on target