NISH1001

Vanilla Configuration

If you are not using any third party variants of bash like oh-my-bash, put the following command in your .bashrc:

export PROMPT_COMMAND='if [ "$(id -u)" -ne 0 ]; then echo "$(date "+%Y-%m-%d.%H:%M:%S") $(pwd) $(history 1)" >> ~/.logs/bash-history-$(date "+%Y-%m-%d").log; fi'

Close bashrc and open new terminal. Now, your history are saved in the folder ~/.logs according to timestamp.
Example file

/home/paradox/.logs/bash-history-2018-12-15.log

NISH1001

Extentions of Topic Models

There are a lot of Topic Models. 18/02/23 # of TM is 24

A

• ATM(author topic model)
  • The Author-Topic Model for Authors and Documents (UAI'04)

NISH1001

# add watermark
ffmpeg -y -i demo.mp4 -i logo.png -filter_complex \
          "[1]lut=a=val*0.3[a];[0][a]overlay=5:600" \
       -c:v libx264 -an output.mp4

NISH1001

# WIDTH:HEIGHT:Xstart:Ystart
ffmpeg -i output.mp4 -filter:v "crop=700:1170:0:50" cropped.mp4

# cut video
ffmpeg -ss 00:03:00.8 -i test.mp4 -c copy -t 00:00:02.2 output.mp4 -y

# embed subtitle
ffmpeg -i inp.mp4 -vf ass=subtitles.ass out.mp4

NISH1001

Check If archivelog mode is enabled

select log_mode from v$database;

Enable Archive mode

alter database archivelog;

NISH1001

Append File to File

hdfs dfs -appendToFile <src> <dest>

Echo to File

echo "hello world" | hadoop fs -appendToFile - /dir/hadoop/hello_world.txt

NISH1001

Sort Filenames by Size

du ./ | sort -n -r | head -n 20

Search string in files

grep -rnw -e "string" .

NISH1001

Data Type Conversion

//first read data to dataframe with any way suitable for you
var df: DataFrame = ???
val dfSchema = df.schema

import org.apache.spark.sql.functions._
import org.apache.spark.sql.types.DecimalType
dfSchema.foreach { field =>
 field.dataType match {

NISH1001

MSSQL CLI

github...

UI

https://dbeaver.io/

sqlcmd -S <ip> -d <dbname> -U <username> -P <password> -I

NISH1001

#!/bin/bash

echo "i am paradox"


#ffmpeg -i audio.mp3 -ignore_loop 0 -i test.gif -vf "scale=trunc(iw/2)*2:trunc(ih/2)*2" -shortest -strict -2 -c:v libx264 -threads 5 -c:a aac -b:a 192k -pix_fmt yuv420p -shortest final.mp4

# ffmpeg -i audio.mp3 -ignore_loop 0 -i test.gif -shortest -strict -2 -c:v libx264 -threads 5 -c:a aac -b:a 192k -pix_fmt yuv420p -shortest final.mp4

# ffmpeg -i audio.mp3 -ignore_loop 0 -i test.gif -vf "scale=trunc(iw/2)*1:trunc(ih/2)*2" -shortest -strict -2 -c:v libx264 -threads 5 -c:a aac -b:a 192k -pix_fmt yuv420p -shortest final.mp4