Script_Delete_Duplicate_Rows_&_Split

Display Only Duplicate lines using Bash :
   
    1) On specifi column : cat  *.* | cut -f 2 -d\ | sort | uniq -d

    2) All row           : cat  *.* | sort | uniq -d


Delete duplicate rows and copy them to different files with a size limit

    1) awk '!seen[$0]++' *.* | split --additional-suffix=.ttl -d -l 1000 - yedG_
    
    2) gawk -i inplace '!a[$0]++' *.*  & find . -size 0 -delete