Skip to content

Instantly share code, notes, and snippets.

@dukechem
Created September 23, 2020 17:09
Show Gist options
  • Save dukechem/f25dc3934f23a0097b5cff2d9225ada7 to your computer and use it in GitHub Desktop.
Save dukechem/f25dc3934f23a0097b5cff2d9225ada7 to your computer and use it in GitHub Desktop.
Easy way to get csv list of files with each md5-sum using free TREESIZE.EXE from https://downloads.jam-software.de/filelist/FileList.zip
cd <path to parent folder of the files>
echo "Do not open c:\temp\filelist-with-md5.csv until you see current time displayed"
filelist /md5 > c:\temp\filelist-with-md5.csv
time /t
@dukechem
Copy link
Author

Example: On windows, start: cmd /u and in the cmd window that appears type command similar to those in transcript below

>    mkdir c:\temp
>    choco upgrade filelist   

If choco is not found, manually download FILELIST.zip from https://downloads.jam-software.de/filelist/FileList.zip. Unzip and copy FileList.exe and FileList.chm to your path or c:\temp\ folder

>     L:
>     cd L:\KJF\Lizzie Hunsaker\Raw Data\RNA-seq raw data\hunsaker_5070
>     dir /s
... 
02/02/2019  11:21 AM       577,477,962 5070-S7_S24_L002_R2_001.fastq.gz
02/02/2019  04:38 PM       664,143,595 5070-S8_S25_L002_R1_001.fastq.gz
02/03/2019  10:35 AM       681,145,074 5070-S8_S25_L002_R2_001.fastq.gz
02/03/2019  03:26 AM       670,054,019 5070-S9_S26_L002_R1_001.fastq.gz
02/02/2019  08:59 PM       689,720,978 5070-S9_S26_L002_R2_001.fastq.gz
02/02/2019  10:01 PM            13,632 HUNSAKER_5070_190114B6.checksum
02/03/2019  03:21 AM             1,126 README.rtf
     Total Files Listed:
             152 File(s) 90,620,099,578 bytes
>    pwd
/l/KJF/Lizzie Hunsaker/Raw Data/RNA-seq raw data/hunsaker_5070

>   filelist.exe   /md5  > c:\temp\filelist-with-md5.csv

... or if you did not have filelist.exe in your path instead type:

>  c:\temp\FileList.exe  /md5  > c:\temp\filelist-with-md5.csv
> time /t

NOTE: In this example, the csv file was not be ready to open until after 15+ minutes needed to calculate md5 checksum for each of 150 files of 600+MB each. You will know when the csv file is ready when the prompt returns and/or you see current time. Dozens of pages of help for using FileList.exe command-line-utility can be searched by opening the FileList.chm file. If windows does not open the chm file correctly, the free sumatrapdf reader can open it: choco upgrade sumatrapdf.install

A description and online-manual for FileList is at https://www.jam-software.com/filelist

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment