Skip to content

Instantly share code, notes, and snippets.

@wbazant
Created January 25, 2017 11:00
Show Gist options
  • Save wbazant/39ec0c2ed5de3317bc5cdc36a1971e9b to your computer and use it in GitHub Desktop.
Save wbazant/39ec0c2ed5de3317bc5cdc36a1971e9b to your computer and use it in GitHub Desktop.
[fg_atlas@ebi-005 ~]$ ls $ATLAS_EXPS | grep 'E-.*' | tee /var/tmp/atlas-exps-exps | wc -l
3165
[fg_atlas@ebi-005 ~]$ ls $ATLAS_PROD/analysis/*/*/experiments | grep 'E-.*' | tee /var/tmp/atlas-prod-exps | wc -l
3244
[fg_atlas@ebi-005 ~]$ sort /var/tmp/atlas-prod-exps -o /var/tmp/atlas-prod-exps
[fg_atlas@ebi-005 ~]$ sort /var/tmp/atlas-exps-exps -o /var/tmp/atlas-exps-exps
# experiments in atlas exps but not in atlas prod
[fg_atlas@ebi-005 ~]$ comm -13 /var/tmp/atlas-prod-exps /var/tmp/atlas-exps-exps
E-GEOD-53580
E-GEOD-73312
E-GEOD-74905
E-GEOD-77846
E-MTAB-3398
E-MTAB-5061
E-TABM-358
E-TABM-713
# I have moved a bunch of experiments with missing array designs here:
[fg_atlas@ebi-005 ~]$ cd $ATLAS_PROD/failedProcessing/tmp/*/*/experiments ; ls
E-GEOD-13316 E-GEOD-21679 E-GEOD-23739 E-GEOD-27626 E-GEOD-37556 E-GEOD-46475 E-GEOD-52227 E-MTAB-1430 E-MTAB-3711 E-MTAB-4028 E-TABM-357
E-GEOD-16567 E-GEOD-21706 E-GEOD-25185 E-GEOD-29747 E-GEOD-37782 E-GEOD-48406 E-MEXP-2642 E-MTAB-2545 E-MTAB-3930 E-MTAB-4507 E-TABM-358
E-GEOD-21070 E-GEOD-22479 E-GEOD-25820 E-GEOD-31188 E-GEOD-44394 E-GEOD-51615 E-MEXP-2702 E-MTAB-309 E-MTAB-3956 E-MTAB-5011 E-TABM-713
# which experiments are missing from Atlas exps because I've moved them out?
[fg_atlas@ebi-005 experiments]$ comm -12 <(comm -13 /var/tmp/atlas-prod-exps /var/tmp/atlas-exps-exps) <(ls)
E-TABM-358
E-TABM-713
# uh oh let's move them back
[fg_atlas@ebi-005 experiments]$ mv E-TABM-358 E-TABM-713 $ATLAS_PROD/analysis/differential/microarray/experiments
# TODO find out where the other five experiments are
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment