Last active
August 29, 2015 14:25
-
-
Save zomux/27e8b3921a5200d2cc6d to your computer and use it in GitHub Desktop.
WAT EXP
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| export PYTHONPATH="/home/hadoop/deepy:/home/hadoop/works/nmt" | |
| python bin/pack_data.py /var/spool/data/hadoop-local/nmt/pickles/remt1.v80k_40k.unkpos.bin.txt /var/spool/data/hadoop-local/nmt/pickles/remt1.v80k_40k.unkpos.b80.trun40.rev.pack --pick 1280 --avoid_valid_data --truncate_length 40 --reverse_source --batch 80 --source_size 80000 --target_size 40000 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| export PYTHONPATH="/home/ubuntu/deepy:/home/ubuntu/nmt" | |
| python bin/pack_data.py /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.bin.txt /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.b80.trun40.rev.fix.pack --pick 1280 --avoid_valid_data --truncate_length 40 --reverse_source --batch 80 --source_size 80000 --target_size 40000 --fix_length | |
| python bin/pack_data.py /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.bin.txt /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.b80.trun40.rev.fix.valid.pack --pick 1280 --truncate_length 40 --reverse_source --batch 80 --source_size 80000 --target_size 40000 --fix_length | |
| CUDA_LAUNCH_BLOCKING=1 python ./trails/lstm_encdec/train.py /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.b80.trun40.rev.fix.pack --valid /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.b80.trun40.rev.fix.valid.pack --source_size 80000 --target_size 40001 --hidden_size 1024 --approx --word_embed 1000 --arch one_layer_search --encoder_mask --save /home/ubuntu/data/models/irnn_sch_1lay_v80k40k_1024h_trun40_emb_msk_pred_adadelta.uncompressed.npz --optimizer adadelta --lr 0.01 --train_size 12500 --predict |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| CUDA_LAUNCH_BLOCKING=1 python ./trails/length_model/train.py /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.b80.trun40.rev.pack --valid /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.b80.trun40.rev.valid.pack --source_size 80000 --hidden_size 512 --word_embed 500 --arch lstm_one_layer --encoder_mask --save /home/ubuntu/data/models/length_model_lstm_1lay_v80k40k_512h_trun40_emb_msk_adadelta.uncompressed.npz --optimizer adadelta --lr 0.01 --train_size 12500 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # irnn search v80k40k pred | |
| mkdir /var/spool/data/hadoop-local/nmt/models | |
| python ./trails/lstm_encdec/train.py /var/spool/data/hadoop-local/nmt/pickles/remt1.v80k_40k.unkpos.b80.trun40.rev.pack --valid /var/spool/data/hadoop-local/nmt/pickles/remt1.v80k_40k.unkpos.b80.trun40.rev.valid.pack --source_size 80000 --target_size 40001 --hidden_size 1024 --approx --word_embed 1000 --arch one_layer_search --encoder_mask --save /var/spool/data/hadoop-local/nmt/models/irnn_sch_1lay_v80k40k_1024h_trun40_emb_msk_pred_adadelta.uncompressed.npz --optimizer adadelta --lr 0.01 --train_size 12500 --predict | |
CUDA_LAUNCH_BLOCKING=1 python ./trails/lstm_encdec/train.py /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.b60.trun40.rev.pack --valid /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.b60.trun40.rev.valid.pack --source_size 80000 --target_size 40001 --hidden_size 1024 --approx --word_embed 1000 --arch lstm_one_layer_search --encoder_mask --optimizer adadelta --lr 0.01 --train_size 17000 --predict --gradient_clip 0
Better LSTM
Search
CUDA_LAUNCH_BLOCKING=1 python ./trails/lstm_encdec/train.py /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.b60.trun40.rev.pack --valid /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.b60.trun40.rev.valid.pack --source_size 80000 --target_size 40001 --hidden_size 1024 --approx --word_embed 1000 --arch lstm_one_layer_search --encoder_mask --save /home/ubuntu/data/models/better_lstm_sch_1lay_v80k40k_1024h_trun40_emb_msk_pred_adadelta.uncompressed.npz --optimizer adadelta --lr 0.01 --train_size 12500 --predict --shuffle_memory --better_lstm
Two layer
python ./trails/lstm_encdec/train.py /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.b80.trun40.rev.pack --valid /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.b80.trun40.rev.valid.pack --source_size 80000 --target_size 40001 --hidden_size 1024 --approx --word_embed 1000 --arch lstm_two_layer --encoder_mask --save /home/ubuntu/data/models/better_lstm_2lay_v80k40k_1024h_trun40_emb_msk_pred_mom.uncompressed.npz --optimizer momentum --lr 0.05 --train_size 12500 --predict --shuffle_memory --better_lstm
LSTM California
export DEEPY_SEED=3333
CUDA_LAUNCH_BLOCKING=1 python ./trails/lstm_encdec/train.py /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.b60.trun40.rev.pack --valid /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.b60.trun40.rev.valid.pack --source_size 80000 --target_size 40001 --hidden_size 1024 --approx --word_embed 1000 --arch lstm_one_layer_search --encoder_mask --save /home/ubuntu/data/models/lstm_sch_1lay_v80k40k_1024h_trun40_emb_msk_pred_adadelta_c3.uncompressed.npz --optimizer adadelta --lr 0.01 --train_size 17000 --predict --shuffle_memory
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
export PYTHONPATH="/home/ubuntu/deepy:/home/ubuntu/nmt"
python bin/pack_data.py /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.bin.txt /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.b60.trun40.rev.pack --pick 1280 --avoid_valid_data --truncate_length 40 --reverse_source --batch 60 --source_size 80000 --target_size 40000
python bin/pack_data.py /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.bin.txt /home/ubuntu/data/pickles/remt1.v80k_40k.unkpos.b60.trun40.rev.valid.pack --pick 1280 --truncate_length 40 --reverse_source --batch 60 --source_size 80000 --target_size 40000