This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/env python | |
# -*- coding: utf-8 -*- | |
# Author: Rico Sennrich | |
"""Use operations learned with learn_bpe.py to encode a new text. | |
The text will not be smaller, but use only a fixed vocabulary, with rare words | |
encoded as variable-length sequences of subword units. | |
Reference: | |
Rico Sennrich, Barry Haddow and Alexandra Birch (2015). Neural Machine Translation of Rare Words with Subword Units. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
14 Stunden kämpften die Ärzte um das Überleben des Opfers , jedoch vergeblich . | |
16.000 Keulen pro Woche sprechen für sich . | |
1. November , den die in Den Haag ansässige Organisation Damaskus gesetzt hatte , um alle Einrichtungen zur Herstellung von Chemiewaffen zu zerstören oder „ inoperabel “ zu machen , einschließlich aller Maschinen für das Mischen von Chemikalien zu Giftgas und das Befüllen von Munition . | |
2004 wurde von vier Männern , die alle Minderheiten angehörten , Klage eingereicht , die sich zu einer Sammelklage entwickelte . | |
2009 wurden die Pachtverträge für die Unternehmen am Circular Quay , die den Obeids jährlich 2,5 Millionen Dollar einbrachten , ohne öffentliche Ausschreibung verlängert . | |
2011 luden Firmenmitarbeiter ein Passagierflugzeug voller Kindle E @-@ Reader und machten einen Testflug , um Probleme zu ermitteln , konnten aber keine feststellen . | |
2011 unterzeichneten Dutzende französische Abgeordnete des streng katholischen Landes eine Petition , dass die „ Geschlechtertheorie “ aus Schul |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
14 Stunden kämpften die Ärzte um das Überleben des Opfers, jedoch vergeblich. | |
16.000 Keulen pro Woche sprechen für sich. | |
1. November, den die in Den Haag ansässige Organisation Damaskus gesetzt hatte, um alle Einrichtungen zur Herstellung von Chemiewaffen zu zerstören oder „inoperabel" zu machen, einschließlich aller Maschinen für das Mischen von Chemikalien zu Giftgas und das Befüllen von Munition. | |
2004 wurde von vier Männern, die alle Minderheiten angehörten, Klage eingereicht, die sich zu einer Sammelklage entwickelte. | |
2009 wurden die Pachtverträge für die Unternehmen am Circular Quay, die den Obeids jährlich 2,5 Millionen Dollar einbrachten, ohne öffentliche Ausschreibung verlängert. | |
2011 luden Firmenmitarbeiter ein Passagierflugzeug voller Kindle E-Reader und machten einen Testflug, um Probleme zu ermitteln, konnten aber keine feststellen. | |
2011 unterzeichneten Dutzende französische Abgeordnete des streng katholischen Landes eine Petition, dass die „Geschlechtertheorie" aus Schulbüchern entfernt werden so |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/env python | |
# -*- coding: utf-8 -*- | |
from __future__ import division | |
from __future__ import print_function | |
import os, sys | |
from torch import optim | |
from argparse import ArgumentParser | |
sys.path.append(".") |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
version: "3.6" | |
services: | |
apiserver: | |
command: | |
- apiserver | |
container_name: trains-apiserver | |
image: allegroai/trains:latest | |
restart: unless-stopped | |
volumes: |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
version: "3.6" | |
services: | |
apiserver: | |
command: | |
- apiserver | |
container_name: trains-apiserver | |
image: allegroai/trains:latest | |
restart: unless-stopped | |
volumes: |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Your job 1199571 ("run_single.sh") has been submitted | |
➜ jobs qstatjob-ID prior name user state submit/start at queue | |
jclass slots ja-task-ID | |
------------------------------------------------------------------------------------------------------- | |
----------------------------------------- | |
1199571 0.25586 run_single acb11190vf r 10/05/2019 23:25:46 gpu@g0022 | |
10 | |
➜ jobs qsub -g gcb50169 -l rt_F=4 ./run.sh python $HOME/lanmt/run.py --opt_dtok wmt14_ende --opt_disti | |
ll --opt_annealbudget --opt_finetune --opt_sgdft --opt_Trefine_steps 1 --train --test --evaluate |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/env python | |
# -*- coding: utf-8 -*- | |
from __future__ import absolute_import | |
from __future__ import division | |
from __future__ import print_function | |
import math | |
import torch | |
import torch.nn as nn |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/env python | |
# -*- coding: utf-8 -*- | |
from __future__ import absolute_import | |
from __future__ import division | |
from __future__ import print_function | |
import torch | |
import torch.nn as nn | |
import torch.nn.functional as F |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/env python | |
# -*- coding: utf-8 -*- | |
from __future__ import absolute_import | |
from __future__ import division | |
from __future__ import print_function | |
import numpy as np | |
import torch | |
import torch.nn as nn |