Skip to content

Instantly share code, notes, and snippets.

@wasertech
Created July 5, 2022 10:41
Show Gist options
  • Save wasertech/2379fe66d5d3ff94674e484b6f41b24f to your computer and use it in GitHub Desktop.
Save wasertech/2379fe66d5d3ff94674e484b6f41b24f to your computer and use it in GitHub Desktop.
Get number of CPU available.
_____ __
/__ / _____/ /_
/ / / ___/ __ \
/ /__(__ ) / / /
/____/____/_/ /_/
Bonsoir, Monsieur.
❯ docker build \
--rm \
--build-arg uid=1018 \
--build-arg gid=1018 \
-f Dockerfile.train \
-t stt-train . && \
docker run \
-it \
--gpus=all \
--privileged \
--shm-size=1g \
--ulimit memlock=-1 \
--ulimit stack=67108864 \
--mount type=bind,src="/mnt/Données II/Données/STT/data",dst=/mnt stt-train && \
docker container prune || docker container prune -f
Sending build context to Docker daemon 102.1MB
Step 1/33 : FROM nvcr.io/nvidia/tensorflow:22.02-tf1-py3 AS kenlm-build
---> 538f4b790e0b
Step 2/33 : ENV DEBIAN_FRONTEND=noninteractive
---> Using cache
---> d52841efe74c
Step 3/33 : RUN apt-get update && apt-get install -y --no-install-recommends build-essential cmake libboost-system-dev libboost-thread-dev libboost-program-options-dev libboost-test-dev libeigen3-dev zlib1g-dev libbz2-dev liblzma-dev && rm -rf /var/lib/apt/lists/*
---> Using cache
---> 0b5952cf1a93
Step 4/33 : WORKDIR /code
---> Using cache
---> a8bcefa6af84
Step 5/33 : COPY kenlm /code/kenlm
---> Using cache
---> 05422adae686
Step 6/33 : RUN cd /code/kenlm && mkdir -p build && cd build && cmake .. && make -j $(nproc) || ( echo "ERROR: Failed to build KenLM." echo "ERROR: Make sure you update the kenlm submodule on host before building this Dockerfile." echo "ERROR: $ cd STT; git submodule update --init kenlm" exit 1 )
---> Using cache
---> 42858a9440fd
Step 7/33 : FROM nvcr.io/nvidia/tensorflow:22.02-tf1-py3
---> 538f4b790e0b
Step 8/33 : ENV DEBIAN_FRONTEND=noninteractive
---> Using cache
---> d52841efe74c
Step 9/33 : RUN apt-get update && apt-get install -y --no-install-recommends git wget libopus0 libvorbisfile3 libopusfile0 libsndfile1 libboost-program-options-dev libboost-thread-dev sox libsox-fmt-mp3 python3-venv software-properties-common && rm -rf /var/lib/apt/lists/*
---> Using cache
---> 9cb43b71df7e
Step 10/33 : RUN add-apt-repository ppa:deadsnakes/ppa -y
---> Using cache
---> 7cea64628c7a
Step 11/33 : RUN apt-get -qq update && apt-get -qq install -y --no-install-recommends python3.7 python3.7-venv
---> Using cache
---> 5ff8640a1cf2
Step 12/33 : RUN python3 -m venv --system-site-packages /venv
---> Using cache
---> c30adedba2a6
Step 13/33 : ENV VIRTUAL_ENV=/venv
---> Using cache
---> 922ecd889030
Step 14/33 : RUN python3.7 -m venv /tflite-venv
---> Using cache
---> 867a9d9b03ad
Step 15/33 : ENV PATH="$VIRTUAL_ENV/bin:/tflite-venv/bin:$PATH"
---> Using cache
---> fbf9cfa07776
Step 16/33 : RUN pip install --upgrade pip wheel setuptools
---> Using cache
---> 0bb2265c15c9
Step 17/33 : WORKDIR /code
---> Using cache
---> 6c0694d06518
Step 18/33 : COPY native_client /code/native_client
---> Using cache
---> 38af2c273259
Step 19/33 : COPY .git /code/.git
---> 0ac6f98b36ae
Step 20/33 : COPY training/coqui_stt_training/VERSION /code/training/coqui_stt_training/VERSION
---> 39fb3cc5624e
Step 21/33 : COPY training/coqui_stt_training/GRAPH_VERSION /code/training/coqui_stt_training/GRAPH_VERSION
---> a8b508d1f23d
Step 22/33 : RUN cd native_client/ctcdecode && make NUM_PROCESSES=$(nproc) bindings
---> Running in e4b8a934d043
rm -rf dist temp_build coqui_stt_ctcdecoder.egg-info
rm -f swigwrapper_wrap.cpp swigwrapper.py first_party.a
mkdir -p bazel-out/ && \
../bazel_workspace_status_cmd.sh > bazel-out/stable-status.txt && \
../gen_workspace_status.sh > workspace_status.cc
++ git describe --long --tags
+ tf_git_rev=v1.4.0-alpha.1-64-g559acb70
+ echo 'STABLE_TF_GIT_VERSION v1.4.0-alpha.1-64-g559acb70'
++ dirname ../bazel_workspace_status_cmd.sh
+ pushd ..
++ git describe --long --tags
+ ds_git_rev=v1.4.0-alpha.1-64-g559acb70
+ echo 'STABLE_DS_GIT_VERSION v1.4.0-alpha.1-64-g559acb70'
++ cat ../training/coqui_stt_training/VERSION
+ ds_version=1.4.0-alpha.1
+ echo 'STABLE_DS_VERSION 1.4.0-alpha.1'
++ cat ../training/coqui_stt_training/GRAPH_VERSION
+ ds_graph_version=6
+ echo 'STABLE_DS_GRAPH_VERSION 6'
+ popd
++ grep STABLE_TF_GIT_VERSION bazel-out/stable-status.txt
++ cut '-d ' -f2
+ tf_git_version=v1.4.0-alpha.1-64-g559acb70
++ grep STABLE_DS_VERSION bazel-out/stable-status.txt
++ cut '-d ' -f2
+ ds_version=1.4.0-alpha.1
++ grep STABLE_DS_GIT_VERSION bazel-out/stable-status.txt
++ cut '-d ' -f2
+ ds_git_version=v1.4.0-alpha.1-64-g559acb70
++ grep STABLE_DS_GRAPH_VERSION bazel-out/stable-status.txt
++ cut '-d ' -f2
+ ds_graph_version=6
+ cat
mkdir -p /code/native_client/ds-swig
curl -sSL ""https://github.com/mozilla/DeepSpeech/releases/download/v0.9.3/ds-swig.linux.amd64.tar.gz"" | tar -C /code/native_client/ds-swig -zxf -
ln -s ds-swig /code/native_client/ds-swig/bin/swig
SWIG_LIB="/code/native_client/ds-swig/share/swig/4.1.0/" PATH="/code/native_client/ds-swig/bin:/venv/bin:/tflite-venv/bin:/usr/local/mpi/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/tensorrt/bin" swig -version
SWIG Version 4.1.0
Compiled with g++ [x86_64-pc-linux-gnu]
Configured options: +pcre
Please see http://www.swig.org for reporting bugs and further information
SWIG_LIB="/code/native_client/ds-swig/share/swig/4.1.0/" PATH="/code/native_client/ds-swig/bin:/venv/bin:/tflite-venv/bin:/usr/local/mpi/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/tensorrt/bin" swig -swiglib
/code/native_client/ds-swig/share/swig/4.1.0/
python -m pip install --quiet numpy wheel setuptools
DISTUTILS_USE_SDK=1 PATH=/code/native_client/ds-swig/bin::$PATH SWIG_LIB="/code/native_client/ds-swig/share/swig/4.1.0/" AS=as CC=gcc CXX=c++ LD=ld LIBEXE= CFLAGS=" " LDFLAGS="-Wl,--no-as-needed" python ./setup.py build_ext --num_processes 24
mkdir temp_build/temp_build/../kenlm/util
mkdir temp_build/temp_build/../kenlm/lm
mkdir temp_build/temp_build/../kenlm/util/double-conversion
mkdir temp_build/temp_build/third_party/openfst-1.6.7/src/lib
mkdir temp_build/temp_build/third_party/flashlight/flashlight/lib/common
mkdir temp_build/temp_build/third_party/flashlight/flashlight/lib/text/decoder
mkdir temp_build/temp_build/third_party/flashlight/flashlight/lib/text/decoder/lm
mkdir temp_build/temp_build/third_party/flashlight/flashlight/lib/text/dictionary
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/pool.cc -o temp_build/temp_build/../kenlm/util/pool.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/file_piece.cc -o temp_build/temp_build/../kenlm/util/file_piece.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/string_piece.cc -o temp_build/temp_build/../kenlm/util/string_piece.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/spaces.cc -o temp_build/temp_build/../kenlm/util/spaces.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/bit_packing.cc -o temp_build/temp_build/../kenlm/util/bit_packing.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/ersatz_progress.cc -o temp_build/temp_build/../kenlm/util/ersatz_progress.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/mmap.cc -o temp_build/temp_build/../kenlm/util/mmap.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/file.cc -o temp_build/temp_build/../kenlm/util/file.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/integer_to_string.cc -o temp_build/temp_build/../kenlm/util/integer_to_string.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/read_compressed.cc -o temp_build/temp_build/../kenlm/util/read_compressed.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/usage.cc -o temp_build/temp_build/../kenlm/util/usage.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/float_to_string.cc -o temp_build/temp_build/../kenlm/util/float_to_string.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/parallel_read.cc -o temp_build/temp_build/../kenlm/util/parallel_read.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/murmur_hash.cc -o temp_build/temp_build/../kenlm/util/murmur_hash.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/scoped.cc -o temp_build/temp_build/../kenlm/util/scoped.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/exception.cc -o temp_build/temp_build/../kenlm/util/exception.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/lm/lm_exception.cc -o temp_build/temp_build/../kenlm/lm/lm_exception.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/lm/config.cc -o temp_build/temp_build/../kenlm/lm/config.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/lm/search_trie.cc -o temp_build/temp_build/../kenlm/lm/search_trie.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/lm/trie.cc -o temp_build/temp_build/../kenlm/lm/trie.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/lm/bhiksha.cc -o temp_build/temp_build/../kenlm/lm/bhiksha.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/lm/binary_format.cc -o temp_build/temp_build/../kenlm/lm/binary_format.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/lm/trie_sort.cc -o temp_build/temp_build/../kenlm/lm/trie_sort.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/lm/read_arpa.cc -o temp_build/temp_build/../kenlm/lm/read_arpa.o
../kenlm/util/usage.cc: In function ‘double util::ThreadTime()’:
../kenlm/util/usage.cc:188:1: warning: no return statement in function returning non-void [-Wreturn-type]
188 | }
| ^
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/lm/value_build.cc -o temp_build/temp_build/../kenlm/lm/value_build.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/lm/vocab.cc -o temp_build/temp_build/../kenlm/lm/vocab.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/lm/quantize.cc -o temp_build/temp_build/../kenlm/lm/quantize.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/lm/virtual_interface.cc -o temp_build/temp_build/../kenlm/lm/virtual_interface.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/lm/model.cc -o temp_build/temp_build/../kenlm/lm/model.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/lm/sizes.cc -o temp_build/temp_build/../kenlm/lm/sizes.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/lm/search_hashed.cc -o temp_build/temp_build/../kenlm/lm/search_hashed.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/double-conversion/bignum.cc -o temp_build/temp_build/../kenlm/util/double-conversion/bignum.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/double-conversion/cached-powers.cc -o temp_build/temp_build/../kenlm/util/double-conversion/cached-powers.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/double-conversion/fixed-dtoa.cc -o temp_build/temp_build/../kenlm/util/double-conversion/fixed-dtoa.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/double-conversion/string-to-double.cc -o temp_build/temp_build/../kenlm/util/double-conversion/string-to-double.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/double-conversion/strtod.cc -o temp_build/temp_build/../kenlm/util/double-conversion/strtod.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/double-conversion/bignum-dtoa.cc -o temp_build/temp_build/../kenlm/util/double-conversion/bignum-dtoa.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/double-conversion/double-to-string.cc -o temp_build/temp_build/../kenlm/util/double-conversion/double-to-string.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../kenlm/util/double-conversion/fast-dtoa.cc -o temp_build/temp_build/../kenlm/util/double-conversion/fast-dtoa.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/openfst-1.6.7/src/lib/flags.cc -o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/flags.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/openfst-1.6.7/src/lib/fst.cc -o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/fst.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/openfst-1.6.7/src/lib/compat.cc -o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/compat.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/openfst-1.6.7/src/lib/fst-types.cc -o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/fst-types.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/openfst-1.6.7/src/lib/properties.cc -o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/properties.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/openfst-1.6.7/src/lib/symbol-table-ops.cc -o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/symbol-table-ops.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/openfst-1.6.7/src/lib/util.cc -o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/util.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/openfst-1.6.7/src/lib/mapped-file.cc -o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/mapped-file.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/openfst-1.6.7/src/lib/weight.cc -o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/weight.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/openfst-1.6.7/src/lib/symbol-table.cc -o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/symbol-table.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/flashlight/flashlight/lib/common/String.cpp -o temp_build/temp_build/third_party/flashlight/flashlight/lib/common/String.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/flashlight/flashlight/lib/common/System.cpp -o temp_build/temp_build/third_party/flashlight/flashlight/lib/common/System.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/flashlight/flashlight/lib/text/decoder/LexiconDecoder.cpp -o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/decoder/LexiconDecoder.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/flashlight/flashlight/lib/text/decoder/LexiconFreeDecoder.cpp -o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/decoder/LexiconFreeDecoder.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/flashlight/flashlight/lib/text/decoder/lm/ConvLM.cpp -o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/decoder/lm/ConvLM.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/flashlight/flashlight/lib/text/decoder/lm/KenLM.cpp -o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/decoder/lm/KenLM.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/flashlight/flashlight/lib/text/decoder/lm/ZeroLM.cpp -o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/decoder/lm/ZeroLM.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/flashlight/flashlight/lib/text/decoder/Trie.cpp -o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/decoder/Trie.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/flashlight/flashlight/lib/text/decoder/Utils.cpp -o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/decoder/Utils.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/flashlight/flashlight/lib/text/dictionary/Dictionary.cpp -o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/dictionary/Dictionary.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight third_party/flashlight/flashlight/lib/text/dictionary/Utils.cpp -o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/dictionary/Utils.o
scorer.cpp:32:30: warning: multi-character character constant [-Wmultichar]
32 | static const int32_t MAGIC = 'TRIE';
| ^~~~~~
ar rcs third_party.a temp_build/temp_build/../kenlm/util/spaces.o temp_build/temp_build/../kenlm/util/murmur_hash.o temp_build/temp_build/../kenlm/util/float_to_string.o temp_build/temp_build/../kenlm/util/ersatz_progress.o temp_build/temp_build/../kenlm/util/parallel_read.o temp_build/temp_build/../kenlm/util/pool.o temp_build/temp_build/../kenlm/util/bit_packing.o temp_build/temp_build/../kenlm/util/integer_to_string.o temp_build/temp_build/../kenlm/util/exception.o temp_build/temp_build/../kenlm/lm/lm_exception.o temp_build/temp_build/../kenlm/util/string_piece.o temp_build/temp_build/../kenlm/util/scoped.o temp_build/temp_build/../kenlm/lm/config.o temp_build/temp_build/../kenlm/util/double-conversion/cached-powers.o temp_build/temp_build/../kenlm/util/read_compressed.o temp_build/temp_build/../kenlm/lm/bhiksha.o temp_build/temp_build/../kenlm/lm/trie.o temp_build/temp_build/../kenlm/util/mmap.o temp_build/temp_build/../kenlm/util/double-conversion/fixed-dtoa.o temp_build/temp_build/../kenlm/lm/quantize.o temp_build/temp_build/../kenlm/lm/virtual_interface.o temp_build/temp_build/../kenlm/util/double-conversion/bignum-dtoa.o temp_build/temp_build/../kenlm/util/double-conversion/fast-dtoa.o temp_build/temp_build/../kenlm/util/double-conversion/strtod.o temp_build/temp_build/../kenlm/util/file_piece.o temp_build/temp_build/../kenlm/util/double-conversion/double-to-string.o temp_build/temp_build/../kenlm/lm/binary_format.o temp_build/temp_build/../kenlm/util/double-conversion/bignum.o temp_build/temp_build/../kenlm/lm/read_arpa.o temp_build/temp_build/../kenlm/util/usage.o temp_build/temp_build/../kenlm/util/file.o temp_build/temp_build/../kenlm/lm/value_build.o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/compat.o temp_build/temp_build/../kenlm/lm/sizes.o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/decoder/Utils.o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/properties.o temp_build/temp_build/third_party/flashlight/flashlight/lib/common/String.o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/mapped-file.o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/util.o temp_build/temp_build/../kenlm/lm/vocab.o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/decoder/lm/ZeroLM.o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/weight.o temp_build/temp_build/../kenlm/util/double-conversion/string-to-double.o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/decoder/Trie.o temp_build/temp_build/third_party/flashlight/flashlight/lib/common/System.o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/dictionary/Dictionary.o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/decoder/lm/KenLM.o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/flags.o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/decoder/lm/ConvLM.o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/fst.o temp_build/temp_build/../kenlm/lm/search_hashed.o temp_build/temp_build/../kenlm/lm/trie_sort.o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/decoder/LexiconDecoder.o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/symbol-table-ops.o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/decoder/LexiconFreeDecoder.o temp_build/temp_build/third_party/flashlight/flashlight/lib/text/dictionary/Utils.o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/symbol-table.o temp_build/temp_build/../kenlm/lm/model.o temp_build/temp_build/../kenlm/lm/search_trie.o temp_build/temp_build/third_party/openfst-1.6.7/src/lib/fst-types.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight scorer.cpp -o temp_build/temp_build/scorer.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ctc_beam_search_decoder.cpp -o temp_build/temp_build/ctc_beam_search_decoder.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight decoder_utils.cpp -o temp_build/temp_build/decoder_utils.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight path_trie.cpp -o temp_build/temp_build/path_trie.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight workspace_status.cc -o temp_build/temp_build/workspace_status.o
c++ -c -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight ../alphabet.cc -o temp_build/temp_build/../alphabet.o
ar rcs first_party.a temp_build/temp_build/workspace_status.o temp_build/temp_build/../alphabet.o temp_build/temp_build/path_trie.o temp_build/temp_build/decoder_utils.o temp_build/temp_build/ctc_beam_search_decoder.o temp_build/temp_build/scorer.o
running build_ext
building 'coqui_stt_ctcdecoder._swigwrapper' extension
swigging swigwrapper.i to swigwrapper_wrap.cpp
swig -python -c++ -extranative -o swigwrapper_wrap.cpp swigwrapper.i
../alphabet.h:20: Warning 362: operator= ignored
path_trie.h:83: Warning 314: 'print' is a python keyword, renaming to '_print'
path_trie.h:121: Warning 302: Identifier 'add_child' redefined (ignored),
path_trie.h:31: Warning 302: previous definition of 'add_child'.
path_trie.h:136: Warning 302: Identifier 'get_history' redefined (ignored),
path_trie.h:37: Warning 302: previous definition of 'get_history'.
scorer.h:28: Warning 401: Nothing known about base class 'fl::lib::text::LM'. Ignored.
gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -I.. -I../kenlm -Ithird_party/openfst-1.6.7/src/include -Ithird_party/ThreadPool -Ithird_party/object_pool -Ithird_party/flashlight -I/usr/local/lib/python3.8/dist-packages/numpy/core/include -I/venv/include -I/usr/include/python3.8 -c swigwrapper_wrap.cpp -o temp_build/temp_build/swigwrapper_wrap.o -fPIC -DKENLM_MAX_ORDER=6 -std=c++14 -Wno-unused-local-typedefs -Wno-sign-compare -O3 -DNDEBUG
creating temp_build/temp_build/coqui_stt_ctcdecoder
c++ -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,--no-as-needed temp_build/temp_build/swigwrapper_wrap.o -L/usr/lib -o temp_build/temp_build/coqui_stt_ctcdecoder/_swigwrapper.cpython-38-x86_64-linux-gnu.so first_party.a third_party.a
/venv/lib/python3.8/site-packages/setuptools/dist.py:771: UserWarning: Usage of dash-separated 'build-lib' will not be supported in future versions. Please use the underscore name 'build_lib' instead
warnings.warn(
/venv/lib/python3.8/site-packages/setuptools/dist.py:771: UserWarning: Usage of dash-separated 'build-temp' will not be supported in future versions. Please use the underscore name 'build_temp' instead
warnings.warn(
/venv/lib/python3.8/site-packages/setuptools/dist.py:771: UserWarning: Usage of dash-separated 'build-dir' will not be supported in future versions. Please use the underscore name 'build_dir' instead
warnings.warn(
/venv/lib/python3.8/site-packages/setuptools/dist.py:530: UserWarning: Normalizing '1.4.0-alpha.1' to '1.4.0a1'
warnings.warn(tmpl.format(**locals()))
find temp_build -type f -name "*.o" -delete
DISTUTILS_USE_SDK=1 AS=as CC=gcc CXX=c++ LD=ld LIBEXE= CFLAGS=" " LDFLAGS="-Wl,--no-as-needed" python ./setup.py bdist_wheel
running bdist_wheel
running build
running build_ext
running build_py
/venv/lib/python3.8/site-packages/setuptools/dist.py:771: UserWarning: Usage of dash-separated 'build-lib' will not be supported in future versions. Please use the underscore name 'build_lib' instead
warnings.warn(
/venv/lib/python3.8/site-packages/setuptools/dist.py:771: UserWarning: Usage of dash-separated 'build-temp' will not be supported in future versions. Please use the underscore name 'build_temp' instead
warnings.warn(
/venv/lib/python3.8/site-packages/setuptools/dist.py:771: UserWarning: Usage of dash-separated 'build-dir' will not be supported in future versions. Please use the underscore name 'build_dir' instead
warnings.warn(
/venv/lib/python3.8/site-packages/setuptools/dist.py:530: UserWarning: Normalizing '1.4.0-alpha.1' to '1.4.0a1'
warnings.warn(tmpl.format(**locals()))
file coqui_stt_ctcdecoder.py (for module coqui_stt_ctcdecoder) not found
copying ./__init__.py -> temp_build/temp_build/coqui_stt_ctcdecoder
copying ./swigwrapper.py -> temp_build/temp_build/coqui_stt_ctcdecoder
file coqui_stt_ctcdecoder.py (for module coqui_stt_ctcdecoder) not found
installing to temp_build/temp_build
running install
running install_lib
running install_egg_info
running egg_info
creating coqui_stt_ctcdecoder.egg-info
writing coqui_stt_ctcdecoder.egg-info/PKG-INFO
writing dependency_links to coqui_stt_ctcdecoder.egg-info/dependency_links.txt
writing requirements to coqui_stt_ctcdecoder.egg-info/requires.txt
writing top-level names to coqui_stt_ctcdecoder.egg-info/top_level.txt
writing manifest file 'coqui_stt_ctcdecoder.egg-info/SOURCES.txt'
/venv/lib/python3.8/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
file coqui_stt_ctcdecoder.py (for module coqui_stt_ctcdecoder) not found
adding license file 'LICENSE.paddlepaddle'
adding license file 'LICENSE.parlance'
adding license file 'COPYING'
writing manifest file 'coqui_stt_ctcdecoder.egg-info/SOURCES.txt'
Copying coqui_stt_ctcdecoder.egg-info to temp_build/temp_build/coqui_stt_ctcdecoder-1.4.0a1-py3.8.egg-info
running install_scripts
adding license file "LICENSE.parlance" (matched pattern "LICEN[CS]E*")
adding license file "LICENSE.paddlepaddle" (matched pattern "LICEN[CS]E*")
adding license file "COPYING" (matched pattern "COPYING*")
creating temp_build/temp_build/coqui_stt_ctcdecoder-1.4.0a1.dist-info/WHEEL
creating 'dist/coqui_stt_ctcdecoder-1.4.0a1-cp38-cp38-linux_x86_64.whl' and adding 'temp_build/temp_build' to it
adding 'coqui_stt_ctcdecoder/__init__.py'
adding 'coqui_stt_ctcdecoder/_swigwrapper.cpython-38-x86_64-linux-gnu.so'
adding 'coqui_stt_ctcdecoder/swigwrapper.py'
adding 'coqui_stt_ctcdecoder-1.4.0a1.dist-info/COPYING'
adding 'coqui_stt_ctcdecoder-1.4.0a1.dist-info/LICENSE.paddlepaddle'
adding 'coqui_stt_ctcdecoder-1.4.0a1.dist-info/LICENSE.parlance'
adding 'coqui_stt_ctcdecoder-1.4.0a1.dist-info/METADATA'
adding 'coqui_stt_ctcdecoder-1.4.0a1.dist-info/WHEEL'
adding 'coqui_stt_ctcdecoder-1.4.0a1.dist-info/top_level.txt'
adding 'coqui_stt_ctcdecoder-1.4.0a1.dist-info/RECORD'
removing temp_build/temp_build
rm -rf temp_build
Removing intermediate container e4b8a934d043
---> 85b74563e0ba
Step 23/33 : RUN pip install --upgrade native_client/ctcdecode/dist/*.whl
---> Running in bd2418f4247e
Processing ./native_client/ctcdecode/dist/coqui_stt_ctcdecoder-1.4.0a1-cp38-cp38-linux_x86_64.whl
Requirement already satisfied: numpy in /usr/local/lib/python3.8/dist-packages (from coqui-stt-ctcdecoder==1.4.0a1) (1.18.5)
Installing collected packages: coqui-stt-ctcdecoder
Successfully installed coqui-stt-ctcdecoder-1.4.0a1
Removing intermediate container bd2418f4247e
---> 15d6f0cbeb8a
Step 24/33 : COPY setup.py /code/setup.py
---> d83256c1ee4f
Step 25/33 : COPY VERSION /code/VERSION
---> 10ce9cdbe60a
Step 26/33 : COPY training /code/training
---> 0b410932a135
Step 27/33 : RUN mkdir -p /code/kenlm/build/
---> Running in 2060920dfe14
Removing intermediate container 2060920dfe14
---> deebd3e335cd
Step 28/33 : COPY --from=kenlm-build /code/kenlm/build/bin /code/kenlm/build/bin
---> 60bc11618034
Step 29/33 : RUN LATEST_STABLE_RELEASE=$(curl "https://api.github.com/repos/coqui-ai/STT/releases/latest" | python -c 'import sys; import json; print(json.load(sys.stdin)["tag_name"])') bash -c 'curl -L https://github.com/coqui-ai/STT/releases/download/${LATEST_STABLE_RELEASE}/native_client.tflite.Linux.tar.xz | tar -xJvf -'
---> Running in c8dfc8bd8b38
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 88956 0 88956 0 0 207k 0 --:--:-- --:--:-- --:--:-- 207k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
libstt.so
6 3143k 6 191k 0 0 372k 0 0:00:08 --:--:-- 0:00:08 372klibkenlm.so
libsox.so.3
generate_scorer_package
100 3143k 100 3143k 0 0 2502k 0 0:00:01 0:00:01 --:--:-- 3983k
LICENSE
stt
coqui-stt.h
KenLM_License_Info.txt
Removing intermediate container c8dfc8bd8b38
---> 06234d6afb1d
Step 30/33 : RUN DS_NODECODER=y DS_NOTENSORFLOW=y pip install --upgrade -e .
---> Running in e82dbcd71530
Obtaining file:///code
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting attrdict
Downloading attrdict-2.0.1-py2.py3-none-any.whl (9.9 kB)
Collecting bs4
Downloading bs4-0.0.1.tar.gz (1.1 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting coqpit
Downloading coqpit-0.0.16-py3-none-any.whl (13 kB)
Requirement already satisfied: numpy in /usr/local/lib/python3.8/dist-packages (from coqui-stt-training==1.4.0a1) (1.18.5)
Collecting optuna
Downloading optuna-2.10.1-py3-none-any.whl (308 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 308.2/308.2 kB 3.4 MB/s eta 0:00:00
Requirement already satisfied: numba<=0.53.1 in /usr/local/lib/python3.8/dist-packages (from coqui-stt-training==1.4.0a1) (0.53.1)
Collecting opuslib==2.0.0
Downloading opuslib-2.0.0.tar.gz (7.3 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: pandas in /usr/local/lib/python3.8/dist-packages (from coqui-stt-training==1.4.0a1) (1.2.5)
Collecting progressbar2
Downloading progressbar2-4.0.0-py2.py3-none-any.whl (26 kB)
Requirement already satisfied: protobuf<=3.20.1 in /usr/local/lib/python3.8/dist-packages (from coqui-stt-training==1.4.0a1) (3.19.4)
Collecting pyogg>=0.6.14a1
Downloading PyOgg-0.6.14a1.tar.gz (35 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting resampy>=0.2.2
Downloading resampy-0.3.0-py3-none-any.whl (3.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.1/3.1 MB 4.5 MB/s eta 0:00:00
Requirement already satisfied: requests in /usr/local/lib/python3.8/dist-packages (from coqui-stt-training==1.4.0a1) (2.27.1)
Collecting semver
Downloading semver-2.13.0-py2.py3-none-any.whl (12 kB)
Requirement already satisfied: six in /usr/local/lib/python3.8/dist-packages (from coqui-stt-training==1.4.0a1) (1.16.0)
Collecting sox
Downloading sox-1.4.1-py2.py3-none-any.whl (39 kB)
Collecting soundfile
Downloading SoundFile-0.10.3.post1-py2.py3-none-any.whl (21 kB)
Requirement already satisfied: tqdm in /usr/local/lib/python3.8/dist-packages (from coqui-stt-training==1.4.0a1) (4.62.3)
Collecting webdataset==0.1.103
Downloading webdataset-0.1.103-py3-none-any.whl (47 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47.7/47.7 kB 2.4 MB/s eta 0:00:00
Collecting miniaudio
Downloading miniaudio-1.51-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 588.7/588.7 kB 4.8 MB/s eta 0:00:00
Collecting clearml
Downloading clearml-1.6.2-py2.py3-none-any.whl (812 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 812.5/812.5 kB 4.9 MB/s eta 0:00:00
Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/dist-packages (from webdataset==0.1.103->coqui-stt-training==1.4.0a1) (6.0)
Collecting braceexpand
Downloading braceexpand-0.1.7-py2.py3-none-any.whl (5.9 kB)
Requirement already satisfied: setuptools in /venv/lib/python3.8/site-packages (from numba<=0.53.1->coqui-stt-training==1.4.0a1) (63.1.0)
Requirement already satisfied: llvmlite<0.37,>=0.36.0rc1 in /usr/local/lib/python3.8/dist-packages (from numba<=0.53.1->coqui-stt-training==1.4.0a1) (0.36.0)
Collecting beautifulsoup4
Downloading beautifulsoup4-4.11.1-py3-none-any.whl (128 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 128.2/128.2 kB 4.9 MB/s eta 0:00:00
Collecting furl>=2.0.0
Downloading furl-2.1.3-py2.py3-none-any.whl (20 kB)
Requirement already satisfied: jsonschema>=2.6.0 in /usr/local/lib/python3.8/dist-packages (from clearml->coqui-stt-training==1.4.0a1) (4.4.0)
Collecting pathlib2>=2.3.0
Downloading pathlib2-2.3.7.post1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: attrs>=18.0 in /usr/local/lib/python3.8/dist-packages (from clearml->coqui-stt-training==1.4.0a1) (21.4.0)
Requirement already satisfied: future>=0.16.0 in /usr/local/lib/python3.8/dist-packages (from clearml->coqui-stt-training==1.4.0a1) (0.18.2)
Requirement already satisfied: python-dateutil>=2.6.1 in /usr/local/lib/python3.8/dist-packages (from clearml->coqui-stt-training==1.4.0a1) (2.8.2)
Requirement already satisfied: Pillow>=4.1.1 in /usr/local/lib/python3.8/dist-packages (from clearml->coqui-stt-training==1.4.0a1) (9.0.1)
Requirement already satisfied: pyparsing>=2.0.3 in /usr/local/lib/python3.8/dist-packages (from clearml->coqui-stt-training==1.4.0a1) (3.0.7)
Requirement already satisfied: psutil>=3.4.2 in /usr/local/lib/python3.8/dist-packages (from clearml->coqui-stt-training==1.4.0a1) (5.7.0)
Requirement already satisfied: urllib3>=1.21.1 in /usr/local/lib/python3.8/dist-packages (from clearml->coqui-stt-training==1.4.0a1) (1.26.8)
Collecting pyjwt<2.5.0,>=2.4.0
Downloading PyJWT-2.4.0-py3-none-any.whl (18 kB)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.8/dist-packages (from requests->coqui-stt-training==1.4.0a1) (2021.10.8)
Requirement already satisfied: charset-normalizer~=2.0.0 in /usr/local/lib/python3.8/dist-packages (from requests->coqui-stt-training==1.4.0a1) (2.0.11)
Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.8/dist-packages (from requests->coqui-stt-training==1.4.0a1) (3.3)
Requirement already satisfied: cffi>=1.12.0 in /usr/local/lib/python3.8/dist-packages (from miniaudio->coqui-stt-training==1.4.0a1) (1.15.0)
Collecting alembic
Downloading alembic-1.8.0-py3-none-any.whl (209 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 209.3/209.3 kB 5.0 MB/s eta 0:00:00
Requirement already satisfied: scipy!=1.4.0 in /usr/local/lib/python3.8/dist-packages (from optuna->coqui-stt-training==1.4.0a1) (1.4.1)
Collecting sqlalchemy>=1.1.0
Downloading SQLAlchemy-1.4.39-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 4.7 MB/s eta 0:00:00
Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.8/dist-packages (from optuna->coqui-stt-training==1.4.0a1) (21.3)
Collecting cliff
Downloading cliff-3.10.1-py3-none-any.whl (81 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 81.0/81.0 kB 3.5 MB/s eta 0:00:00
Collecting cmaes>=0.8.2
Downloading cmaes-0.8.2-py3-none-any.whl (15 kB)
Collecting colorlog
Downloading colorlog-6.6.0-py2.py3-none-any.whl (11 kB)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas->coqui-stt-training==1.4.0a1) (2021.3)
Collecting python-utils>=3.0.0
Downloading python_utils-3.3.3-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: pycparser in /usr/local/lib/python3.8/dist-packages (from cffi>=1.12.0->miniaudio->coqui-stt-training==1.4.0a1) (2.21)
Collecting orderedmultidict>=1.0.1
Downloading orderedmultidict-1.0.1-py2.py3-none-any.whl (11 kB)
Requirement already satisfied: importlib-resources>=1.4.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6.0->clearml->coqui-stt-training==1.4.0a1) (5.4.0)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6.0->clearml->coqui-stt-training==1.4.0a1) (0.18.1)
Collecting greenlet!=0.4.17
Downloading greenlet-1.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (156 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 156.6/156.6 kB 5.7 MB/s eta 0:00:00
Requirement already satisfied: importlib-metadata in /usr/local/lib/python3.8/dist-packages (from alembic->optuna->coqui-stt-training==1.4.0a1) (4.10.1)
Collecting Mako
Downloading Mako-1.2.1-py3-none-any.whl (78 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.6/78.6 kB 3.6 MB/s eta 0:00:00
Collecting soupsieve>1.2
Downloading soupsieve-2.3.2.post1-py3-none-any.whl (37 kB)
Collecting pbr!=2.1.0,>=2.0.0
Downloading pbr-5.9.0-py2.py3-none-any.whl (112 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 112.3/112.3 kB 3.4 MB/s eta 0:00:00
Collecting PrettyTable>=0.7.2
Downloading prettytable-3.3.0-py3-none-any.whl (26 kB)
Collecting autopage>=0.4.0
Downloading autopage-0.5.1-py3-none-any.whl (29 kB)
Collecting cmd2>=1.0.0
Downloading cmd2-2.4.1-py3-none-any.whl (146 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 147.0/147.0 kB 4.3 MB/s eta 0:00:00
Collecting stevedore>=2.0.1
Downloading stevedore-3.5.0-py3-none-any.whl (49 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.7/49.7 kB 4.0 MB/s eta 0:00:00
Requirement already satisfied: wcwidth>=0.1.7 in /usr/local/lib/python3.8/dist-packages (from cmd2>=1.0.0->cliff->optuna->coqui-stt-training==1.4.0a1) (0.2.5)
Collecting pyperclip>=1.6
Downloading pyperclip-1.8.2.tar.gz (20 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: zipp>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from importlib-resources>=1.4.0->jsonschema>=2.6.0->clearml->coqui-stt-training==1.4.0a1) (3.7.0)
Requirement already satisfied: MarkupSafe>=0.9.2 in /usr/local/lib/python3.8/dist-packages (from Mako->alembic->optuna->coqui-stt-training==1.4.0a1) (2.0.1)
Building wheels for collected packages: opuslib, pyogg, bs4, pyperclip
Building wheel for opuslib (setup.py): started
Building wheel for opuslib (setup.py): finished with status 'done'
Created wheel for opuslib: filename=opuslib-2.0.0-py3-none-any.whl size=10988 sha256=a7699d9a7de6e0fb9b949fa20157b779ea6b9873e5e5e99815be4709af5d1944
Stored in directory: /root/.cache/pip/wheels/68/73/fa/6552d77d022e1d53fcc2726b15cd94a8849a4e17934fe46369
Building wheel for pyogg (setup.py): started
Building wheel for pyogg (setup.py): finished with status 'done'
Created wheel for pyogg: filename=PyOgg-0.6.14a1-py2.py3-none-any.whl size=35311 sha256=04bb3b9cbd2e8ebaaab25d5f994f3bb7206f45940d0e2716d837a3a93381d633
Stored in directory: /root/.cache/pip/wheels/59/07/2f/c6719b834e6bda7fe3630e3bbf3d57991db1e9df1af8676a9a
Building wheel for bs4 (setup.py): started
Building wheel for bs4 (setup.py): finished with status 'done'
Created wheel for bs4: filename=bs4-0.0.1-py3-none-any.whl size=1257 sha256=94464cb5b942d5627e46083cc5b9a5ada453bc676c52ad68615e49eddd31698a
Stored in directory: /root/.cache/pip/wheels/75/78/21/68b124549c9bdc94f822c02fb9aa3578a669843f9767776bca
Building wheel for pyperclip (setup.py): started
Building wheel for pyperclip (setup.py): finished with status 'done'
Created wheel for pyperclip: filename=pyperclip-1.8.2-py3-none-any.whl size=11123 sha256=c63b8077f3282c3d3232037ea79c0be9ef550bf3d96608b2da2f715c420767ec
Stored in directory: /root/.cache/pip/wheels/7f/1a/65/84ff8c386bec21fca6d220ea1f5498a0367883a78dd5ba6122
Successfully built opuslib pyogg bs4 pyperclip
Installing collected packages: pyperclip, pyogg, opuslib, braceexpand, webdataset, sox, soupsieve, semver, python-utils, pyjwt, PrettyTable, pbr, pathlib2, orderedmultidict, Mako, greenlet, coqpit, colorlog, cmd2, cmaes, autopage, attrdict, stevedore, sqlalchemy, soundfile, resampy, progressbar2, miniaudio, furl, beautifulsoup4, cliff, clearml, bs4, alembic, optuna, coqui-stt-training
Running setup.py develop for coqui-stt-training
Successfully installed Mako-1.2.1 PrettyTable-3.3.0 alembic-1.8.0 attrdict-2.0.1 autopage-0.5.1 beautifulsoup4-4.11.1 braceexpand-0.1.7 bs4-0.0.1 clearml-1.6.2 cliff-3.10.1 cmaes-0.8.2 cmd2-2.4.1 colorlog-6.6.0 coqpit-0.0.16 coqui-stt-training furl-2.1.3 greenlet-1.1.2 miniaudio-1.51 optuna-2.10.1 opuslib-2.0.0 orderedmultidict-1.0.1 pathlib2-2.3.7.post1 pbr-5.9.0 progressbar2-4.0.0 pyjwt-2.4.0 pyogg-0.6.14a1 pyperclip-1.8.2 python-utils-3.3.3 resampy-0.3.0 semver-2.13.0 soundfile-0.10.3.post1 soupsieve-2.3.2.post1 sox-1.4.1 sqlalchemy-1.4.39 stevedore-3.5.0 webdataset-0.1.103
Removing intermediate container e82dbcd71530
---> 86bc72550552
Step 31/33 : RUN /tflite-venv/bin/pip install -e .
---> Running in 7003aba367ed
Obtaining file:///code
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting attrdict
Using cached attrdict-2.0.1-py2.py3-none-any.whl (9.9 kB)
Collecting bs4
Using cached bs4-0.0.1.tar.gz (1.1 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting coqpit
Using cached coqpit-0.0.16-py3-none-any.whl (13 kB)
Collecting numpy
Downloading numpy-1.21.6-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (15.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15.7/15.7 MB 4.7 MB/s eta 0:00:00
Collecting optuna
Using cached optuna-2.10.1-py3-none-any.whl (308 kB)
Collecting numba<=0.53.1
Downloading numba-0.53.1-cp37-cp37m-manylinux2014_x86_64.whl (3.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.4/3.4 MB 5.0 MB/s eta 0:00:00
Collecting opuslib==2.0.0
Using cached opuslib-2.0.0.tar.gz (7.3 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting pandas
Downloading pandas-1.3.5-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.3/11.3 MB 4.8 MB/s eta 0:00:00
Collecting progressbar2
Using cached progressbar2-4.0.0-py2.py3-none-any.whl (26 kB)
Collecting protobuf<=3.20.1
Downloading protobuf-3.20.1-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.0/1.0 MB 4.8 MB/s eta 0:00:00
Collecting pyogg>=0.6.14a1
Using cached PyOgg-0.6.14a1.tar.gz (35 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting resampy>=0.2.2
Using cached resampy-0.3.0-py3-none-any.whl (3.1 MB)
Collecting requests
Downloading requests-2.28.1-py3-none-any.whl (62 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.8/62.8 KB 4.3 MB/s eta 0:00:00
Collecting semver
Using cached semver-2.13.0-py2.py3-none-any.whl (12 kB)
Collecting six
Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting sox
Using cached sox-1.4.1-py2.py3-none-any.whl (39 kB)
Collecting soundfile
Using cached SoundFile-0.10.3.post1-py2.py3-none-any.whl (21 kB)
Collecting tqdm
Downloading tqdm-4.64.0-py2.py3-none-any.whl (78 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.4/78.4 KB 3.1 MB/s eta 0:00:00
Collecting webdataset==0.1.103
Using cached webdataset-0.1.103-py3-none-any.whl (47 kB)
Collecting miniaudio
Downloading miniaudio-1.51-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 588.5/588.5 KB 5.1 MB/s eta 0:00:00
Collecting clearml
Using cached clearml-1.6.2-py2.py3-none-any.whl (812 kB)
Collecting coqui_stt_ctcdecoder==1.4.0-alpha.1
Downloading coqui_stt_ctcdecoder-1.4.0a1-cp37-cp37m-manylinux_2_24_x86_64.whl (2.9 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.9/2.9 MB 4.4 MB/s eta 0:00:00
Collecting tensorflow==1.15.4
Downloading tensorflow-1.15.4-cp37-cp37m-manylinux2010_x86_64.whl (110.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 110.5/110.5 MB 4.4 MB/s eta 0:00:00
Collecting numpy
Downloading numpy-1.18.5-cp37-cp37m-manylinux1_x86_64.whl (20.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20.1/20.1 MB 4.6 MB/s eta 0:00:00
Collecting absl-py>=0.7.0
Downloading absl_py-1.1.0-py3-none-any.whl (123 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 123.7/123.7 KB 4.0 MB/s eta 0:00:00
Collecting wrapt>=1.11.1
Downloading wrapt-1.14.1-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (75 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 75.2/75.2 KB 4.0 MB/s eta 0:00:00
Collecting gast==0.2.2
Downloading gast-0.2.2.tar.gz (10 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting google-pasta>=0.1.6
Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.5/57.5 KB 3.9 MB/s eta 0:00:00
Collecting wheel>=0.26
Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB)
Collecting astor>=0.6.0
Downloading astor-0.8.1-py2.py3-none-any.whl (27 kB)
Collecting keras-preprocessing>=1.0.5
Downloading Keras_Preprocessing-1.1.2-py2.py3-none-any.whl (42 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42.6/42.6 KB 4.2 MB/s eta 0:00:00
Collecting keras-applications>=1.0.8
Downloading Keras_Applications-1.0.8-py3-none-any.whl (50 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.7/50.7 KB 2.7 MB/s eta 0:00:00
Collecting tensorflow-estimator==1.15.1
Downloading tensorflow_estimator-1.15.1-py2.py3-none-any.whl (503 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 503.4/503.4 KB 4.6 MB/s eta 0:00:00
Collecting opt-einsum>=2.3.2
Downloading opt_einsum-3.3.0-py3-none-any.whl (65 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65.5/65.5 KB 3.6 MB/s eta 0:00:00
Collecting grpcio>=1.8.6
Downloading grpcio-1.47.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.5/4.5 MB 4.6 MB/s eta 0:00:00
Collecting tensorboard<1.16.0,>=1.15.0
Downloading tensorboard-1.15.0-py3-none-any.whl (3.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.8/3.8 MB 5.0 MB/s eta 0:00:00
Collecting termcolor>=1.1.0
Downloading termcolor-1.1.0.tar.gz (3.9 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting pyyaml
Downloading PyYAML-6.0-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (596 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 596.3/596.3 KB 4.9 MB/s eta 0:00:00
Collecting braceexpand
Using cached braceexpand-0.1.7-py2.py3-none-any.whl (5.9 kB)
Requirement already satisfied: setuptools in /tflite-venv/lib/python3.7/site-packages (from numba<=0.53.1->coqui-stt-training==1.4.0a1) (47.1.0)
Collecting llvmlite<0.37,>=0.36.0rc1
Downloading llvmlite-0.36.0-cp37-cp37m-manylinux2010_x86_64.whl (25.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 25.3/25.3 MB 4.6 MB/s eta 0:00:00
Collecting beautifulsoup4
Using cached beautifulsoup4-4.11.1-py3-none-any.whl (128 kB)
Collecting pathlib2>=2.3.0
Using cached pathlib2-2.3.7.post1-py2.py3-none-any.whl (18 kB)
Collecting psutil>=3.4.2
Downloading psutil-5.9.1-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (281 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 281.4/281.4 KB 4.6 MB/s eta 0:00:00
Collecting pyjwt<2.5.0,>=2.4.0
Using cached PyJWT-2.4.0-py3-none-any.whl (18 kB)
Collecting future>=0.16.0
Downloading future-0.18.2.tar.gz (829 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 829.2/829.2 KB 4.9 MB/s eta 0:00:00
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting pyparsing>=2.0.3
Downloading pyparsing-3.0.9-py3-none-any.whl (98 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 98.3/98.3 KB 4.3 MB/s eta 0:00:00
Collecting attrs>=18.0
Downloading attrs-21.4.0-py2.py3-none-any.whl (60 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.6/60.6 KB 3.3 MB/s eta 0:00:00
Collecting furl>=2.0.0
Using cached furl-2.1.3-py2.py3-none-any.whl (20 kB)
Collecting jsonschema>=2.6.0
Downloading jsonschema-4.6.1-py3-none-any.whl (80 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80.8/80.8 KB 4.2 MB/s eta 0:00:00
Collecting python-dateutil>=2.6.1
Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 KB 4.8 MB/s eta 0:00:00
Collecting Pillow>=4.1.1
Downloading Pillow-9.2.0-cp37-cp37m-manylinux_2_28_x86_64.whl (3.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.2/3.2 MB 4.8 MB/s eta 0:00:00
Collecting urllib3>=1.21.1
Downloading urllib3-1.26.9-py2.py3-none-any.whl (138 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 139.0/139.0 KB 4.3 MB/s eta 0:00:00
Collecting idna<4,>=2.5
Downloading idna-3.3-py3-none-any.whl (61 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.2/61.2 KB 3.4 MB/s eta 0:00:00
Collecting certifi>=2017.4.17
Downloading certifi-2022.6.15-py3-none-any.whl (160 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 160.2/160.2 KB 4.7 MB/s eta 0:00:00
Collecting charset-normalizer<3,>=2
Downloading charset_normalizer-2.1.0-py3-none-any.whl (39 kB)
Collecting cffi>=1.12.0
Downloading cffi-1.15.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (427 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 427.9/427.9 KB 4.6 MB/s eta 0:00:00
Collecting scipy!=1.4.0
Downloading scipy-1.7.3-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (38.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38.1/38.1 MB 4.5 MB/s eta 0:00:00
Collecting alembic
Using cached alembic-1.8.0-py3-none-any.whl (209 kB)
Collecting cmaes>=0.8.2
Using cached cmaes-0.8.2-py3-none-any.whl (15 kB)
Collecting cliff
Using cached cliff-3.10.1-py3-none-any.whl (81 kB)
Collecting colorlog
Using cached colorlog-6.6.0-py2.py3-none-any.whl (11 kB)
Collecting sqlalchemy>=1.1.0
Downloading SQLAlchemy-1.4.39-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 4.7 MB/s eta 0:00:00
Collecting packaging>=20.0
Downloading packaging-21.3-py3-none-any.whl (40 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40.8/40.8 KB 2.5 MB/s eta 0:00:00
Collecting pytz>=2017.3
Downloading pytz-2022.1-py2.py3-none-any.whl (503 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 503.5/503.5 KB 4.5 MB/s eta 0:00:00
Collecting python-utils>=3.0.0
Using cached python_utils-3.3.3-py2.py3-none-any.whl (23 kB)
Collecting pycparser
Downloading pycparser-2.21-py2.py3-none-any.whl (118 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 118.7/118.7 KB 4.2 MB/s eta 0:00:00
Collecting orderedmultidict>=1.0.1
Using cached orderedmultidict-1.0.1-py2.py3-none-any.whl (11 kB)
Collecting importlib-resources>=1.4.0
Downloading importlib_resources-5.8.0-py3-none-any.whl (28 kB)
Collecting typing-extensions
Downloading typing_extensions-4.3.0-py3-none-any.whl (25 kB)
Collecting pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0
Downloading pyrsistent-0.18.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (117 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 117.1/117.1 KB 3.4 MB/s eta 0:00:00
Collecting importlib-metadata
Downloading importlib_metadata-4.12.0-py3-none-any.whl (21 kB)
Collecting h5py
Downloading h5py-3.7.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (4.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.1/4.1 MB 4.6 MB/s eta 0:00:00
Collecting greenlet!=0.4.17
Downloading greenlet-1.1.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (150 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 150.2/150.2 KB 4.4 MB/s eta 0:00:00
Collecting markdown>=2.6.8
Downloading Markdown-3.3.7-py3-none-any.whl (97 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.8/97.8 KB 4.4 MB/s eta 0:00:00
Collecting werkzeug>=0.11.15
Downloading Werkzeug-2.1.2-py3-none-any.whl (224 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 224.9/224.9 KB 4.2 MB/s eta 0:00:00
Collecting Mako
Using cached Mako-1.2.1-py3-none-any.whl (78 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.3.2.post1-py3-none-any.whl (37 kB)
Collecting cmd2>=1.0.0
Using cached cmd2-2.4.1-py3-none-any.whl (146 kB)
Collecting autopage>=0.4.0
Using cached autopage-0.5.1-py3-none-any.whl (29 kB)
Collecting PrettyTable>=0.7.2
Using cached prettytable-3.3.0-py3-none-any.whl (26 kB)
Collecting stevedore>=2.0.1
Using cached stevedore-3.5.0-py3-none-any.whl (49 kB)
Collecting pbr!=2.1.0,>=2.0.0
Using cached pbr-5.9.0-py2.py3-none-any.whl (112 kB)
Collecting wcwidth>=0.1.7
Downloading wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Collecting pyperclip>=1.6
Using cached pyperclip-1.8.2.tar.gz (20 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting zipp>=0.5
Downloading zipp-3.8.0-py3-none-any.whl (5.4 kB)
Collecting MarkupSafe>=0.9.2
Downloading MarkupSafe-2.1.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Using legacy 'setup.py install' for opuslib, since package 'wheel' is not installed.
Using legacy 'setup.py install' for gast, since package 'wheel' is not installed.
Using legacy 'setup.py install' for pyogg, since package 'wheel' is not installed.
Using legacy 'setup.py install' for bs4, since package 'wheel' is not installed.
Using legacy 'setup.py install' for future, since package 'wheel' is not installed.
Using legacy 'setup.py install' for termcolor, since package 'wheel' is not installed.
Using legacy 'setup.py install' for pyperclip, since package 'wheel' is not installed.
Installing collected packages: wcwidth, termcolor, tensorflow-estimator, pytz, pyperclip, pyogg, opuslib, braceexpand, zipp, wrapt, wheel, werkzeug, urllib3, typing-extensions, tqdm, soupsieve, six, semver, pyyaml, python-utils, pyrsistent, pyparsing, pyjwt, pycparser, psutil, protobuf, Pillow, pbr, numpy, MarkupSafe, llvmlite, idna, greenlet, gast, future, coqpit, colorlog, charset-normalizer, certifi, autopage, attrs, astor, absl-py, webdataset, sox, scipy, requests, python-dateutil, progressbar2, pathlib2, packaging, orderedmultidict, opt-einsum, numba, keras-preprocessing, importlib-resources, importlib-metadata, h5py, grpcio, google-pasta, coqui_stt_ctcdecoder, cmaes, cffi, beautifulsoup4, attrdict, stevedore, sqlalchemy, soundfile, resampy, PrettyTable, pandas, miniaudio, markdown, Mako, keras-applications, jsonschema, furl, cmd2, bs4, tensorboard, cliff, clearml, alembic, tensorflow, optuna, coqui-stt-training
Running setup.py install for termcolor: started
Running setup.py install for termcolor: finished with status 'done'
Running setup.py install for pyperclip: started
Running setup.py install for pyperclip: finished with status 'done'
Running setup.py install for pyogg: started
Running setup.py install for pyogg: finished with status 'done'
Running setup.py install for opuslib: started
Running setup.py install for opuslib: finished with status 'done'
Running setup.py install for gast: started
Running setup.py install for gast: finished with status 'done'
Running setup.py install for future: started
Running setup.py install for future: finished with status 'done'
Running setup.py install for bs4: started
Running setup.py install for bs4: finished with status 'done'
Running setup.py develop for coqui-stt-training
Successfully installed Mako-1.2.1 MarkupSafe-2.1.1 Pillow-9.2.0 PrettyTable-3.3.0 absl-py-1.1.0 alembic-1.8.0 astor-0.8.1 attrdict-2.0.1 attrs-21.4.0 autopage-0.5.1 beautifulsoup4-4.11.1 braceexpand-0.1.7 bs4-0.0.1 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 clearml-1.6.2 cliff-3.10.1 cmaes-0.8.2 cmd2-2.4.1 colorlog-6.6.0 coqpit-0.0.16 coqui-stt-training-1.4.0a1 coqui_stt_ctcdecoder-1.4.0a1 furl-2.1.3 future-0.18.2 gast-0.2.2 google-pasta-0.2.0 greenlet-1.1.2 grpcio-1.47.0 h5py-3.7.0 idna-3.3 importlib-metadata-4.12.0 importlib-resources-5.8.0 jsonschema-4.6.1 keras-applications-1.0.8 keras-preprocessing-1.1.2 llvmlite-0.36.0 markdown-3.3.7 miniaudio-1.51 numba-0.53.1 numpy-1.18.5 opt-einsum-3.3.0 optuna-2.10.1 opuslib-2.0.0 orderedmultidict-1.0.1 packaging-21.3 pandas-1.3.5 pathlib2-2.3.7.post1 pbr-5.9.0 progressbar2-4.0.0 protobuf-3.20.1 psutil-5.9.1 pycparser-2.21 pyjwt-2.4.0 pyogg-0.6.14a1 pyparsing-3.0.9 pyperclip-1.8.2 pyrsistent-0.18.1 python-dateutil-2.8.2 python-utils-3.3.3 pytz-2022.1 pyyaml-6.0 requests-2.28.1 resampy-0.3.0 scipy-1.7.3 semver-2.13.0 six-1.16.0 soundfile-0.10.3.post1 soupsieve-2.3.2.post1 sox-1.4.1 sqlalchemy-1.4.39 stevedore-3.5.0 tensorboard-1.15.0 tensorflow-1.15.4 tensorflow-estimator-1.15.1 termcolor-1.1.0 tqdm-4.64.0 typing-extensions-4.3.0 urllib3-1.26.9 wcwidth-0.2.5 webdataset-0.1.103 werkzeug-2.1.2 wheel-0.37.1 wrapt-1.14.1 zipp-3.8.0
WARNING: You are using pip version 22.0.4; however, version 22.1.2 is available.
You should consider upgrading via the '/tflite-venv/bin/python3.7 -m pip install --upgrade pip' command.
Removing intermediate container 7003aba367ed
---> 8deca9ff4001
Step 32/33 : COPY . /code
---> ecbaf3e340cb
Step 33/33 : RUN ./bin/run-ldc93s1.sh && rm -rf ~/.local/share/stt
---> Running in 4d8ad067a4d9
+ '[' '!' -f train.py ']'
+ '[' '!' -f data/smoke_test/ldc93s1.csv ']'
+ checkpoint_dir=/root/.local/share/stt/ldc93s1
+ export CUDA_VISIBLE_DEVICES=0
+ CUDA_VISIBLE_DEVICES=0
+ python -m coqui_stt_training.train --alphabet_config_path data/alphabet.txt --show_progressbar false --train_files data/smoke_test/ldc93s1.csv --test_files data/smoke_test/ldc93s1.csv --train_batch_size 1 --test_batch_size 1 --n_hidden 100 --epochs 200 --checkpoint_dir /root/.local/share/stt/ldc93s1
WARNING:tensorflow:Deprecation warnings have been disabled. Set TF_ENABLE_DEPRECATION_WARNINGS=1 to re-enable them.
I Performing dummy training to check for memory problems.
I If the following process crashes, you likely have batch sizes that are too big for your available system memory (or GPU memory).
I Could not find best validating checkpoint.
I Could not find most recent checkpoint.
I Initializing all variables.
I STARTING Optimization
I Training epoch 0...
I Finished training epoch 0 - loss: 354.664978
--------------------------------------------------------------------------------
I FINISHED optimization in 0:00:00.581714
I Dummy run finished without problems, now starting real training process.
I STARTING Optimization
I Training epoch 0...
I Finished training epoch 0 - loss: 354.664978
--------------------------------------------------------------------------------
I Training epoch 1...
I Finished training epoch 1 - loss: 320.415375
--------------------------------------------------------------------------------
I Training epoch 2...
I Finished training epoch 2 - loss: 285.564728
--------------------------------------------------------------------------------
I Training epoch 3...
I Finished training epoch 3 - loss: 248.713043
--------------------------------------------------------------------------------
I Training epoch 4...
I Finished training epoch 4 - loss: 214.128006
--------------------------------------------------------------------------------
I Training epoch 5...
I Finished training epoch 5 - loss: 184.272141
--------------------------------------------------------------------------------
I Training epoch 6...
I Finished training epoch 6 - loss: 165.691101
--------------------------------------------------------------------------------
I Training epoch 7...
I Finished training epoch 7 - loss: 158.581955
--------------------------------------------------------------------------------
I Training epoch 8...
I Finished training epoch 8 - loss: 158.953384
--------------------------------------------------------------------------------
I Training epoch 9...
I Finished training epoch 9 - loss: 161.114975
--------------------------------------------------------------------------------
I Training epoch 10...
I Finished training epoch 10 - loss: 162.563766
--------------------------------------------------------------------------------
I Training epoch 11...
I Finished training epoch 11 - loss: 159.334808
--------------------------------------------------------------------------------
I Training epoch 12...
I Finished training epoch 12 - loss: 156.039627
--------------------------------------------------------------------------------
I Training epoch 13...
I Finished training epoch 13 - loss: 151.965347
--------------------------------------------------------------------------------
I Training epoch 14...
I Finished training epoch 14 - loss: 147.631760
--------------------------------------------------------------------------------
I Training epoch 15...
I Finished training epoch 15 - loss: 145.049957
--------------------------------------------------------------------------------
I Training epoch 16...
I Finished training epoch 16 - loss: 144.044998
--------------------------------------------------------------------------------
I Training epoch 17...
I Finished training epoch 17 - loss: 143.909256
--------------------------------------------------------------------------------
I Training epoch 18...
I Finished training epoch 18 - loss: 142.969238
--------------------------------------------------------------------------------
I Training epoch 19...
I Finished training epoch 19 - loss: 144.265015
--------------------------------------------------------------------------------
I Training epoch 20...
I Finished training epoch 20 - loss: 144.121902
--------------------------------------------------------------------------------
I Training epoch 21...
I Finished training epoch 21 - loss: 141.708023
--------------------------------------------------------------------------------
I Training epoch 22...
I Finished training epoch 22 - loss: 141.445084
--------------------------------------------------------------------------------
I Training epoch 23...
I Finished training epoch 23 - loss: 140.563522
--------------------------------------------------------------------------------
I Training epoch 24...
I Finished training epoch 24 - loss: 138.959808
--------------------------------------------------------------------------------
I Training epoch 25...
I Finished training epoch 25 - loss: 138.582932
--------------------------------------------------------------------------------
I Training epoch 26...
I Finished training epoch 26 - loss: 139.360138
--------------------------------------------------------------------------------
I Training epoch 27...
I Finished training epoch 27 - loss: 138.093185
--------------------------------------------------------------------------------
I Training epoch 28...
I Finished training epoch 28 - loss: 138.547028
--------------------------------------------------------------------------------
I Training epoch 29...
I Finished training epoch 29 - loss: 137.555420
--------------------------------------------------------------------------------
I Training epoch 30...
I Finished training epoch 30 - loss: 137.137833
--------------------------------------------------------------------------------
I Training epoch 31...
I Finished training epoch 31 - loss: 136.900543
--------------------------------------------------------------------------------
I Training epoch 32...
I Finished training epoch 32 - loss: 135.603607
--------------------------------------------------------------------------------
I Training epoch 33...
I Finished training epoch 33 - loss: 135.150528
--------------------------------------------------------------------------------
I Training epoch 34...
I Finished training epoch 34 - loss: 134.997543
--------------------------------------------------------------------------------
I Training epoch 35...
I Finished training epoch 35 - loss: 135.627579
--------------------------------------------------------------------------------
I Training epoch 36...
I Finished training epoch 36 - loss: 133.874496
--------------------------------------------------------------------------------
I Training epoch 37...
I Finished training epoch 37 - loss: 134.164734
--------------------------------------------------------------------------------
I Training epoch 38...
I Finished training epoch 38 - loss: 133.575699
--------------------------------------------------------------------------------
I Training epoch 39...
I Finished training epoch 39 - loss: 132.518402
--------------------------------------------------------------------------------
I Training epoch 40...
I Finished training epoch 40 - loss: 132.061859
--------------------------------------------------------------------------------
I Training epoch 41...
I Finished training epoch 41 - loss: 132.842316
--------------------------------------------------------------------------------
I Training epoch 42...
I Finished training epoch 42 - loss: 131.311951
--------------------------------------------------------------------------------
I Training epoch 43...
I Finished training epoch 43 - loss: 131.165604
--------------------------------------------------------------------------------
I Training epoch 44...
I Finished training epoch 44 - loss: 130.746033
--------------------------------------------------------------------------------
I Training epoch 45...
I Finished training epoch 45 - loss: 130.028854
--------------------------------------------------------------------------------
I Training epoch 46...
I Finished training epoch 46 - loss: 130.055725
--------------------------------------------------------------------------------
I Training epoch 47...
I Finished training epoch 47 - loss: 129.689926
--------------------------------------------------------------------------------
I Training epoch 48...
I Finished training epoch 48 - loss: 129.608734
--------------------------------------------------------------------------------
I Training epoch 49...
I Finished training epoch 49 - loss: 128.393555
--------------------------------------------------------------------------------
I Training epoch 50...
I Finished training epoch 50 - loss: 128.767029
--------------------------------------------------------------------------------
I Training epoch 51...
I Finished training epoch 51 - loss: 127.720085
--------------------------------------------------------------------------------
I Training epoch 52...
I Finished training epoch 52 - loss: 127.041206
--------------------------------------------------------------------------------
I Training epoch 53...
I Finished training epoch 53 - loss: 126.146637
--------------------------------------------------------------------------------
I Training epoch 54...
I Finished training epoch 54 - loss: 126.902763
--------------------------------------------------------------------------------
I Training epoch 55...
I Finished training epoch 55 - loss: 125.859856
--------------------------------------------------------------------------------
I Training epoch 56...
I Finished training epoch 56 - loss: 123.677353
--------------------------------------------------------------------------------
I Training epoch 57...
I Finished training epoch 57 - loss: 124.647354
--------------------------------------------------------------------------------
I Training epoch 58...
I Finished training epoch 58 - loss: 123.864799
--------------------------------------------------------------------------------
I Training epoch 59...
I Finished training epoch 59 - loss: 122.782379
--------------------------------------------------------------------------------
I Training epoch 60...
I Finished training epoch 60 - loss: 123.863693
--------------------------------------------------------------------------------
I Training epoch 61...
I Finished training epoch 61 - loss: 122.674690
--------------------------------------------------------------------------------
I Training epoch 62...
I Finished training epoch 62 - loss: 120.663361
--------------------------------------------------------------------------------
I Training epoch 63...
I Finished training epoch 63 - loss: 120.974030
--------------------------------------------------------------------------------
I Training epoch 64...
I Finished training epoch 64 - loss: 119.462669
--------------------------------------------------------------------------------
I Training epoch 65...
I Finished training epoch 65 - loss: 119.900345
--------------------------------------------------------------------------------
I Training epoch 66...
I Finished training epoch 66 - loss: 118.628265
--------------------------------------------------------------------------------
I Training epoch 67...
I Finished training epoch 67 - loss: 118.404610
--------------------------------------------------------------------------------
I Training epoch 68...
I Finished training epoch 68 - loss: 117.094879
--------------------------------------------------------------------------------
I Training epoch 69...
I Finished training epoch 69 - loss: 116.028801
--------------------------------------------------------------------------------
I Training epoch 70...
I Finished training epoch 70 - loss: 116.433403
--------------------------------------------------------------------------------
I Training epoch 71...
I Finished training epoch 71 - loss: 116.004524
--------------------------------------------------------------------------------
I Training epoch 72...
I Finished training epoch 72 - loss: 115.623322
--------------------------------------------------------------------------------
I Training epoch 73...
I Finished training epoch 73 - loss: 113.289589
--------------------------------------------------------------------------------
I Training epoch 74...
I Finished training epoch 74 - loss: 111.817467
--------------------------------------------------------------------------------
I Training epoch 75...
I Finished training epoch 75 - loss: 111.857521
--------------------------------------------------------------------------------
I Training epoch 76...
I Finished training epoch 76 - loss: 110.594521
--------------------------------------------------------------------------------
I Training epoch 77...
I Finished training epoch 77 - loss: 108.276039
--------------------------------------------------------------------------------
I Training epoch 78...
I Finished training epoch 78 - loss: 107.798683
--------------------------------------------------------------------------------
I Training epoch 79...
I Finished training epoch 79 - loss: 107.530296
--------------------------------------------------------------------------------
I Training epoch 80...
I Finished training epoch 80 - loss: 107.986786
--------------------------------------------------------------------------------
I Training epoch 81...
I Finished training epoch 81 - loss: 106.134216
--------------------------------------------------------------------------------
I Training epoch 82...
I Finished training epoch 82 - loss: 105.934044
--------------------------------------------------------------------------------
I Training epoch 83...
I Finished training epoch 83 - loss: 102.657097
--------------------------------------------------------------------------------
I Training epoch 84...
I Finished training epoch 84 - loss: 101.564438
--------------------------------------------------------------------------------
I Training epoch 85...
I Finished training epoch 85 - loss: 99.731758
--------------------------------------------------------------------------------
I Training epoch 86...
I Finished training epoch 86 - loss: 98.892998
--------------------------------------------------------------------------------
I Training epoch 87...
I Finished training epoch 87 - loss: 96.474983
--------------------------------------------------------------------------------
I Training epoch 88...
I Finished training epoch 88 - loss: 96.633820
--------------------------------------------------------------------------------
I Training epoch 89...
I Finished training epoch 89 - loss: 93.393143
--------------------------------------------------------------------------------
I Training epoch 90...
I Finished training epoch 90 - loss: 91.748886
--------------------------------------------------------------------------------
I Training epoch 91...
I Finished training epoch 91 - loss: 90.932220
--------------------------------------------------------------------------------
I Training epoch 92...
I Finished training epoch 92 - loss: 89.760956
--------------------------------------------------------------------------------
I Training epoch 93...
I Finished training epoch 93 - loss: 86.891457
--------------------------------------------------------------------------------
I Training epoch 94...
I Finished training epoch 94 - loss: 86.594841
--------------------------------------------------------------------------------
I Training epoch 95...
I Finished training epoch 95 - loss: 83.793785
--------------------------------------------------------------------------------
I Training epoch 96...
I Finished training epoch 96 - loss: 81.582932
--------------------------------------------------------------------------------
I Training epoch 97...
I Finished training epoch 97 - loss: 81.950409
--------------------------------------------------------------------------------
I Training epoch 98...
I Finished training epoch 98 - loss: 80.482574
--------------------------------------------------------------------------------
I Training epoch 99...
I Finished training epoch 99 - loss: 77.287697
--------------------------------------------------------------------------------
I Training epoch 100...
I Finished training epoch 100 - loss: 74.772720
--------------------------------------------------------------------------------
I Training epoch 101...
I Finished training epoch 101 - loss: 74.686821
--------------------------------------------------------------------------------
I Training epoch 102...
I Finished training epoch 102 - loss: 70.582245
--------------------------------------------------------------------------------
I Training epoch 103...
I Finished training epoch 103 - loss: 70.440346
--------------------------------------------------------------------------------
I Training epoch 104...
I Finished training epoch 104 - loss: 68.172562
--------------------------------------------------------------------------------
I Training epoch 105...
I Finished training epoch 105 - loss: 67.593559
--------------------------------------------------------------------------------
I Training epoch 106...
I Finished training epoch 106 - loss: 66.371773
--------------------------------------------------------------------------------
I Training epoch 107...
I Finished training epoch 107 - loss: 63.052479
--------------------------------------------------------------------------------
I Training epoch 108...
I Finished training epoch 108 - loss: 61.507336
--------------------------------------------------------------------------------
I Training epoch 109...
I Finished training epoch 109 - loss: 57.415592
--------------------------------------------------------------------------------
I Training epoch 110...
I Finished training epoch 110 - loss: 59.571144
--------------------------------------------------------------------------------
I Training epoch 111...
I Finished training epoch 111 - loss: 55.919498
--------------------------------------------------------------------------------
I Training epoch 112...
I Finished training epoch 112 - loss: 54.061535
--------------------------------------------------------------------------------
I Training epoch 113...
I Finished training epoch 113 - loss: 54.768543
--------------------------------------------------------------------------------
I Training epoch 114...
I Finished training epoch 114 - loss: 51.447540
--------------------------------------------------------------------------------
I Training epoch 115...
I Finished training epoch 115 - loss: 49.608025
--------------------------------------------------------------------------------
I Training epoch 116...
I Finished training epoch 116 - loss: 48.166584
--------------------------------------------------------------------------------
I Training epoch 117...
I Finished training epoch 117 - loss: 43.791725
--------------------------------------------------------------------------------
I Training epoch 118...
I Finished training epoch 118 - loss: 46.521969
--------------------------------------------------------------------------------
I Training epoch 119...
I Finished training epoch 119 - loss: 42.618443
--------------------------------------------------------------------------------
I Training epoch 120...
I Finished training epoch 120 - loss: 41.456074
--------------------------------------------------------------------------------
I Training epoch 121...
I Finished training epoch 121 - loss: 39.392223
--------------------------------------------------------------------------------
I Training epoch 122...
I Finished training epoch 122 - loss: 36.490211
--------------------------------------------------------------------------------
I Training epoch 123...
I Finished training epoch 123 - loss: 38.654755
--------------------------------------------------------------------------------
I Training epoch 124...
I Finished training epoch 124 - loss: 36.822651
--------------------------------------------------------------------------------
I Training epoch 125...
I Finished training epoch 125 - loss: 35.283218
--------------------------------------------------------------------------------
I Training epoch 126...
I Finished training epoch 126 - loss: 32.675945
--------------------------------------------------------------------------------
I Training epoch 127...
I Finished training epoch 127 - loss: 32.769966
--------------------------------------------------------------------------------
I Training epoch 128...
I Finished training epoch 128 - loss: 31.303562
--------------------------------------------------------------------------------
I Training epoch 129...
I Finished training epoch 129 - loss: 28.539923
--------------------------------------------------------------------------------
I Training epoch 130...
I Finished training epoch 130 - loss: 28.348139
--------------------------------------------------------------------------------
I Training epoch 131...
I Finished training epoch 131 - loss: 26.384321
--------------------------------------------------------------------------------
I Training epoch 132...
I Finished training epoch 132 - loss: 24.642979
--------------------------------------------------------------------------------
I Training epoch 133...
I Finished training epoch 133 - loss: 23.872425
--------------------------------------------------------------------------------
I Training epoch 134...
I Finished training epoch 134 - loss: 24.208776
--------------------------------------------------------------------------------
I Training epoch 135...
I Finished training epoch 135 - loss: 21.323790
--------------------------------------------------------------------------------
I Training epoch 136...
I Finished training epoch 136 - loss: 19.588440
--------------------------------------------------------------------------------
I Training epoch 137...
I Finished training epoch 137 - loss: 20.564184
--------------------------------------------------------------------------------
I Training epoch 138...
I Finished training epoch 138 - loss: 19.297869
--------------------------------------------------------------------------------
I Training epoch 139...
I Finished training epoch 139 - loss: 16.346846
--------------------------------------------------------------------------------
I Training epoch 140...
I Finished training epoch 140 - loss: 17.914940
--------------------------------------------------------------------------------
I Training epoch 141...
I Finished training epoch 141 - loss: 14.330806
--------------------------------------------------------------------------------
I Training epoch 142...
I Finished training epoch 142 - loss: 15.483095
--------------------------------------------------------------------------------
I Training epoch 143...
I Finished training epoch 143 - loss: 13.843297
--------------------------------------------------------------------------------
I Training epoch 144...
I Finished training epoch 144 - loss: 12.472682
--------------------------------------------------------------------------------
I Training epoch 145...
I Finished training epoch 145 - loss: 11.450865
--------------------------------------------------------------------------------
I Training epoch 146...
I Finished training epoch 146 - loss: 11.179328
--------------------------------------------------------------------------------
I Training epoch 147...
I Finished training epoch 147 - loss: 11.649710
--------------------------------------------------------------------------------
I Training epoch 148...
I Finished training epoch 148 - loss: 10.456033
--------------------------------------------------------------------------------
I Training epoch 149...
I Finished training epoch 149 - loss: 9.305213
--------------------------------------------------------------------------------
I Training epoch 150...
I Finished training epoch 150 - loss: 9.027702
--------------------------------------------------------------------------------
I Training epoch 151...
I Finished training epoch 151 - loss: 8.230052
--------------------------------------------------------------------------------
I Training epoch 152...
I Finished training epoch 152 - loss: 8.457263
--------------------------------------------------------------------------------
I Training epoch 153...
I Finished training epoch 153 - loss: 8.551076
--------------------------------------------------------------------------------
I Training epoch 154...
I Finished training epoch 154 - loss: 7.459320
--------------------------------------------------------------------------------
I Training epoch 155...
I Finished training epoch 155 - loss: 8.017043
--------------------------------------------------------------------------------
I Training epoch 156...
I Finished training epoch 156 - loss: 7.484283
--------------------------------------------------------------------------------
I Training epoch 157...
I Finished training epoch 157 - loss: 6.789213
--------------------------------------------------------------------------------
I Training epoch 158...
I Finished training epoch 158 - loss: 6.744447
--------------------------------------------------------------------------------
I Training epoch 159...
I Finished training epoch 159 - loss: 7.696823
--------------------------------------------------------------------------------
I Training epoch 160...
I Finished training epoch 160 - loss: 5.364358
--------------------------------------------------------------------------------
I Training epoch 161...
I Finished training epoch 161 - loss: 7.688350
--------------------------------------------------------------------------------
I Training epoch 162...
I Finished training epoch 162 - loss: 4.999766
--------------------------------------------------------------------------------
I Training epoch 163...
I Finished training epoch 163 - loss: 6.325555
--------------------------------------------------------------------------------
I Training epoch 164...
I Finished training epoch 164 - loss: 5.261263
--------------------------------------------------------------------------------
I Training epoch 165...
I Finished training epoch 165 - loss: 5.232212
--------------------------------------------------------------------------------
I Training epoch 166...
I Finished training epoch 166 - loss: 4.370108
--------------------------------------------------------------------------------
I Training epoch 167...
I Finished training epoch 167 - loss: 4.652157
--------------------------------------------------------------------------------
I Training epoch 168...
I Finished training epoch 168 - loss: 4.067513
--------------------------------------------------------------------------------
I Training epoch 169...
I Finished training epoch 169 - loss: 3.868341
--------------------------------------------------------------------------------
I Training epoch 170...
I Finished training epoch 170 - loss: 3.650261
--------------------------------------------------------------------------------
I Training epoch 171...
I Finished training epoch 171 - loss: 4.137506
--------------------------------------------------------------------------------
I Training epoch 172...
I Finished training epoch 172 - loss: 4.626536
--------------------------------------------------------------------------------
I Training epoch 173...
I Finished training epoch 173 - loss: 3.525649
--------------------------------------------------------------------------------
I Training epoch 174...
I Finished training epoch 174 - loss: 4.134913
--------------------------------------------------------------------------------
I Training epoch 175...
I Finished training epoch 175 - loss: 3.344223
--------------------------------------------------------------------------------
I Training epoch 176...
I Finished training epoch 176 - loss: 3.045211
--------------------------------------------------------------------------------
I Training epoch 177...
I Finished training epoch 177 - loss: 2.681853
--------------------------------------------------------------------------------
I Training epoch 178...
I Finished training epoch 178 - loss: 3.426148
--------------------------------------------------------------------------------
I Training epoch 179...
I Finished training epoch 179 - loss: 2.251219
--------------------------------------------------------------------------------
I Training epoch 180...
I Finished training epoch 180 - loss: 2.882182
--------------------------------------------------------------------------------
I Training epoch 181...
I Finished training epoch 181 - loss: 2.414073
--------------------------------------------------------------------------------
I Training epoch 182...
I Finished training epoch 182 - loss: 2.464688
--------------------------------------------------------------------------------
I Training epoch 183...
I Finished training epoch 183 - loss: 2.893761
--------------------------------------------------------------------------------
I Training epoch 184...
I Finished training epoch 184 - loss: 2.361792
--------------------------------------------------------------------------------
I Training epoch 185...
I Finished training epoch 185 - loss: 2.375844
--------------------------------------------------------------------------------
I Training epoch 186...
I Finished training epoch 186 - loss: 3.487264
--------------------------------------------------------------------------------
I Training epoch 187...
I Finished training epoch 187 - loss: 1.801264
--------------------------------------------------------------------------------
I Training epoch 188...
I Finished training epoch 188 - loss: 2.083435
--------------------------------------------------------------------------------
I Training epoch 189...
I Finished training epoch 189 - loss: 2.509098
--------------------------------------------------------------------------------
I Training epoch 190...
I Finished training epoch 190 - loss: 2.109040
--------------------------------------------------------------------------------
I Training epoch 191...
I Finished training epoch 191 - loss: 2.077983
--------------------------------------------------------------------------------
I Training epoch 192...
I Finished training epoch 192 - loss: 1.756558
--------------------------------------------------------------------------------
I Training epoch 193...
I Finished training epoch 193 - loss: 1.944540
--------------------------------------------------------------------------------
I Training epoch 194...
I Finished training epoch 194 - loss: 1.740517
--------------------------------------------------------------------------------
I Training epoch 195...
I Finished training epoch 195 - loss: 1.841543
--------------------------------------------------------------------------------
I Training epoch 196...
I Finished training epoch 196 - loss: 1.806286
--------------------------------------------------------------------------------
I Training epoch 197...
I Finished training epoch 197 - loss: 1.556920
--------------------------------------------------------------------------------
I Training epoch 198...
I Finished training epoch 198 - loss: 1.579158
--------------------------------------------------------------------------------
I Training epoch 199...
I Finished training epoch 199 - loss: 1.492264
--------------------------------------------------------------------------------
I FINISHED optimization in 0:01:39.573615
W Specifying --test_files when calling train module. Use python -m coqui_stt_training.evaluate Using the training module as a generic driver for all training related functionality is deprecated and will be removed soon. Use the specific modules:
W python -m coqui_stt_training.train
W python -m coqui_stt_training.evaluate
W python -m coqui_stt_training.export
W python -m coqui_stt_training.training_graph_inference
I Could not find best validating checkpoint.
I Loading most recent checkpoint from /root/.local/share/stt/ldc93s1/train-200
I Loading variable from checkpoint: cudnn_lstm/rnn/multi_rnn_cell/cell_0/cudnn_compatible_lstm_cell/bias
I Loading variable from checkpoint: cudnn_lstm/rnn/multi_rnn_cell/cell_0/cudnn_compatible_lstm_cell/kernel
I Loading variable from checkpoint: global_step
I Loading variable from checkpoint: layer_1/bias
I Loading variable from checkpoint: layer_1/weights
I Loading variable from checkpoint: layer_2/bias
I Loading variable from checkpoint: layer_2/weights
I Loading variable from checkpoint: layer_3/bias
I Loading variable from checkpoint: layer_3/weights
I Loading variable from checkpoint: layer_5/bias
I Loading variable from checkpoint: layer_5/weights
I Loading variable from checkpoint: layer_6/bias
I Loading variable from checkpoint: layer_6/weights
Testing model on data/smoke_test/ldc93s1.csv
I Test epoch...
Test on data/smoke_test/ldc93s1.csv - WER: 0.000000, CER: 0.000000, loss: 0.872811
--------------------------------------------------------------------------------
Best WER:
--------------------------------------------------------------------------------
WER: 0.000000, CER: 0.000000, loss: 0.872811
- wav: data/smoke_test/LDC93S1.wav
- src: "she had your dark suit in greasy wash water all year"
- res: "she had your dark suit in greasy wash water all year"
--------------------------------------------------------------------------------
Median WER:
--------------------------------------------------------------------------------
WER: 0.000000, CER: 0.000000, loss: 0.872811
- wav: data/smoke_test/LDC93S1.wav
- src: "she had your dark suit in greasy wash water all year"
- res: "she had your dark suit in greasy wash water all year"
--------------------------------------------------------------------------------
Worst WER:
--------------------------------------------------------------------------------
WER: 0.000000, CER: 0.000000, loss: 0.872811
- wav: data/smoke_test/LDC93S1.wav
- src: "she had your dark suit in greasy wash water all year"
- res: "she had your dark suit in greasy wash water all year"
--------------------------------------------------------------------------------
Removing intermediate container 4d8ad067a4d9
---> ed4653f3b8ff
[Warning] One or more build-args [uid gid] were not consumed
Successfully built ed4653f3b8ff
Successfully tagged stt-train:latest
================
== TensorFlow ==
================
NVIDIA Release 22.02-tf1 (build 32060646)
TensorFlow Version 1.15.5
Container image Copyright (c) 2022, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
Copyright 2017-2022 The TensorFlow Authors. All rights reserved.
Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES. All rights reserved.
This container image and its contents are governed by the NVIDIA Deep Learning Container License.
By pulling and using the container, you accept the terms and conditions of this license:
https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license
NOTE: MOFED driver for multi-node communication was not detected.
Multi-node communication performance may be reduced.
root@bbd6819f5df5:/code# python
Python 3.8.10 (default, Mar 15 2022, 12:22:08)
[GCC 9.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from coqui_stt_training.util import cpu
>>> cpu.available_count()
24
>>> exit()
root@bbd6819f5df5:/code# exit
exit
WARNING! This will remove all stopped containers.
Are you sure you want to continue? [y/N] y
Deleted Containers:
bbd6819f5df562b54846caf881fdbefb1ac0a1a19f5cc53c5914daf64ce84e48
Total reclaimed space: 64.37kB
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment