To be posted in: https://forums.fast.ai/c/fastai-users/fastai-v2/
Title: Proposed workflow to compare & monitor models using WandbCallback
Content:
Hi,
I’ve been working on WandbCallback for the past few months (with a lot of help from @sgugger) and I'm very excited to show how it works!
| ``` | |
| boris@Desk-Ubuntu:~/Projects/tests$ python ../transformers/examples/text-classification/run_tf_glue.py --model_name_or_path bert-base-cased --task_name $TASK_NAME --do_train --do_eval --max_seq_length 128 --per_device_train_batch_size 32 --learning_rate 2e-5 --num_train_epochs 3.0 --output_dir /tmp/$TASK_NAME/ --overwrite_output_dir --logging_dir log --evaluate_during_training --eval_steps 50 --logging_steps 10 | |
| 06/12/2020 13:16:33 - INFO - transformers.training_args_tf - Tensorflow: setting up strategy | |
| 2020-06-12 13:16:33.776937: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 | |
| 2020-06-12 13:16:33.798135: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:981] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero | |
| 2020-06-12 13:16:33.798688: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: | |
| pciBusID: 0000:01:00.0 name: Ge |