Skip to content

Instantly share code, notes, and snippets.

@haifengkao
Created August 15, 2020 07:25
Show Gist options
  • Save haifengkao/da6d5fa7ef73596a5781096cbff519cb to your computer and use it in GitHub Desktop.
Save haifengkao/da6d5fa7ef73596a5781096cbff519cb to your computer and use it in GitHub Desktop.
Tensorflow TPU Error
InvalidArgumentError: 9 root error(s) found.
(0) Invalid argument: {{function_node __inference_train_function_80125}} Compilation failure: Detected unsupported operations when trying to compile graph broadcast_weights_1_assert_broadcastable_is_valid_shape_has_valid_nonscalar_shape_true_79965_const_0[] on XLA_TPU_JIT: DenseToDenseSetOperation (No registered 'DenseToDenseSetOperation' OpKernel for XLA_TPU_JIT devices compatible with node {{node broadcast_weights_1/assert_broadcastable/is_valid_shape/has_valid_nonscalar_shape/has_invalid_dims/DenseToDenseSetOperation}}){{node broadcast_weights_1/assert_broadcastable/is_valid_shape/has_valid_nonscalar_shape/has_invalid_dims/DenseToDenseSetOperation}}
[[broadcast_weights_1/assert_broadcastable/is_valid_shape/has_valid_nonscalar_shape]]
[[broadcast_weights_1/assert_broadcastable/is_valid_shape]]
TPU compilation failed
[[tpu_compile_succeeded_assert/_16364550150888184836/_30]]
[[TPUReplicate/_compile/_2384856891229734177/_29/_1132]]
(1) Invalid argument: {{function_node __inference_train_function_80125}} Compilation failure: Detected unsupported operations when trying to compile graph broadcast_weights_1_assert_broadcastable_is_valid_shape_has_valid_nonscalar_shape_true_79965_const_0[] on XLA_TPU_JIT: DenseToDenseSetOperation (No registered 'DenseToDenseSetOperation' OpKernel for XLA_TPU_JIT devices compatible with node {{node broadcast_weights_1/assert_broadcastable/is_valid_shape/has_valid_nonscalar_shape/has_invalid_dims/DenseToDenseSetOperation}}){{node broadcast_weights_1/assert_broadcastable/is_valid_shape/has_valid_nonscalar_shape/has_invalid_dims/DenseToDenseSetOperation}}
[[broadcast_weights_1/assert_broadcastable/is_valid_shape/has_valid_nonscalar_shape]]
[[broadcast_weights_1/assert_broadcastable/is_valid_shape]]
TPU compilation failed
[[tpu_compile_succeeded_assert/_16364550150888184836/_30]]
[[tpu_compile_succeeded_assert/_16364550150888184836/_30/_1321]]
(2) Invalid argument: {{function_node __inference_train_function_80125}} Compilation failure: Detected unsupported operations when trying to compile graph broadcast_weights_1_assert_broadcastable_is_valid_shape_has_valid_nonscalar_shape_true_79965_const_0[] on XLA_TPU_JIT: DenseToDenseSetOperation (No registered 'DenseToDenseSetOperation' OpKernel for XLA_TPU_JIT devices compatible with node {{node broadcast_weights_1/assert_broadcastable/is_valid_shape/has_valid_nonscalar_shape/has_invalid_dims/DenseToDenseSetOperation}}){{node broadcast_weights_1/assert_broadcastable/is_valid_shape/has_valid_nonscalar_shape/has_invalid_dims/DenseToDenseSetOperation}}
[[broadcast_weights_1/assert_broadcastable/is_valid_shape/has_valid_nonscalar_shape]]
[[broadcast_weights_1/assert_broadcastable/is_valid_shape]]
TPU compilation failed
[[tpu_compile_succeeded_assert/_16364550150888184836/_30]]
[[tpu_compile_succeeded_assert/_16364550150888184836/_30/_1197]]
(3) Invalid argument: {{function_node __inference_train_function_80125}} Compilation failure: Detected unsupported operations when trying to compile graph broad ... [truncated]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment