Skip to content

Instantly share code, notes, and snippets.

@davidberard98
Last active April 28, 2022 21:02
Show Gist options
  • Save davidberard98/d6e30e7c888e04cd884397d0e5922139 to your computer and use it in GitHub Desktop.
Save davidberard98/d6e30e7c888e04cd884397d0e5922139 to your computer and use it in GitHub Desktop.
extremal nvfuser opinfo failures - logs
2022-04-28T18:21:31.8743911Z ======================================================================
2022-04-28T18:21:31.8745075Z FAIL [0.152s]: test_nvfuser_extremal_values_nn_functional_binary_cross_entropy_with_logits_cuda_bfloat16 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8746363Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8746833Z Traceback (most recent call last):
2022-04-28T18:21:31.8747861Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8748515Z method(*args, **kwargs)
2022-04-28T18:21:31.8749414Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8749935Z method(*args, **kwargs)
2022-04-28T18:21:31.8750485Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8751089Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8751650Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8752061Z return test(*args, **kwargs)
2022-04-28T18:21:31.8752598Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8753149Z fn(*args, **kwargs)
2022-04-28T18:21:31.8753535Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8753979Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8754544Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8754931Z assert_equal(
2022-04-28T18:21:31.8756230Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8756610Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8756927Z AssertionError: Scalars are not close!
2022-04-28T18:21:31.8757137Z
2022-04-28T18:21:31.8757360Z Absolute difference: inf (up to 1e-05 allowed)
2022-04-28T18:21:31.8757712Z Relative difference: nan (up to 0.016 allowed)
2022-04-28T18:21:31.8757892Z
2022-04-28T18:21:31.8757931Z
2022-04-28T18:21:31.8758054Z ======================================================================
2022-04-28T18:21:31.8758737Z FAIL [0.259s]: test_nvfuser_extremal_values_nn_functional_binary_cross_entropy_with_logits_cuda_float16 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8759339Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8759697Z Traceback (most recent call last):
2022-04-28T18:21:31.8760216Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8760580Z method(*args, **kwargs)
2022-04-28T18:21:31.8761077Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8761563Z method(*args, **kwargs)
2022-04-28T18:21:31.8762383Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8762973Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8763931Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8764677Z return test(*args, **kwargs)
2022-04-28T18:21:31.8765663Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8766327Z fn(*args, **kwargs)
2022-04-28T18:21:31.8766997Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8767788Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8768860Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8769634Z assert_equal(
2022-04-28T18:21:31.8770485Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8770996Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8771301Z AssertionError: Scalars are not close!
2022-04-28T18:21:31.8771496Z
2022-04-28T18:21:31.8771703Z Absolute difference: inf (up to 1e-05 allowed)
2022-04-28T18:21:31.8772038Z Relative difference: nan (up to 0.001 allowed)
2022-04-28T18:21:31.8772229Z
2022-04-28T18:21:31.8772248Z
2022-04-28T18:21:31.8772387Z ======================================================================
2022-04-28T18:21:31.8772841Z FAIL [0.257s]: test_nvfuser_extremal_values_nn_functional_binary_cross_entropy_with_logits_cuda_float32 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8773398Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8773754Z Traceback (most recent call last):
2022-04-28T18:21:31.8774284Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8774678Z method(*args, **kwargs)
2022-04-28T18:21:31.8775160Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8775534Z method(*args, **kwargs)
2022-04-28T18:21:31.8776067Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8776467Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8777005Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8777408Z return test(*args, **kwargs)
2022-04-28T18:21:31.8778141Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8778509Z fn(*args, **kwargs)
2022-04-28T18:21:31.8778892Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8779328Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8779878Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8780258Z assert_equal(
2022-04-28T18:21:31.8780737Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8781108Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8781412Z AssertionError: Scalars are not close!
2022-04-28T18:21:31.8781606Z
2022-04-28T18:21:31.8781825Z Absolute difference: inf (up to 1e-05 allowed)
2022-04-28T18:21:31.8782201Z Relative difference: nan (up to 1.3e-06 allowed)
2022-04-28T18:21:31.8782401Z
2022-04-28T18:21:31.8782419Z
2022-04-28T18:21:31.8782555Z ======================================================================
2022-04-28T18:21:31.8783071Z FAIL [0.244s]: test_nvfuser_extremal_values_nn_functional_binary_cross_entropy_with_logits_cuda_float64 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8783652Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8783989Z Traceback (most recent call last):
2022-04-28T18:21:31.8784506Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8784887Z method(*args, **kwargs)
2022-04-28T18:21:31.8785390Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8785795Z method(*args, **kwargs)
2022-04-28T18:21:31.8786329Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8786741Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8787269Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8787670Z return test(*args, **kwargs)
2022-04-28T18:21:31.8788231Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8788598Z fn(*args, **kwargs)
2022-04-28T18:21:31.8788960Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8789396Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8789959Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8790313Z assert_equal(
2022-04-28T18:21:31.8790793Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8791179Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8791463Z AssertionError: Scalars are not close!
2022-04-28T18:21:31.8791661Z
2022-04-28T18:21:31.8791878Z Absolute difference: inf (up to 1e-07 allowed)
2022-04-28T18:21:31.8792271Z Relative difference: nan (up to 1e-07 allowed)
2022-04-28T18:21:31.8792467Z
2022-04-28T18:21:31.8792486Z
2022-04-28T18:21:31.8792624Z ======================================================================
2022-04-28T18:21:31.8793041Z FAIL [0.083s]: test_nvfuser_extremal_values_nn_functional_conv_transpose3d_cuda_float16 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8793591Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8793944Z Traceback (most recent call last):
2022-04-28T18:21:31.8794445Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8794821Z method(*args, **kwargs)
2022-04-28T18:21:31.8795317Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8795691Z method(*args, **kwargs)
2022-04-28T18:21:31.8796212Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8796633Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8797168Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8797550Z return test(*args, **kwargs)
2022-04-28T18:21:31.8798052Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8798679Z fn(*args, **kwargs)
2022-04-28T18:21:31.8799060Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4650, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8799493Z trace(*clone_inputs((sample.input, *sample.args)), **sample.kwargs)
2022-04-28T18:21:31.8800101Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/jit_metaprogramming_utils.py", line 437, in traced_fn
2022-04-28T18:21:31.8800660Z self.assertExportImport(traced.graph, inputs_tensors)
2022-04-28T18:21:31.8801243Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_jit.py", line 148, in assertExportImport
2022-04-28T18:21:31.8801689Z self.assertExportImportModule(m, inputs)
2022-04-28T18:21:31.8802280Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_jit.py", line 154, in assertExportImportModule
2022-04-28T18:21:31.8802743Z self.assertEqual(a, b, "Results of original model and "
2022-04-28T18:21:31.8803285Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8803663Z assert_equal(
2022-04-28T18:21:31.8804144Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8804514Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8804904Z AssertionError: Results of original model and exported/imported version of model differed
2022-04-28T18:21:31.8805170Z
2022-04-28T18:21:31.8805312Z ======================================================================
2022-04-28T18:21:31.8805820Z FAIL [0.190s]: test_nvfuser_extremal_values_nn_functional_conv_transpose3d_cuda_float32 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8806360Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8806713Z Traceback (most recent call last):
2022-04-28T18:21:31.8807231Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8807593Z method(*args, **kwargs)
2022-04-28T18:21:31.8808093Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8808461Z method(*args, **kwargs)
2022-04-28T18:21:31.8808996Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8809401Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8809940Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8810340Z return test(*args, **kwargs)
2022-04-28T18:21:31.8810824Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8811193Z fn(*args, **kwargs)
2022-04-28T18:21:31.8811574Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4650, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8812020Z trace(*clone_inputs((sample.input, *sample.args)), **sample.kwargs)
2022-04-28T18:21:31.8812605Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/jit_metaprogramming_utils.py", line 437, in traced_fn
2022-04-28T18:21:31.8813078Z self.assertExportImport(traced.graph, inputs_tensors)
2022-04-28T18:21:31.8813663Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_jit.py", line 148, in assertExportImport
2022-04-28T18:21:31.8814102Z self.assertExportImportModule(m, inputs)
2022-04-28T18:21:31.8814689Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_jit.py", line 154, in assertExportImportModule
2022-04-28T18:21:31.8815153Z self.assertEqual(a, b, "Results of original model and "
2022-04-28T18:21:31.8815708Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8816063Z assert_equal(
2022-04-28T18:21:31.8816539Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8816918Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8817285Z AssertionError: Results of original model and exported/imported version of model differed
2022-04-28T18:21:31.8817549Z
2022-04-28T18:21:31.8817754Z ======================================================================
2022-04-28T18:21:31.8818185Z FAIL [0.060s]: test_nvfuser_extremal_values_nn_functional_nll_loss_cuda_bfloat16 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8818733Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8819065Z Traceback (most recent call last):
2022-04-28T18:21:31.8819577Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8819956Z method(*args, **kwargs)
2022-04-28T18:21:31.8820437Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8820813Z method(*args, **kwargs)
2022-04-28T18:21:31.8821339Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8821754Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8822276Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8822669Z return test(*args, **kwargs)
2022-04-28T18:21:31.8823229Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8823577Z fn(*args, **kwargs)
2022-04-28T18:21:31.8823953Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8824389Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8824952Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8825307Z assert_equal(
2022-04-28T18:21:31.8825784Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8826168Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8826520Z AssertionError: Tensor-likes are not close!
2022-04-28T18:21:31.8826728Z
2022-04-28T18:21:31.8826861Z Mismatched elements: 2 / 2 (100.0%)
2022-04-28T18:21:31.8827287Z Greatest absolute difference: inf at index (0,) (up to 1e-05 allowed)
2022-04-28T18:21:31.8827664Z Greatest relative difference: nan at index (0,) (up to 0.016 allowed)
2022-04-28T18:21:31.8827884Z
2022-04-28T18:21:31.8827902Z
2022-04-28T18:21:31.8828040Z ======================================================================
2022-04-28T18:21:31.8828460Z FAIL [0.162s]: test_nvfuser_extremal_values_nn_functional_nll_loss_cuda_float16 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8828993Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8829325Z Traceback (most recent call last):
2022-04-28T18:21:31.8829839Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8830219Z method(*args, **kwargs)
2022-04-28T18:21:31.8830706Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8831079Z method(*args, **kwargs)
2022-04-28T18:21:31.8831609Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8832023Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8832545Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8832938Z return test(*args, **kwargs)
2022-04-28T18:21:31.8833439Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8833792Z fn(*args, **kwargs)
2022-04-28T18:21:31.8834169Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8834598Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8835221Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8835589Z assert_equal(
2022-04-28T18:21:31.8836067Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8836452Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8836805Z AssertionError: Tensor-likes are not close!
2022-04-28T18:21:31.8837011Z
2022-04-28T18:21:31.8837141Z Mismatched elements: 2 / 2 (100.0%)
2022-04-28T18:21:31.8837564Z Greatest absolute difference: inf at index (0,) (up to 1e-05 allowed)
2022-04-28T18:21:31.8837951Z Greatest relative difference: nan at index (0,) (up to 0.001 allowed)
2022-04-28T18:21:31.8838151Z
2022-04-28T18:21:31.8838169Z
2022-04-28T18:21:31.8838475Z ======================================================================
2022-04-28T18:21:31.8838910Z FAIL [0.163s]: test_nvfuser_extremal_values_nn_functional_nll_loss_cuda_float32 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8839458Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8839884Z Traceback (most recent call last):
2022-04-28T18:21:31.8840405Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8840784Z method(*args, **kwargs)
2022-04-28T18:21:31.8841283Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8841642Z method(*args, **kwargs)
2022-04-28T18:21:31.8842172Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8842591Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8843109Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8843509Z return test(*args, **kwargs)
2022-04-28T18:21:31.8844012Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8844385Z fn(*args, **kwargs)
2022-04-28T18:21:31.8844741Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8845172Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8845730Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8846085Z assert_equal(
2022-04-28T18:21:31.8846565Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8846947Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8847300Z AssertionError: Tensor-likes are not close!
2022-04-28T18:21:31.8847504Z
2022-04-28T18:21:31.8847634Z Mismatched elements: 2 / 2 (100.0%)
2022-04-28T18:21:31.8848061Z Greatest absolute difference: inf at index (0,) (up to 1e-05 allowed)
2022-04-28T18:21:31.8848537Z Greatest relative difference: nan at index (0,) (up to 1.3e-06 allowed)
2022-04-28T18:21:31.8848766Z
2022-04-28T18:21:31.8848785Z
2022-04-28T18:21:31.8848905Z ======================================================================
2022-04-28T18:21:31.8849325Z FAIL [0.163s]: test_nvfuser_extremal_values_nn_functional_nll_loss_cuda_float64 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8849860Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8850210Z Traceback (most recent call last):
2022-04-28T18:21:31.8850708Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8851087Z method(*args, **kwargs)
2022-04-28T18:21:31.8851586Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8851945Z method(*args, **kwargs)
2022-04-28T18:21:31.8852552Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8852981Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8853522Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8853902Z return test(*args, **kwargs)
2022-04-28T18:21:31.8854404Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8854770Z fn(*args, **kwargs)
2022-04-28T18:21:31.8855130Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8855561Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8856120Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8856473Z assert_equal(
2022-04-28T18:21:31.8856954Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8857413Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8857789Z AssertionError: Tensor-likes are not close!
2022-04-28T18:21:31.8857973Z
2022-04-28T18:21:31.8858105Z Mismatched elements: 1 / 2 (50.0%)
2022-04-28T18:21:31.8858527Z Greatest absolute difference: inf at index (0,) (up to 1e-07 allowed)
2022-04-28T18:21:31.8858997Z Greatest relative difference: nan at index (0,) (up to 1e-07 allowed)
2022-04-28T18:21:31.8859216Z
2022-04-28T18:21:31.8859234Z
2022-04-28T18:21:31.8859353Z ======================================================================
2022-04-28T18:21:31.8859767Z FAIL [0.203s]: test_nvfuser_extremal_values_nn_functional_prelu_cuda_float16 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8860303Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8860654Z Traceback (most recent call last):
2022-04-28T18:21:31.8861154Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8861541Z method(*args, **kwargs)
2022-04-28T18:21:31.8862039Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8862398Z method(*args, **kwargs)
2022-04-28T18:21:31.8862925Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8863339Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8863870Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8864250Z return test(*args, **kwargs)
2022-04-28T18:21:31.8864754Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8865120Z fn(*args, **kwargs)
2022-04-28T18:21:31.8865486Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8865920Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8866482Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8866855Z assert_equal(
2022-04-28T18:21:31.8867313Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8867696Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8868065Z AssertionError: Tensor-likes are not close!
2022-04-28T18:21:31.8868270Z
2022-04-28T18:21:31.8868386Z Mismatched elements: 25 / 25 (100.0%)
2022-04-28T18:21:31.8868819Z Greatest absolute difference: inf at index (0, 0) (up to 1e-05 allowed)
2022-04-28T18:21:31.8869213Z Greatest relative difference: nan at index (0, 0) (up to 0.001 allowed)
2022-04-28T18:21:31.8869438Z
2022-04-28T18:21:31.8869532Z
2022-04-28T18:21:31.8869677Z ======================================================================
2022-04-28T18:21:31.8870084Z FAIL [0.329s]: test_nvfuser_extremal_values_nn_functional_prelu_cuda_float32 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8870622Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8870971Z Traceback (most recent call last):
2022-04-28T18:21:31.8871467Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8871848Z method(*args, **kwargs)
2022-04-28T18:21:31.8872346Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8872723Z method(*args, **kwargs)
2022-04-28T18:21:31.8873232Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8873650Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8874185Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8874618Z return test(*args, **kwargs)
2022-04-28T18:21:31.8875123Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8875492Z fn(*args, **kwargs)
2022-04-28T18:21:31.8875853Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8876288Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8876853Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8877225Z assert_equal(
2022-04-28T18:21:31.8877685Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8878071Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8878624Z AssertionError: Tensor-likes are not close!
2022-04-28T18:21:31.8878834Z
2022-04-28T18:21:31.8878950Z Mismatched elements: 25 / 25 (100.0%)
2022-04-28T18:21:31.8879381Z Greatest absolute difference: inf at index (0, 0) (up to 1e-05 allowed)
2022-04-28T18:21:31.8879854Z Greatest relative difference: nan at index (0, 0) (up to 1.3e-06 allowed)
2022-04-28T18:21:31.8880081Z
2022-04-28T18:21:31.8880100Z
2022-04-28T18:21:31.8880239Z ======================================================================
2022-04-28T18:21:31.8880638Z FAIL [0.305s]: test_nvfuser_extremal_values_nn_functional_prelu_cuda_float64 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8881178Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8881527Z Traceback (most recent call last):
2022-04-28T18:21:31.8882027Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8882413Z method(*args, **kwargs)
2022-04-28T18:21:31.8882911Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8883286Z method(*args, **kwargs)
2022-04-28T18:21:31.8883799Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8884207Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8884744Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8885125Z return test(*args, **kwargs)
2022-04-28T18:21:31.8885673Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8886041Z fn(*args, **kwargs)
2022-04-28T18:21:31.8886414Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8886909Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8887487Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8887865Z assert_equal(
2022-04-28T18:21:31.8888323Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8888710Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8889075Z AssertionError: Tensor-likes are not close!
2022-04-28T18:21:31.8889279Z
2022-04-28T18:21:31.8889413Z Mismatched elements: 25 / 25 (100.0%)
2022-04-28T18:21:31.8889823Z Greatest absolute difference: inf at index (0, 0) (up to 1e-07 allowed)
2022-04-28T18:21:31.8890291Z Greatest relative difference: nan at index (0, 0) (up to 1e-07 allowed)
2022-04-28T18:21:31.8890515Z
2022-04-28T18:21:31.8890533Z
2022-04-28T18:21:31.8890673Z ======================================================================
2022-04-28T18:21:31.8891077Z FAIL [0.164s]: test_nvfuser_extremal_values_unique_consecutive_cuda_float16 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8891689Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8892037Z Traceback (most recent call last):
2022-04-28T18:21:31.8892555Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8892919Z method(*args, **kwargs)
2022-04-28T18:21:31.8893420Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8893789Z method(*args, **kwargs)
2022-04-28T18:21:31.8894298Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8894714Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8895248Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8895650Z return test(*args, **kwargs)
2022-04-28T18:21:31.8896140Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8896510Z fn(*args, **kwargs)
2022-04-28T18:21:31.8896888Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8897306Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8897868Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8898240Z assert_equal(
2022-04-28T18:21:31.8898700Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8899087Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8899456Z AssertionError: Tensor-likes are not equal!
2022-04-28T18:21:31.8899660Z
2022-04-28T18:21:31.8899797Z Mismatched elements: 1 / 2 (50.0%)
2022-04-28T18:21:31.8900107Z Greatest absolute difference: 4888017880192958818 at index (1,)
2022-04-28T18:21:31.8900457Z Greatest relative difference: inf at index (1,)
2022-04-28T18:21:31.8900659Z
2022-04-28T18:21:31.8900678Z
2022-04-28T18:21:31.8900813Z The failure occurred for item [1]
2022-04-28T18:21:31.8900994Z
2022-04-28T18:21:31.8901114Z ======================================================================
2022-04-28T18:21:31.8901534Z FAIL [0.262s]: test_nvfuser_extremal_values_unique_consecutive_cuda_float32 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8902073Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8902420Z Traceback (most recent call last):
2022-04-28T18:21:31.8902926Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8903307Z method(*args, **kwargs)
2022-04-28T18:21:31.8903854Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8904224Z method(*args, **kwargs)
2022-04-28T18:21:31.8904756Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8905174Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8905706Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8906088Z return test(*args, **kwargs)
2022-04-28T18:21:31.8906589Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8906960Z fn(*args, **kwargs)
2022-04-28T18:21:31.8907321Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8907755Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8908321Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8908746Z assert_equal(
2022-04-28T18:21:31.8909207Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8909595Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8909962Z AssertionError: Tensor-likes are not equal!
2022-04-28T18:21:31.8910164Z
2022-04-28T18:21:31.8910279Z Mismatched elements: 1 / 2 (50.0%)
2022-04-28T18:21:31.8910604Z Greatest absolute difference: 4553085638182913608 at index (1,)
2022-04-28T18:21:31.8910949Z Greatest relative difference: inf at index (1,)
2022-04-28T18:21:31.8911150Z
2022-04-28T18:21:31.8911168Z
2022-04-28T18:21:31.8911300Z The failure occurred for item [1]
2022-04-28T18:21:31.8911464Z
2022-04-28T18:21:31.8911598Z ======================================================================
2022-04-28T18:21:31.8912019Z FAIL [0.266s]: test_nvfuser_extremal_values_unique_consecutive_cuda_float64 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8912560Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8912897Z Traceback (most recent call last):
2022-04-28T18:21:31.8913416Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8913797Z method(*args, **kwargs)
2022-04-28T18:21:31.8914291Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8914651Z method(*args, **kwargs)
2022-04-28T18:21:31.8915180Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8915595Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8916110Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8916510Z return test(*args, **kwargs)
2022-04-28T18:21:31.8917016Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8917384Z fn(*args, **kwargs)
2022-04-28T18:21:31.8917742Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8918176Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8918919Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8919272Z assert_equal(
2022-04-28T18:21:31.8919745Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8920129Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8920483Z AssertionError: Tensor-likes are not close!
2022-04-28T18:21:31.8920688Z
2022-04-28T18:21:31.8920897Z Mismatched elements: 1 / 2 (50.0%)
2022-04-28T18:21:31.8921353Z Greatest absolute difference: 4.950630001322665 at index (1,) (up to 1e-07 allowed)
2022-04-28T18:21:31.8921831Z Greatest relative difference: 1.0 at index (1,) (up to 1e-07 allowed)
2022-04-28T18:21:31.8922035Z
2022-04-28T18:21:31.8922071Z
2022-04-28T18:21:31.8922187Z The failure occurred for item [0]
2022-04-28T18:21:31.8922368Z
2022-04-28T18:21:31.8922505Z ======================================================================
2022-04-28T18:21:31.8922899Z FAIL [0.272s]: test_nvfuser_extremal_values_unique_cuda_float16 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8923425Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8923758Z Traceback (most recent call last):
2022-04-28T18:21:31.8924275Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8924656Z method(*args, **kwargs)
2022-04-28T18:21:31.8925140Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8925512Z method(*args, **kwargs)
2022-04-28T18:21:31.8926116Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8926515Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8927053Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8927445Z return test(*args, **kwargs)
2022-04-28T18:21:31.8927945Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8928296Z fn(*args, **kwargs)
2022-04-28T18:21:31.8928671Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8929109Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8929659Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8930036Z assert_equal(
2022-04-28T18:21:31.8930512Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8930897Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8931247Z AssertionError: Tensor-likes are not close!
2022-04-28T18:21:31.8931449Z
2022-04-28T18:21:31.8931579Z Mismatched elements: 1 / 2 (50.0%)
2022-04-28T18:21:31.8932004Z Greatest absolute difference: nan at index (0,) (up to 1e-05 allowed)
2022-04-28T18:21:31.8932381Z Greatest relative difference: nan at index (0,) (up to 0.001 allowed)
2022-04-28T18:21:31.8932602Z
2022-04-28T18:21:31.8932621Z
2022-04-28T18:21:31.8932755Z The failure occurred for item [0]
2022-04-28T18:21:31.8932933Z
2022-04-28T18:21:31.8933070Z ======================================================================
2022-04-28T18:21:31.8933470Z FAIL [0.272s]: test_nvfuser_extremal_values_unique_cuda_float32 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8933980Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8934331Z Traceback (most recent call last):
2022-04-28T18:21:31.8934848Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8935207Z method(*args, **kwargs)
2022-04-28T18:21:31.8935703Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8936074Z method(*args, **kwargs)
2022-04-28T18:21:31.8936602Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8937004Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8937539Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8937984Z return test(*args, **kwargs)
2022-04-28T18:21:31.8938479Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8938849Z fn(*args, **kwargs)
2022-04-28T18:21:31.8939225Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8939661Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8940209Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8940582Z assert_equal(
2022-04-28T18:21:31.8941059Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8941427Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8941798Z AssertionError: Tensor-likes are not close!
2022-04-28T18:21:31.8942001Z
2022-04-28T18:21:31.8942135Z Mismatched elements: 2 / 2 (100.0%)
2022-04-28T18:21:31.8942543Z Greatest absolute difference: nan at index (0,) (up to 1e-05 allowed)
2022-04-28T18:21:31.8943073Z Greatest relative difference: nan at index (0,) (up to 1.3e-06 allowed)
2022-04-28T18:21:31.8943299Z
2022-04-28T18:21:31.8943318Z
2022-04-28T18:21:31.8943449Z The failure occurred for item [0]
2022-04-28T18:21:31.8943627Z
2022-04-28T18:21:31.8943763Z ======================================================================
2022-04-28T18:21:31.8944140Z FAIL [0.282s]: test_nvfuser_extremal_values_unique_cuda_float64 (__main__.TestCudaFuserOpInfoCUDA)
2022-04-28T18:21:31.8944661Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8945008Z Traceback (most recent call last):
2022-04-28T18:21:31.8945507Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8945889Z method(*args, **kwargs)
2022-04-28T18:21:31.8946386Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1796, in wrapper
2022-04-28T18:21:31.8946756Z method(*args, **kwargs)
2022-04-28T18:21:31.8947278Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 376, in instantiated_test
2022-04-28T18:21:31.8947691Z result = test(self, **param_kwargs)
2022-04-28T18:21:31.8948226Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 773, in test_wrapper
2022-04-28T18:21:31.8948607Z return test(*args, **kwargs)
2022-04-28T18:21:31.8949107Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1117, in wrapper
2022-04-28T18:21:31.8949469Z fn(*args, **kwargs)
2022-04-28T18:21:31.8949846Z File "/var/lib/jenkins/workspace/test/test_jit_cuda_fuser.py", line 4666, in test_nvfuser_extremal_values
2022-04-28T18:21:31.8950259Z self.assertEqual(val, ref, equal_nan=True, exact_device=True)
2022-04-28T18:21:31.8950830Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2180, in assertEqual
2022-04-28T18:21:31.8951211Z assert_equal(
2022-04-28T18:21:31.8951669Z File "/opt/conda/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1074, in assert_equal
2022-04-28T18:21:31.8952052Z raise error_metas[0].to_error()
2022-04-28T18:21:31.8952419Z AssertionError: Tensor-likes are not close!
2022-04-28T18:21:31.8952624Z
2022-04-28T18:21:31.8952754Z Mismatched elements: 1 / 2 (50.0%)
2022-04-28T18:21:31.8953183Z Greatest absolute difference: 2.137796365437257 at index (1,) (up to 1e-07 allowed)
2022-04-28T18:21:31.8953653Z Greatest relative difference: 1.0 at index (1,) (up to 1e-07 allowed)
2022-04-28T18:21:31.8953874Z
2022-04-28T18:21:31.8953892Z
2022-04-28T18:21:31.8954026Z The failure occurred for item [0]
2022-04-28T18:21:31.8954204Z
2022-04-28T18:21:31.8954456Z ----------------------------------------------------------------------
2022-04-28T18:21:31.8954840Z Ran 7181 tests in 3648.344s
2022-04-28T18:21:31.8955017Z
2022-04-28T18:21:31.8955186Z FAILED (failures=19, skipped=258, expected failures=57)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment