See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/331/display/redirect
Changes:
------------------------------------------ [...truncated 1.91 MB...] //tensorflow/python/data/kernel_tests:map_test PASSED in 31.9s Stats over 19 runs: max = 31.9s, min = 13.9s, avg = 21.6s, dev = 5.2s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 7.2s Stats over 20 runs: max = 7.2s, min = 3.3s, avg = 5.5s, dev = 1.0s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 7.1s Stats over 20 runs: max = 7.1s, min = 5.0s, avg = 6.0s, dev = 0.6s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 19.2s Stats over 20 runs: max = 19.2s, min = 8.9s, avg = 15.1s, dev = 3.0s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 13.8s Stats over 20 runs: max = 13.8s, min = 4.2s, avg = 7.0s, dev = 2.0s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 7.4s Stats over 20 runs: max = 7.4s, min = 6.0s, avg = 6.6s, dev = 0.4s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 13.9s Stats over 20 runs: max = 13.9s, min = 10.1s, avg = 12.2s, dev = 1.0s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 11.2s Stats over 20 runs: max = 11.2s, min = 9.8s, avg = 10.5s, dev = 0.4s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 47.7s Stats over 20 runs: max = 47.7s, min = 6.4s, avg = 16.9s, dev = 12.7s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 22.0s Stats over 20 runs: max = 22.0s, min = 13.9s, avg = 17.9s, dev = 2.2s //tensorflow/python/kernel_tests:metrics_test PASSED in 47.5s Stats over 20 runs: max = 47.5s, min = 8.4s, avg = 22.3s, dev = 11.4s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 9.2s Stats over 20 runs: max = 9.2s, min = 3.2s, avg = 6.0s, dev = 1.5s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 15.5s Stats over 20 runs: max = 15.5s, min = 4.6s, avg = 7.7s, dev = 3.2s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 56.4s Stats over 20 runs: max = 56.4s, min = 5.5s, avg = 16.3s, dev = 15.2s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 111.1s Stats over 20 runs: max = 111.1s, min = 28.5s, avg = 62.7s, dev = 24.5s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 7.0s Stats over 20 runs: max = 7.0s, min = 4.0s, avg = 5.5s, dev = 1.0s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 18.6s Stats over 20 runs: max = 18.6s, min = 6.9s, avg = 11.9s, dev = 3.1s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 233.0s Stats over 20 runs: max = 233.0s, min = 39.0s, avg = 116.2s, dev = 57.3s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 24.3s Stats over 20 runs: max = 24.3s, min = 3.9s, avg = 10.7s, dev = 5.9s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 21.8s Stats over 20 runs: max = 21.8s, min = 6.9s, avg = 13.7s, dev = 5.7s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 17.7s Stats over 20 runs: max = 17.7s, min = 12.6s, avg = 14.9s, dev = 1.9s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 68.8s Stats over 20 runs: max = 68.8s, min = 5.1s, avg = 29.4s, dev = 22.2s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 22.0s Stats over 20 runs: max = 22.0s, min = 2.9s, avg = 7.2s, dev = 4.4s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 23.6s Stats over 24 runs: max = 23.6s, min = 8.0s, avg = 15.9s, dev = 4.0s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 27.0s Stats over 24 runs: max = 27.0s, min = 8.6s, avg = 15.6s, dev = 5.6s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 18.4s Stats over 24 runs: max = 18.4s, min = 4.9s, avg = 10.6s, dev = 4.1s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 10.8s Stats over 25 runs: max = 10.8s, min = 8.0s, avg = 8.9s, dev = 0.6s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 34.7s Stats over 25 runs: max = 34.7s, min = 8.1s, avg = 12.0s, dev = 6.7s //tensorflow/dtensor/python/tests:spmd_test_cpu PASSED in 40.3s Stats over 25 runs: max = 40.3s, min = 23.6s, avg = 31.0s, dev = 3.7s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 10.9s Stats over 30 runs: max = 10.9s, min = 6.5s, avg = 7.9s, dev = 1.1s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 15.2s Stats over 30 runs: max = 15.2s, min = 12.0s, avg = 13.5s, dev = 0.7s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 9.0s Stats over 30 runs: max = 9.0s, min = 6.8s, avg = 7.4s, dev = 0.5s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 9.0s Stats over 30 runs: max = 9.0s, min = 7.3s, avg = 8.1s, dev = 0.5s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 40.0s Stats over 30 runs: max = 40.0s, min = 3.3s, avg = 11.1s, dev = 8.6s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 9.5s Stats over 31 runs: max = 9.5s, min = 6.6s, avg = 8.3s, dev = 0.8s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 11.7s Stats over 32 runs: max = 11.7s, min = 7.1s, avg = 9.2s, dev = 1.2s //tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 19.1s Stats over 32 runs: max = 19.1s, min = 4.8s, avg = 14.1s, dev = 4.0s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 21.9s Stats over 32 runs: max = 21.9s, min = 8.1s, avg = 14.7s, dev = 3.6s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 9.2s Stats over 40 runs: max = 9.2s, min = 7.3s, avg = 8.3s, dev = 0.5s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 9.6s Stats over 40 runs: max = 9.6s, min = 7.7s, avg = 8.5s, dev = 0.6s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 15.0s Stats over 40 runs: max = 15.0s, min = 8.4s, avg = 11.1s, dev = 1.6s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 11.9s Stats over 40 runs: max = 11.9s, min = 7.1s, avg = 8.8s, dev = 1.0s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 119.7s Stats over 50 runs: max = 119.7s, min = 29.1s, avg = 57.0s, dev = 32.3s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 53.2s Stats over 50 runs: max = 53.2s, min = 2.9s, avg = 12.8s, dev = 9.1s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 48.3s Stats over 50 runs: max = 48.3s, min = 2.8s, avg = 11.7s, dev = 9.3s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 13.7s Stats over 50 runs: max = 13.7s, min = 8.3s, avg = 9.8s, dev = 1.4s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 11.3s Stats over 50 runs: max = 11.3s, min = 8.5s, avg = 10.0s, dev = 0.6s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 16.4s Stats over 50 runs: max = 16.4s, min = 9.4s, avg = 12.3s, dev = 1.8s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 14.8s Stats over 50 runs: max = 14.8s, min = 4.5s, avg = 8.5s, dev = 2.6s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 7.8s Stats over 50 runs: max = 7.8s, min = 3.0s, avg = 4.9s, dev = 1.2s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 6.5s Stats over 50 runs: max = 6.5s, min = 2.9s, avg = 4.2s, dev = 0.9s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 32.0s Stats over 50 runs: max = 32.0s, min = 8.0s, avg = 15.2s, dev = 6.2s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 12.9s Stats over 50 runs: max = 12.9s, min = 2.8s, avg = 4.5s, dev = 1.7s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 15.7s Stats over 50 runs: max = 15.7s, min = 3.2s, avg = 5.7s, dev = 2.7s
Executed 3576 out of 3577 tests: 3576 tests pass and 1 fails to build. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.11) collect list of installed Python packages] *** Monday 06 February 2023 05:21:46 +0000 (0:25:26.546) 3:25:39.149 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save list of installed Python packages] *** Monday 06 February 2023 05:21:48 +0000 (0:00:02.108) 3:25:41.257 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save tests output to file] ******* Monday 06 February 2023 05:21:48 +0000 (0:00:00.703) 3:25:41.960 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save tests stderr output to file] *** Monday 06 February 2023 05:21:49 +0000 (0:00:00.693) 3:25:42.654 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Extract number of tests run] ***** Monday 06 February 2023 05:21:50 +0000 (0:00:00.692) 3:25:43.347 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Show number of tests run] ******** Monday 06 February 2023 05:21:50 +0000 (0:00:00.079) 3:25:43.426 ******* ok: [localhost] => ut_tests_line: ''
TASK [tensorflow_in_container : (Python 3.11) Extract failed tests] ************ Monday 06 February 2023 05:21:50 +0000 (0:00:00.047) 3:25:43.474 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Show which tests failed] ********* Monday 06 February 2023 05:21:50 +0000 (0:00:00.069) 3:25:43.544 ******* ok: [localhost] => tests_failed: 'FAILED: '
TASK [tensorflow_in_container : (Python 3.11) Convert wheel to manylinux2014 compatible one] *** Monday 06 February 2023 05:21:50 +0000 (0:00:00.047) 3:25:43.591 ******* fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- + for wheel in /tf/pkg/*.whl + echo 'Checking and renaming /tf/pkg/tensorflow-2.13.0-cp311-cp311-linux_aarch64.whl...' + python3 -m auditwheel repair --plat manylinux2014_aarch64 /tf/pkg/tensorflow-2.13.0-cp311-cp311-linux_aarch64.whl --wheel-dir /tf/pkg + tee check.txt
real 2m21.058s user 1m55.241s sys 0m16.624s ++ grep --extended-regexp --only-matching '/tf/pkg/\S+.whl' check.txt + new_wheel=/tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + [[ /tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl != /\t\f/\p\k\g/\t\e\n\s\o\r\f\l\o\w-\2.\1\3.\0-\c\p\3\1\1-\c\p\3\1\1-\l\i\n\u\x_\a\a\r\c\h\6\4.\w\h\l ]] + rm /tf/pkg/tensorflow-2.13.0-cp311-cp311-linux_aarch64.whl + wheel=/tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + TF_WHEEL=/tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + bats /usertools/wheel_verification.bats --timing stderr_lines: <omitted> stdout: |- Checking and renaming /tf/pkg/tensorflow-2.13.0-cp311-cp311-linux_aarch64.whl... INFO:auditwheel.main_repair:Repairing tensorflow-2.13.0-cp311-cp311-linux_aarch64.whl INFO:auditwheel.wheeltools:Previous filename tags: linux_aarch64 INFO:auditwheel.wheeltools:New filename tags: manylinux_2_17_aarch64, manylinux2014_aarch64 INFO:auditwheel.wheeltools:Previous WHEEL info tags: cp311-cp311-linux_aarch64 INFO:auditwheel.wheeltools:New WHEEL info tags: cp311-cp311-manylinux_2_17_aarch64, cp311-cp311-manylinux2014_aarch64 INFO:auditwheel.main_repair: Fixed-up wheel written to /tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 1..6 ok 1 Wheel is manylinux2014 (manylinux_2_17) compliant in 53787ms # Size of /tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl is 230 / 580 megabytes. ok 2 Wheel conforms to upstream size limitations in 14ms not ok 3 Wheel is installable in 9817ms # (in test file /usertools/wheel_verification.bats, line 62) # `python3 -m pip install --only-binary grpcio "$TF_WHEEL"' failed # Processing ./tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl # Collecting absl-py>=1.0.0 # Downloading absl_py-1.4.0-py3-none-any.whl (126 kB) # ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 126.5/126.5 kB 9.7 MB/s eta 0:00:00 # Collecting astunparse>=1.6.0 # Downloading astunparse-1.6.3-py2.py3-none-any.whl (12 kB) # Collecting flatbuffers>=2.0 # Downloading flatbuffers-23.1.21-py2.py3-none-any.whl (26 kB) # Collecting gast<=0.4.0,>=0.2.1 # Downloading gast-0.4.0-py3-none-any.whl (9.8 kB) # Collecting google-pasta>=0.1.1 # Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB) # ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.5/57.5 kB 6.2 MB/s eta 0:00:00 # ERROR: Could not find a version that satisfies the requirement grpcio<2.0,>=1.24.3 (from tensorflow) (from versions: none) # ERROR: No matching distribution found for grpcio<2.0,>=1.24.3 # # [notice] A new release of pip available: 22.3.1 -> 23.0 # [notice] To update, run: pip install --upgrade pip not ok 4 TensorFlow is importable in 40ms # (in test file /usertools/wheel_verification.bats, line 67) # `python3 -c 'import tensorflow as tf; t1=tf.constant([1,2,3,4]); t2=tf.constant([5,6,7,8]); print(tf.add(t1,t2).shape)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' not ok 5 TensorFlow has Keras in 39ms # (in test file /usertools/wheel_verification.bats, line 73) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "_v2.keras" in tf.keras.__name__ else 1)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' not ok 6 TensorFlow has Estimator in 39ms # (in test file /usertools/wheel_verification.bats, line 79) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "_v2.estimator" in tf.estimator.__name__ else 1)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=136 changed=104 unreachable=0 failed=1 skipped=13 rescued=0 ignored=4
Monday 06 February 2023 05:25:16 +0000 (0:03:25.955) 3:29:09.546 ******* =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow-oneDNN-ACL git tests 2845.30s tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git 1922.26s tensorflow_in_container : (Python 3.11) run TensorFlow-oneDNN-ACL git tests 1526.55s tensorflow_in_container : (Python 3.9) run TensorFlow-oneDNN-ACL git tests 1436.63s tensorflow_in_container : (Python 3.10) run TensorFlow-oneDNN-ACL git tests 1385.74s tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one - 320.55s tensorflow_in_container : (Python 3.10) Convert wheel to manylinux2014 compatible one - 314.18s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 300.82s tensorflow_in_container : (Python 3.11) start build container --------- 266.52s tensorflow_in_container : (Python 3.11) install Python packages ------- 239.44s tensorflow_in_container : (Python 3.10) stop build container ---------- 214.59s tensorflow_in_container : (Python 3.8) stop build container ----------- 213.77s tensorflow_in_container : (Python 3.9) stop build container ----------- 211.10s tensorflow_in_container : (Python 3.11) Convert wheel to manylinux2014 compatible one - 205.96s tensorflow_in_container : (Python 3.11) build TensorFlow-oneDNN-ACL git - 189.96s tensorflow_in_container : (Python 3.10) build TensorFlow-oneDNN-ACL git - 184.17s tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git - 179.85s tensorflow_in_container : (Python 3.9) build Python package ----------- 115.18s tensorflow_in_container : (Python 3.8) build Python package ----------- 114.83s tensorflow_in_container : (Python 3.11) build Python package ---------- 112.03s Build step 'Execute shell' marked build as failure