See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/674/display/redirect
Changes:
------------------------------------------ Started by timer Started by user Marcin Juszkiewicz (marcin.juszkiewicz@linaro.org) Rebuilds build #673 Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on ldcg-aarch64-02 (aarch64 leg-aarch64) in workspace https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/ [ldcg-python-manylinux-tensorflow-nightly] $ /bin/bash /tmp/jenkins6257093834359270958.sh + dual_abi=false + cd https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/ + rm -rf '*.sh' configs wheels cache_upload + mkdir wheels cache_upload + git clone --depth 1 https://git.linaro.org/ci/job/configs.git Cloning into 'configs'... + cd configs + git log --pretty=oneline -1 7ffa9d4dcec4ff110237c2634c7fdf946e6bf31b ldcg-*-tensorflow: adapt search for failed tests + cd .. + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' true = true ']' + echo ' - "git"' + dual_abi=true + '[' false = true ']' + '[' '' = true ']' + '[' true == true ']' + ansible-galaxy collection install community.docker Starting galaxy collection install process Nothing to do. All requested collections are already installed. If you want to reinstall them, consider using `--force`. + cd configs/ldcg-python-manylinux-tensorflow/ansible/ + sed -i -es+/tmp/workspace+https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/+g vars/vars.yml + ansible-playbook playbooks/build-tf-dual-abi.yml [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all'
PLAY [Build TensorFlow in Dual ABI container] **********************************
TASK [Gathering Facts] ********************************************************* Thursday 02 February 2023 10:36:46 +0000 (0:00:00.056) 0:00:00.056 ***** ok: [localhost]
TASK [Cleanup after previous build] ******************************************** Thursday 02 February 2023 10:36:49 +0000 (0:00:02.628) 0:00:02.685 ***** changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels) ok: [localhost] => (item=tensorflow)
TASK [Create cache dirs] ******************************************************* Thursday 02 February 2023 10:36:50 +0000 (0:00:01.274) 0:00:03.959 ***** ok: [localhost] => (item=disk-cache) ok: [localhost] => (item=bazel-cache) changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels)
TASK [Set dual abi variable] *************************************************** Thursday 02 February 2023 10:36:52 +0000 (0:00:01.399) 0:00:05.359 ***** ok: [localhost]
TASK [Go through each TensorFlow version] ************************************** Thursday 02 February 2023 10:36:52 +0000 (0:00:00.035) 0:00:05.394 ***** skipping: [localhost] => (item={'key': '2.11', 'value': {'tensorflow_version': '2.11.0', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.11.0', 'tensorboard_version': '==2.11.0', 'tensorflow_estimator_version': '==2.11.0', 'python_install_packages': ['packaging', 'portpicker', 'keras-nightly', 'tb-nightly', 'tf-estimator-nightly'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/training:server_lib_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.10', 'value': {'tensorflow_version': '2.10.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.10.0', 'tensorboard_version': '==2.10.1', 'tensorflow_estimator_version': '==2.10.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tensorflow/tests/...', '//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/tests:jit_test_cpu', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/training:server_lib_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.9', 'value': {'tensorflow_version': '2.9.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.9.0', 'tensorboard_version': '==2.9.0', 'tensorflow_estimator_version': '==2.9.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.8', 'value': {'tensorflow_version': '2.8.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.8.0', 'tensorboard_version': '==2.8.0', 'tensorflow_estimator_version': '==2.8.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/mlir/lite/tests:prepare-tf.mlir.test', '//tensorflow/compiler/mlir/tensorflow:dump_graph_test', '//tensorflow/core/common_runtime:direct_session_test', '//tensorflow/core/common_runtime:direct_session_with_debug_test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:quantize_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python:quantized_ops_test', '//tensorflow/python:script_ops_test', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.7', 'value': {'tensorflow_version': '2.7.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.5', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.7.0', 'tensorboard_version': '==2.7.0', 'tensorflow_estimator_version': '==2.7.0', 'python_install_packages': ['portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/java/...', '//tensorflow/lite/...', '//tensorflow/compiler/xla/python/...', '//tensorflow/compiler/xla/service/cpu/...', '//tensorflow/compiler/xla/tests/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/core/kernels:sparse_matmul_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/debug/cli:debugger_cli_common_test', '//tensorflow/python/debug/examples/v2:examples_v2_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/keras/mixed_precision:model_test', '//tensorflow/python/keras/preprocessing:image_test', '//tensorflow/python/kernel_tests:init_ops_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests:self_adjoint_eig_op_test', '//tensorflow/python/kernel_tests:sparse_matmul_op_test', '//tensorflow/python/lib/io:file_io_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python/ops/ragged:ragged_print_op_test', '//tensorflow/python/profiler/integration_test:profiler_api_test', '//tensorflow/python/profiler:profiler_v2_test', '//tensorflow/python/util:dispatch_test', '//tensorflow/python/util:traceback_utils_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tools/docs:tf_doctest', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.6', 'value': {'tensorflow_version': '2.6.5', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.6.0', 'tensorboard_version': '==2.6.0', 'tensorflow_estimator_version': '==2.6.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.5', 'value': {'tensorflow_version': '2.5.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.34.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.5.0', 'tensorboard_version': '==2.5.0', 'tensorflow_estimator_version': '==2.5.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.4', 'value': {'tensorflow_version': '2.4.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.3.3', 'grpcio_version': '~=1.32.0', 'h5py_version': '~=2.10', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.4.3', 'tensorboard_version': '==2.4.1', 'tensorflow_estimator_version': '==2.4.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '1.15', 'value': {'tensorflow_version': '1.15.5', 'bazel_version': '0.29.1', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.2.2', 'grpcio_version': '~=1.32.0', 'h5py_version': '==2.10', 'numpy_version': '~=1.18.0', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==1.2.2', 'tensorboard_version': '==1.15.0', 'tensorflow_estimator_version': '==1.15.2', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m']}})
TASK [tensorflow : Set TensorFlow and other package versions] ****************** Thursday 02 February 2023 10:36:52 +0000 (0:00:00.240) 0:00:05.635 ***** ok: [localhost]
TASK [tensorflow : Set build dir for TensorFlow git] *************************** Thursday 02 February 2023 10:36:52 +0000 (0:00:00.080) 0:00:05.716 ***** ok: [localhost]
TASK [tensorflow : Remove TensorFlow git sources from previous build] ********** Thursday 02 February 2023 10:36:52 +0000 (0:00:00.044) 0:00:05.760 ***** changed: [localhost]
TASK [tensorflow : Fetch TensorFlow] ******************************************* Thursday 02 February 2023 10:36:56 +0000 (0:00:03.560) 0:00:09.321 ***** included: https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/configs/ldcg-python-manylinux-tensorflow/ansible/roles/tensorflow/tasks/fetch.yml for localhost
TASK [tensorflow : Fetch TensorFlow git source] ******************************** Thursday 02 February 2023 10:36:56 +0000 (0:00:00.099) 0:00:09.420 ***** skipping: [localhost]
TASK [tensorflow : Unpack TensorFlow git source] ******************************* Thursday 02 February 2023 10:36:56 +0000 (0:00:00.040) 0:00:09.461 ***** skipping: [localhost]
TASK [tensorflow : Rename source dir for oneDNN build] ************************* Thursday 02 February 2023 10:36:56 +0000 (0:00:00.035) 0:00:09.496 ***** skipping: [localhost]
TASK [tensorflow : Fetch TensorFlow from git] ********************************** Thursday 02 February 2023 10:36:56 +0000 (0:00:00.039) 0:00:09.536 ***** changed: [localhost]
TASK [tensorflow : Set world write access to source] *************************** Thursday 02 February 2023 10:37:19 +0000 (0:00:23.403) 0:00:32.939 ***** changed: [localhost]
TASK [tensorflow : Get oneline version of git log for this checkout] *********** Thursday 02 February 2023 10:37:20 +0000 (0:00:00.373) 0:00:33.313 ***** changed: [localhost]
TASK [tensorflow : Show git log] *********************************************** Thursday 02 February 2023 10:37:20 +0000 (0:00:00.583) 0:00:33.896 ***** ok: [localhost] => git_log.stdout: '31f49a0006e78da1d6cc022909ccc8db448febe1 Merge pull request #58518 from Tessil:toupstream/support_for_transform_params_lut_populate'
TASK [tensorflow : Record git commit hash to variable] ************************* Thursday 02 February 2023 10:37:20 +0000 (0:00:00.042) 0:00:33.939 ***** ok: [localhost]
TASK [tensorflow : Save git commit hash to file] ******************************* Thursday 02 February 2023 10:37:20 +0000 (0:00:00.061) 0:00:34.000 ***** changed: [localhost]
TASK [Build Bazel] ************************************************************* Thursday 02 February 2023 10:37:21 +0000 (0:00:01.143) 0:00:35.143 ***** skipping: [localhost]
TASK [Build TensorFlow for each Python version] ******************************** Thursday 02 February 2023 10:37:21 +0000 (0:00:00.036) 0:00:35.180 ***** skipping: [localhost] => (item=3.8) skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10)
TASK [Build TensorFlow for each Python version (dual abi)] ********************* Thursday 02 February 2023 10:37:22 +0000 (0:00:00.081) 0:00:35.262 *****
TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Thursday 02 February 2023 10:37:22 +0000 (0:00:00.457) 0:00:35.719 ***** changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] *** Thursday 02 February 2023 10:37:23 +0000 (0:00:00.628) 0:00:36.347 ***** skipping: [localhost]
TASK [Fetch TensorFlow] ******************************************************** Thursday 02 February 2023 10:37:23 +0000 (0:00:00.036) 0:00:36.384 ***** skipping: [localhost]
TASK [(Python 3.8) patch TensorFlow tree] ************************************** Thursday 02 February 2023 10:37:23 +0000 (0:00:00.036) 0:00:36.421 *****
TASK [tensorflow : Create linklibs shell script] ******************************* Thursday 02 February 2023 10:37:23 +0000 (0:00:00.142) 0:00:36.563 ***** changed: [localhost]
TASK [tensorflow : Create readme file about unit tests] ************************ Thursday 02 February 2023 10:37:24 +0000 (0:00:00.695) 0:00:37.259 ***** changed: [localhost]
TASK [tensorflow : Add to the copied files] ************************************ Thursday 02 February 2023 10:37:24 +0000 (0:00:00.704) 0:00:37.963 ***** changed: [localhost]
TASK [tensorflow : Add to the long_description in setup.py] ******************** Thursday 02 February 2023 10:37:25 +0000 (0:00:00.572) 0:00:38.536 ***** changed: [localhost]
TASK [tensorflow : Use nightly package requirements] *************************** Thursday 02 February 2023 10:37:25 +0000 (0:00:00.554) 0:00:39.090 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) start build container] ************ Thursday 02 February 2023 10:37:26 +0000 (0:00:00.390) 0:00:39.481 ***** fatal: [localhost]: FAILED! => changed=false msg: 'Error removing container cfe923d833ccaa5768a3680b761ff4eef403ae2c6258e4ebb4c90f0d436990cf: UnixHTTPConnectionPool(host=''localhost'', port=None): Read timed out. (read timeout=60)'
PLAY RECAP ********************************************************************* localhost : ok=20 changed=13 unreachable=0 failed=1 skipped=7 rescued=0 ignored=0
Thursday 02 February 2023 10:38:48 +0000 (0:01:22.318) 0:02:01.799 ***** =============================================================================== tensorflow_in_container : (Python 3.8) start build container ----------- 82.32s tensorflow : Fetch TensorFlow from git --------------------------------- 23.40s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.56s Gathering Facts --------------------------------------------------------- 2.63s Create cache dirs ------------------------------------------------------- 1.40s Cleanup after previous build -------------------------------------------- 1.27s tensorflow : Save git commit hash to file ------------------------------- 1.14s tensorflow : Create readme file about unit tests ------------------------ 0.70s tensorflow : Create linklibs shell script ------------------------------- 0.70s tensorflow_in_container : Reset checkout to clean state ----------------- 0.63s tensorflow : Get oneline version of git log for this checkout ----------- 0.58s tensorflow : Add to the copied files ------------------------------------ 0.57s tensorflow : Add to the long_description in setup.py -------------------- 0.55s Build TensorFlow for each Python version (dual abi) --------------------- 0.46s tensorflow : Use nightly package requirements --------------------------- 0.39s tensorflow : Set world write access to source --------------------------- 0.37s Go through each TensorFlow version -------------------------------------- 0.24s (Python 3.8) patch TensorFlow tree -------------------------------------- 0.14s tensorflow : Fetch TensorFlow ------------------------------------------- 0.10s Build TensorFlow for each Python version -------------------------------- 0.08s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/675/display/redirect
Changes:
------------------------------------------ [...truncated 1.74 MB...] //tensorflow/python/data/kernel_tests:map_test PASSED in 36.0s Stats over 19 runs: max = 36.0s, min = 14.3s, avg = 24.0s, dev = 5.6s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 7.1s Stats over 20 runs: max = 7.1s, min = 4.3s, avg = 5.8s, dev = 0.7s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 6.7s Stats over 20 runs: max = 6.7s, min = 2.9s, avg = 3.8s, dev = 1.0s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 8.9s Stats over 20 runs: max = 8.9s, min = 3.2s, avg = 4.4s, dev = 1.6s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 10.4s Stats over 20 runs: max = 10.4s, min = 3.3s, avg = 4.9s, dev = 1.9s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 15.3s Stats over 20 runs: max = 15.3s, min = 7.6s, avg = 9.7s, dev = 1.8s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 13.3s Stats over 20 runs: max = 13.3s, min = 10.4s, avg = 11.7s, dev = 0.7s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 11.6s Stats over 20 runs: max = 11.6s, min = 9.5s, avg = 10.4s, dev = 0.6s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 47.7s Stats over 20 runs: max = 47.7s, min = 7.0s, avg = 16.9s, dev = 12.9s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 24.5s Stats over 20 runs: max = 24.5s, min = 18.0s, avg = 20.8s, dev = 1.6s //tensorflow/python/kernel_tests:metrics_test PASSED in 44.9s Stats over 20 runs: max = 44.9s, min = 8.1s, avg = 20.0s, dev = 11.2s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 6.1s Stats over 20 runs: max = 6.1s, min = 2.9s, avg = 4.0s, dev = 0.9s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 14.0s Stats over 20 runs: max = 14.0s, min = 4.8s, avg = 7.2s, dev = 2.4s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 41.1s Stats over 20 runs: max = 41.1s, min = 3.5s, avg = 13.1s, dev = 12.1s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 97.5s Stats over 20 runs: max = 97.5s, min = 29.5s, avg = 53.2s, dev = 19.9s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 7.9s Stats over 20 runs: max = 7.9s, min = 3.9s, avg = 6.4s, dev = 0.9s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 17.5s Stats over 20 runs: max = 17.5s, min = 6.5s, avg = 12.4s, dev = 3.7s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 209.1s Stats over 20 runs: max = 209.1s, min = 30.7s, avg = 96.6s, dev = 54.2s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 25.0s Stats over 20 runs: max = 25.0s, min = 7.1s, avg = 12.4s, dev = 6.0s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 22.5s Stats over 20 runs: max = 22.5s, min = 4.5s, avg = 13.1s, dev = 7.2s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 17.9s Stats over 20 runs: max = 17.9s, min = 13.2s, avg = 14.9s, dev = 1.3s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 75.9s Stats over 20 runs: max = 75.9s, min = 4.4s, avg = 28.9s, dev = 23.4s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 22.5s Stats over 20 runs: max = 22.5s, min = 4.2s, avg = 7.6s, dev = 4.1s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 22.1s Stats over 24 runs: max = 22.1s, min = 6.3s, avg = 15.6s, dev = 4.2s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 49.1s Stats over 24 runs: max = 49.1s, min = 15.2s, avg = 28.1s, dev = 9.8s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 20.1s Stats over 24 runs: max = 20.1s, min = 4.5s, avg = 10.5s, dev = 4.6s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 7.2s Stats over 25 runs: max = 7.2s, min = 5.8s, avg = 6.3s, dev = 0.4s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 39.9s Stats over 25 runs: max = 39.9s, min = 8.0s, avg = 13.7s, dev = 8.0s //tensorflow/dtensor/python/tests:spmd_test_cpu PASSED in 31.4s Stats over 25 runs: max = 31.4s, min = 20.2s, avg = 24.4s, dev = 2.6s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 8.7s Stats over 30 runs: max = 8.7s, min = 6.1s, avg = 7.4s, dev = 0.5s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 26.7s Stats over 30 runs: max = 26.7s, min = 16.1s, avg = 21.6s, dev = 2.9s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 7.5s Stats over 30 runs: max = 7.5s, min = 6.4s, avg = 7.0s, dev = 0.3s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 8.1s Stats over 30 runs: max = 8.1s, min = 6.7s, avg = 7.7s, dev = 0.3s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 14.6s Stats over 30 runs: max = 14.6s, min = 3.3s, avg = 6.9s, dev = 2.8s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 11.2s Stats over 31 runs: max = 11.2s, min = 8.3s, avg = 9.6s, dev = 1.0s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 10.9s Stats over 32 runs: max = 10.9s, min = 6.5s, avg = 8.3s, dev = 1.1s //tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 20.8s Stats over 32 runs: max = 20.8s, min = 8.8s, avg = 16.1s, dev = 3.5s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 26.0s Stats over 32 runs: max = 26.0s, min = 10.6s, avg = 18.9s, dev = 4.0s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 11.0s Stats over 40 runs: max = 11.0s, min = 6.7s, avg = 8.5s, dev = 1.0s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 15.7s Stats over 40 runs: max = 15.7s, min = 6.2s, avg = 9.7s, dev = 1.8s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 14.5s Stats over 40 runs: max = 14.5s, min = 7.8s, avg = 10.4s, dev = 1.4s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 14.8s Stats over 40 runs: max = 14.8s, min = 7.3s, avg = 10.8s, dev = 1.6s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 101.9s Stats over 50 runs: max = 101.9s, min = 24.3s, avg = 51.1s, dev = 28.3s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 36.6s Stats over 50 runs: max = 36.6s, min = 3.3s, avg = 10.8s, dev = 7.3s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 41.9s Stats over 50 runs: max = 41.9s, min = 3.0s, avg = 11.2s, dev = 8.3s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 8.4s Stats over 50 runs: max = 8.4s, min = 6.0s, avg = 6.8s, dev = 0.5s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 14.9s Stats over 50 runs: max = 14.9s, min = 8.6s, avg = 12.0s, dev = 2.0s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 14.2s Stats over 50 runs: max = 14.2s, min = 8.1s, avg = 10.2s, dev = 1.4s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 10.8s Stats over 50 runs: max = 10.8s, min = 4.1s, avg = 7.2s, dev = 2.1s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 8.3s Stats over 50 runs: max = 8.3s, min = 2.8s, avg = 4.5s, dev = 1.1s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 6.3s Stats over 50 runs: max = 6.3s, min = 2.9s, avg = 4.0s, dev = 0.9s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 27.1s Stats over 50 runs: max = 27.1s, min = 8.2s, avg = 14.4s, dev = 5.1s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 13.1s Stats over 50 runs: max = 13.1s, min = 3.2s, avg = 4.5s, dev = 1.7s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 11.7s Stats over 50 runs: max = 11.7s, min = 2.9s, avg = 4.8s, dev = 1.9s
Executed 3573 out of 3574 tests: 3573 tests pass and 1 fails to build. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.11) collect list of installed Python packages] *** Thursday 02 February 2023 15:00:54 +0000 (0:24:47.890) 3:50:18.894 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save list of installed Python packages] *** Thursday 02 February 2023 15:00:56 +0000 (0:00:02.180) 3:50:21.075 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save tests output to file] ******* Thursday 02 February 2023 15:00:57 +0000 (0:00:00.701) 3:50:21.776 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save tests stderr output to file] *** Thursday 02 February 2023 15:00:58 +0000 (0:00:00.696) 3:50:22.473 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Extract number of tests run] ***** Thursday 02 February 2023 15:00:58 +0000 (0:00:00.690) 3:50:23.164 ***** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Show number of tests run] ******** Thursday 02 February 2023 15:00:58 +0000 (0:00:00.080) 3:50:23.245 ***** ok: [localhost] => ut_tests_line: ''
TASK [tensorflow_in_container : (Python 3.11) Extract failed tests] ************ Thursday 02 February 2023 15:00:58 +0000 (0:00:00.046) 3:50:23.291 ***** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Show which tests failed] ********* Thursday 02 February 2023 15:00:58 +0000 (0:00:00.070) 3:50:23.361 ***** ok: [localhost] => tests_failed: 'FAILED: '
TASK [tensorflow_in_container : (Python 3.11) Convert wheel to manylinux2014 compatible one] *** Thursday 02 February 2023 15:00:59 +0000 (0:00:00.046) 3:50:23.408 ***** fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- + for wheel in /tf/pkg/*.whl + echo 'Checking and renaming /tf/pkg/tensorflow-2.12.0-cp311-cp311-linux_aarch64.whl...' + python3 -m auditwheel repair --plat manylinux2014_aarch64 /tf/pkg/tensorflow-2.12.0-cp311-cp311-linux_aarch64.whl --wheel-dir /tf/pkg + tee check.txt
real 1m56.572s user 1m43.107s sys 0m13.236s ++ grep --extended-regexp --only-matching '/tf/pkg/\S+.whl' check.txt + new_wheel=/tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + [[ /tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl != /\t\f/\p\k\g/\t\e\n\s\o\r\f\l\o\w-\2.\1\2.\0-\c\p\3\1\1-\c\p\3\1\1-\l\i\n\u\x_\a\a\r\c\h\6\4.\w\h\l ]] + rm /tf/pkg/tensorflow-2.12.0-cp311-cp311-linux_aarch64.whl + wheel=/tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + TF_WHEEL=/tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + bats /usertools/wheel_verification.bats --timing stderr_lines: <omitted> stdout: |- Checking and renaming /tf/pkg/tensorflow-2.12.0-cp311-cp311-linux_aarch64.whl... INFO:auditwheel.main_repair:Repairing tensorflow-2.12.0-cp311-cp311-linux_aarch64.whl INFO:auditwheel.wheeltools:Previous filename tags: linux_aarch64 INFO:auditwheel.wheeltools:New filename tags: manylinux_2_17_aarch64, manylinux2014_aarch64 INFO:auditwheel.wheeltools:Previous WHEEL info tags: cp311-cp311-linux_aarch64 INFO:auditwheel.wheeltools:New WHEEL info tags: cp311-cp311-manylinux_2_17_aarch64, cp311-cp311-manylinux2014_aarch64 INFO:auditwheel.main_repair: Fixed-up wheel written to /tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 1..6 ok 1 Wheel is manylinux2014 (manylinux_2_17) compliant in 51080ms # Size of /tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl is 217 / 580 megabytes. ok 2 Wheel conforms to upstream size limitations in 15ms not ok 3 Wheel is installable in 9850ms # (in test file /usertools/wheel_verification.bats, line 62) # `python3 -m pip install --only-binary grpcio "$TF_WHEEL"' failed # Processing ./tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl # Collecting absl-py>=1.0.0 # Downloading absl_py-1.4.0-py3-none-any.whl (126 kB) # ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 126.5/126.5 kB 10.0 MB/s eta 0:00:00 # Collecting astunparse>=1.6.0 # Downloading astunparse-1.6.3-py2.py3-none-any.whl (12 kB) # Collecting flatbuffers>=2.0 # Downloading flatbuffers-23.1.21-py2.py3-none-any.whl (26 kB) # Collecting gast<=0.4.0,>=0.2.1 # Downloading gast-0.4.0-py3-none-any.whl (9.8 kB) # Collecting google-pasta>=0.1.1 # Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB) # ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.5/57.5 kB 8.5 MB/s eta 0:00:00 # ERROR: Could not find a version that satisfies the requirement grpcio<2.0,>=1.24.3 (from tensorflow) (from versions: none) # ERROR: No matching distribution found for grpcio<2.0,>=1.24.3 # # [notice] A new release of pip available: 22.3.1 -> 23.0 # [notice] To update, run: pip install --upgrade pip not ok 4 TensorFlow is importable in 39ms # (in test file /usertools/wheel_verification.bats, line 67) # `python3 -c 'import tensorflow as tf; t1=tf.constant([1,2,3,4]); t2=tf.constant([5,6,7,8]); print(tf.add(t1,t2).shape)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' not ok 5 TensorFlow has Keras in 39ms # (in test file /usertools/wheel_verification.bats, line 73) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "_v2.keras" in tf.keras.__name__ else 1)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' not ok 6 TensorFlow has Estimator in 38ms # (in test file /usertools/wheel_verification.bats, line 79) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "_v2.estimator" in tf.estimator.__name__ else 1)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=136 changed=104 unreachable=0 failed=1 skipped=13 rescued=0 ignored=4
Thursday 02 February 2023 15:03:57 +0000 (0:02:58.792) 3:53:22.200 ***** =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow git tests ------ 4111.60s tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 3086.60s tensorflow_in_container : (Python 3.11) run TensorFlow git tests ----- 1487.89s tensorflow_in_container : (Python 3.10) run TensorFlow git tests ----- 1309.20s tensorflow_in_container : (Python 3.9) run TensorFlow git tests ------ 1273.51s tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one - 289.75s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 270.71s tensorflow_in_container : (Python 3.10) Convert wheel to manylinux2014 compatible one - 269.34s tensorflow_in_container : (Python 3.10) stop build container ---------- 217.40s tensorflow_in_container : (Python 3.8) stop build container ----------- 208.42s tensorflow_in_container : (Python 3.9) stop build container ----------- 208.33s tensorflow_in_container : (Python 3.10) build TensorFlow git ---------- 192.55s tensorflow_in_container : (Python 3.9) build TensorFlow git ----------- 183.86s tensorflow_in_container : (Python 3.11) build TensorFlow git ---------- 180.68s tensorflow_in_container : (Python 3.11) Convert wheel to manylinux2014 compatible one - 178.79s tensorflow_in_container : (Python 3.9) build Python package ------------ 97.98s tensorflow_in_container : (Python 3.8) build Python package ------------ 95.35s tensorflow_in_container : (Python 3.10) build Python package ----------- 94.95s tensorflow_in_container : (Python 3.11) build Python package ----------- 94.81s tensorflow : Fetch TensorFlow from git --------------------------------- 27.27s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/676/display/redirect
Changes:
------------------------------------------ [...truncated 1.82 MB...] Stats over 17 runs: max = 900.1s, min = 9.7s, avg = 67.1s, dev = 208.3s /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/data/experimental/kernel_tests/service/worker_tags_test/shard_14_of_16/test_attempts/attempt_1.log //tensorflow/python/data/kernel_tests:map_test PASSED in 30.6s Stats over 19 runs: max = 30.6s, min = 14.8s, avg = 21.0s, dev = 4.5s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 7.2s Stats over 20 runs: max = 7.2s, min = 3.2s, avg = 5.0s, dev = 1.3s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 9.4s Stats over 20 runs: max = 9.4s, min = 3.4s, avg = 6.6s, dev = 2.1s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 13.0s Stats over 20 runs: max = 13.0s, min = 3.9s, avg = 6.6s, dev = 2.2s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 14.7s Stats over 20 runs: max = 14.7s, min = 6.3s, avg = 8.4s, dev = 1.9s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 7.2s Stats over 20 runs: max = 7.2s, min = 5.7s, avg = 6.3s, dev = 0.5s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 14.9s Stats over 20 runs: max = 14.9s, min = 10.9s, avg = 12.4s, dev = 1.0s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 11.0s Stats over 20 runs: max = 11.0s, min = 8.6s, avg = 9.7s, dev = 0.7s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 45.0s Stats over 20 runs: max = 45.0s, min = 6.9s, avg = 16.0s, dev = 11.8s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 42.8s Stats over 20 runs: max = 42.8s, min = 38.7s, avg = 41.0s, dev = 1.1s //tensorflow/python/kernel_tests:metrics_test PASSED in 50.6s Stats over 20 runs: max = 50.6s, min = 14.0s, avg = 26.3s, dev = 10.0s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 9.8s Stats over 20 runs: max = 9.8s, min = 3.8s, avg = 7.0s, dev = 2.1s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 15.0s Stats over 20 runs: max = 15.0s, min = 5.5s, avg = 7.9s, dev = 2.5s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 54.6s Stats over 20 runs: max = 54.6s, min = 7.4s, avg = 19.9s, dev = 13.7s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 101.1s Stats over 20 runs: max = 101.1s, min = 29.2s, avg = 55.5s, dev = 19.6s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 7.7s Stats over 20 runs: max = 7.7s, min = 3.7s, avg = 5.4s, dev = 1.2s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 16.7s Stats over 20 runs: max = 16.7s, min = 8.1s, avg = 12.5s, dev = 2.9s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 199.1s Stats over 20 runs: max = 199.1s, min = 34.8s, avg = 100.7s, dev = 51.4s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 26.5s Stats over 20 runs: max = 26.5s, min = 5.7s, avg = 12.9s, dev = 5.3s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 24.3s Stats over 20 runs: max = 24.3s, min = 6.6s, avg = 15.1s, dev = 5.7s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 17.6s Stats over 20 runs: max = 17.6s, min = 13.4s, avg = 15.8s, dev = 1.1s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 90.7s Stats over 20 runs: max = 90.7s, min = 7.1s, avg = 34.8s, dev = 27.8s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 35.5s Stats over 20 runs: max = 35.5s, min = 11.5s, avg = 17.2s, dev = 5.1s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 22.2s Stats over 24 runs: max = 22.2s, min = 11.6s, avg = 17.6s, dev = 3.5s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 21.8s Stats over 24 runs: max = 21.8s, min = 8.9s, avg = 14.7s, dev = 3.3s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 25.3s Stats over 24 runs: max = 25.3s, min = 10.6s, avg = 15.4s, dev = 4.0s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 10.2s Stats over 25 runs: max = 10.2s, min = 6.5s, avg = 7.5s, dev = 0.8s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 35.6s Stats over 25 runs: max = 35.6s, min = 6.6s, avg = 11.5s, dev = 7.3s //tensorflow/dtensor/python/tests:spmd_test_cpu PASSED in 36.5s Stats over 25 runs: max = 36.5s, min = 22.9s, avg = 29.6s, dev = 3.7s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 7.5s Stats over 30 runs: max = 7.5s, min = 6.2s, avg = 6.9s, dev = 0.5s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 15.2s Stats over 30 runs: max = 15.2s, min = 12.4s, avg = 13.4s, dev = 0.6s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 10.2s Stats over 30 runs: max = 10.2s, min = 8.0s, avg = 9.1s, dev = 0.7s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 8.7s Stats over 30 runs: max = 8.7s, min = 6.9s, avg = 7.7s, dev = 0.5s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 16.8s Stats over 30 runs: max = 16.8s, min = 3.1s, avg = 7.7s, dev = 3.6s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 7.8s Stats over 31 runs: max = 7.8s, min = 6.3s, avg = 7.0s, dev = 0.4s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 9.3s Stats over 32 runs: max = 9.3s, min = 6.0s, avg = 7.3s, dev = 0.8s //tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 18.9s Stats over 32 runs: max = 18.9s, min = 4.8s, avg = 12.1s, dev = 3.6s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 23.7s Stats over 32 runs: max = 23.7s, min = 8.4s, avg = 16.6s, dev = 4.5s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 10.3s Stats over 40 runs: max = 10.3s, min = 7.9s, avg = 8.9s, dev = 0.7s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 7.7s Stats over 40 runs: max = 7.7s, min = 5.5s, avg = 6.7s, dev = 0.7s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 9.8s Stats over 40 runs: max = 9.8s, min = 6.6s, avg = 8.0s, dev = 0.8s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 13.6s Stats over 40 runs: max = 13.6s, min = 9.6s, avg = 11.4s, dev = 0.8s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 112.9s Stats over 50 runs: max = 112.9s, min = 29.7s, avg = 58.2s, dev = 29.0s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 44.8s Stats over 50 runs: max = 44.8s, min = 3.3s, avg = 13.1s, dev = 8.4s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 37.3s Stats over 50 runs: max = 37.3s, min = 3.0s, avg = 10.1s, dev = 7.5s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 9.2s Stats over 50 runs: max = 9.2s, min = 6.7s, avg = 7.7s, dev = 0.5s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 12.5s Stats over 50 runs: max = 12.5s, min = 8.6s, avg = 10.5s, dev = 0.8s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 15.5s Stats over 50 runs: max = 15.5s, min = 8.6s, avg = 11.7s, dev = 1.6s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 20.4s Stats over 50 runs: max = 20.4s, min = 3.9s, avg = 11.3s, dev = 5.0s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 6.3s Stats over 50 runs: max = 6.3s, min = 2.8s, avg = 3.7s, dev = 0.9s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 11.1s Stats over 50 runs: max = 11.1s, min = 3.0s, avg = 4.4s, dev = 1.7s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 59.1s Stats over 50 runs: max = 59.1s, min = 10.0s, avg = 26.8s, dev = 10.9s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 13.4s Stats over 50 runs: max = 13.4s, min = 3.2s, avg = 4.4s, dev = 1.6s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 11.8s Stats over 50 runs: max = 11.8s, min = 3.0s, avg = 4.5s, dev = 1.8s
Executed 3576 out of 3577 tests: 3576 tests pass and 1 fails to build. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.11) collect list of installed Python packages] *** Thursday 02 February 2023 21:47:45 +0000 (0:25:20.798) 3:37:41.630 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save list of installed Python packages] *** Thursday 02 February 2023 21:47:47 +0000 (0:00:02.029) 3:37:43.659 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save tests output to file] ******* Thursday 02 February 2023 21:47:48 +0000 (0:00:00.707) 3:37:44.367 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save tests stderr output to file] *** Thursday 02 February 2023 21:47:49 +0000 (0:00:00.696) 3:37:45.063 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Extract number of tests run] ***** Thursday 02 February 2023 21:47:50 +0000 (0:00:00.691) 3:37:45.755 ***** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Show number of tests run] ******** Thursday 02 February 2023 21:47:50 +0000 (0:00:00.080) 3:37:45.836 ***** ok: [localhost] => ut_tests_line: ''
TASK [tensorflow_in_container : (Python 3.11) Extract failed tests] ************ Thursday 02 February 2023 21:47:50 +0000 (0:00:00.046) 3:37:45.882 ***** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Show which tests failed] ********* Thursday 02 February 2023 21:47:50 +0000 (0:00:00.097) 3:37:45.980 ***** ok: [localhost] => tests_failed: 'FAILED: '
TASK [tensorflow_in_container : (Python 3.11) Convert wheel to manylinux2014 compatible one] *** Thursday 02 February 2023 21:47:50 +0000 (0:00:00.047) 3:37:46.027 ***** fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- + for wheel in /tf/pkg/*.whl + echo 'Checking and renaming /tf/pkg/tensorflow-2.12.0-cp311-cp311-linux_aarch64.whl...' + python3 -m auditwheel repair --plat manylinux2014_aarch64 /tf/pkg/tensorflow-2.12.0-cp311-cp311-linux_aarch64.whl --wheel-dir /tf/pkg + tee check.txt
real 1m56.227s user 1m43.485s sys 0m12.684s ++ grep --extended-regexp --only-matching '/tf/pkg/\S+.whl' check.txt + new_wheel=/tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + [[ /tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl != /\t\f/\p\k\g/\t\e\n\s\o\r\f\l\o\w-\2.\1\2.\0-\c\p\3\1\1-\c\p\3\1\1-\l\i\n\u\x_\a\a\r\c\h\6\4.\w\h\l ]] + rm /tf/pkg/tensorflow-2.12.0-cp311-cp311-linux_aarch64.whl + wheel=/tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + TF_WHEEL=/tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + bats /usertools/wheel_verification.bats --timing stderr_lines: <omitted> stdout: |- Checking and renaming /tf/pkg/tensorflow-2.12.0-cp311-cp311-linux_aarch64.whl... INFO:auditwheel.main_repair:Repairing tensorflow-2.12.0-cp311-cp311-linux_aarch64.whl INFO:auditwheel.wheeltools:Previous filename tags: linux_aarch64 INFO:auditwheel.wheeltools:New filename tags: manylinux_2_17_aarch64, manylinux2014_aarch64 INFO:auditwheel.wheeltools:Previous WHEEL info tags: cp311-cp311-linux_aarch64 INFO:auditwheel.wheeltools:New WHEEL info tags: cp311-cp311-manylinux_2_17_aarch64, cp311-cp311-manylinux2014_aarch64 INFO:auditwheel.main_repair: Fixed-up wheel written to /tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 1..6 ok 1 Wheel is manylinux2014 (manylinux_2_17) compliant in 51194ms # Size of /tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl is 217 / 580 megabytes. ok 2 Wheel conforms to upstream size limitations in 14ms not ok 3 Wheel is installable in 9704ms # (in test file /usertools/wheel_verification.bats, line 62) # `python3 -m pip install --only-binary grpcio "$TF_WHEEL"' failed # Processing ./tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl # Collecting absl-py>=1.0.0 # Using cached absl_py-1.4.0-py3-none-any.whl (126 kB) # Collecting astunparse>=1.6.0 # Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB) # Collecting flatbuffers>=2.0 # Using cached flatbuffers-23.1.21-py2.py3-none-any.whl (26 kB) # Collecting gast<=0.4.0,>=0.2.1 # Using cached gast-0.4.0-py3-none-any.whl (9.8 kB) # Collecting google-pasta>=0.1.1 # Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB) # ERROR: Could not find a version that satisfies the requirement grpcio<2.0,>=1.24.3 (from tensorflow) (from versions: none) # ERROR: No matching distribution found for grpcio<2.0,>=1.24.3 # # [notice] A new release of pip available: 22.3.1 -> 23.0 # [notice] To update, run: pip install --upgrade pip not ok 4 TensorFlow is importable in 40ms # (in test file /usertools/wheel_verification.bats, line 67) # `python3 -c 'import tensorflow as tf; t1=tf.constant([1,2,3,4]); t2=tf.constant([5,6,7,8]); print(tf.add(t1,t2).shape)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' not ok 5 TensorFlow has Keras in 38ms # (in test file /usertools/wheel_verification.bats, line 73) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "_v2.keras" in tf.keras.__name__ else 1)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' not ok 6 TensorFlow has Estimator in 39ms # (in test file /usertools/wheel_verification.bats, line 79) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "_v2.estimator" in tf.estimator.__name__ else 1)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=136 changed=104 unreachable=0 failed=1 skipped=13 rescued=0 ignored=4
Thursday 02 February 2023 21:50:48 +0000 (0:02:58.416) 3:40:44.443 ***** =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow git tests ------ 3517.80s tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 2368.00s tensorflow_in_container : (Python 3.9) run TensorFlow git tests ------ 1706.41s tensorflow_in_container : (Python 3.11) run TensorFlow git tests ----- 1520.80s tensorflow_in_container : (Python 3.10) run TensorFlow git tests ----- 1428.10s tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one - 293.76s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 271.77s tensorflow_in_container : (Python 3.10) Convert wheel to manylinux2014 compatible one - 266.42s tensorflow_in_container : (Python 3.8) stop build container ----------- 211.12s tensorflow_in_container : (Python 3.10) stop build container ---------- 209.52s tensorflow_in_container : (Python 3.9) stop build container ----------- 208.35s tensorflow_in_container : (Python 3.10) build TensorFlow git ---------- 179.16s tensorflow_in_container : (Python 3.11) Convert wheel to manylinux2014 compatible one - 178.42s tensorflow_in_container : (Python 3.9) build TensorFlow git ----------- 177.07s tensorflow_in_container : (Python 3.11) build TensorFlow git ---------- 167.63s tensorflow_in_container : (Python 3.10) build Python package ----------- 97.43s tensorflow_in_container : (Python 3.9) build Python package ------------ 95.42s tensorflow_in_container : (Python 3.8) build Python package ------------ 94.12s tensorflow_in_container : (Python 3.11) build Python package ----------- 93.94s tensorflow : Fetch TensorFlow from git --------------------------------- 28.71s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/677/display/redirect
Changes:
------------------------------------------ [...truncated 1.78 MB...] //tensorflow/python/data/kernel_tests:map_test PASSED in 44.6s Stats over 19 runs: max = 44.6s, min = 25.6s, avg = 35.7s, dev = 5.5s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 8.1s Stats over 20 runs: max = 8.1s, min = 4.0s, avg = 5.2s, dev = 0.9s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 12.1s Stats over 20 runs: max = 12.1s, min = 4.7s, avg = 6.9s, dev = 1.8s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 11.8s Stats over 20 runs: max = 11.8s, min = 3.1s, avg = 5.2s, dev = 2.1s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 12.7s Stats over 20 runs: max = 12.7s, min = 3.4s, avg = 6.6s, dev = 1.9s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 8.7s Stats over 20 runs: max = 8.7s, min = 5.8s, avg = 7.3s, dev = 0.8s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 12.8s Stats over 20 runs: max = 12.8s, min = 9.0s, avg = 10.4s, dev = 0.9s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 11.6s Stats over 20 runs: max = 11.6s, min = 9.5s, avg = 10.5s, dev = 0.6s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 46.2s Stats over 20 runs: max = 46.2s, min = 7.3s, avg = 16.8s, dev = 11.5s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 21.0s Stats over 20 runs: max = 21.0s, min = 13.4s, avg = 18.1s, dev = 2.3s //tensorflow/python/kernel_tests:metrics_test PASSED in 47.9s Stats over 20 runs: max = 47.9s, min = 10.0s, avg = 21.0s, dev = 11.0s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 6.8s Stats over 20 runs: max = 6.8s, min = 2.8s, avg = 4.6s, dev = 1.2s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 13.2s Stats over 20 runs: max = 13.2s, min = 3.4s, avg = 7.0s, dev = 2.6s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 43.4s Stats over 20 runs: max = 43.4s, min = 4.0s, avg = 14.0s, dev = 13.5s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 102.7s Stats over 20 runs: max = 102.7s, min = 27.4s, avg = 50.2s, dev = 20.4s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 7.6s Stats over 20 runs: max = 7.6s, min = 3.9s, avg = 6.3s, dev = 1.1s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 14.5s Stats over 20 runs: max = 14.5s, min = 5.7s, avg = 10.3s, dev = 2.9s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 234.2s Stats over 20 runs: max = 234.2s, min = 35.6s, avg = 105.8s, dev = 60.3s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 25.9s Stats over 20 runs: max = 25.9s, min = 4.9s, avg = 12.8s, dev = 6.1s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 21.2s Stats over 20 runs: max = 21.2s, min = 5.5s, avg = 13.5s, dev = 6.2s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 31.9s Stats over 20 runs: max = 31.9s, min = 18.7s, avg = 25.1s, dev = 4.3s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 72.3s Stats over 20 runs: max = 72.3s, min = 7.4s, avg = 31.1s, dev = 22.5s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 20.8s Stats over 20 runs: max = 20.8s, min = 3.1s, avg = 6.4s, dev = 4.2s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 23.7s Stats over 24 runs: max = 23.7s, min = 9.4s, avg = 16.0s, dev = 3.5s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 29.2s Stats over 24 runs: max = 29.2s, min = 9.8s, avg = 16.8s, dev = 5.7s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 22.2s Stats over 24 runs: max = 22.2s, min = 4.6s, avg = 10.4s, dev = 5.0s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 10.5s Stats over 25 runs: max = 10.5s, min = 6.5s, avg = 8.2s, dev = 0.9s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 41.4s Stats over 25 runs: max = 41.4s, min = 11.9s, avg = 16.5s, dev = 6.9s //tensorflow/dtensor/python/tests:spmd_test_cpu PASSED in 30.1s Stats over 25 runs: max = 30.1s, min = 19.3s, avg = 25.8s, dev = 3.2s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 8.2s Stats over 30 runs: max = 8.2s, min = 6.0s, avg = 7.1s, dev = 0.6s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 14.7s Stats over 30 runs: max = 14.7s, min = 13.0s, avg = 13.5s, dev = 0.4s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 9.4s Stats over 30 runs: max = 9.4s, min = 7.6s, avg = 8.5s, dev = 0.6s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 7.1s Stats over 30 runs: max = 7.1s, min = 5.8s, avg = 6.3s, dev = 0.3s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 13.6s Stats over 30 runs: max = 13.6s, min = 3.6s, avg = 7.8s, dev = 2.6s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 9.2s Stats over 31 runs: max = 9.2s, min = 7.6s, avg = 8.4s, dev = 0.4s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 10.9s Stats over 32 runs: max = 10.9s, min = 7.3s, avg = 8.7s, dev = 0.8s //tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 18.3s Stats over 32 runs: max = 18.3s, min = 5.0s, avg = 12.8s, dev = 3.5s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 20.3s Stats over 32 runs: max = 20.3s, min = 7.5s, avg = 13.8s, dev = 3.5s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 10.1s Stats over 40 runs: max = 10.1s, min = 7.0s, avg = 8.2s, dev = 0.7s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 15.4s Stats over 40 runs: max = 15.4s, min = 7.6s, avg = 10.3s, dev = 2.2s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 11.7s Stats over 40 runs: max = 11.7s, min = 7.4s, avg = 9.7s, dev = 1.0s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 11.1s Stats over 40 runs: max = 11.1s, min = 7.2s, avg = 8.3s, dev = 0.8s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 105.3s Stats over 50 runs: max = 105.3s, min = 26.0s, avg = 52.4s, dev = 28.6s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 39.8s Stats over 50 runs: max = 39.8s, min = 2.8s, avg = 10.9s, dev = 8.2s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 46.5s Stats over 50 runs: max = 46.5s, min = 2.9s, avg = 12.8s, dev = 8.9s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 10.1s Stats over 50 runs: max = 10.1s, min = 6.3s, avg = 8.2s, dev = 0.8s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 12.7s Stats over 50 runs: max = 12.7s, min = 10.2s, avg = 11.9s, dev = 0.5s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 12.3s Stats over 50 runs: max = 12.3s, min = 7.7s, avg = 9.9s, dev = 1.2s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 11.9s Stats over 50 runs: max = 11.9s, min = 4.1s, avg = 7.0s, dev = 1.9s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 7.1s Stats over 50 runs: max = 7.1s, min = 3.1s, avg = 4.3s, dev = 0.8s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 6.3s Stats over 50 runs: max = 6.3s, min = 2.9s, avg = 4.1s, dev = 0.9s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 26.4s Stats over 50 runs: max = 26.4s, min = 6.6s, avg = 13.7s, dev = 5.0s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 10.1s Stats over 50 runs: max = 10.1s, min = 3.5s, avg = 4.9s, dev = 1.3s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 14.8s Stats over 50 runs: max = 14.8s, min = 2.9s, avg = 6.0s, dev = 3.6s
Executed 3580 out of 3581 tests: 3580 tests pass and 1 fails to build. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.11) collect list of installed Python packages] *** Friday 03 February 2023 22:00:38 +0000 (0:23:58.312) 3:50:34.012 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save list of installed Python packages] *** Friday 03 February 2023 22:00:40 +0000 (0:00:02.107) 3:50:36.120 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save tests output to file] ******* Friday 03 February 2023 22:00:41 +0000 (0:00:00.694) 3:50:36.815 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save tests stderr output to file] *** Friday 03 February 2023 22:00:42 +0000 (0:00:00.730) 3:50:37.546 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Extract number of tests run] ***** Friday 03 February 2023 22:00:42 +0000 (0:00:00.689) 3:50:38.236 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Show number of tests run] ******** Friday 03 February 2023 22:00:42 +0000 (0:00:00.080) 3:50:38.316 ******* ok: [localhost] => ut_tests_line: ''
TASK [tensorflow_in_container : (Python 3.11) Extract failed tests] ************ Friday 03 February 2023 22:00:42 +0000 (0:00:00.046) 3:50:38.363 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Show which tests failed] ********* Friday 03 February 2023 22:00:43 +0000 (0:00:00.070) 3:50:38.433 ******* ok: [localhost] => tests_failed: 'FAILED: '
TASK [tensorflow_in_container : (Python 3.11) Convert wheel to manylinux2014 compatible one] *** Friday 03 February 2023 22:00:43 +0000 (0:00:00.047) 3:50:38.480 ******* fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- + for wheel in /tf/pkg/*.whl + echo 'Checking and renaming /tf/pkg/tensorflow-2.12.0-cp311-cp311-linux_aarch64.whl...' + python3 -m auditwheel repair --plat manylinux2014_aarch64 /tf/pkg/tensorflow-2.12.0-cp311-cp311-linux_aarch64.whl --wheel-dir /tf/pkg + tee check.txt
real 1m56.703s user 1m42.941s sys 0m13.643s ++ grep --extended-regexp --only-matching '/tf/pkg/\S+.whl' check.txt + new_wheel=/tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + [[ /tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl != /\t\f/\p\k\g/\t\e\n\s\o\r\f\l\o\w-\2.\1\2.\0-\c\p\3\1\1-\c\p\3\1\1-\l\i\n\u\x_\a\a\r\c\h\6\4.\w\h\l ]] + rm /tf/pkg/tensorflow-2.12.0-cp311-cp311-linux_aarch64.whl + wheel=/tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + TF_WHEEL=/tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + bats /usertools/wheel_verification.bats --timing stderr_lines: <omitted> stdout: |- Checking and renaming /tf/pkg/tensorflow-2.12.0-cp311-cp311-linux_aarch64.whl... INFO:auditwheel.main_repair:Repairing tensorflow-2.12.0-cp311-cp311-linux_aarch64.whl INFO:auditwheel.wheeltools:Previous filename tags: linux_aarch64 INFO:auditwheel.wheeltools:New filename tags: manylinux_2_17_aarch64, manylinux2014_aarch64 INFO:auditwheel.wheeltools:Previous WHEEL info tags: cp311-cp311-linux_aarch64 INFO:auditwheel.wheeltools:New WHEEL info tags: cp311-cp311-manylinux_2_17_aarch64, cp311-cp311-manylinux2014_aarch64 INFO:auditwheel.main_repair: Fixed-up wheel written to /tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 1..6 ok 1 Wheel is manylinux2014 (manylinux_2_17) compliant in 51327ms # Size of /tf/pkg/tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl is 217 / 580 megabytes. ok 2 Wheel conforms to upstream size limitations in 14ms not ok 3 Wheel is installable in 9788ms # (in test file /usertools/wheel_verification.bats, line 62) # `python3 -m pip install --only-binary grpcio "$TF_WHEEL"' failed # Processing ./tensorflow-2.12.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl # Collecting absl-py>=1.0.0 # Downloading absl_py-1.4.0-py3-none-any.whl (126 kB) # ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 126.5/126.5 kB 7.5 MB/s eta 0:00:00 # Collecting astunparse>=1.6.0 # Downloading astunparse-1.6.3-py2.py3-none-any.whl (12 kB) # Collecting flatbuffers>=2.0 # Downloading flatbuffers-23.1.21-py2.py3-none-any.whl (26 kB) # Collecting gast<=0.4.0,>=0.2.1 # Downloading gast-0.4.0-py3-none-any.whl (9.8 kB) # Collecting google-pasta>=0.1.1 # Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB) # ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.5/57.5 kB 8.3 MB/s eta 0:00:00 # ERROR: Could not find a version that satisfies the requirement grpcio<2.0,>=1.24.3 (from tensorflow) (from versions: none) # ERROR: No matching distribution found for grpcio<2.0,>=1.24.3 # # [notice] A new release of pip available: 22.3.1 -> 23.0 # [notice] To update, run: pip install --upgrade pip not ok 4 TensorFlow is importable in 40ms # (in test file /usertools/wheel_verification.bats, line 67) # `python3 -c 'import tensorflow as tf; t1=tf.constant([1,2,3,4]); t2=tf.constant([5,6,7,8]); print(tf.add(t1,t2).shape)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' not ok 5 TensorFlow has Keras in 39ms # (in test file /usertools/wheel_verification.bats, line 73) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "_v2.keras" in tf.keras.__name__ else 1)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' not ok 6 TensorFlow has Estimator in 38ms # (in test file /usertools/wheel_verification.bats, line 79) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "_v2.estimator" in tf.estimator.__name__ else 1)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=136 changed=104 unreachable=0 failed=1 skipped=13 rescued=0 ignored=4
Friday 03 February 2023 22:03:42 +0000 (0:02:59.146) 3:53:37.627 ******* =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow git tests ------ 3871.63s tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 2825.84s tensorflow_in_container : (Python 3.11) run TensorFlow git tests ----- 1438.31s tensorflow_in_container : (Python 3.10) run TensorFlow git tests ----- 1338.35s tensorflow_in_container : (Python 3.9) run TensorFlow git tests ------ 1323.64s tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one - 294.85s tensorflow_in_container : (Python 3.11) start build container --------- 273.33s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 271.24s tensorflow_in_container : (Python 3.10) Convert wheel to manylinux2014 compatible one - 266.30s tensorflow_in_container : (Python 3.11) install Python packages ------- 239.20s tensorflow_in_container : (Python 3.8) stop build container ----------- 216.61s tensorflow_in_container : (Python 3.9) stop build container ----------- 208.60s tensorflow_in_container : (Python 3.10) stop build container ---------- 207.63s tensorflow_in_container : (Python 3.9) build TensorFlow git ----------- 180.98s tensorflow_in_container : (Python 3.11) Convert wheel to manylinux2014 compatible one - 179.15s tensorflow_in_container : (Python 3.11) build TensorFlow git ---------- 175.21s tensorflow_in_container : (Python 3.10) build TensorFlow git ---------- 172.15s tensorflow_in_container : (Python 3.9) build Python package ------------ 97.85s tensorflow_in_container : (Python 3.8) build Python package ------------ 95.47s tensorflow_in_container : (Python 3.10) build Python package ----------- 93.69s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/678/display/redirect
Changes:
------------------------------------------ [...truncated 1.76 MB...] //tensorflow/python/data/kernel_tests:map_test PASSED in 31.4s Stats over 19 runs: max = 31.4s, min = 11.1s, avg = 19.9s, dev = 5.6s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 7.1s Stats over 20 runs: max = 7.1s, min = 2.9s, avg = 4.8s, dev = 1.1s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 8.0s Stats over 20 runs: max = 8.0s, min = 3.0s, avg = 5.4s, dev = 1.4s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 10.9s Stats over 20 runs: max = 10.9s, min = 3.3s, avg = 4.7s, dev = 1.9s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 12.8s Stats over 20 runs: max = 12.8s, min = 3.3s, avg = 5.7s, dev = 2.3s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 7.9s Stats over 20 runs: max = 7.9s, min = 5.9s, avg = 6.5s, dev = 0.6s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 13.1s Stats over 20 runs: max = 13.1s, min = 8.4s, avg = 10.6s, dev = 1.1s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 11.9s Stats over 20 runs: max = 11.9s, min = 9.4s, avg = 10.4s, dev = 0.7s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 44.0s Stats over 20 runs: max = 44.0s, min = 6.0s, avg = 14.6s, dev = 11.3s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 34.7s Stats over 20 runs: max = 34.7s, min = 16.2s, avg = 22.8s, dev = 4.3s //tensorflow/python/kernel_tests:metrics_test PASSED in 51.5s Stats over 20 runs: max = 51.5s, min = 10.2s, avg = 24.1s, dev = 12.8s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 6.3s Stats over 20 runs: max = 6.3s, min = 2.8s, avg = 4.6s, dev = 1.0s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 15.0s Stats over 20 runs: max = 15.0s, min = 2.9s, avg = 7.2s, dev = 2.9s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 41.0s Stats over 20 runs: max = 41.0s, min = 3.4s, avg = 13.2s, dev = 12.3s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 102.4s Stats over 20 runs: max = 102.4s, min = 27.5s, avg = 51.1s, dev = 19.3s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 7.0s Stats over 20 runs: max = 7.0s, min = 3.7s, avg = 4.5s, dev = 0.7s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 15.0s Stats over 20 runs: max = 15.0s, min = 7.4s, avg = 11.1s, dev = 2.7s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 225.9s Stats over 20 runs: max = 225.9s, min = 37.2s, avg = 104.8s, dev = 57.8s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 22.4s Stats over 20 runs: max = 22.4s, min = 5.3s, avg = 10.4s, dev = 5.2s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 20.4s Stats over 20 runs: max = 20.4s, min = 5.2s, avg = 12.5s, dev = 5.8s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 14.9s Stats over 20 runs: max = 14.9s, min = 12.5s, avg = 13.9s, dev = 0.7s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 77.5s Stats over 20 runs: max = 77.5s, min = 7.0s, avg = 32.9s, dev = 24.8s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 21.8s Stats over 20 runs: max = 21.8s, min = 4.5s, avg = 7.5s, dev = 4.0s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 21.7s Stats over 24 runs: max = 21.7s, min = 9.6s, avg = 16.1s, dev = 3.1s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 31.7s Stats over 24 runs: max = 31.7s, min = 8.1s, avg = 16.0s, dev = 6.3s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 29.6s Stats over 24 runs: max = 29.6s, min = 4.0s, avg = 10.9s, dev = 5.6s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 17.9s Stats over 25 runs: max = 17.9s, min = 7.1s, avg = 10.5s, dev = 3.0s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 34.4s Stats over 25 runs: max = 34.4s, min = 6.6s, avg = 11.5s, dev = 7.4s //tensorflow/dtensor/python/tests:spmd_test_cpu PASSED in 35.9s Stats over 25 runs: max = 35.9s, min = 22.1s, avg = 29.1s, dev = 3.8s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 12.5s Stats over 30 runs: max = 12.5s, min = 8.5s, avg = 10.1s, dev = 0.6s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 15.4s Stats over 30 runs: max = 15.4s, min = 13.0s, avg = 14.0s, dev = 0.6s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 8.4s Stats over 30 runs: max = 8.4s, min = 5.8s, avg = 7.2s, dev = 0.7s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 12.8s Stats over 30 runs: max = 12.8s, min = 5.9s, avg = 7.8s, dev = 1.5s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 16.2s Stats over 30 runs: max = 16.2s, min = 3.1s, avg = 7.1s, dev = 3.1s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 18.4s Stats over 31 runs: max = 18.4s, min = 8.5s, avg = 12.4s, dev = 2.4s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 8.5s Stats over 32 runs: max = 8.5s, min = 5.8s, avg = 6.5s, dev = 0.6s //tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 22.9s Stats over 32 runs: max = 22.9s, min = 4.5s, avg = 14.5s, dev = 4.1s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 27.5s Stats over 32 runs: max = 27.5s, min = 11.0s, avg = 20.0s, dev = 4.2s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 9.3s Stats over 40 runs: max = 9.3s, min = 6.5s, avg = 7.9s, dev = 0.8s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 8.5s Stats over 40 runs: max = 8.5s, min = 6.2s, avg = 7.2s, dev = 0.5s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 15.9s Stats over 40 runs: max = 15.9s, min = 7.9s, avg = 11.4s, dev = 2.1s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 12.7s Stats over 40 runs: max = 12.7s, min = 8.2s, avg = 9.8s, dev = 0.8s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 108.7s Stats over 50 runs: max = 108.7s, min = 25.6s, avg = 56.1s, dev = 29.2s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 41.9s Stats over 50 runs: max = 41.9s, min = 2.8s, avg = 10.8s, dev = 8.2s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 45.2s Stats over 50 runs: max = 45.2s, min = 2.7s, avg = 10.0s, dev = 8.7s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 10.7s Stats over 50 runs: max = 10.7s, min = 6.6s, avg = 8.4s, dev = 0.8s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 13.5s Stats over 50 runs: max = 13.5s, min = 12.5s, avg = 13.1s, dev = 0.3s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 15.6s Stats over 50 runs: max = 15.6s, min = 8.1s, avg = 10.2s, dev = 1.4s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 12.8s Stats over 50 runs: max = 12.8s, min = 4.1s, avg = 7.8s, dev = 2.4s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 7.4s Stats over 50 runs: max = 7.4s, min = 3.1s, avg = 4.8s, dev = 1.3s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 7.3s Stats over 50 runs: max = 7.3s, min = 3.0s, avg = 4.1s, dev = 1.0s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 27.2s Stats over 50 runs: max = 27.2s, min = 6.6s, avg = 13.8s, dev = 5.1s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 13.4s Stats over 50 runs: max = 13.4s, min = 3.0s, avg = 5.0s, dev = 1.6s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 11.1s Stats over 50 runs: max = 11.1s, min = 2.9s, avg = 5.0s, dev = 2.3s
Executed 3581 out of 3582 tests: 3581 tests pass and 1 fails to build. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.11) collect list of installed Python packages] *** Saturday 04 February 2023 21:43:02 +0000 (0:23:13.495) 3:32:57.985 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save list of installed Python packages] *** Saturday 04 February 2023 21:43:04 +0000 (0:00:02.057) 3:33:00.043 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save tests output to file] ******* Saturday 04 February 2023 21:43:05 +0000 (0:00:00.695) 3:33:00.738 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save tests stderr output to file] *** Saturday 04 February 2023 21:43:05 +0000 (0:00:00.692) 3:33:01.431 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Extract number of tests run] ***** Saturday 04 February 2023 21:43:06 +0000 (0:00:00.689) 3:33:02.120 ***** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Show number of tests run] ******** Saturday 04 February 2023 21:43:06 +0000 (0:00:00.076) 3:33:02.197 ***** ok: [localhost] => ut_tests_line: ''
TASK [tensorflow_in_container : (Python 3.11) Extract failed tests] ************ Saturday 04 February 2023 21:43:06 +0000 (0:00:00.046) 3:33:02.244 ***** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Show which tests failed] ********* Saturday 04 February 2023 21:43:06 +0000 (0:00:00.067) 3:33:02.311 ***** ok: [localhost] => tests_failed: 'FAILED: '
TASK [tensorflow_in_container : (Python 3.11) Convert wheel to manylinux2014 compatible one] *** Saturday 04 February 2023 21:43:06 +0000 (0:00:00.046) 3:33:02.358 ***** fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- + for wheel in /tf/pkg/*.whl + echo 'Checking and renaming /tf/pkg/tensorflow-2.13.0-cp311-cp311-linux_aarch64.whl...' + python3 -m auditwheel repair --plat manylinux2014_aarch64 /tf/pkg/tensorflow-2.13.0-cp311-cp311-linux_aarch64.whl --wheel-dir /tf/pkg + tee check.txt
real 1m56.256s user 1m42.501s sys 0m13.453s ++ grep --extended-regexp --only-matching '/tf/pkg/\S+.whl' check.txt + new_wheel=/tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + [[ /tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl != /\t\f/\p\k\g/\t\e\n\s\o\r\f\l\o\w-\2.\1\3.\0-\c\p\3\1\1-\c\p\3\1\1-\l\i\n\u\x_\a\a\r\c\h\6\4.\w\h\l ]] + rm /tf/pkg/tensorflow-2.13.0-cp311-cp311-linux_aarch64.whl + wheel=/tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + TF_WHEEL=/tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + bats /usertools/wheel_verification.bats --timing stderr_lines: <omitted> stdout: |- Checking and renaming /tf/pkg/tensorflow-2.13.0-cp311-cp311-linux_aarch64.whl... INFO:auditwheel.main_repair:Repairing tensorflow-2.13.0-cp311-cp311-linux_aarch64.whl INFO:auditwheel.wheeltools:Previous filename tags: linux_aarch64 INFO:auditwheel.wheeltools:New filename tags: manylinux_2_17_aarch64, manylinux2014_aarch64 INFO:auditwheel.wheeltools:Previous WHEEL info tags: cp311-cp311-linux_aarch64 INFO:auditwheel.wheeltools:New WHEEL info tags: cp311-cp311-manylinux_2_17_aarch64, cp311-cp311-manylinux2014_aarch64 INFO:auditwheel.main_repair: Fixed-up wheel written to /tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 1..6 ok 1 Wheel is manylinux2014 (manylinux_2_17) compliant in 51362ms # Size of /tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl is 217 / 580 megabytes. ok 2 Wheel conforms to upstream size limitations in 15ms not ok 3 Wheel is installable in 9967ms # (in test file /usertools/wheel_verification.bats, line 62) # `python3 -m pip install --only-binary grpcio "$TF_WHEEL"' failed # Processing ./tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl # Collecting absl-py>=1.0.0 # Downloading absl_py-1.4.0-py3-none-any.whl (126 kB) # ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 126.5/126.5 kB 9.8 MB/s eta 0:00:00 # Collecting astunparse>=1.6.0 # Downloading astunparse-1.6.3-py2.py3-none-any.whl (12 kB) # Collecting flatbuffers>=2.0 # Downloading flatbuffers-23.1.21-py2.py3-none-any.whl (26 kB) # Collecting gast<=0.4.0,>=0.2.1 # Downloading gast-0.4.0-py3-none-any.whl (9.8 kB) # Collecting google-pasta>=0.1.1 # Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB) # ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.5/57.5 kB 8.5 MB/s eta 0:00:00 # ERROR: Could not find a version that satisfies the requirement grpcio<2.0,>=1.24.3 (from tensorflow) (from versions: none) # ERROR: No matching distribution found for grpcio<2.0,>=1.24.3 # # [notice] A new release of pip available: 22.3.1 -> 23.0 # [notice] To update, run: pip install --upgrade pip not ok 4 TensorFlow is importable in 39ms # (in test file /usertools/wheel_verification.bats, line 67) # `python3 -c 'import tensorflow as tf; t1=tf.constant([1,2,3,4]); t2=tf.constant([5,6,7,8]); print(tf.add(t1,t2).shape)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' not ok 5 TensorFlow has Keras in 39ms # (in test file /usertools/wheel_verification.bats, line 73) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "_v2.keras" in tf.keras.__name__ else 1)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' not ok 6 TensorFlow has Estimator in 38ms # (in test file /usertools/wheel_verification.bats, line 79) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "_v2.estimator" in tf.estimator.__name__ else 1)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=136 changed=104 unreachable=0 failed=1 skipped=13 rescued=0 ignored=4
Saturday 04 February 2023 21:46:05 +0000 (0:02:58.841) 3:36:01.199 ***** =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow git tests ------ 3332.38s tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 2175.87s tensorflow_in_container : (Python 3.10) run TensorFlow git tests ----- 1444.10s tensorflow_in_container : (Python 3.9) run TensorFlow git tests ------ 1399.19s tensorflow_in_container : (Python 3.11) run TensorFlow git tests ----- 1393.50s tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one - 295.57s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 272.04s tensorflow_in_container : (Python 3.11) start build container --------- 268.93s tensorflow_in_container : (Python 3.10) Convert wheel to manylinux2014 compatible one - 265.96s tensorflow_in_container : (Python 3.11) install Python packages ------- 240.61s tensorflow_in_container : (Python 3.10) stop build container ---------- 211.81s tensorflow_in_container : (Python 3.8) stop build container ----------- 211.01s tensorflow_in_container : (Python 3.9) stop build container ----------- 209.53s tensorflow_in_container : (Python 3.11) build TensorFlow git ---------- 185.68s tensorflow_in_container : (Python 3.11) Convert wheel to manylinux2014 compatible one - 178.84s tensorflow_in_container : (Python 3.9) build TensorFlow git ----------- 176.60s tensorflow_in_container : (Python 3.10) build TensorFlow git ---------- 174.76s tensorflow_in_container : (Python 3.9) build Python package ------------ 98.90s tensorflow_in_container : (Python 3.10) build Python package ----------- 98.21s tensorflow_in_container : (Python 3.8) build Python package ------------ 96.44s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/679/display/redirect
Changes:
------------------------------------------ [...truncated 2.02 MB...] //tensorflow/python/data/kernel_tests:map_test PASSED in 27.5s Stats over 19 runs: max = 27.5s, min = 12.8s, avg = 18.8s, dev = 3.9s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 7.4s Stats over 20 runs: max = 7.4s, min = 3.1s, avg = 4.8s, dev = 1.4s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 13.7s Stats over 20 runs: max = 13.7s, min = 5.1s, avg = 7.8s, dev = 2.1s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 12.0s Stats over 20 runs: max = 12.0s, min = 4.7s, avg = 6.3s, dev = 1.7s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 12.4s Stats over 20 runs: max = 12.4s, min = 5.1s, avg = 6.3s, dev = 1.6s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 8.0s Stats over 20 runs: max = 8.0s, min = 6.3s, avg = 7.0s, dev = 0.5s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 13.6s Stats over 20 runs: max = 13.6s, min = 10.4s, avg = 11.5s, dev = 0.8s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 12.1s Stats over 20 runs: max = 12.1s, min = 10.0s, avg = 10.9s, dev = 0.6s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 43.8s Stats over 20 runs: max = 43.8s, min = 7.6s, avg = 17.1s, dev = 10.8s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 22.2s Stats over 20 runs: max = 22.2s, min = 17.6s, avg = 20.1s, dev = 1.2s //tensorflow/python/kernel_tests:metrics_test PASSED in 46.0s Stats over 20 runs: max = 46.0s, min = 8.7s, avg = 20.6s, dev = 10.9s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 7.4s Stats over 20 runs: max = 7.4s, min = 3.5s, avg = 5.5s, dev = 1.3s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 17.0s Stats over 20 runs: max = 17.0s, min = 3.5s, avg = 7.3s, dev = 3.7s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 38.9s Stats over 20 runs: max = 38.9s, min = 3.0s, avg = 12.3s, dev = 12.0s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 116.2s Stats over 20 runs: max = 116.2s, min = 23.0s, avg = 47.9s, dev = 24.3s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 6.6s Stats over 20 runs: max = 6.6s, min = 3.5s, avg = 4.9s, dev = 1.1s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 13.6s Stats over 20 runs: max = 13.6s, min = 5.1s, avg = 9.0s, dev = 2.6s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 192.5s Stats over 20 runs: max = 192.5s, min = 30.5s, avg = 92.9s, dev = 49.7s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 22.6s Stats over 20 runs: max = 22.6s, min = 4.6s, avg = 10.3s, dev = 5.9s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 16.9s Stats over 20 runs: max = 16.9s, min = 4.7s, avg = 9.7s, dev = 3.7s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 18.1s Stats over 20 runs: max = 18.1s, min = 12.7s, avg = 15.1s, dev = 1.4s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 74.7s Stats over 20 runs: max = 74.7s, min = 4.9s, avg = 31.2s, dev = 24.6s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 20.4s Stats over 20 runs: max = 20.4s, min = 4.3s, avg = 7.9s, dev = 4.1s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 22.8s Stats over 24 runs: max = 22.8s, min = 9.1s, avg = 16.5s, dev = 4.0s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 25.7s Stats over 24 runs: max = 25.7s, min = 9.1s, avg = 16.1s, dev = 4.7s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 18.3s Stats over 24 runs: max = 18.3s, min = 4.3s, avg = 10.1s, dev = 3.9s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 10.0s Stats over 25 runs: max = 10.0s, min = 7.8s, avg = 8.6s, dev = 0.5s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 33.0s Stats over 25 runs: max = 33.0s, min = 7.0s, avg = 11.6s, dev = 6.7s //tensorflow/dtensor/python/tests:spmd_test_cpu PASSED in 35.6s Stats over 25 runs: max = 35.6s, min = 20.7s, avg = 27.4s, dev = 3.5s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 9.0s Stats over 30 runs: max = 9.0s, min = 7.0s, avg = 7.7s, dev = 0.5s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 12.7s Stats over 30 runs: max = 12.7s, min = 11.3s, avg = 12.0s, dev = 0.4s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 8.8s Stats over 30 runs: max = 8.8s, min = 6.7s, avg = 7.7s, dev = 0.6s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 9.7s Stats over 30 runs: max = 9.7s, min = 7.5s, avg = 8.4s, dev = 0.6s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 15.5s Stats over 30 runs: max = 15.5s, min = 3.0s, avg = 6.9s, dev = 3.0s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 9.2s Stats over 31 runs: max = 9.2s, min = 7.3s, avg = 8.0s, dev = 0.5s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 10.6s Stats over 32 runs: max = 10.6s, min = 6.5s, avg = 7.9s, dev = 0.9s //tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 22.2s Stats over 32 runs: max = 22.2s, min = 5.5s, avg = 14.2s, dev = 4.0s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 23.8s Stats over 32 runs: max = 23.8s, min = 8.4s, avg = 16.3s, dev = 4.3s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 9.2s Stats over 40 runs: max = 9.2s, min = 6.3s, avg = 7.6s, dev = 0.7s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 8.7s Stats over 40 runs: max = 8.7s, min = 6.3s, avg = 7.4s, dev = 0.8s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 23.8s Stats over 40 runs: max = 23.8s, min = 8.7s, avg = 15.7s, dev = 3.4s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 13.3s Stats over 40 runs: max = 13.3s, min = 8.3s, avg = 10.1s, dev = 1.0s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 110.8s Stats over 50 runs: max = 110.8s, min = 34.3s, avg = 59.1s, dev = 27.5s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 36.6s Stats over 50 runs: max = 36.6s, min = 2.8s, avg = 10.4s, dev = 7.4s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 42.3s Stats over 50 runs: max = 42.3s, min = 3.8s, avg = 14.4s, dev = 8.8s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 10.4s Stats over 50 runs: max = 10.4s, min = 7.1s, avg = 8.7s, dev = 0.8s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 11.1s Stats over 50 runs: max = 11.1s, min = 7.4s, avg = 9.3s, dev = 1.1s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 13.3s Stats over 50 runs: max = 13.3s, min = 7.7s, avg = 10.3s, dev = 1.3s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 12.0s Stats over 50 runs: max = 12.0s, min = 4.3s, avg = 7.3s, dev = 2.0s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 9.4s Stats over 50 runs: max = 9.4s, min = 2.8s, avg = 4.5s, dev = 1.3s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 7.3s Stats over 50 runs: max = 7.3s, min = 3.0s, avg = 4.2s, dev = 1.0s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 34.8s Stats over 50 runs: max = 34.8s, min = 6.9s, avg = 15.2s, dev = 5.9s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 13.5s Stats over 50 runs: max = 13.5s, min = 3.8s, avg = 6.6s, dev = 1.4s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 11.8s Stats over 50 runs: max = 11.8s, min = 2.9s, avg = 4.8s, dev = 2.2s
Executed 3581 out of 3582 tests: 3581 tests pass and 1 fails to build. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.11) collect list of installed Python packages] *** Sunday 05 February 2023 21:41:30 +0000 (0:24:11.815) 3:31:26.479 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save list of installed Python packages] *** Sunday 05 February 2023 21:41:32 +0000 (0:00:02.079) 3:31:28.559 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save tests output to file] ******* Sunday 05 February 2023 21:41:33 +0000 (0:00:00.701) 3:31:29.261 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) save tests stderr output to file] *** Sunday 05 February 2023 21:41:34 +0000 (0:00:00.693) 3:31:29.954 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Extract number of tests run] ***** Sunday 05 February 2023 21:41:35 +0000 (0:00:00.691) 3:31:30.645 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Show number of tests run] ******** Sunday 05 February 2023 21:41:35 +0000 (0:00:00.079) 3:31:30.725 ******* ok: [localhost] => ut_tests_line: ''
TASK [tensorflow_in_container : (Python 3.11) Extract failed tests] ************ Sunday 05 February 2023 21:41:35 +0000 (0:00:00.073) 3:31:30.799 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Show which tests failed] ********* Sunday 05 February 2023 21:41:35 +0000 (0:00:00.069) 3:31:30.869 ******* ok: [localhost] => tests_failed: 'FAILED: '
TASK [tensorflow_in_container : (Python 3.11) Convert wheel to manylinux2014 compatible one] *** Sunday 05 February 2023 21:41:35 +0000 (0:00:00.045) 3:31:30.914 ******* fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- + for wheel in /tf/pkg/*.whl + echo 'Checking and renaming /tf/pkg/tensorflow-2.13.0-cp311-cp311-linux_aarch64.whl...' + python3 -m auditwheel repair --plat manylinux2014_aarch64 /tf/pkg/tensorflow-2.13.0-cp311-cp311-linux_aarch64.whl --wheel-dir /tf/pkg + tee check.txt
real 1m56.703s user 1m42.660s sys 0m13.983s ++ grep --extended-regexp --only-matching '/tf/pkg/\S+.whl' check.txt + new_wheel=/tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + [[ /tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl != /\t\f/\p\k\g/\t\e\n\s\o\r\f\l\o\w-\2.\1\3.\0-\c\p\3\1\1-\c\p\3\1\1-\l\i\n\u\x_\a\a\r\c\h\6\4.\w\h\l ]] + rm /tf/pkg/tensorflow-2.13.0-cp311-cp311-linux_aarch64.whl + wheel=/tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + TF_WHEEL=/tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + bats /usertools/wheel_verification.bats --timing stderr_lines: <omitted> stdout: |- Checking and renaming /tf/pkg/tensorflow-2.13.0-cp311-cp311-linux_aarch64.whl... INFO:auditwheel.main_repair:Repairing tensorflow-2.13.0-cp311-cp311-linux_aarch64.whl INFO:auditwheel.wheeltools:Previous filename tags: linux_aarch64 INFO:auditwheel.wheeltools:New filename tags: manylinux_2_17_aarch64, manylinux2014_aarch64 INFO:auditwheel.wheeltools:Previous WHEEL info tags: cp311-cp311-linux_aarch64 INFO:auditwheel.wheeltools:New WHEEL info tags: cp311-cp311-manylinux_2_17_aarch64, cp311-cp311-manylinux2014_aarch64 INFO:auditwheel.main_repair: Fixed-up wheel written to /tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 1..6 ok 1 Wheel is manylinux2014 (manylinux_2_17) compliant in 51025ms # Size of /tf/pkg/tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl is 217 / 580 megabytes. ok 2 Wheel conforms to upstream size limitations in 14ms not ok 3 Wheel is installable in 9777ms # (in test file /usertools/wheel_verification.bats, line 62) # `python3 -m pip install --only-binary grpcio "$TF_WHEEL"' failed # Processing ./tensorflow-2.13.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl # Collecting absl-py>=1.0.0 # Downloading absl_py-1.4.0-py3-none-any.whl (126 kB) # ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 126.5/126.5 kB 7.9 MB/s eta 0:00:00 # Collecting astunparse>=1.6.0 # Downloading astunparse-1.6.3-py2.py3-none-any.whl (12 kB) # Collecting flatbuffers>=2.0 # Downloading flatbuffers-23.1.21-py2.py3-none-any.whl (26 kB) # Collecting gast<=0.4.0,>=0.2.1 # Downloading gast-0.4.0-py3-none-any.whl (9.8 kB) # Collecting google-pasta>=0.1.1 # Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB) # ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.5/57.5 kB 5.0 MB/s eta 0:00:00 # ERROR: Could not find a version that satisfies the requirement grpcio<2.0,>=1.24.3 (from tensorflow) (from versions: none) # ERROR: No matching distribution found for grpcio<2.0,>=1.24.3 # # [notice] A new release of pip available: 22.3.1 -> 23.0 # [notice] To update, run: pip install --upgrade pip not ok 4 TensorFlow is importable in 39ms # (in test file /usertools/wheel_verification.bats, line 67) # `python3 -c 'import tensorflow as tf; t1=tf.constant([1,2,3,4]); t2=tf.constant([5,6,7,8]); print(tf.add(t1,t2).shape)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' not ok 5 TensorFlow has Keras in 39ms # (in test file /usertools/wheel_verification.bats, line 73) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "_v2.keras" in tf.keras.__name__ else 1)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' not ok 6 TensorFlow has Estimator in 39ms # (in test file /usertools/wheel_verification.bats, line 79) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "_v2.estimator" in tf.estimator.__name__ else 1)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=136 changed=104 unreachable=0 failed=1 skipped=13 rescued=0 ignored=4
Sunday 05 February 2023 21:44:34 +0000 (0:02:58.785) 3:34:29.699 ******* =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow git tests ------ 3471.35s tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 2018.21s tensorflow_in_container : (Python 3.11) run TensorFlow git tests ----- 1451.82s tensorflow_in_container : (Python 3.9) run TensorFlow git tests ------ 1392.75s tensorflow_in_container : (Python 3.10) run TensorFlow git tests ----- 1351.60s tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one - 292.40s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 272.14s tensorflow_in_container : (Python 3.10) Convert wheel to manylinux2014 compatible one - 268.40s tensorflow_in_container : (Python 3.11) start build container --------- 256.01s tensorflow_in_container : (Python 3.11) install Python packages ------- 239.35s tensorflow_in_container : (Python 3.9) stop build container ----------- 213.25s tensorflow_in_container : (Python 3.10) stop build container ---------- 211.38s tensorflow_in_container : (Python 3.8) stop build container ----------- 210.75s tensorflow_in_container : (Python 3.11) build TensorFlow git ---------- 180.58s tensorflow_in_container : (Python 3.11) Convert wheel to manylinux2014 compatible one - 178.79s tensorflow_in_container : (Python 3.9) build TensorFlow git ----------- 174.65s tensorflow_in_container : (Python 3.10) build TensorFlow git ---------- 173.80s tensorflow_in_container : (Python 3.9) build Python package ------------ 95.64s tensorflow_in_container : (Python 3.8) build Python package ------------ 94.25s tensorflow_in_container : (Python 3.10) build Python package ----------- 92.27s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/680/display/redirect
Changes:
------------------------------------------ [...truncated 772.98 KB...] //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 11.9s Stats over 50 runs: max = 11.9s, min = 4.1s, avg = 7.2s, dev = 2.3s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 5.9s Stats over 50 runs: max = 5.9s, min = 2.6s, avg = 3.6s, dev = 0.7s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 5.8s Stats over 50 runs: max = 5.8s, min = 2.8s, avg = 3.9s, dev = 0.8s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 31.0s Stats over 50 runs: max = 31.0s, min = 7.0s, avg = 15.3s, dev = 5.8s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 14.4s Stats over 50 runs: max = 14.4s, min = 3.2s, avg = 4.9s, dev = 1.7s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 11.5s Stats over 50 runs: max = 11.5s, min = 2.7s, avg = 4.5s, dev = 1.9s
Executed 3581 out of 3582 tests: 3581 tests pass and 1 fails to build. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages] *** Monday 06 February 2023 12:52:36 +0000 (0:24:15.164) 2:06:19.565 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save list of installed Python packages] *** Monday 06 February 2023 12:52:38 +0000 (0:00:01.862) 2:06:21.427 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests output to file] ******** Monday 06 February 2023 12:52:38 +0000 (0:00:00.696) 2:06:22.124 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests stderr output to file] *** Monday 06 February 2023 12:52:39 +0000 (0:00:00.692) 2:06:22.816 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Extract number of tests run] ****** Monday 06 February 2023 12:52:40 +0000 (0:00:00.735) 2:06:23.551 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show number of tests run] ********* Monday 06 February 2023 12:52:40 +0000 (0:00:00.077) 2:06:23.629 ******* ok: [localhost] => ut_tests_line: ''
TASK [tensorflow_in_container : (Python 3.9) Extract failed tests] ************* Monday 06 February 2023 12:52:40 +0000 (0:00:00.046) 2:06:23.675 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show which tests failed] ********** Monday 06 February 2023 12:52:40 +0000 (0:00:00.067) 2:06:23.743 ******* ok: [localhost] => tests_failed: 'FAILED: '
TASK [tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one] *** Monday 06 February 2023 12:52:40 +0000 (0:00:00.045) 2:06:23.789 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Get list of wheel files] ********** Monday 06 February 2023 12:57:19 +0000 (0:04:38.716) 2:11:02.506 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Get filename of latest wheel] ***** Monday 06 February 2023 12:57:19 +0000 (0:00:00.363) 2:11:02.869 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) move manylinux2014 wheel outside] *** Monday 06 February 2023 12:57:19 +0000 (0:00:00.064) 2:11:02.934 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Remove manylinux2014 wheel] ******* Monday 06 February 2023 12:57:22 +0000 (0:00:02.316) 2:11:05.251 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) stop build container] ************* Monday 06 February 2023 12:57:22 +0000 (0:00:00.378) 2:11:05.630 ******* changed: [localhost]
TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Monday 06 February 2023 13:00:51 +0000 (0:03:28.868) 2:14:34.499 ******* changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] *** Monday 06 February 2023 13:00:56 +0000 (0:00:05.634) 2:14:40.134 ******* skipping: [localhost]
TASK [Fetch TensorFlow] ******************************************************** Monday 06 February 2023 13:00:56 +0000 (0:00:00.038) 2:14:40.172 ******* skipping: [localhost]
TASK [(Python 3.10) patch TensorFlow tree] ************************************* Monday 06 February 2023 13:00:57 +0000 (0:00:00.037) 2:14:40.210 *******
TASK [tensorflow : Create linklibs shell script] ******************************* Monday 06 February 2023 13:00:57 +0000 (0:00:00.159) 2:14:40.370 ******* changed: [localhost]
TASK [tensorflow : Create readme file about unit tests] ************************ Monday 06 February 2023 13:00:57 +0000 (0:00:00.695) 2:14:41.065 ******* changed: [localhost]
TASK [tensorflow : Add to the copied files] ************************************ Monday 06 February 2023 13:00:58 +0000 (0:00:00.702) 2:14:41.768 ******* changed: [localhost]
TASK [tensorflow : Add to the long_description in setup.py] ******************** Monday 06 February 2023 13:00:58 +0000 (0:00:00.366) 2:14:42.135 ******* changed: [localhost]
TASK [tensorflow : Use nightly package requirements] *************************** Monday 06 February 2023 13:00:59 +0000 (0:00:00.362) 2:14:42.497 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.10) start build container] *********** Monday 06 February 2023 13:00:59 +0000 (0:00:00.393) 2:14:42.891 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.10) create buildslave bazel cache dir] *** Monday 06 February 2023 13:01:01 +0000 (0:00:01.469) 2:14:44.360 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.10) create link for bazel cache] ***** Monday 06 February 2023 13:01:01 +0000 (0:00:00.788) 2:14:45.149 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.10) create link for bazelisk cache] *** Monday 06 February 2023 13:01:02 +0000 (0:00:00.809) 2:14:45.958 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.10) create link for pip cache] ******* Monday 06 February 2023 13:01:03 +0000 (0:00:00.807) 2:14:46.766 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.10) copy upper constraints] ********** Monday 06 February 2023 13:01:04 +0000 (0:00:00.832) 2:14:47.598 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.10) install Python packages] ********* Monday 06 February 2023 13:01:05 +0000 (0:00:00.754) 2:14:48.352 ******* fatal: [localhost]: FAILED! => changed=true rc: 2 stderr: |- ERROR: Exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/pip/_internal/cli/base_command.py", line 160, in exc_logging_wrapper status = run_func(*args) File "/usr/local/lib/python3.10/dist-packages/pip/_internal/cli/req_command.py", line 247, in wrapper return func(self, options, args) File "/usr/local/lib/python3.10/dist-packages/pip/_internal/commands/install.py", line 415, in run requirement_set = resolver.resolve( File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/resolver.py", line 92, in resolve result = self._result = resolver.resolve( File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/resolvelib/resolvers.py", line 481, in resolve state = resolution.resolve(requirements, max_rounds=max_rounds) File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/resolvelib/resolvers.py", line 348, in resolve self._add_to_criteria(self.state.criteria, r, parent=None) File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/resolvelib/resolvers.py", line 172, in _add_to_criteria if not criterion.candidates: File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/resolvelib/structs.py", line 151, in __bool__ return bool(self._sequence) File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 155, in __bool__ return any(self) File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 143, in <genexpr> return (c for c in iterator if id(c) not in self._incompatible_ids) File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 47, in _iter_built candidate = func() File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/factory.py", line 206, in _make_candidate_from_link self._link_candidate_cache[link] = LinkCandidate( File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/candidates.py", line 297, in __init__ super().__init__( File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/candidates.py", line 162, in __init__ self.dist = self._prepare() File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/candidates.py", line 231, in _prepare dist = self._prepare_distribution() File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/candidates.py", line 308, in _prepare_distribution return preparer.prepare_linked_requirement(self._ireq, parallel_builds=True) File "/usr/local/lib/python3.10/dist-packages/pip/_internal/operations/prepare.py", line 491, in prepare_linked_requirement return self._prepare_linked_requirement(req, parallel_builds) File "/usr/local/lib/python3.10/dist-packages/pip/_internal/operations/prepare.py", line 577, in _prepare_linked_requirement dist = _get_prepared_distribution( File "/usr/local/lib/python3.10/dist-packages/pip/_internal/operations/prepare.py", line 69, in _get_prepared_distribution abstract_dist.prepare_distribution_metadata( File "/usr/local/lib/python3.10/dist-packages/pip/_internal/distributions/sdist.py", line 48, in prepare_distribution_metadata self._install_build_reqs(finder) File "/usr/local/lib/python3.10/dist-packages/pip/_internal/distributions/sdist.py", line 118, in _install_build_reqs build_reqs = self._get_build_requires_wheel() File "/usr/local/lib/python3.10/dist-packages/pip/_internal/distributions/sdist.py", line 95, in _get_build_requires_wheel return backend.get_requires_for_build_wheel() File "/usr/local/lib/python3.10/dist-packages/pip/_internal/utils/misc.py", line 701, in get_requires_for_build_wheel return super().get_requires_for_build_wheel(config_settings=cs) File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_impl.py", line 166, in get_requires_for_build_wheel return self._call_hook('get_requires_for_build_wheel', { File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_impl.py", line 321, in _call_hook raise BackendUnavailable(data.get('traceback', '')) pip._vendor.pyproject_hooks._impl.BackendUnavailable: Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 77, in _build_backend obj = import_module(mod_path) File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 992, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1004, in _find_and_load_unlocked ModuleNotFoundError: No module named 'setuptools' stderr_lines: <omitted> stdout: |- Collecting Cython>=0.29 Downloading Cython-0.29.33-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.manylinux_2_24_aarch64.whl (1.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 MB 10.6 MB/s eta 0:00:00 Requirement already satisfied: pip>=21 in /usr/local/lib/python3.10/dist-packages (from -r /tf/pkg/upper-constraints.txt (line 2)) (23.0) Requirement already satisfied: flatbuffers<3.0,>=1.12 in /usr/local/lib/python3.10/dist-packages (from -r /tf/pkg/upper-constraints.txt (line 5)) (2.0.7) Requirement already satisfied: gast==0.4.0 in /usr/local/lib/python3.10/dist-packages (from -r /tf/pkg/upper-constraints.txt (line 6)) (0.4.0) Requirement already satisfied: grpcio<2.0,>=1.37.0 in /usr/local/lib/python3.10/dist-packages (from -r /tf/pkg/upper-constraints.txt (line 7)) (1.49.1) Collecting h5py~=3.6.0 Downloading h5py-3.6.0.tar.gz (384 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 384.2/384.2 kB 10.8 MB/s eta 0:00:00 Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=90 changed=69 unreachable=0 failed=1 skipped=11 rescued=0 ignored=2
Monday 06 February 2023 13:01:19 +0000 (0:00:14.758) 2:15:03.111 ******* =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow git tests ------ 2742.21s tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 2224.20s tensorflow_in_container : (Python 3.9) run TensorFlow git tests ------ 1455.16s tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one - 452.86s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 278.72s tensorflow_in_container : (Python 3.8) stop build container ----------- 210.94s tensorflow_in_container : (Python 3.9) stop build container ----------- 208.87s tensorflow_in_container : (Python 3.9) build TensorFlow git ----------- 186.67s tensorflow_in_container : (Python 3.8) build Python package ------------ 96.75s tensorflow_in_container : (Python 3.9) build Python package ------------ 95.23s tensorflow_in_container : (Python 3.8) install Python packages --------- 25.63s tensorflow_in_container : (Python 3.9) install Python packages --------- 24.81s tensorflow : Fetch TensorFlow from git --------------------------------- 20.81s tensorflow_in_container : (Python 3.10) install Python packages -------- 14.76s tensorflow_in_container : Reset checkout to clean state ----------------- 5.63s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.69s tensorflow_in_container : (Python 3.8) start build container ------------ 2.73s Gathering Facts --------------------------------------------------------- 2.66s tensorflow_in_container : (Python 3.9) move manylinux2014 wheel outside --- 2.32s tensorflow_in_container : (Python 3.8) move manylinux2014 wheel outside --- 2.30s Build step 'Execute shell' marked build as failure
ldcg-ai-ml@op-lists.linaro.org
-
ci_notify＠linaro.org