See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/647/display/redirect
Changes:
------------------------------------------ Started by user Marcin Juszkiewicz (marcin.juszkiewicz@linaro.org) Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on ldcg-aarch64-02 (aarch64 leg-aarch64) in workspace https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/ [ldcg-python-manylinux-tensorflow-nightly] $ /bin/bash /tmp/jenkins4538647425816341970.sh + dual_abi=false + cd https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/ + rm -rf '*.sh' configs wheels cache_upload + mkdir wheels cache_upload + git clone --depth 1 https://git.linaro.org/ci/job/configs.git Cloning into 'configs'... + cd configs + git log --pretty=oneline -1 7487b71076bca85ad2c4607949caae5a4cf311fd ldcg-python-manylinux-tensorflow: take care of file permissions + cd .. + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' true = true ']' + echo ' - "git"' + dual_abi=true + '[' false = true ']' + '[' '' = true ']' + '[' true == true ']' + ansible-galaxy collection install community.docker Starting galaxy collection install process Nothing to do. All requested collections are already installed. If you want to reinstall them, consider using `--force`. + cd configs/ldcg-python-manylinux-tensorflow/ansible/ + ansible-playbook playbooks/build-tf-dual-abi.yml [DEPRECATION WARNING]: [defaults]callback_whitelist option, normalizing names to new standard, use callbacks_enabled instead. This feature will be removed from ansible-core in version 2.15. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all'
PLAY [localhost] ***************************************************************
TASK [Gathering Facts] ********************************************************* Wednesday 18 January 2023 13:08:05 +0000 (0:00:00.055) 0:00:00.055 ***** ok: [localhost]
TASK [cleanup after previous build] ******************************************** Wednesday 18 January 2023 13:08:08 +0000 (0:00:02.621) 0:00:02.676 ***** changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels) ok: [localhost] => (item=tensorflow)
TASK [create cache dirs] ******************************************************* Wednesday 18 January 2023 13:08:09 +0000 (0:00:01.277) 0:00:03.953 ***** ok: [localhost] => (item=disk-cache) ok: [localhost] => (item=bazel-cache) changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels)
TASK [set dual abi variable] *************************************************** Wednesday 18 January 2023 13:08:10 +0000 (0:00:01.398) 0:00:05.352 ***** ok: [localhost]
TASK [go through each TensorFlow version] ************************************** Wednesday 18 January 2023 13:08:11 +0000 (0:00:00.034) 0:00:05.386 ***** skipping: [localhost] => (item={'key': '2.11', 'value': {'tensorflow_version': '2.11.0', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.11.0', 'tensorboard_version': '==2.11.0', 'tensorflow_estimator_version': '==2.11.0', 'python_install_packages': ['packaging', 'portpicker', 'keras-nightly', 'tb-nightly', 'tf-estimator-nightly'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/training:server_lib_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.10', 'value': {'tensorflow_version': '2.10.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.10.0', 'tensorboard_version': '==2.10.1', 'tensorflow_estimator_version': '==2.10.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tensorflow/tests/...', '//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/tests:jit_test_cpu', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/training:server_lib_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.9', 'value': {'tensorflow_version': '2.9.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.9.0', 'tensorboard_version': '==2.9.0', 'tensorflow_estimator_version': '==2.9.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.8', 'value': {'tensorflow_version': '2.8.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.8.0', 'tensorboard_version': '==2.8.0', 'tensorflow_estimator_version': '==2.8.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/mlir/lite/tests:prepare-tf.mlir.test', '//tensorflow/compiler/mlir/tensorflow:dump_graph_test', '//tensorflow/core/common_runtime:direct_session_test', '//tensorflow/core/common_runtime:direct_session_with_debug_test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:quantize_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python:quantized_ops_test', '//tensorflow/python:script_ops_test', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.7', 'value': {'tensorflow_version': '2.7.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.5', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.7.0', 'tensorboard_version': '==2.7.0', 'tensorflow_estimator_version': '==2.7.0', 'python_install_packages': ['portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/java/...', '//tensorflow/lite/...', '//tensorflow/compiler/xla/python/...', '//tensorflow/compiler/xla/service/cpu/...', '//tensorflow/compiler/xla/tests/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/core/kernels:sparse_matmul_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/debug/cli:debugger_cli_common_test', '//tensorflow/python/debug/examples/v2:examples_v2_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/keras/mixed_precision:model_test', '//tensorflow/python/keras/preprocessing:image_test', '//tensorflow/python/kernel_tests:init_ops_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests:self_adjoint_eig_op_test', '//tensorflow/python/kernel_tests:sparse_matmul_op_test', '//tensorflow/python/lib/io:file_io_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python/ops/ragged:ragged_print_op_test', '//tensorflow/python/profiler/integration_test:profiler_api_test', '//tensorflow/python/profiler:profiler_v2_test', '//tensorflow/python/util:dispatch_test', '//tensorflow/python/util:traceback_utils_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tools/docs:tf_doctest', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.6', 'value': {'tensorflow_version': '2.6.5', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.6.0', 'tensorboard_version': '==2.6.0', 'tensorflow_estimator_version': '==2.6.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.5', 'value': {'tensorflow_version': '2.5.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.34.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.5.0', 'tensorboard_version': '==2.5.0', 'tensorflow_estimator_version': '==2.5.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.4', 'value': {'tensorflow_version': '2.4.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.3.3', 'grpcio_version': '~=1.32.0', 'h5py_version': '~=2.10', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.4.3', 'tensorboard_version': '==2.4.1', 'tensorflow_estimator_version': '==2.4.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '1.15', 'value': {'tensorflow_version': '1.15.5', 'bazel_version': '0.29.1', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.2.2', 'grpcio_version': '~=1.32.0', 'h5py_version': '==2.10', 'numpy_version': '~=1.18.0', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==1.2.2', 'tensorboard_version': '==1.15.0', 'tensorflow_estimator_version': '==1.15.2', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m']}}) [DEPRECATION WARNING]: "include" is deprecated, use include_tasks/import_tasks instead. This feature will be removed in version 2.16. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.
TASK [tensorflow : set TensorFlow and other package versions] ****************** Wednesday 18 January 2023 13:08:11 +0000 (0:00:00.255) 0:00:05.641 ***** ok: [localhost]
TASK [tensorflow : Set build dir for TensorFlow git] *************************** Wednesday 18 January 2023 13:08:11 +0000 (0:00:00.080) 0:00:05.722 ***** ok: [localhost]
TASK [tensorflow : remove TensorFlow git sources from previous build] ********** Wednesday 18 January 2023 13:08:11 +0000 (0:00:00.044) 0:00:05.766 ***** changed: [localhost]
TASK [tensorflow : fetch tensorflow git source] ******************************** Wednesday 18 January 2023 13:08:14 +0000 (0:00:03.154) 0:00:08.920 ***** skipping: [localhost]
TASK [tensorflow : unpack tensorflow git source] ******************************* Wednesday 18 January 2023 13:08:14 +0000 (0:00:00.043) 0:00:08.964 ***** skipping: [localhost]
TASK [tensorflow : Rename source dir for oneDNN build] ************************* Wednesday 18 January 2023 13:08:14 +0000 (0:00:00.035) 0:00:09.000 ***** skipping: [localhost]
TASK [tensorflow : fetch tensorflow from git] ********************************** Wednesday 18 January 2023 13:08:14 +0000 (0:00:00.039) 0:00:09.039 ***** changed: [localhost]
TASK [tensorflow : set world write access to source] *************************** Wednesday 18 January 2023 13:08:43 +0000 (0:00:28.355) 0:00:37.395 ***** changed: [localhost]
TASK [tensorflow : Get oneline version of git log for this checkout] *********** Wednesday 18 January 2023 13:08:43 +0000 (0:00:00.374) 0:00:37.769 ***** changed: [localhost]
TASK [tensorflow : Show git log] *********************************************** Wednesday 18 January 2023 13:08:43 +0000 (0:00:00.580) 0:00:38.350 ***** ok: [localhost] => git_log.stdout: df4957514a1a0a80db26b186e378f2e97fe232ee Integrate LLVM at llvm/llvm-project@48c2172e51b2
TASK [tensorflow : Record git commit hash to variable] ************************* Wednesday 18 January 2023 13:08:44 +0000 (0:00:00.041) 0:00:38.391 ***** ok: [localhost]
TASK [tensorflow : Save git commit hash to file] ******************************* Wednesday 18 January 2023 13:08:44 +0000 (0:00:00.061) 0:00:38.452 ***** changed: [localhost]
TASK [build Bazel] ************************************************************* Wednesday 18 January 2023 13:08:45 +0000 (0:00:01.139) 0:00:39.592 ***** skipping: [localhost]
TASK [Build TensorFlow for each Python version] ******************************** Wednesday 18 January 2023 13:08:45 +0000 (0:00:00.035) 0:00:39.628 ***** skipping: [localhost] => (item=3.8) skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10)
TASK [Build TensorFlow for each Python version (dual abi)] ********************* Wednesday 18 January 2023 13:08:45 +0000 (0:00:00.050) 0:00:39.679 *****
TASK [tensorflow_in_container : reset checkout to clean state] ***************** Wednesday 18 January 2023 13:08:45 +0000 (0:00:00.428) 0:00:40.107 ***** changed: [localhost]
TASK [tensorflow_in_container : remove TensorFlow git sources from previous build] *** Wednesday 18 January 2023 13:08:46 +0000 (0:00:00.869) 0:00:40.976 ***** skipping: [localhost]
TASK [fetch TensorFlow] ******************************************************** Wednesday 18 January 2023 13:08:46 +0000 (0:00:00.036) 0:00:41.013 ***** skipping: [localhost]
TASK [(Python 3.8) patch TensorFlow tree] ************************************** Wednesday 18 January 2023 13:08:46 +0000 (0:00:00.036) 0:00:41.049 *****
TASK [tensorflow : Create linklibs shell script] ******************************* Wednesday 18 January 2023 13:08:46 +0000 (0:00:00.160) 0:00:41.210 ***** changed: [localhost]
TASK [tensorflow : create readme file about unit tests] ************************ Wednesday 18 January 2023 13:08:47 +0000 (0:00:00.687) 0:00:41.898 ***** changed: [localhost]
TASK [tensorflow : add to the copied files] ************************************ Wednesday 18 January 2023 13:08:48 +0000 (0:00:00.694) 0:00:42.593 ***** changed: [localhost]
TASK [tensorflow : add to the long_description in setup.py] ******************** Wednesday 18 January 2023 13:08:48 +0000 (0:00:00.595) 0:00:43.188 ***** changed: [localhost]
TASK [tensorflow : use nightly package requirements] *************************** Wednesday 18 January 2023 13:08:49 +0000 (0:00:00.586) 0:00:43.774 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) start build container] ************ Wednesday 18 January 2023 13:08:49 +0000 (0:00:00.413) 0:00:44.188 ***** An exception occurred during task execution. To see the full traceback, use -vvv. The error was: ModuleNotFoundError: No module named 'requests' fatal: [localhost]: FAILED! => changed=false msg: Failed to import the required Python library (requests) on ldcg-aarch64-02's Python /usr/bin/python3.9. Please read the module documentation and install it in the appropriate location. If the required library is installed, but Ansible is using the wrong Python interpreter, please consult the documentation on ansible_python_interpreter
PLAY RECAP ********************************************************************* localhost : ok=19 changed=13 unreachable=0 failed=1 skipped=7 rescued=0 ignored=0
Wednesday 18 January 2023 13:08:50 +0000 (0:00:01.071) 0:00:45.259 ***** =============================================================================== tensorflow : fetch tensorflow from git --------------------------------- 28.36s tensorflow : remove TensorFlow git sources from previous build ---------- 3.15s Gathering Facts --------------------------------------------------------- 2.62s create cache dirs ------------------------------------------------------- 1.40s cleanup after previous build -------------------------------------------- 1.28s tensorflow : Save git commit hash to file ------------------------------- 1.14s tensorflow_in_container : (Python 3.8) start build container ------------ 1.07s tensorflow_in_container : reset checkout to clean state ----------------- 0.87s tensorflow : create readme file about unit tests ------------------------ 0.69s tensorflow : Create linklibs shell script ------------------------------- 0.69s tensorflow : add to the copied files ------------------------------------ 0.60s tensorflow : add to the long_description in setup.py -------------------- 0.59s tensorflow : Get oneline version of git log for this checkout ----------- 0.58s Build TensorFlow for each Python version (dual abi) --------------------- 0.43s tensorflow : use nightly package requirements --------------------------- 0.41s tensorflow : set world write access to source --------------------------- 0.37s go through each TensorFlow version -------------------------------------- 0.26s (Python 3.8) patch TensorFlow tree -------------------------------------- 0.16s tensorflow : set TensorFlow and other package versions ------------------ 0.08s tensorflow : Record git commit hash to variable ------------------------- 0.06s Build step 'Execute shell' marked build as failure