See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/473/display/redirect
Changes:
------------------------------------------ [...truncated 34.66 KB...]
TASK [python : build wheels of Python package scipy] *************************** Tuesday 16 August 2022 18:22:30 +0000 (0:00:02.209) 0:11:55.186 ******** changed: [localhost]
TASK [python : get list of wheel files matching scipy] ************************* Tuesday 16 August 2022 18:22:39 +0000 (0:00:09.403) 0:12:04.589 ******** ok: [localhost]
TASK [python : get filename of latest scipy wheel] ***************************** Tuesday 16 August 2022 18:22:40 +0000 (0:00:00.269) 0:12:04.859 ******** ok: [localhost]
TASK [python : install scipy-1.7.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package] *** Tuesday 16 August 2022 18:22:40 +0000 (0:00:00.052) 0:12:04.911 ******** changed: [localhost]
TASK [tensorflow : Set build dir for TensorFlow git] *************************** Tuesday 16 August 2022 18:22:47 +0000 (0:00:07.511) 0:12:12.422 ******** ok: [localhost]
TASK [tensorflow : remove TensorFlow git sources from previous build] ********** Tuesday 16 August 2022 18:22:47 +0000 (0:00:00.050) 0:12:12.473 ******** changed: [localhost]
TASK [fetch tensorflow git source] ********************************************* Tuesday 16 August 2022 18:22:52 +0000 (0:00:04.946) 0:12:17.420 ******** skipping: [localhost]
TASK [unpack tensorflow git source] ******************************************** Tuesday 16 August 2022 18:22:52 +0000 (0:00:00.057) 0:12:17.477 ******** skipping: [localhost]
TASK [tensorflow : Rename source dir for oneDNN build] ************************* Tuesday 16 August 2022 18:22:52 +0000 (0:00:00.040) 0:12:17.518 ******** skipping: [localhost]
TASK [fetch tensorflow from git] *********************************************** Tuesday 16 August 2022 18:22:52 +0000 (0:00:00.043) 0:12:17.562 ******** changed: [localhost]
TASK [tensorflow : Get oneline version of git log for this checkout] *********** Tuesday 16 August 2022 18:23:25 +0000 (0:00:32.456) 0:12:50.018 ******** changed: [localhost]
TASK [tensorflow : Show git log] *********************************************** Tuesday 16 August 2022 18:23:26 +0000 (0:00:00.589) 0:12:50.607 ******** ok: [localhost] => git_log.stdout: f98e4555e9b25ea67f0acf2136b89a5439cf3f32 Fix missing CMake deps for THLO
TASK [tensorflow : use nightly package requirements] *************************** Tuesday 16 August 2022 18:23:26 +0000 (0:00:00.049) 0:12:50.656 ******** changed: [localhost]
TASK [tensorflow : Fix version of tb-nightly to one that exists] *************** Tuesday 16 August 2022 18:23:26 +0000 (0:00:00.473) 0:12:51.129 ******** changed: [localhost]
TASK [tensorflow : Use rolling bazel release instead of last_downstream_green] *** Tuesday 16 August 2022 18:23:26 +0000 (0:00:00.460) 0:12:51.590 ******** ok: [localhost]
TASK [tensorflow : Create linklibs shell script] ******************************* Tuesday 16 August 2022 18:23:27 +0000 (0:00:00.256) 0:12:51.846 ******** changed: [localhost]
TASK [tensorflow : create readme file about unit tests] ************************ Tuesday 16 August 2022 18:23:27 +0000 (0:00:00.462) 0:12:52.308 ******** changed: [localhost]
TASK [tensorflow : add to the copied files] ************************************ Tuesday 16 August 2022 18:23:28 +0000 (0:00:00.470) 0:12:52.779 ******** changed: [localhost]
TASK [tensorflow : add to the long_description in setup.py] ******************** Tuesday 16 August 2022 18:23:28 +0000 (0:00:00.265) 0:12:53.044 ******** changed: [localhost]
TASK [tensorflow : Get python site-packages location] ************************** Tuesday 16 August 2022 18:23:28 +0000 (0:00:00.414) 0:12:53.459 ******** changed: [localhost]
TASK [tensorflow : Configure default TensorFlow settings] ********************** Tuesday 16 August 2022 18:23:29 +0000 (0:00:00.618) 0:12:54.077 ******** changed: [localhost]
TASK [tensorflow : Set Python bin path] **************************************** Tuesday 16 August 2022 18:23:30 +0000 (0:00:00.567) 0:12:54.645 ******** changed: [localhost]
TASK [tensorflow : build TensorFlow git for cp37-cp37m] ************************ Tuesday 16 August 2022 18:23:30 +0000 (0:00:00.573) 0:12:55.218 ******** fatal: [localhost]: FAILED! => changed=true cmd: |- set -xe; source /tmp/workspace/venv-cp37-cp37m/bin/activate; source ./linklibs.sh; bazel clean --expunge; bazel build --config=nonccl --copt="-mtune=generic" --copt="-march=armv8-a" --copt="-O3" \ //tensorflow/tools/pip_package:build_pip_package --verbose_failures; mkdir tensorflow-pkg; bazel-bin/tensorflow/tools/pip_package/build_pip_package --cpu --project_name tensorflow_aarch64 ./tensorflow-pkg delta: '0:02:14.075570' end: '2022-08-16 18:25:44.910835' msg: non-zero return code rc: 1 start: '2022-08-16 18:23:30.835265' stderr: |- + source /tmp/workspace/venv-cp37-cp37m/bin/activate ++ deactivate nondestructive ++ '[' -n '' ']' ++ '[' -n '' ']' ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r ++ '[' -n '' ']' ++ unset VIRTUAL_ENV ++ '[' '!' nondestructive = nondestructive ']' ++ VIRTUAL_ENV=/tmp/workspace/venv-cp37-cp37m ++ export VIRTUAL_ENV ++ _OLD_VIRTUAL_PATH=/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ PATH=/tmp/workspace/venv-cp37-cp37m/bin:/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ export PATH ++ '[' -n '' ']' ++ '[' -z '' ']' ++ _OLD_VIRTUAL_PS1= ++ '[' 'x(venv-cp37-cp37m) ' '!=' x ']' ++ PS1='(venv-cp37-cp37m) ' ++ export PS1 ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r + source ./linklibs.sh + bazel clean --expunge 2022/08/16 18:23:31 Downloading https://releases.bazel.build/5.1.1/release/bazel-5.1.1-linux-arm64... Extracting Bazel installation... Starting local Bazel server and connecting to it... INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'build' options: --define framework_shared_object=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: Inherited 'build' options: --action_env PYTHON_BIN_PATH=/tmp/workspace/venv-cp37-cp37m/bin/python3 --action_env PYTHON_LIB_PATH=/tmp/workspace/venv-cp37-cp37m/lib/python3.7/site-packages --python_path=/tmp/workspace/venv-cp37-cp37m/bin/python3 INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Found applicable config definition build:short_logs in file /tmp/workspace/tensorflow-git/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tmp/workspace/tensorflow-git/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:linux in file /tmp/workspace/tensorflow-git/.bazelrc: --copt=-w --host_copt=-w --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tmp/workspace/tensorflow-git/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS INFO: Starting clean (this may take a while). Consider using --async if the clean takes more than several minutes. + bazel build --config=nonccl --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 //tensorflow/tools/pip_package:build_pip_package --verbose_failures Starting local Bazel server and connecting to it... INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: 'build' options: --define framework_shared_object=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: 'build' options: --action_env PYTHON_BIN_PATH=/tmp/workspace/venv-cp37-cp37m/bin/python3 --action_env PYTHON_LIB_PATH=/tmp/workspace/venv-cp37-cp37m/lib/python3.7/site-packages --python_path=/tmp/workspace/venv-cp37-cp37m/bin/python3 INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: 'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Found applicable config definition build:short_logs in file /tmp/workspace/tensorflow-git/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tmp/workspace/tensorflow-git/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:nonccl in file /tmp/workspace/tensorflow-git/.bazelrc: --define=no_nccl_support=true INFO: Found applicable config definition build:linux in file /tmp/workspace/tensorflow-git/.bazelrc: --copt=-w --host_copt=-w --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tmp/workspace/tensorflow-git/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/tensorflow/r... failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-pr... failed: class java.io.FileNotFoundException GET returned 404 Not Found Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) WARNING: Download from https://mirror.bazel.build/github.com/bazelbuild/rules_cc/archive/081771d4a0... failed: class java.io.FileNotFoundException GET returned 404 Not Found WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/abseil/absei... failed: class java.io.FileNotFoundException GET returned 404 Not Found WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/pytorch/cpui... failed: class java.io.FileNotFoundException GET returned 404 Not Found Analyzing: target //tensorflow/tools/pip_package:build_pip_package (271 packages loaded, 4024 targets configured) WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/google/XNNPA... failed: class java.io.FileNotFoundException GET returned 404 Not Found Analyzing: target //tensorflow/tools/pip_package:build_pip_package (274 packages loaded, 4074 targets configured) WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/pybind/pybin... failed: class java.io.FileNotFoundException GET returned 404 Not Found ERROR: Traceback (most recent call last): File "/tmp/workspace/tensorflow-git/tensorflow/compiler/xla/pjrt/BUILD", line 737, column 17, in <toplevel> tf_proto_library( File "/tmp/workspace/tensorflow-git/tensorflow/core/platform/default/build_config.bzl", line 562, column 5, in tf_proto_library def tf_proto_library( Error: tf_proto_library() got unexpected keyword argument: deps ERROR: /tmp/workspace/tensorflow-git/tensorflow/compiler/tf2xla/kernels/BUILD:23:18: Target '//tensorflow/compiler/xla/pjrt:mlir_to_hlo' contains an error and its package is in error and referenced by '//tensorflow/compiler/tf2xla/kernels:xla_ops' INFO: Repository cython instantiated at: /tmp/workspace/tensorflow-git/WORKSPACE:15:14: in <toplevel> /tmp/workspace/tensorflow-git/tensorflow/workspace2.bzl:888:21: in workspace /tmp/workspace/tensorflow-git/tensorflow/workspace2.bzl:688:20: in _tf_repositories /tmp/workspace/tensorflow-git/third_party/repo.bzl:136:21: in tf_http_archive Repository rule _tf_http_archive defined at: /tmp/workspace/tensorflow-git/third_party/repo.bzl:89:35: in <toplevel> ERROR: Analysis of target '//tensorflow/tools/pip_package:build_pip_package' failed; build aborted: INFO: Elapsed time: 112.379s INFO: 0 processes. FAILED: Build did NOT complete successfully (467 packages loaded, 14806 targets configured) FAILED: Build did NOT complete successfully (467 packages loaded, 14806 targets configured) stderr_lines: <omitted> stdout: '' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=53 changed=32 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0
Tuesday 16 August 2022 18:25:44 +0000 (0:02:14.374) 0:15:09.593 ******** =============================================================================== python : build wheels of Python package h5py~=3.6.0 ------------------- 258.36s python : build wheels of Python package Keras_Applications ------------ 257.31s tensorflow : build TensorFlow git for cp37-cp37m ---------------------- 134.37s install bazel build requirements --------------------------------------- 48.50s tensorflow : populate cp37-cp37m virtualenv ---------------------------- 41.18s fetch tensorflow from git ---------------------------------------------- 32.46s python : install numpy build requirements ------------------------------ 28.80s python : create cp37-cp37m virtualenv ---------------------------------- 12.69s python : install h5py build requirements ------------------------------- 12.20s python : build wheels of Python package grpcio ------------------------- 11.62s python : build wheels of Python package scipy --------------------------- 9.40s install tensorflow build requirements ----------------------------------- 7.84s python : install scipy-1.7.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package --- 7.51s python : build wheels of Python package Keras_Preprocessing ------------- 5.65s tensorflow : remove TensorFlow git sources from previous build ---------- 4.95s Gathering Facts --------------------------------------------------------- 4.61s python : build wheels of Python package numpy>=1.20 --------------------- 4.21s python : enable EPEL ---------------------------------------------------- 3.08s python : install h5py-3.6.0-cp37-cp37m-linux_aarch64.whl Python package --- 2.98s python : install Keras_Preprocessing-1.1.2-py2.py3-none-any.whl Python package --- 2.21s Build step 'Execute shell' marked build as failure