See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/157/display/redirect
Changes:
------------------------------------------ [...truncated 30.29 KB...] TASK [unpack tensorflow git source] ******************************************** Tuesday 02 November 2021 18:14:56 +0000 (0:00:00.053) 0:04:23.251 ****** skipping: [localhost]
TASK [tensorflow : copy configure script] ************************************** Tuesday 02 November 2021 18:14:56 +0000 (0:00:00.044) 0:04:23.295 ****** skipping: [localhost]
TASK [tensorflow : drop Python 2.7 deps] *************************************** Tuesday 02 November 2021 18:14:56 +0000 (0:00:00.042) 0:04:23.338 ****** skipping: [localhost] => (item=functools32) skipping: [localhost] => (item=enum34) skipping: [localhost] => (item=backports.weakref)
TASK [fetch tensorflow from git] *********************************************** Tuesday 02 November 2021 18:14:56 +0000 (0:00:00.070) 0:04:23.409 ****** changed: [localhost]
TASK [tensorflow : copy configure script] ************************************** Tuesday 02 November 2021 18:15:18 +0000 (0:00:21.452) 0:04:44.862 ****** changed: [localhost]
TASK [tensorflow : create readme file about unit tests] ************************ Tuesday 02 November 2021 18:15:18 +0000 (0:00:00.449) 0:04:45.311 ****** changed: [localhost]
TASK [tensorflow : add to the copied files] ************************************ Tuesday 02 November 2021 18:15:19 +0000 (0:00:00.463) 0:04:45.775 ****** changed: [localhost]
TASK [tensorflow : add to the long_description in setup.py] ******************** Tuesday 02 November 2021 18:15:19 +0000 (0:00:00.469) 0:04:46.245 ****** changed: [localhost]
TASK [tensorflow : build TensorFlow git for cp36-cp36m] ************************ Tuesday 02 November 2021 18:15:20 +0000 (0:00:00.467) 0:04:46.712 ****** fatal: [localhost]: FAILED! => changed=true cmd: |- set -xe source /tmp/workspace/venv-cp36-cp36m/bin/activate expect configure_tensorflow bazel clean --expunge export BAZEL_LINKLIBS=-l%:libstdc++.a bazel build --config=nonccl //tensorflow/tools/pip_package:build_pip_package --verbose_failures mkdir tensorflow-pkg bazel-bin/tensorflow/tools/pip_package/build_pip_package --cpu --project_name tensorflow_aarch64 ./tensorflow-pkg delta: '0:26:26.176092' end: '2021-11-02 18:41:46.499380' msg: non-zero return code rc: 1 start: '2021-11-02 18:15:20.323288' stderr: |- + source /tmp/workspace/venv-cp36-cp36m/bin/activate ++ deactivate nondestructive ++ '[' -n '' ']' ++ '[' -n '' ']' ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r ++ '[' -n '' ']' ++ unset VIRTUAL_ENV ++ '[' '!' nondestructive = nondestructive ']' ++ VIRTUAL_ENV=/tmp/workspace/venv-cp36-cp36m ++ export VIRTUAL_ENV ++ _OLD_VIRTUAL_PATH=/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ PATH=/tmp/workspace/venv-cp36-cp36m/bin:/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ export PATH ++ '[' -n '' ']' ++ '[' -z '' ']' ++ _OLD_VIRTUAL_PS1= ++ '[' 'x(venv-cp36-cp36m) ' '!=' x ']' ++ PS1='(venv-cp36-cp36m) ' ++ export PS1 ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r + expect configure_tensorflow + bazel clean --expunge Extracting Bazel installation... Starting local Bazel server and connecting to it... INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'build' options: --define framework_shared_object=true --java_toolchain=@tf_toolchains//toolchains/java:tf_java_toolchain --host_java_toolchain=@tf_toolchains//toolchains/java:tf_java_toolchain --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: Inherited 'build' options: --action_env PYTHON_BIN_PATH=/tmp/workspace/venv-cp36-cp36m/bin/python3 --action_env PYTHON_LIB_PATH=/tmp/workspace/venv-cp36-cp36m/lib/python3.6/site-packages --python_path=/tmp/workspace/venv-cp36-cp36m/bin/python3 INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/fallback,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Found applicable config definition build:short_logs in file /tmp/workspace/tensorflow-git/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tmp/workspace/tensorflow-git/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:linux in file /tmp/workspace/tensorflow-git/.bazelrc: --copt=-w --host_copt=-w --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++14 --host_cxxopt=-std=c++14 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tmp/workspace/tensorflow-git/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS INFO: Starting clean (this may take a while). Consider using --async if the clean takes more than several minutes. + export BAZEL_LINKLIBS=-l%:libstdc++.a + BAZEL_LINKLIBS=-l%:libstdc++.a + bazel build --config=nonccl //tensorflow/tools/pip_package:build_pip_package --verbose_failures Starting local Bazel server and connecting to it... INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: 'build' options: --define framework_shared_object=true --java_toolchain=@tf_toolchains//toolchains/java:tf_java_toolchain --host_java_toolchain=@tf_toolchains//toolchains/java:tf_java_toolchain --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: 'build' options: --action_env PYTHON_BIN_PATH=/tmp/workspace/venv-cp36-cp36m/bin/python3 --action_env PYTHON_LIB_PATH=/tmp/workspace/venv-cp36-cp36m/lib/python3.6/site-packages --python_path=/tmp/workspace/venv-cp36-cp36m/bin/python3 INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: 'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/fallback,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Found applicable config definition build:short_logs in file /tmp/workspace/tensorflow-git/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tmp/workspace/tensorflow-git/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:nonccl in file /tmp/workspace/tensorflow-git/.bazelrc: --define=no_nccl_support=true INFO: Found applicable config definition build:linux in file /tmp/workspace/tensorflow-git/.bazelrc: --copt=-w --host_copt=-w --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++14 --host_cxxopt=-std=c++14 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tmp/workspace/tensorflow-git/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from http://mirror.tensorflow.org/github.com/tensorflow/runtime/archive/cf4f978c4... failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-pr... failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found Loading: 0 packages loaded Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) DEBUG: Rule 'io_bazel_rules_docker' indicated that a canonical reproducible form can be obtained by modifying arguments shallow_since = "1596824487 -0400" DEBUG: Repository io_bazel_rules_docker instantiated at: /tmp/workspace/tensorflow-git/WORKSPACE:23:14: in <toplevel> /tmp/workspace/tensorflow-git/tensorflow/workspace0.bzl:108:34: in workspace /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/external/bazel_toolchains/repositories/repositories.bzl:35:23: in repositories Repository rule git_repository defined at: /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/external/bazel_tools/tools/build_defs/repo/git.bzl:199:33: in <toplevel> Analyzing: target //tensorflow/tools/pip_package:build_pip_package (234 packages loaded, 3907 targets configured) Analyzing: target //tensorflow/tools/pip_package:build_pip_package (240 packages loaded, 3924 targets configured) Analyzing: target //tensorflow/tools/pip_package:build_pip_package (243 packages loaded, 3978 targets configured) WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/google/XNNPA... failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (431 packages loaded, 25563 targets configured). INFO: Found 1 target... [0 / 577] [Prepa] Expanding template tensorflow/lite/tools/visualize ... (15 actions, 0 running) [1,265 / 10,083] Compiling tensorflow/python/framework/python_api_dispatcher_wrapper.cc; 10s local ... (56 actions, 55 running) [1,798 / 10,083] Compiling llvm-project/llvm/lib/TableGen/TGParser.cpp; 8s local ... (56 actions, 55 running) [2,422 / 10,083] Compiling llvm-project/llvm/utils/TableGen/CodeGenDAGPatterns.cpp; 17s local ... (56 actions, 55 running) [3,337 / 10,083] Compiling boringssl/src/crypto/fipsmodule/bcm.c; 10s local ... (56 actions, 55 running) [3,953 / 10,083] Compiling org_sqlite/sqlite3.c; 22s local ... (56 actions, 55 running) [4,848 / 10,083] Compiling org_sqlite/sqlite3.c; 46s local ... (56 actions, 55 running) [5,089 / 10,083] Compiling tensorflow/compiler/mlir/hlo/lib/Dialect/mhlo/transforms/hlo_legalize_to_lhlo.cc; 20s local ... (56 actions, 55 running) [5,265 / 10,083] Compiling llvm-project/llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local ... (56 actions running) [5,660 / 10,083] Compiling tensorflow/python/util/tf_stack.cc; 19s local ... (56 actions running) [5,945 / 10,083] Compiling tensorflow/stream_executor/stream.cc; 28s local ... (56 actions running) [6,154 / 10,083] Compiling tensorflow/core/util/batch_util.cc; 70s local ... (56 actions running) [6,358 / 10,083] Compiling tensorflow/core/kernels/bias_op.cc; 60s local ... (56 actions running) [6,770 / 10,083] Compiling llvm-project/llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local ... (56 actions running) [7,092 / 10,083] Compiling tensorflow/compiler/mlir/hlo/lib/Dialect/mhlo/transforms/legalize_to_linalg.cc; 86s local ... (56 actions running) [7,625 / 10,083] Compiling tensorflow/core/kernels/sdca_internal.cc; 31s local ... (56 actions running) [7,863 / 10,083] Compiling tensorflow/core/kernels/cwise_op_select.cc; 94s local ... (56 actions running) [8,051 / 10,083] Compiling tensorflow/core/kernels/conv_grad_ops_3d.cc; 189s local ... (56 actions running) [8,400 / 10,083] Compiling tensorflow/core/kernels/matmul_op_real.cc; 176s local ... (56 actions running) [8,900 / 10,083] Compiling tensorflow/core/kernels/matmul_op_real.cc; 325s local ... (56 actions running) [10,347 / 10,805] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 206s local ... (56 actions running) [10,752 / 10,805] Compiling tensorflow/compiler/mlir/lite/ir/tfl_ops.cc; 171s local Target //tensorflow/tools/pip_package:build_pip_package up-to-date: bazel-bin/tensorflow/tools/pip_package/build_pip_package INFO: Elapsed time: 1559.143s, Critical Path: 418.44s INFO: 10805 processes: 1301 internal, 9504 local. INFO: Build completed successfully, 10805 total actions INFO: Build completed successfully, 10805 total actions + mkdir tensorflow-pkg + bazel-bin/tensorflow/tools/pip_package/build_pip_package --cpu --project_name tensorflow_aarch64 ./tensorflow-pkg error in tensorflow_aarch64 setup command: 'install_requires' must be a string or list of strings containing valid project/version requirement specifiers; Parse error at "'< 2.8'": Expected stringEnd stderr_lines: <omitted> stdout: |- spawn ./configure You have bazel 3.7.2 installed. Please specify the location of python. [Default is /tmp/workspace/venv-cp36-cp36m/bin/python3]:
Found possible Python library paths: /tmp/workspace/venv-cp36-cp36m/lib/python3.6/site-packages Please input the desired Python library path to use. Default is [/tmp/workspace/venv-cp36-cp36m/lib/python3.6/site-packages]
Do you wish to build TensorFlow with ROCm support? [y/N]: n No ROCm support will be enabled for TensorFlow.
Do you wish to build TensorFlow with CUDA support? [y/N]: n No CUDA support will be enabled for TensorFlow.
Do you wish to download a fresh release of clang? (Experimental) [y/N]: n Clang will not be downloaded.
Please specify optimization flags to use during compilation when bazel option "--config=opt" is specified [Default is -Wno-sign-compare]:
Would you like to interactively configure ./WORKSPACE for Android builds? [y/N]: n Not configuring the WORKSPACE for Android builds.
Preconfigured Bazel build configs. You can use any of the below by adding "--config=<>" to your build command. See .bazelrc for more details. --config=mkl # Build with MKL support. --config=mkl_aarch64 # Build with oneDNN and Compute Library for the Arm Architecture (ACL). --config=monolithic # Config for mostly static monolithic build. --config=numa # Build with NUMA support. --config=dynamic_kernels # (Experimental) Build kernels into separate shared objects. --config=v1 # Build with TensorFlow 1 API instead of TF 2 API. Preconfigured Bazel build configs to DISABLE default on features: --config=nogcp # Disable GCP support. --config=nonccl # Disable NVIDIA NCCL support. Configuration finished Tue Nov 2 18:41:26 UTC 2021 : === Preparing sources in dir: /tmp/tmp.lFLNzVyOQS /tmp/workspace/tensorflow-git /tmp/workspace/tensorflow-git /tmp/workspace/tensorflow-git /tmp/workspace/tensorflow-git/bazel-bin/tensorflow/tools/pip_package/build_pip_package.runfiles/org_tensorflow /tmp/workspace/tensorflow-git /tmp/workspace/tensorflow-git /tmp/tmp.lFLNzVyOQS/tensorflow/include /tmp/workspace/tensorflow-git /tmp/workspace/tensorflow-git Tue Nov 2 18:41:45 UTC 2021 : === Building wheel stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=43 changed=26 unreachable=0 failed=1 skipped=9 rescued=0 ignored=0
Tuesday 02 November 2021 18:41:46 +0000 (0:26:26.476) 0:31:13.189 ****** =============================================================================== tensorflow : build TensorFlow git for cp36-cp36m --------------------- 1586.48s install bazel build requirements --------------------------------------- 52.64s python : install numpy build requirements ------------------------------ 38.17s tensorflow : populate cp36-cp36m virtualenv ---------------------------- 33.24s python : install h5py build requirements ------------------------------- 26.34s fetch tensorflow from git ---------------------------------------------- 21.45s bazel : fetch Bazel 3.7.2 binary from Github --------------------------- 15.06s python : create cp36-cp36m virtualenv ---------------------------------- 13.50s python : build wheels of Python package grpcio -------------------------- 8.78s python : build wheels of Python package scipy --------------------------- 7.71s python : build wheels of Python package Keras_Applications -------------- 7.66s install tensorflow build requirements ----------------------------------- 7.59s python : build wheels of Python package h5py~=3.1.0 --------------------- 6.91s python : install scipy-1.5.4-cp36-cp36m-manylinux2014_aarch64.whl Python package --- 6.53s python : build wheels of Python package Keras_Preprocessing ------------- 6.12s Gathering Facts --------------------------------------------------------- 4.56s python : build wheels of Python package numpy~=1.19.5 ------------------- 4.36s tensorflow : remove TensorFlow git sources from previous build ---------- 4.30s python : enable EPEL ---------------------------------------------------- 2.99s python : install h5py-3.1.0-cp36-cp36m-linux_aarch64.whl Python package --- 2.78s Build step 'Execute shell' marked build as failure