See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/680/display/redirect
Changes:
------------------------------------------ [...truncated 772.98 KB...] //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 11.9s Stats over 50 runs: max = 11.9s, min = 4.1s, avg = 7.2s, dev = 2.3s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 5.9s Stats over 50 runs: max = 5.9s, min = 2.6s, avg = 3.6s, dev = 0.7s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 5.8s Stats over 50 runs: max = 5.8s, min = 2.8s, avg = 3.9s, dev = 0.8s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 31.0s Stats over 50 runs: max = 31.0s, min = 7.0s, avg = 15.3s, dev = 5.8s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 14.4s Stats over 50 runs: max = 14.4s, min = 3.2s, avg = 4.9s, dev = 1.7s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 11.5s Stats over 50 runs: max = 11.5s, min = 2.7s, avg = 4.5s, dev = 1.9s
Executed 3581 out of 3582 tests: 3581 tests pass and 1 fails to build. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages] *** Monday 06 February 2023 12:52:36 +0000 (0:24:15.164) 2:06:19.565 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save list of installed Python packages] *** Monday 06 February 2023 12:52:38 +0000 (0:00:01.862) 2:06:21.427 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests output to file] ******** Monday 06 February 2023 12:52:38 +0000 (0:00:00.696) 2:06:22.124 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests stderr output to file] *** Monday 06 February 2023 12:52:39 +0000 (0:00:00.692) 2:06:22.816 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Extract number of tests run] ****** Monday 06 February 2023 12:52:40 +0000 (0:00:00.735) 2:06:23.551 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show number of tests run] ********* Monday 06 February 2023 12:52:40 +0000 (0:00:00.077) 2:06:23.629 ******* ok: [localhost] => ut_tests_line: ''
TASK [tensorflow_in_container : (Python 3.9) Extract failed tests] ************* Monday 06 February 2023 12:52:40 +0000 (0:00:00.046) 2:06:23.675 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show which tests failed] ********** Monday 06 February 2023 12:52:40 +0000 (0:00:00.067) 2:06:23.743 ******* ok: [localhost] => tests_failed: 'FAILED: '
TASK [tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one] *** Monday 06 February 2023 12:52:40 +0000 (0:00:00.045) 2:06:23.789 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Get list of wheel files] ********** Monday 06 February 2023 12:57:19 +0000 (0:04:38.716) 2:11:02.506 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Get filename of latest wheel] ***** Monday 06 February 2023 12:57:19 +0000 (0:00:00.363) 2:11:02.869 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) move manylinux2014 wheel outside] *** Monday 06 February 2023 12:57:19 +0000 (0:00:00.064) 2:11:02.934 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Remove manylinux2014 wheel] ******* Monday 06 February 2023 12:57:22 +0000 (0:00:02.316) 2:11:05.251 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) stop build container] ************* Monday 06 February 2023 12:57:22 +0000 (0:00:00.378) 2:11:05.630 ******* changed: [localhost]
TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Monday 06 February 2023 13:00:51 +0000 (0:03:28.868) 2:14:34.499 ******* changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] *** Monday 06 February 2023 13:00:56 +0000 (0:00:05.634) 2:14:40.134 ******* skipping: [localhost]
TASK [Fetch TensorFlow] ******************************************************** Monday 06 February 2023 13:00:56 +0000 (0:00:00.038) 2:14:40.172 ******* skipping: [localhost]
TASK [(Python 3.10) patch TensorFlow tree] ************************************* Monday 06 February 2023 13:00:57 +0000 (0:00:00.037) 2:14:40.210 *******
TASK [tensorflow : Create linklibs shell script] ******************************* Monday 06 February 2023 13:00:57 +0000 (0:00:00.159) 2:14:40.370 ******* changed: [localhost]
TASK [tensorflow : Create readme file about unit tests] ************************ Monday 06 February 2023 13:00:57 +0000 (0:00:00.695) 2:14:41.065 ******* changed: [localhost]
TASK [tensorflow : Add to the copied files] ************************************ Monday 06 February 2023 13:00:58 +0000 (0:00:00.702) 2:14:41.768 ******* changed: [localhost]
TASK [tensorflow : Add to the long_description in setup.py] ******************** Monday 06 February 2023 13:00:58 +0000 (0:00:00.366) 2:14:42.135 ******* changed: [localhost]
TASK [tensorflow : Use nightly package requirements] *************************** Monday 06 February 2023 13:00:59 +0000 (0:00:00.362) 2:14:42.497 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.10) start build container] *********** Monday 06 February 2023 13:00:59 +0000 (0:00:00.393) 2:14:42.891 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.10) create buildslave bazel cache dir] *** Monday 06 February 2023 13:01:01 +0000 (0:00:01.469) 2:14:44.360 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.10) create link for bazel cache] ***** Monday 06 February 2023 13:01:01 +0000 (0:00:00.788) 2:14:45.149 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.10) create link for bazelisk cache] *** Monday 06 February 2023 13:01:02 +0000 (0:00:00.809) 2:14:45.958 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.10) create link for pip cache] ******* Monday 06 February 2023 13:01:03 +0000 (0:00:00.807) 2:14:46.766 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.10) copy upper constraints] ********** Monday 06 February 2023 13:01:04 +0000 (0:00:00.832) 2:14:47.598 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.10) install Python packages] ********* Monday 06 February 2023 13:01:05 +0000 (0:00:00.754) 2:14:48.352 ******* fatal: [localhost]: FAILED! => changed=true rc: 2 stderr: |- ERROR: Exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/pip/_internal/cli/base_command.py", line 160, in exc_logging_wrapper status = run_func(*args) File "/usr/local/lib/python3.10/dist-packages/pip/_internal/cli/req_command.py", line 247, in wrapper return func(self, options, args) File "/usr/local/lib/python3.10/dist-packages/pip/_internal/commands/install.py", line 415, in run requirement_set = resolver.resolve( File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/resolver.py", line 92, in resolve result = self._result = resolver.resolve( File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/resolvelib/resolvers.py", line 481, in resolve state = resolution.resolve(requirements, max_rounds=max_rounds) File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/resolvelib/resolvers.py", line 348, in resolve self._add_to_criteria(self.state.criteria, r, parent=None) File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/resolvelib/resolvers.py", line 172, in _add_to_criteria if not criterion.candidates: File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/resolvelib/structs.py", line 151, in __bool__ return bool(self._sequence) File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 155, in __bool__ return any(self) File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 143, in <genexpr> return (c for c in iterator if id(c) not in self._incompatible_ids) File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 47, in _iter_built candidate = func() File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/factory.py", line 206, in _make_candidate_from_link self._link_candidate_cache[link] = LinkCandidate( File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/candidates.py", line 297, in __init__ super().__init__( File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/candidates.py", line 162, in __init__ self.dist = self._prepare() File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/candidates.py", line 231, in _prepare dist = self._prepare_distribution() File "/usr/local/lib/python3.10/dist-packages/pip/_internal/resolution/resolvelib/candidates.py", line 308, in _prepare_distribution return preparer.prepare_linked_requirement(self._ireq, parallel_builds=True) File "/usr/local/lib/python3.10/dist-packages/pip/_internal/operations/prepare.py", line 491, in prepare_linked_requirement return self._prepare_linked_requirement(req, parallel_builds) File "/usr/local/lib/python3.10/dist-packages/pip/_internal/operations/prepare.py", line 577, in _prepare_linked_requirement dist = _get_prepared_distribution( File "/usr/local/lib/python3.10/dist-packages/pip/_internal/operations/prepare.py", line 69, in _get_prepared_distribution abstract_dist.prepare_distribution_metadata( File "/usr/local/lib/python3.10/dist-packages/pip/_internal/distributions/sdist.py", line 48, in prepare_distribution_metadata self._install_build_reqs(finder) File "/usr/local/lib/python3.10/dist-packages/pip/_internal/distributions/sdist.py", line 118, in _install_build_reqs build_reqs = self._get_build_requires_wheel() File "/usr/local/lib/python3.10/dist-packages/pip/_internal/distributions/sdist.py", line 95, in _get_build_requires_wheel return backend.get_requires_for_build_wheel() File "/usr/local/lib/python3.10/dist-packages/pip/_internal/utils/misc.py", line 701, in get_requires_for_build_wheel return super().get_requires_for_build_wheel(config_settings=cs) File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_impl.py", line 166, in get_requires_for_build_wheel return self._call_hook('get_requires_for_build_wheel', { File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_impl.py", line 321, in _call_hook raise BackendUnavailable(data.get('traceback', '')) pip._vendor.pyproject_hooks._impl.BackendUnavailable: Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 77, in _build_backend obj = import_module(mod_path) File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 992, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1004, in _find_and_load_unlocked ModuleNotFoundError: No module named 'setuptools' stderr_lines: <omitted> stdout: |- Collecting Cython>=0.29 Downloading Cython-0.29.33-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.manylinux_2_24_aarch64.whl (1.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 MB 10.6 MB/s eta 0:00:00 Requirement already satisfied: pip>=21 in /usr/local/lib/python3.10/dist-packages (from -r /tf/pkg/upper-constraints.txt (line 2)) (23.0) Requirement already satisfied: flatbuffers<3.0,>=1.12 in /usr/local/lib/python3.10/dist-packages (from -r /tf/pkg/upper-constraints.txt (line 5)) (2.0.7) Requirement already satisfied: gast==0.4.0 in /usr/local/lib/python3.10/dist-packages (from -r /tf/pkg/upper-constraints.txt (line 6)) (0.4.0) Requirement already satisfied: grpcio<2.0,>=1.37.0 in /usr/local/lib/python3.10/dist-packages (from -r /tf/pkg/upper-constraints.txt (line 7)) (1.49.1) Collecting h5py~=3.6.0 Downloading h5py-3.6.0.tar.gz (384 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 384.2/384.2 kB 10.8 MB/s eta 0:00:00 Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=90 changed=69 unreachable=0 failed=1 skipped=11 rescued=0 ignored=2
Monday 06 February 2023 13:01:19 +0000 (0:00:14.758) 2:15:03.111 ******* =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow git tests ------ 2742.21s tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 2224.20s tensorflow_in_container : (Python 3.9) run TensorFlow git tests ------ 1455.16s tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one - 452.86s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 278.72s tensorflow_in_container : (Python 3.8) stop build container ----------- 210.94s tensorflow_in_container : (Python 3.9) stop build container ----------- 208.87s tensorflow_in_container : (Python 3.9) build TensorFlow git ----------- 186.67s tensorflow_in_container : (Python 3.8) build Python package ------------ 96.75s tensorflow_in_container : (Python 3.9) build Python package ------------ 95.23s tensorflow_in_container : (Python 3.8) install Python packages --------- 25.63s tensorflow_in_container : (Python 3.9) install Python packages --------- 24.81s tensorflow : Fetch TensorFlow from git --------------------------------- 20.81s tensorflow_in_container : (Python 3.10) install Python packages -------- 14.76s tensorflow_in_container : Reset checkout to clean state ----------------- 5.63s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.69s tensorflow_in_container : (Python 3.8) start build container ------------ 2.73s Gathering Facts --------------------------------------------------------- 2.66s tensorflow_in_container : (Python 3.9) move manylinux2014 wheel outside --- 2.32s tensorflow_in_container : (Python 3.8) move manylinux2014 wheel outside --- 2.30s Build step 'Execute shell' marked build as failure