Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #807
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/8…>
Changes:
------------------------------------------
[...truncated 7.14 KiB...]
TASK [tensorflow : Record git commit hash to variable] *************************
Tuesday 21 May 2024 01:11:31 +0100 (0:00:00.035) 0:01:26.096 ***********
ok: [localhost]
TASK [tensorflow : Save git commit hash to file] *******************************
Tuesday 21 May 2024 01:11:31 +0100 (0:00:00.055) 0:01:26.152 ***********
changed: [localhost]
TASK [Build TensorFlow for each Python version (dual abi)] *********************
Tuesday 21 May 2024 01:11:33 +0100 (0:00:01.107) 0:01:27.260 ***********
TASK [tensorflow_in_container : Reset checkout to clean state] *****************
Tuesday 21 May 2024 01:11:33 +0100 (0:00:00.433) 0:01:27.693 ***********
changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow-oneDNN-ACL git sources from previous build] ***
Tuesday 21 May 2024 01:11:34 +0100 (0:00:00.650) 0:01:28.344 ***********
skipping: [localhost]
TASK [Fetch TensorFlow] ********************************************************
Tuesday 21 May 2024 01:11:34 +0100 (0:00:00.029) 0:01:28.374 ***********
skipping: [localhost]
TASK [(Python 3.9) patch TensorFlow tree] **************************************
Tuesday 21 May 2024 01:11:34 +0100 (0:00:00.030) 0:01:28.405 ***********
TASK [tensorflow : Create linklibs shell script] *******************************
Tuesday 21 May 2024 01:11:34 +0100 (0:00:00.081) 0:01:28.487 ***********
changed: [localhost]
TASK [tensorflow : Use nightly package requirements] ***************************
Tuesday 21 May 2024 01:11:34 +0100 (0:00:00.686) 0:01:29.173 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds] ***
Tuesday 21 May 2024 01:11:35 +0100 (0:00:00.632) 0:01:29.805 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] ***
Tuesday 21 May 2024 01:11:36 +0100 (0:00:00.682) 0:01:30.488 ***********
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) start build container] ************
Tuesday 21 May 2024 01:11:37 +0100 (0:00:01.717) 0:01:32.205 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir] ***
Tuesday 21 May 2024 01:11:56 +0100 (0:00:18.198) 0:01:50.404 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazel cache] ******
Tuesday 21 May 2024 01:11:57 +0100 (0:00:01.212) 0:01:51.617 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazelisk cache] ***
Tuesday 21 May 2024 01:11:58 +0100 (0:00:00.842) 0:01:52.460 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for pip cache] ********
Tuesday 21 May 2024 01:11:59 +0100 (0:00:00.816) 0:01:53.276 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build] ***
Tuesday 21 May 2024 01:11:59 +0100 (0:00:00.899) 0:01:54.176 ***********
changed: [localhost]
TASK [tensorflow_in_container : Show list of installed Python packages for build] ***
Tuesday 21 May 2024 01:12:03 +0100 (0:00:03.435) 0:01:57.612 ***********
ok: [localhost] =>
pip_list_output.stdout: |-
Package Version Location Installer
------------------- -------------------- -------------------------------------- ---------
auditwheel 5.4.0 /usr/local/lib/python3.9/dist-packages pip
certifi 2019.11.28 /usr/lib/python3/dist-packages
cffi 1.16.0 /usr/local/lib/python3.9/dist-packages pip
chardet 3.0.4 /usr/lib/python3/dist-packages
cryptography 42.0.5 /usr/local/lib/python3.9/dist-packages pip
Cython 3.0.9 /usr/local/lib/python3.9/dist-packages pip
dbus-python 1.2.16 /usr/lib/python3/dist-packages
docutils 0.20.1 /usr/local/lib/python3.9/dist-packages pip
idna 2.8 /usr/lib/python3/dist-packages
importlib-metadata 7.0.1 /usr/local/lib/python3.9/dist-packages pip
jaraco.classes 3.3.1 /usr/local/lib/python3.9/dist-packages pip
jeepney 0.8.0 /usr/local/lib/python3.9/dist-packages pip
keyring 24.3.1 /usr/local/lib/python3.9/dist-packages pip
markdown-it-py 3.0.0 /usr/local/lib/python3.9/dist-packages pip
mdurl 0.1.2 /usr/local/lib/python3.9/dist-packages pip
more-itertools 10.2.0 /usr/local/lib/python3.9/dist-packages pip
nh3 0.2.15 /usr/local/lib/python3.9/dist-packages pip
pip 24.0 /usr/local/lib/python3.9/dist-packages pip
pkginfo 1.10.0 /usr/local/lib/python3.9/dist-packages pip
portpicker 1.6.0 /usr/local/lib/python3.9/dist-packages pip
psutil 5.9.8 /usr/local/lib/python3.9/dist-packages pip
pycparser 2.21 /usr/local/lib/python3.9/dist-packages pip
pyelftools 0.30 /usr/local/lib/python3.9/dist-packages pip
Pygments 2.17.2 /usr/local/lib/python3.9/dist-packages pip
PyGObject 3.36.0 /usr/lib/python3/dist-packages
python-apt 2.0.1+ubuntu0.20.4.1 /usr/lib/python3/dist-packages
readme_renderer 43.0 /usr/local/lib/python3.9/dist-packages pip
requests 2.22.0 /usr/lib/python3/dist-packages
requests-toolbelt 1.0.0 /usr/local/lib/python3.9/dist-packages pip
requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages
rfc3986 2.0.0 /usr/local/lib/python3.9/dist-packages pip
rich 13.7.1 /usr/local/lib/python3.9/dist-packages pip
SecretStorage 3.3.3 /usr/local/lib/python3.9/dist-packages pip
setuptools 69.1.1 /usr/local/lib/python3.9/dist-packages pip
six 1.14.0 /usr/lib/python3/dist-packages
twine 4.0.2 /usr/local/lib/python3.9/dist-packages pip
urllib3 2.2.1 /usr/local/lib/python3.9/dist-packages pip
wheel 0.42.0 /usr/local/lib/python3.9/dist-packages pip
zipp 3.17.0 /usr/local/lib/python3.9/dist-packages pip
TASK [tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git] ***
Tuesday 21 May 2024 01:12:03 +0100 (0:00:00.037) 0:01:57.649 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python package] *************
Tuesday 21 May 2024 02:45:32 +0100 (1:33:28.823) 1:35:26.473 ***********
skipping: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Copy built wheel] *****************
Tuesday 21 May 2024 02:45:32 +0100 (0:00:00.032) 1:35:26.505 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) cleanup Bazel install directory] ***
Tuesday 21 May 2024 02:45:33 +0100 (0:00:01.010) 1:35:27.516 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create script to run tests] *******
Tuesday 21 May 2024 02:45:34 +0100 (0:00:00.964) 1:35:28.481 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) run TensorFlow-oneDNN-ACL git tests] ***
Tuesday 21 May 2024 02:45:34 +0100 (0:00:00.706) 1:35:29.187 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages] ***
Tuesday 21 May 2024 04:54:45 +0100 (2:09:10.985) 3:44:40.173 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save list of installed Python packages] ***
Tuesday 21 May 2024 04:54:48 +0100 (0:00:02.215) 3:44:42.388 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests output to file] ********
Tuesday 21 May 2024 04:54:48 +0100 (0:00:00.712) 3:44:43.101 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests stderr output to file] ***
Tuesday 21 May 2024 04:54:49 +0100 (0:00:00.712) 3:44:43.813 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Extract number of tests run] ******
Tuesday 21 May 2024 04:54:50 +0100 (0:00:00.724) 3:44:44.537 ***********
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show number of tests run] *********
Tuesday 21 May 2024 04:54:50 +0100 (0:00:00.079) 3:44:44.617 ***********
ok: [localhost] =>
ut_tests_line: 'Executed 3085 out of 3085 tests: 3085 tests pass.'
TASK [tensorflow_in_container : (Python 3.9) Extract failed tests] *************
Tuesday 21 May 2024 04:54:50 +0100 (0:00:00.041) 3:44:44.658 ***********
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show which tests are flaky] *******
Tuesday 21 May 2024 04:54:50 +0100 (0:00:00.131) 3:44:44.790 ***********
ok: [localhost] =>
tests_flaky:
- //tensorflow/core/kernels:batch_kernels_test FLAKY, failed in 1 out of 2 in 48.5s
- //tensorflow/core/kernels/mkl:mkl_qmatmul_op_test FLAKY, failed in 1 out of 2 in 0.5s
TASK [tensorflow_in_container : (Python 3.9) Show which tests failed] **********
Tuesday 21 May 2024 04:54:50 +0100 (0:00:00.041) 3:44:44.832 ***********
ok: [localhost] =>
tests_failed: []
TASK [tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one] ***
Tuesday 21 May 2024 04:54:50 +0100 (0:00:00.041) 3:44:44.873 ***********
fatal: [localhost]: FAILED! => changed=true
rc: 1
stderr: |-
+ for wheel in /tf/pkg/*.whl
+ echo 'Checking and renaming /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl...'
+ python3 -m auditwheel repair --plat manylinux2014_aarch64 /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl --wheel-dir /tf/pkg
+ tee check.txt
real 1m28.486s
user 1m10.791s
sys 0m17.263s
stderr_lines: <omitted>
stdout: |-
Checking and renaming /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl...
INFO:auditwheel.main_repair:Repairing tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl
Traceback (most recent call last):
File "/usr/local/lib/python3.9/dist-packages/auditwheel/repair.py", line 80, in repair_wheel
raise ValueError(
ValueError: Cannot repair wheel, because required library "_pywrap_tensorflow_internal.so" could not be located
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.9/runpy.py", line 197, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.9/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/usr/local/lib/python3.9/dist-packages/auditwheel/__main__.py", line 8, in <module>
sys.exit(main())
File "/usr/local/lib/python3.9/dist-packages/auditwheel/main.py", line 59, in main
rval = args.func(args, p)
File "/usr/local/lib/python3.9/dist-packages/auditwheel/main_repair.py", line 175, in execute
out_wheel = repair_wheel(
File "/usr/local/lib/python3.9/dist-packages/auditwheel/repair.py", line 118, in repair_wheel
strip_symbols(itertools.chain(libs_to_strip, extensions))
File "/usr/local/lib/python3.9/dist-packages/auditwheel/wheeltools.py", line 137, in __exit__
dir2zip(self.name, self.out_wheel, date_time)
File "/usr/local/lib/python3.9/dist-packages/auditwheel/tools.py", line 76, in dir2zip
with zipfile.ZipFile(zip_fname, "w", compression=compression) as z:
File "/usr/lib/python3.9/zipfile.py", line 1248, in __init__
self.fp = io.open(file, filemode)
PermissionError: [Errno 13] Permission denied: '/tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl'
stdout_lines: <omitted>
PLAY RECAP *********************************************************************
localhost : ok=39 changed=26 unreachable=0 failed=1 skipped=7 rescued=0 ignored=0
Tuesday 21 May 2024 04:56:19 +0100 (0:01:29.341) 3:46:14.214 ***********
===============================================================================
tensorflow_in_container : (Python 3.9) run TensorFlow-oneDNN-ACL git tests 7750.99s
tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git 5608.82s
tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one -- 89.34s
Cleanup after previous build ------------------------------------------- 47.84s
tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 23.31s
tensorflow_in_container : (Python 3.9) start build container ----------- 18.20s
tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 9.40s
tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 3.44s
Gathering Facts --------------------------------------------------------- 2.66s
tensorflow_in_container : (Python 3.9) collect list of installed Python packages --- 2.22s
tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.72s
Create cache dirs ------------------------------------------------------- 1.44s
tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.21s
tensorflow : Save git commit hash to file ------------------------------- 1.11s
tensorflow_in_container : (Python 3.9) Copy built wheel ----------------- 1.01s
tensorflow_in_container : (Python 3.9) cleanup Bazel install directory --- 0.96s
tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.90s
tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.84s
tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.82s
tensorflow_in_container : (Python 3.9) save tests stderr output to file --- 0.72s
Build step 'Execute shell' marked build as failure
3 months, 4 weeks
- 1
- 3
Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #1177
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/1177/dis…>
Changes:
------------------------------------------
[...truncated 6.63 KiB...]
git_log.stdout: bb20154baa8ace6ac2ebfde8112be8dfccfd4e08 Move MatchShapeCoveringDynamicIndex function to while_loop_unroller.h and update other usages to use the same method.
TASK [tensorflow : Record git commit hash to variable] *************************
Tuesday 21 May 2024 19:11:05 +0100 (0:00:00.037) 0:01:01.331 ***********
ok: [localhost]
TASK [tensorflow : Save git commit hash to file] *******************************
Tuesday 21 May 2024 19:11:05 +0100 (0:00:00.055) 0:01:01.386 ***********
changed: [localhost]
TASK [Build TensorFlow for each Python version (dual abi)] *********************
Tuesday 21 May 2024 19:11:06 +0100 (0:00:01.094) 0:01:02.481 ***********
TASK [tensorflow_in_container : Reset checkout to clean state] *****************
Tuesday 21 May 2024 19:11:07 +0100 (0:00:00.409) 0:01:02.891 ***********
changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] ***
Tuesday 21 May 2024 19:11:07 +0100 (0:00:00.661) 0:01:03.552 ***********
skipping: [localhost]
TASK [Fetch TensorFlow] ********************************************************
Tuesday 21 May 2024 19:11:07 +0100 (0:00:00.030) 0:01:03.583 ***********
skipping: [localhost]
TASK [(Python 3.9) patch TensorFlow tree] **************************************
Tuesday 21 May 2024 19:11:07 +0100 (0:00:00.031) 0:01:03.614 ***********
TASK [tensorflow : Create linklibs shell script] *******************************
Tuesday 21 May 2024 19:11:07 +0100 (0:00:00.081) 0:01:03.696 ***********
changed: [localhost]
TASK [tensorflow : Use nightly package requirements] ***************************
Tuesday 21 May 2024 19:11:08 +0100 (0:00:00.688) 0:01:04.384 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds] ***
Tuesday 21 May 2024 19:11:09 +0100 (0:00:00.622) 0:01:05.007 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] ***
Tuesday 21 May 2024 19:11:09 +0100 (0:00:00.679) 0:01:05.686 ***********
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) start build container] ************
Tuesday 21 May 2024 19:11:11 +0100 (0:00:01.496) 0:01:07.183 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir] ***
Tuesday 21 May 2024 19:11:15 +0100 (0:00:03.780) 0:01:10.964 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazel cache] ******
Tuesday 21 May 2024 19:11:16 +0100 (0:00:01.198) 0:01:12.163 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazelisk cache] ***
Tuesday 21 May 2024 19:11:17 +0100 (0:00:00.858) 0:01:13.022 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for pip cache] ********
Tuesday 21 May 2024 19:11:17 +0100 (0:00:00.831) 0:01:13.853 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build] ***
Tuesday 21 May 2024 19:11:18 +0100 (0:00:00.856) 0:01:14.710 ***********
changed: [localhost]
TASK [tensorflow_in_container : Show list of installed Python packages for build] ***
Tuesday 21 May 2024 19:11:20 +0100 (0:00:01.859) 0:01:16.570 ***********
ok: [localhost] =>
pip_list_output.stdout: |-
Package Version Location Installer
------------------- -------------------- -------------------------------------- ---------
auditwheel 5.4.0 /usr/local/lib/python3.9/dist-packages pip
certifi 2019.11.28 /usr/lib/python3/dist-packages
cffi 1.16.0 /usr/local/lib/python3.9/dist-packages pip
chardet 3.0.4 /usr/lib/python3/dist-packages
cryptography 42.0.5 /usr/local/lib/python3.9/dist-packages pip
Cython 3.0.9 /usr/local/lib/python3.9/dist-packages pip
dbus-python 1.2.16 /usr/lib/python3/dist-packages
docutils 0.20.1 /usr/local/lib/python3.9/dist-packages pip
idna 2.8 /usr/lib/python3/dist-packages
importlib-metadata 7.0.1 /usr/local/lib/python3.9/dist-packages pip
jaraco.classes 3.3.1 /usr/local/lib/python3.9/dist-packages pip
jeepney 0.8.0 /usr/local/lib/python3.9/dist-packages pip
keyring 24.3.1 /usr/local/lib/python3.9/dist-packages pip
markdown-it-py 3.0.0 /usr/local/lib/python3.9/dist-packages pip
mdurl 0.1.2 /usr/local/lib/python3.9/dist-packages pip
more-itertools 10.2.0 /usr/local/lib/python3.9/dist-packages pip
nh3 0.2.15 /usr/local/lib/python3.9/dist-packages pip
pip 24.0 /usr/local/lib/python3.9/dist-packages pip
pkginfo 1.10.0 /usr/local/lib/python3.9/dist-packages pip
portpicker 1.6.0 /usr/local/lib/python3.9/dist-packages pip
psutil 5.9.8 /usr/local/lib/python3.9/dist-packages pip
pycparser 2.21 /usr/local/lib/python3.9/dist-packages pip
pyelftools 0.30 /usr/local/lib/python3.9/dist-packages pip
Pygments 2.17.2 /usr/local/lib/python3.9/dist-packages pip
PyGObject 3.36.0 /usr/lib/python3/dist-packages
python-apt 2.0.1+ubuntu0.20.4.1 /usr/lib/python3/dist-packages
readme_renderer 43.0 /usr/local/lib/python3.9/dist-packages pip
requests 2.22.0 /usr/lib/python3/dist-packages
requests-toolbelt 1.0.0 /usr/local/lib/python3.9/dist-packages pip
requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages
rfc3986 2.0.0 /usr/local/lib/python3.9/dist-packages pip
rich 13.7.1 /usr/local/lib/python3.9/dist-packages pip
SecretStorage 3.3.3 /usr/local/lib/python3.9/dist-packages pip
setuptools 69.1.1 /usr/local/lib/python3.9/dist-packages pip
six 1.14.0 /usr/lib/python3/dist-packages
twine 4.0.2 /usr/local/lib/python3.9/dist-packages pip
urllib3 2.2.1 /usr/local/lib/python3.9/dist-packages pip
wheel 0.42.0 /usr/local/lib/python3.9/dist-packages pip
zipp 3.17.0 /usr/local/lib/python3.9/dist-packages pip
TASK [tensorflow_in_container : (Python 3.9) build TensorFlow git] *************
Tuesday 21 May 2024 19:11:20 +0100 (0:00:00.037) 0:01:16.607 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python package] *************
Tuesday 21 May 2024 20:15:48 +0100 (1:04:28.041) 1:05:44.648 ***********
skipping: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Copy built wheel] *****************
Tuesday 21 May 2024 20:15:48 +0100 (0:00:00.033) 1:05:44.682 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) cleanup Bazel install directory] ***
Tuesday 21 May 2024 20:15:49 +0100 (0:00:01.015) 1:05:45.697 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create script to run tests] *******
Tuesday 21 May 2024 20:15:50 +0100 (0:00:00.905) 1:05:46.603 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) run TensorFlow git tests] *********
Tuesday 21 May 2024 20:15:51 +0100 (0:00:00.712) 1:05:47.316 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages] ***
Tuesday 21 May 2024 22:13:49 +0100 (1:57:57.554) 3:03:44.870 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save list of installed Python packages] ***
Tuesday 21 May 2024 22:13:51 +0100 (0:00:02.332) 3:03:47.202 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests output to file] ********
Tuesday 21 May 2024 22:13:52 +0100 (0:00:00.694) 3:03:47.897 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests stderr output to file] ***
Tuesday 21 May 2024 22:13:52 +0100 (0:00:00.693) 3:03:48.591 ***********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Extract number of tests run] ******
Tuesday 21 May 2024 22:13:53 +0100 (0:00:00.699) 3:03:49.290 ***********
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show number of tests run] *********
Tuesday 21 May 2024 22:13:53 +0100 (0:00:00.075) 3:03:49.365 ***********
ok: [localhost] =>
ut_tests_line: 'Executed 3086 out of 3086 tests: 3086 tests pass.'
TASK [tensorflow_in_container : (Python 3.9) Extract failed tests] *************
Tuesday 21 May 2024 22:13:53 +0100 (0:00:00.039) 3:03:49.405 ***********
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show which tests are flaky] *******
Tuesday 21 May 2024 22:13:53 +0100 (0:00:00.123) 3:03:49.529 ***********
ok: [localhost] =>
tests_flaky: []
TASK [tensorflow_in_container : (Python 3.9) Show which tests failed] **********
Tuesday 21 May 2024 22:13:53 +0100 (0:00:00.038) 3:03:49.567 ***********
ok: [localhost] =>
tests_failed: []
TASK [tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one] ***
Tuesday 21 May 2024 22:13:53 +0100 (0:00:00.039) 3:03:49.607 ***********
fatal: [localhost]: FAILED! => changed=true
rc: 1
stderr: |-
+ for wheel in /tf/pkg/*.whl
+ echo 'Checking and renaming /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl...'
+ python3 -m auditwheel repair --plat manylinux2014_aarch64 /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl --wheel-dir /tf/pkg
+ tee check.txt
real 1m22.487s
user 1m7.324s
sys 0m14.941s
stderr_lines: <omitted>
stdout: |-
Checking and renaming /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl...
INFO:auditwheel.main_repair:Repairing tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl
Traceback (most recent call last):
File "/usr/local/lib/python3.9/dist-packages/auditwheel/repair.py", line 80, in repair_wheel
raise ValueError(
ValueError: Cannot repair wheel, because required library "_pywrap_tensorflow_internal.so" could not be located
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.9/runpy.py", line 197, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.9/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/usr/local/lib/python3.9/dist-packages/auditwheel/__main__.py", line 8, in <module>
sys.exit(main())
File "/usr/local/lib/python3.9/dist-packages/auditwheel/main.py", line 59, in main
rval = args.func(args, p)
File "/usr/local/lib/python3.9/dist-packages/auditwheel/main_repair.py", line 175, in execute
out_wheel = repair_wheel(
File "/usr/local/lib/python3.9/dist-packages/auditwheel/repair.py", line 118, in repair_wheel
strip_symbols(itertools.chain(libs_to_strip, extensions))
File "/usr/local/lib/python3.9/dist-packages/auditwheel/wheeltools.py", line 137, in __exit__
dir2zip(self.name, self.out_wheel, date_time)
File "/usr/local/lib/python3.9/dist-packages/auditwheel/tools.py", line 76, in dir2zip
with zipfile.ZipFile(zip_fname, "w", compression=compression) as z:
File "/usr/lib/python3.9/zipfile.py", line 1248, in __init__
self.fp = io.open(file, filemode)
PermissionError: [Errno 13] Permission denied: '/tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl'
stdout_lines: <omitted>
PLAY RECAP *********************************************************************
localhost : ok=39 changed=26 unreachable=0 failed=1 skipped=7 rescued=0 ignored=0
Tuesday 21 May 2024 22:15:17 +0100 (0:01:23.318) 3:05:12.925 ***********
===============================================================================
tensorflow_in_container : (Python 3.9) run TensorFlow git tests ------ 7077.55s
tensorflow_in_container : (Python 3.9) build TensorFlow git ---------- 3868.04s
tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one -- 83.32s
Cleanup after previous build ------------------------------------------- 31.85s
tensorflow : Fetch TensorFlow from git --------------------------------- 20.85s
tensorflow : Remove TensorFlow git sources from previous build ---------- 4.14s
tensorflow_in_container : (Python 3.9) start build container ------------ 3.78s
tensorflow_in_container : (Python 3.9) collect list of installed Python packages --- 2.33s
tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 1.86s
Gathering Facts --------------------------------------------------------- 1.63s
tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.50s
Create cache dirs ------------------------------------------------------- 1.42s
tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.20s
tensorflow : Save git commit hash to file ------------------------------- 1.09s
tensorflow_in_container : (Python 3.9) Copy built wheel ----------------- 1.02s
tensorflow_in_container : (Python 3.9) cleanup Bazel install directory --- 0.91s
tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.86s
tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.86s
tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.83s
tensorflow_in_container : (Python 3.9) create script to run tests ------- 0.71s
Build step 'Execute shell' marked build as failure
3 months, 4 weeks
- 1
- 2
Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #782
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/7…>
Changes:
------------------------------------------
[...truncated 6.74 KiB...]
changed: [localhost]
TASK [tensorflow : Show git log] ***********************************************
Friday 26 April 2024 01:11:25 +0100 (0:00:00.576) 0:01:20.940 **********
ok: [localhost] =>
git_log.stdout: c977e63b30d098344351b48e61c173afe5a2c6a9 Use the input's shapes directly instead of getting them from the op
TASK [tensorflow : Record git commit hash to variable] *************************
Friday 26 April 2024 01:11:25 +0100 (0:00:00.036) 0:01:20.977 **********
ok: [localhost]
TASK [tensorflow : Save git commit hash to file] *******************************
Friday 26 April 2024 01:11:25 +0100 (0:00:00.054) 0:01:21.032 **********
changed: [localhost]
TASK [Build TensorFlow for each Python version (dual abi)] *********************
Friday 26 April 2024 01:11:26 +0100 (0:00:01.130) 0:01:22.162 **********
TASK [tensorflow_in_container : Reset checkout to clean state] *****************
Friday 26 April 2024 01:11:27 +0100 (0:00:00.435) 0:01:22.597 **********
changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow-oneDNN-ACL git sources from previous build] ***
Friday 26 April 2024 01:11:27 +0100 (0:00:00.651) 0:01:23.249 **********
skipping: [localhost]
TASK [Fetch TensorFlow] ********************************************************
Friday 26 April 2024 01:11:27 +0100 (0:00:00.029) 0:01:23.279 **********
skipping: [localhost]
TASK [(Python 3.9) patch TensorFlow tree] **************************************
Friday 26 April 2024 01:11:27 +0100 (0:00:00.030) 0:01:23.309 **********
TASK [tensorflow : Create linklibs shell script] *******************************
Friday 26 April 2024 01:11:27 +0100 (0:00:00.081) 0:01:23.391 **********
changed: [localhost]
TASK [tensorflow : Use nightly package requirements] ***************************
Friday 26 April 2024 01:11:28 +0100 (0:00:00.688) 0:01:24.079 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds] ***
Friday 26 April 2024 01:11:29 +0100 (0:00:00.624) 0:01:24.703 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] ***
Friday 26 April 2024 01:11:29 +0100 (0:00:00.679) 0:01:25.383 **********
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) start build container] ************
Friday 26 April 2024 01:11:31 +0100 (0:00:01.710) 0:01:27.094 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir] ***
Friday 26 April 2024 01:11:45 +0100 (0:00:14.301) 0:01:41.395 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazel cache] ******
Friday 26 April 2024 01:11:47 +0100 (0:00:01.232) 0:01:42.628 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazelisk cache] ***
Friday 26 April 2024 01:11:47 +0100 (0:00:00.848) 0:01:43.476 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for pip cache] ********
Friday 26 April 2024 01:11:48 +0100 (0:00:00.853) 0:01:44.330 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build] ***
Friday 26 April 2024 01:11:49 +0100 (0:00:00.883) 0:01:45.213 **********
changed: [localhost]
TASK [tensorflow_in_container : Show list of installed Python packages for build] ***
Friday 26 April 2024 01:11:51 +0100 (0:00:02.150) 0:01:47.363 **********
ok: [localhost] =>
pip_list_output.stdout: |-
Package Version Location Installer
------------------- -------------------- -------------------------------------- ---------
auditwheel 5.4.0 /usr/local/lib/python3.9/dist-packages pip
certifi 2019.11.28 /usr/lib/python3/dist-packages
cffi 1.16.0 /usr/local/lib/python3.9/dist-packages pip
chardet 3.0.4 /usr/lib/python3/dist-packages
cryptography 42.0.5 /usr/local/lib/python3.9/dist-packages pip
Cython 3.0.9 /usr/local/lib/python3.9/dist-packages pip
dbus-python 1.2.16 /usr/lib/python3/dist-packages
docutils 0.20.1 /usr/local/lib/python3.9/dist-packages pip
idna 2.8 /usr/lib/python3/dist-packages
importlib-metadata 7.0.1 /usr/local/lib/python3.9/dist-packages pip
jaraco.classes 3.3.1 /usr/local/lib/python3.9/dist-packages pip
jeepney 0.8.0 /usr/local/lib/python3.9/dist-packages pip
keyring 24.3.1 /usr/local/lib/python3.9/dist-packages pip
markdown-it-py 3.0.0 /usr/local/lib/python3.9/dist-packages pip
mdurl 0.1.2 /usr/local/lib/python3.9/dist-packages pip
more-itertools 10.2.0 /usr/local/lib/python3.9/dist-packages pip
nh3 0.2.15 /usr/local/lib/python3.9/dist-packages pip
pip 24.0 /usr/local/lib/python3.9/dist-packages pip
pkginfo 1.10.0 /usr/local/lib/python3.9/dist-packages pip
portpicker 1.6.0 /usr/local/lib/python3.9/dist-packages pip
psutil 5.9.8 /usr/local/lib/python3.9/dist-packages pip
pycparser 2.21 /usr/local/lib/python3.9/dist-packages pip
pyelftools 0.30 /usr/local/lib/python3.9/dist-packages pip
Pygments 2.17.2 /usr/local/lib/python3.9/dist-packages pip
PyGObject 3.36.0 /usr/lib/python3/dist-packages
python-apt 2.0.1+ubuntu0.20.4.1 /usr/lib/python3/dist-packages
readme_renderer 43.0 /usr/local/lib/python3.9/dist-packages pip
requests 2.22.0 /usr/lib/python3/dist-packages
requests-toolbelt 1.0.0 /usr/local/lib/python3.9/dist-packages pip
requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages
rfc3986 2.0.0 /usr/local/lib/python3.9/dist-packages pip
rich 13.7.1 /usr/local/lib/python3.9/dist-packages pip
SecretStorage 3.3.3 /usr/local/lib/python3.9/dist-packages pip
setuptools 69.1.1 /usr/local/lib/python3.9/dist-packages pip
six 1.14.0 /usr/lib/python3/dist-packages
twine 4.0.2 /usr/local/lib/python3.9/dist-packages pip
urllib3 2.2.1 /usr/local/lib/python3.9/dist-packages pip
wheel 0.42.0 /usr/local/lib/python3.9/dist-packages pip
zipp 3.17.0 /usr/local/lib/python3.9/dist-packages pip
TASK [tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git] ***
Friday 26 April 2024 01:11:51 +0100 (0:00:00.038) 0:01:47.402 **********
fatal: [localhost]: FAILED! => changed=true
rc: 1
stderr: |-
Extracting Bazel installation...
Starting local Bazel server and connecting to it...
INFO: Invocation ID: b31cd5f3-1f73-47b3-8c40-53c592c12ccd
INFO: Reading 'startup' options from /tf/tensorflow/.bazelrc: --windows_enable_symlinks
INFO: Options provided by the client:
Inherited 'common' options: --isatty=0 --terminal_columns=80
INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc:
Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc:
'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --features=-force_no_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility
INFO: Reading rc options for 'build' from /usertools/aarch64_clang.bazelrc:
'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/local/bin/python3 --python_path=/usr/local/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --linkopt=-fuse-ld=lld --linkopt=-lm --linkopt=-Wl,--undefined-version --host_linkopt=-fuse-ld=lld --host_linkopt=-lm --host_linkopt=-Wl,--undefined-version --distinct_host_configuration=false --copt=-Wno-gnu-offsetof-extensions --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_clang_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3
INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING
INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64_clang.bazelrc: --disk_cache=/tf/cache
INFO: Found applicable config definition build:mkl_aarch64_threadpool in file /tf/tensorflow/.bazelrc: --define=build_with_mkl_aarch64=true -c opt
INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --experimental_guard_against_concurrent_changes
INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading: 0 packages loaded
Analyzing: target //tensorflow/tools/pip_package:wheel (1 packages loaded, 0 targets configured)
Analyzing: target //tensorflow/tools/pip_package:wheel (10 packages loaded, 12 targets configured)
Analyzing: target //tensorflow/tools/pip_package:wheel (152 packages loaded, 302 targets configured)
Analyzing: target //tensorflow/tools/pip_package:wheel (268 packages loaded, 4191 targets configured)
Analyzing: target //tensorflow/tools/pip_package:wheel (271 packages loaded, 4216 targets configured)
Analyzing: target //tensorflow/tools/pip_package:wheel (271 packages loaded, 4216 targets configured)
Analyzing: target //tensorflow/tools/pip_package:wheel (391 packages loaded, 5046 targets configured)
INFO: Repository pthreadpool instantiated at:
/tf/tensorflow/WORKSPACE:95:14: in <toplevel>
/tf/tensorflow/tensorflow/workspace2.bzl:938:21: in workspace
/tf/tensorflow/tensorflow/workspace2.bzl:166:20: in _tf_repositories
/tf/tensorflow/third_party/repo.bzl:136:21: in tf_http_archive
Repository rule _tf_http_archive defined at:
/tf/tensorflow/third_party/repo.bzl:89:35: in <toplevel>
INFO: Repository gif instantiated at:
/tf/tensorflow/WORKSPACE:95:14: in <toplevel>
/tf/tensorflow/tensorflow/workspace2.bzl:938:21: in workspace
/tf/tensorflow/tensorflow/workspace2.bzl:340:20: in _tf_repositories
/tf/tensorflow/third_party/repo.bzl:136:21: in tf_http_archive
Repository rule _tf_http_archive defined at:
/tf/tensorflow/third_party/repo.bzl:89:35: in <toplevel>
INFO: Repository XNNPACK instantiated at:
/tf/tensorflow/WORKSPACE:95:14: in <toplevel>
/tf/tensorflow/tensorflow/workspace2.bzl:938:21: in workspace
/tf/tensorflow/tensorflow/workspace2.bzl:151:20: in _tf_repositories
/tf/tensorflow/third_party/repo.bzl:136:21: in tf_http_archive
Repository rule _tf_http_archive defined at:
/tf/tensorflow/third_party/repo.bzl:89:35: in <toplevel>
INFO: Repository riegeli instantiated at:
/tf/tensorflow/WORKSPACE:95:14: in <toplevel>
/tf/tensorflow/tensorflow/workspace2.bzl:938:21: in workspace
/tf/tensorflow/tensorflow/workspace2.bzl:868:20: in _tf_repositories
/tf/tensorflow/third_party/repo.bzl:136:21: in tf_http_archive
Repository rule _tf_http_archive defined at:
/tf/tensorflow/third_party/repo.bzl:89:35: in <toplevel>
INFO: Repository cpuinfo instantiated at:
/tf/tensorflow/WORKSPACE:95:14: in <toplevel>
/tf/tensorflow/tensorflow/workspace2.bzl:938:21: in workspace
/tf/tensorflow/tensorflow/workspace2.bzl:173:20: in _tf_repositories
/tf/tensorflow/third_party/repo.bzl:136:21: in tf_http_archive
Repository rule _tf_http_archive defined at:
/tf/tensorflow/third_party/repo.bzl:89:35: in <toplevel>
ERROR: /tf/tensorflow/tensorflow/compiler/mlir/lite/stablehlo/BUILD:758:11: no such package 'buildenv/target': BUILD file not found in any of the following directories. Add a BUILD file to a directory to mark it as a package.
- /tf/tensorflow/buildenv/target and referenced by '//tensorflow/compiler/mlir/lite/stablehlo:optimize_layout'
ERROR: Analysis of target '//tensorflow/tools/pip_package:wheel' failed; build aborted:
INFO: Elapsed time: 91.644s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (598 packages loaded, 21661 targets configured)
stderr_lines: <omitted>
stdout: ''
stdout_lines: <omitted>
PLAY RECAP *********************************************************************
localhost : ok=25 changed=17 unreachable=0 failed=1 skipped=6 rescued=0 ignored=0
Friday 26 April 2024 01:13:24 +0100 (0:01:32.693) 0:03:20.096 **********
===============================================================================
tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git -- 92.69s
Cleanup after previous build ------------------------------------------- 49.86s
tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 21.48s
tensorflow_in_container : (Python 3.9) start build container ----------- 14.30s
tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 5.04s
tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 2.15s
Gathering Facts --------------------------------------------------------- 1.71s
tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.71s
Create cache dirs ------------------------------------------------------- 1.44s
tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.23s
tensorflow : Save git commit hash to file ------------------------------- 1.13s
tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.88s
tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.85s
tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.85s
tensorflow : Create linklibs shell script ------------------------------- 0.69s
tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds --- 0.68s
tensorflow_in_container : Reset checkout to clean state ----------------- 0.65s
tensorflow : Use nightly package requirements --------------------------- 0.62s
tensorflow : Get oneline version of git log for this checkout ----------- 0.58s
Build TensorFlow for each Python version (dual abi) --------------------- 0.44s
Build step 'Execute shell' marked build as failure
4 months, 3 weeks
- 1
- 1
Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #1142
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/1142/dis…>
Changes:
------------------------------------------
[...truncated 314.91 KiB...]
[19,191 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/partitioned_topological_sort.cc; 72s local, remote-cache ... (111 actions, 110 running)
[19,194 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/partitioned_topological_sort.cc; 73s local, remote-cache ... (111 actions, 110 running)
[19,196 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/optimize_functional_ops.cc; 74s local, remote-cache ... (111 actions, 110 running)
[19,197 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/optimize_functional_ops.cc; 75s local, remote-cache ... (111 actions, 110 running)
[19,197 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/optimize_functional_ops.cc; 76s local, remote-cache ... (112 actions running)
[19,200 / 19,692] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 61s local, remote-cache ... (111 actions, 110 running)
[19,201 / 19,692] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 62s local, remote-cache ... (111 actions, 110 running)
[19,204 / 19,692] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 63s local, remote-cache ... (111 actions, 110 running)
[19,205 / 19,692] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 64s local, remote-cache ... (112 actions running)
[19,208 / 19,692] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 65s local, remote-cache ... (112 actions running)
[19,210 / 19,692] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 66s local, remote-cache ... (112 actions running)
[19,211 / 19,692] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 67s local, remote-cache ... (112 actions running)
[19,212 / 19,692] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 68s local, remote-cache ... (112 actions running)
[19,212 / 19,692] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 73s local, remote-cache ... (112 actions running)
[19,213 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/lower_static_tensor_list.cc; 73s local, remote-cache ... (112 actions running)
[19,216 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/lower_static_tensor_list.cc; 74s local, remote-cache ... (111 actions, 110 running)
[19,216 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/lower_static_tensor_list.cc; 75s local, remote-cache ... (112 actions running)
[19,218 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/lower_static_tensor_list.cc; 76s local, remote-cache ... (112 actions running)
[19,219 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/lower_static_tensor_list.cc; 77s local, remote-cache ... (111 actions, 110 running)
[19,221 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/lower_static_tensor_list.cc; 79s local, remote-cache ... (111 actions, 110 running)
[19,221 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/lower_static_tensor_list.cc; 80s local, remote-cache ... (112 actions running)
[19,223 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/lower_static_tensor_list.cc; 81s local, remote-cache ... (112 actions running)
[19,224 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/lower_static_tensor_list.cc; 82s local, remote-cache ... (112 actions running)
[19,225 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/lower_static_tensor_list.cc; 83s local, remote-cache ... (111 actions, 110 running)
[19,225 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/lower_static_tensor_list.cc; 85s local, remote-cache ... (112 actions running)
[19,226 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/lower_static_tensor_list.cc; 86s local, remote-cache ... (112 actions running)
[19,227 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/lower_static_tensor_list.cc; 87s local, remote-cache ... (112 actions running)
[19,227 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/lower_static_tensor_list.cc; 88s local, remote-cache ... (112 actions running)
[19,228 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/lower_static_tensor_list.cc; 89s local, remote-cache ... (112 actions running)
[19,229 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/lower_static_tensor_list.cc; 91s local, remote-cache ... (111 actions, 110 running)
[19,231 / 19,692] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 82s local, remote-cache ... (112 actions running)
[19,232 / 19,692] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 83s local, remote-cache ... (111 actions, 110 running)
[19,233 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 76s local, remote-cache ... (111 actions, 110 running)
[19,236 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 77s local, remote-cache ... (111 actions, 110 running)
[19,238 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 79s local, remote-cache ... (112 actions running)
[19,239 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 82s local, remote-cache ... (111 actions, 110 running)
[19,241 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 83s local, remote-cache ... (112 actions running)
[19,242 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 86s local, remote-cache ... (111 actions, 110 running)
[19,244 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 87s local, remote-cache ... (111 actions, 110 running)
[19,248 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 88s local, remote-cache ... (112 actions running)
[19,251 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 89s local, remote-cache ... (112 actions running)
[19,253 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 90s local, remote-cache ... (112 actions running)
[19,257 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 91s local, remote-cache ... (112 actions running)
[19,257 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 92s local, remote-cache ... (112 actions running)
[19,259 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 93s local, remote-cache ... (112 actions running)
[19,260 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 94s local, remote-cache ... (112 actions running)
[19,262 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 95s local, remote-cache ... (112 actions running)
[19,263 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 96s local, remote-cache ... (112 actions running)
[19,264 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 97s local, remote-cache ... (112 actions running)
[19,267 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 98s local, remote-cache ... (112 actions running)
[19,269 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 99s local, remote-cache ... (112 actions running)
[19,271 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 100s local, remote-cache ... (112 actions running)
[19,271 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 102s local, remote-cache ... (112 actions running)
[19,275 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 103s local, remote-cache ... (112 actions running)
[19,276 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 105s local, remote-cache ... (111 actions, 110 running)
[19,279 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 106s local, remote-cache ... (112 actions running)
[19,280 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 111s local, remote-cache ... (111 actions, 110 running)
[19,282 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 112s local, remote-cache ... (111 actions, 110 running)
[19,287 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 113s local, remote-cache ... (111 actions, 110 running)
[19,291 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 114s local, remote-cache ... (111 actions, 110 running)
[19,293 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 115s local, remote-cache ... (112 actions running)
[19,295 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 116s local, remote-cache ... (112 actions running)
[19,296 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 117s local, remote-cache ... (112 actions running)
[19,297 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 120s local, remote-cache ... (111 actions, 110 running)
[19,303 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 121s local, remote-cache ... (111 actions, 110 running)
[19,305 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 122s local, remote-cache ... (111 actions, 110 running)
[19,308 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 123s local, remote-cache ... (111 actions, 110 running)
[19,311 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 124s local, remote-cache ... (112 actions running)
[19,312 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 127s local, remote-cache ... (111 actions, 110 running)
[19,314 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 128s local, remote-cache ... (112 actions running)
[19,320 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 129s local, remote-cache ... (112 actions running)
[19,322 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 131s local, remote-cache ... (112 actions running)
[19,331 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 132s local, remote-cache ... (111 actions, 110 running)
[19,335 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 133s local, remote-cache ... (112 actions running)
[19,340 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 134s local, remote-cache ... (111 actions, 110 running)
[19,344 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 135s local, remote-cache ... (112 actions running)
[19,347 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 136s local, remote-cache ... (111 actions, 110 running)
[19,349 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 137s local, remote-cache ... (112 actions running)
[19,351 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 138s local, remote-cache ... (112 actions running)
[19,354 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 139s local, remote-cache ... (112 actions running)
[19,360 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 140s local, remote-cache ... (112 actions running)
[19,362 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 141s local, remote-cache ... (112 actions running)
[19,365 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 142s local, remote-cache ... (112 actions running)
[19,369 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 143s local, remote-cache ... (112 actions running)
[19,369 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 145s local, remote-cache ... (112 actions running)
[19,371 / 19,692] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 146s local, remote-cache ... (112 actions running)
[19,373 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/quantize_and_dequantize_op.cc; 44s local, remote-cache ... (112 actions running)
[19,374 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/quantize_and_dequantize_op.cc; 45s local, remote-cache ... (111 actions, 110 running)
[19,380 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/pad_op.cc; 43s local, remote-cache ... (111 actions, 110 running)
[19,381 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/pad_op.cc; 45s local, remote-cache ... (112 actions running)
[19,383 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/pad_op.cc; 46s local, remote-cache ... (112 actions running)
[19,387 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/stateless_random_ops.cc; 41s local, remote-cache ... (111 actions, 110 running)
[19,387 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/stateless_random_ops.cc; 42s local, remote-cache ... (112 actions running)
[19,389 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/stateful_random_ops.cc; 42s local, remote-cache ... (112 actions running)
[19,391 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/stateful_random_ops.cc; 43s local, remote-cache ... (112 actions running)
[19,393 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/stateful_random_ops.cc; 44s local, remote-cache ... (112 actions running)
[19,396 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/stateful_random_ops.cc; 45s local, remote-cache ... (112 actions running)
[19,397 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/stateful_random_ops.cc; 46s local, remote-cache ... (112 actions running)
[19,400 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/stateful_random_ops.cc; 47s local, remote-cache ... (111 actions, 110 running)
[19,403 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/stateful_random_ops.cc; 49s local, remote-cache ... (112 actions running)
[19,405 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/matrix_band_part_op.cc; 42s local, remote-cache ... (112 actions running)
[19,406 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/matrix_band_part_op.cc; 44s local, remote-cache ... (111 actions, 110 running)
[19,409 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/matmul_op.cc; 44s local, remote-cache ... (112 actions running)
[19,409 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/matmul_op.cc; 45s local, remote-cache ... (112 actions running)
[19,411 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/matmul_op.cc; 46s local, remote-cache ... (112 actions running)
[19,413 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/matmul_op.cc; 48s local, remote-cache ... (111 actions, 110 running)
[19,416 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/matmul_op.cc; 49s local, remote-cache ... (110 actions running)
[19,418 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/matmul_op.cc; 50s local, remote-cache ... (112 actions running)
[19,420 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/matmul_op.cc; 51s local, remote-cache ... (112 actions running)
[19,421 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/matmul_op.cc; 52s local, remote-cache ... (112 actions running)
[19,424 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/image_resize_ops.cc; 47s local, remote-cache ... (112 actions running)
[19,427 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/gather_scatter_ops.cc; 46s local, remote-cache ... (111 actions, 110 running)
[19,427 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/gather_scatter_ops.cc; 47s local, remote-cache ... (112 actions running)
[19,431 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/gather_op.cc; 48s local, remote-cache ... (111 actions, 110 running)
[19,433 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/gather_op.cc; 49s local, remote-cache ... (112 actions running)
[19,436 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/fused_conv_ops.cc; 49s local, remote-cache ... (112 actions running)
[19,441 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/fused_conv_ops.cc; 50s local, remote-cache ... (111 actions, 110 running)
[19,441 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/fused_conv_ops.cc; 51s local, remote-cache ... (112 actions running)
[19,445 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/fused_conv_ops.cc; 52s local, remote-cache ... (112 actions running)
[19,451 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/dynamic_stitch_op.cc; 48s local, remote-cache ... (112 actions running)
[19,457 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/dynamic_slice_ops.cc; 48s local, remote-cache ... (112 actions running)
[19,458 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/dynamic_slice_ops.cc; 49s local, remote-cache ... (112 actions running)
[19,462 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/dynamic_slice_ops.cc; 50s local, remote-cache ... (112 actions running)
[19,466 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/dynamic_slice_ops.cc; 51s local, remote-cache ... (111 actions, 110 running)
[19,469 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/dynamic_slice_ops.cc; 52s local, remote-cache ... (112 actions running)
[19,473 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/depthtospace_op.cc; 50s local, remote-cache ... (112 actions running)
[19,476 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/depthtospace_op.cc; 51s local, remote-cache ... (112 actions running)
[19,480 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/depthtospace_op.cc; 52s local, remote-cache ... (112 actions running)
[19,482 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/depthtospace_op.cc; 53s local, remote-cache ... (112 actions running)
[19,483 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/depthtospace_op.cc; 54s local, remote-cache ... (111 actions, 110 running)
[19,486 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/depthtospace_op.cc; 55s local, remote-cache ... (111 actions, 110 running)
[19,488 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/const_op.cc; 47s local, remote-cache ... (112 actions running)
[19,496 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/const_op.cc; 48s local, remote-cache ... (112 actions running)
[19,497 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/cholesky_op.cc; 49s local, remote-cache ... (111 actions, 110 running)
[19,504 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/cholesky_op.cc; 50s local, remote-cache ... (111 actions, 110 running)
[19,510 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/binary_ops.cc; 46s local, remote-cache ... (112 actions running)
[19,512 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/binary_ops.cc; 47s local, remote-cache ... (112 actions running)
[19,513 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/binary_ops.cc; 48s local, remote-cache ... (112 actions running)
[19,516 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/binary_ops.cc; 49s local, remote-cache ... (112 actions running)
[19,519 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/binary_ops.cc; 50s local, remote-cache ... (112 actions running)
[19,528 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/bcast_ops.cc; 47s local, remote-cache ... (112 actions running)
[19,531 / 19,692] Compiling tensorflow/compiler/tf2xla/kernels/bcast_ops.cc; 48s local, remote-cache ... (110 actions running)
[19,538 / 19,692] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 45s local, remote-cache ... (104 actions running)
[19,546 / 19,692] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 47s local, remote-cache ... (95 actions, 94 running)
[19,548 / 19,692] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 48s local, remote-cache ... (92 actions running)
[19,548 / 19,692] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 49s local, remote-cache ... (92 actions running)
[19,549 / 19,692] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 51s local, remote-cache ... (90 actions running)
[19,550 / 19,692] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 52s local, remote-cache ... (90 actions running)
[19,557 / 19,692] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 53s local, remote-cache ... (82 actions running)
[19,562 / 19,692] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 54s local, remote-cache ... (77 actions, 76 running)
[19,574 / 19,692] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 55s local, remote-cache ... (65 actions, 64 running)
[19,579 / 19,692] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 57s local, remote-cache ... (59 actions, 58 running)
[19,582 / 19,692] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 58s local, remote-cache ... (56 actions running)
[19,589 / 19,692] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 60s local, remote-cache ... (49 actions, 48 running)
[19,592 / 19,692] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 61s local, remote-cache ... (45 actions, 44 running)
[19,596 / 19,692] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 62s local, remote-cache ... (40 actions running)
[19,598 / 19,692] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 63s local, remote-cache ... (38 actions running)
[19,602 / 19,692] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 65s local, remote-cache ... (33 actions, 32 running)
[19,604 / 19,692] Compiling tensorflow/compiler/jit/kernels/xla_ops.cc; 63s local, remote-cache ... (30 actions running)
[19,605 / 19,692] Compiling tensorflow/compiler/jit/kernels/xla_ops.cc; 64s local, remote-cache ... (28 actions running)
[19,610 / 19,692] Compiling tensorflow/compiler/jit/kernels/xla_ops.cc; 66s local, remote-cache ... (21 actions, 20 running)
[19,617 / 19,692] Compiling tensorflow/compiler/jit/kernels/xla_ops.cc; 67s local, remote-cache ... (14 actions running)
[19,620 / 19,692] Compiling tensorflow/compiler/tf2xla/mlir_tf2xla.cc; 59s local, remote-cache ... (11 actions, 10 running)
[19,621 / 19,692] Compiling tensorflow/compiler/tf2xla/mlir_tf2xla.cc; 60s local, remote-cache ... (10 actions running)
[19,623 / 19,692] Compiling tensorflow/compiler/tf2xla/mlir_tf2xla.cc; 61s local, remote-cache ... (8 actions running)
[19,623 / 19,692] Compiling tensorflow/compiler/tf2xla/mlir_tf2xla.cc; 71s local, remote-cache ... (8 actions running)
[19,624 / 19,692] Compiling tensorflow/compiler/tf2xla/mlir_tf2xla.cc; 72s local, remote-cache ... (7 actions, 6 running)
[19,625 / 19,692] Compiling tensorflow/compiler/tf2xla/mlir_tf2xla.cc; 74s local, remote-cache ... (6 actions running)
[19,626 / 19,692] Compiling tensorflow/compiler/mlir/python/mlir.cc; 61s local, remote-cache ... (5 actions, 4 running)
[19,627 / 19,692] Compiling tensorflow/compiler/mlir/python/mlir.cc; 63s local, remote-cache ... (4 actions running)
[19,627 / 19,692] Compiling tensorflow/compiler/mlir/python/mlir.cc; 73s local, remote-cache ... (4 actions running)
[19,628 / 19,692] Compiling tensorflow/compiler/mlir/python/mlir.cc; 87s local, remote-cache ... (3 actions, 2 running)
[19,629 / 19,692] Compiling tensorflow/compiler/mlir/python/mlir.cc; 89s local, remote-cache
[19,629 / 19,692] Compiling tensorflow/compiler/mlir/python/mlir.cc; 99s local, remote-cache
[19,629 / 19,692] Compiling tensorflow/compiler/mlir/python/mlir.cc; 129s local, remote-cache
[19,630 / 19,692] [Prepa] Linking tensorflow/compiler/mlir/python/libmlir.pic.lo
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 0s local, remote-cache
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 10s local, remote-cache
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 40s local, remote-cache
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 101s local, remote-cache
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 161s local, remote-cache
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 221s local, remote-cache
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 281s local, remote-cache
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 341s local, remote-cache
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 401s local, remote-cache
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 461s local, remote-cache
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 521s local, remote-cache
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 581s local, remote-cache
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 641s local, remote-cache
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 701s local, remote-cache
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 761s local, remote-cache
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 801s local, remote-cache
[19,631 / 19,692] Linking tensorflow/libtensorflow_cc.so.2.17.0; 808s local, remote-cache
[19,635 / 19,692] Linking tensorflow/python/_pywrap_tensorflow_internal.so; 0s local, remote-cache
[19,636 / 19,692] [Prepa] action 'SolibSymlink _solib_local/_Utensorflow_Spython/_pywrap_tensorflow_internal.so'
[19,685 / 19,692] Linking tensorflow/python/_pywrap_tfcompile.so; 1s local, remote-cache ... (12 actions running)
[19,689 / 19,692] Linking tensorflow/python/tpu/_pywrap_tpu_embedding.so; 2s local, remote-cache ... (4 actions running)
[19,690 / 19,692] Linking tensorflow/python/tpu/_pywrap_tpu_embedding.so; 4s local, remote-cache
[19,691 / 19,692] Action tensorflow/tools/pip_package/wheel_house; 0s local, remote-cache
[19,691 / 19,692] Action tensorflow/tools/pip_package/wheel_house; 10s local, remote-cache
ERROR: /tf/tensorflow/tensorflow/tools/pip_package/BUILD:265:9: Action tensorflow/tools/pip_package/wheel_house failed: (Exit 1): build_pip_package_py failed: error executing command (from target //tensorflow/tools/pip_package:wheel) bazel-out/aarch64-opt-exec-50AE0418/bin/tensorflow/tools/pip_package/build_pip_package_py @bazel-out/aarch64-opt/bin/tensorflow/tools/pip_package/wheel_house-0.params
patchelf: getting info about '/tmp/tensorflow_wheel3j1pofb4/tensorflow/compiler/mlir/quantization/tensorflow/calibrator/pywrap_calibration.so': No such file or directory
Traceback (most recent call last):
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt-exec-50AE0418/bin/tensorflow/tools/pip_package/build_pip_package_py.runfiles/org_tensorflow/tensorflow/tools/pip_package/build_pip_package.py", line 340, in <module>
prepare_wheel_srcs(args.headers, args.srcs, args.xla_aot,
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt-exec-50AE0418/bin/tensorflow/tools/pip_package/build_pip_package_py.runfiles/org_tensorflow/tensorflow/tools/pip_package/build_pip_package.py", line 197, in prepare_wheel_srcs
patch_so(srcs_dir)
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt-exec-50AE0418/bin/tensorflow/tools/pip_package/build_pip_package_py.runfiles/org_tensorflow/tensorflow/tools/pip_package/build_pip_package.py", line 239, in patch_so
rpath = subprocess.check_output(
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/external/python_aarch64-unknown-linux-gnu/lib/python3.9/subprocess.py", line 424, in check_output
return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/external/python_aarch64-unknown-linux-gnu/lib/python3.9/subprocess.py", line 528, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['patchelf', '--print-rpath', '/tmp/tensorflow_wheel3j1pofb4/tensorflow/compiler/mlir/quantization/tensorflow/calibrator/pywrap_calibration.so']' returned non-zero exit status 1.
Target //tensorflow/tools/pip_package:wheel failed to build
Use --verbose_failures to see the command lines of failed build steps.
INFO: Elapsed time: 3818.825s, Critical Path: 1498.78s
INFO: 19692 processes: 1223 internal, 18469 local.
FAILED: Build did NOT complete successfully
stderr_lines: <omitted>
stdout: ''
stdout_lines: <omitted>
PLAY RECAP *********************************************************************
localhost : ok=25 changed=17 unreachable=0 failed=1 skipped=6 rescued=0 ignored=0
Tuesday 16 April 2024 20:15:26 +0100 (1:03:40.285) 1:05:21.938 *********
===============================================================================
tensorflow_in_container : (Python 3.9) build TensorFlow git ---------- 3820.29s
Cleanup after previous build ------------------------------------------- 31.14s
tensorflow_in_container : (Python 3.9) start build container ----------- 26.57s
tensorflow : Fetch TensorFlow from git --------------------------------- 22.96s
tensorflow : Remove TensorFlow git sources from previous build ---------- 4.04s
Gathering Facts --------------------------------------------------------- 2.61s
tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 1.83s
tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.51s
Create cache dirs ------------------------------------------------------- 1.43s
tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.25s
tensorflow : Save git commit hash to file ------------------------------- 1.09s
tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.87s
tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.81s
tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.81s
tensorflow : Create linklibs shell script ------------------------------- 0.69s
tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds --- 0.68s
tensorflow_in_container : Reset checkout to clean state ----------------- 0.64s
tensorflow : Use nightly package requirements --------------------------- 0.62s
tensorflow : Get oneline version of git log for this checkout ----------- 0.59s
Build TensorFlow for each Python version (dual abi) --------------------- 0.41s
Build step 'Execute shell' marked build as failure
5 months
- 1
- 2
Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #772
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/7…>
Changes:
------------------------------------------
[...truncated 6.52 KiB...]
TASK [tensorflow : Set world write access to source] ***************************
Tuesday 16 April 2024 01:11:25 +0100 (0:00:00.030) 0:01:21.157 *********
changed: [localhost]
TASK [tensorflow : Get oneline version of git log for this checkout] ***********
Tuesday 16 April 2024 01:11:26 +0100 (0:00:00.385) 0:01:21.542 *********
changed: [localhost]
TASK [tensorflow : Show git log] ***********************************************
Tuesday 16 April 2024 01:11:26 +0100 (0:00:00.559) 0:01:22.101 *********
ok: [localhost] =>
git_log.stdout: 'e9d460922aa8d54b2f48a9b2dff47085726c89e5 Merge pull request #65568 from Intel-tensorflow:mraunak/win_config'
TASK [tensorflow : Record git commit hash to variable] *************************
Tuesday 16 April 2024 01:11:26 +0100 (0:00:00.037) 0:01:22.139 *********
ok: [localhost]
TASK [tensorflow : Save git commit hash to file] *******************************
Tuesday 16 April 2024 01:11:26 +0100 (0:00:00.057) 0:01:22.196 *********
changed: [localhost]
TASK [Build TensorFlow for each Python version (dual abi)] *********************
Tuesday 16 April 2024 01:11:28 +0100 (0:00:01.113) 0:01:23.310 *********
TASK [tensorflow_in_container : Reset checkout to clean state] *****************
Tuesday 16 April 2024 01:11:28 +0100 (0:00:00.417) 0:01:23.728 *********
changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow-oneDNN-ACL git sources from previous build] ***
Tuesday 16 April 2024 01:11:29 +0100 (0:00:00.827) 0:01:24.556 *********
skipping: [localhost]
TASK [Fetch TensorFlow] ********************************************************
Tuesday 16 April 2024 01:11:29 +0100 (0:00:00.029) 0:01:24.586 *********
skipping: [localhost]
TASK [(Python 3.9) patch TensorFlow tree] **************************************
Tuesday 16 April 2024 01:11:29 +0100 (0:00:00.031) 0:01:24.617 *********
TASK [tensorflow : Create linklibs shell script] *******************************
Tuesday 16 April 2024 01:11:29 +0100 (0:00:00.082) 0:01:24.700 *********
changed: [localhost]
TASK [tensorflow : Use nightly package requirements] ***************************
Tuesday 16 April 2024 01:11:30 +0100 (0:00:00.695) 0:01:25.396 *********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds] ***
Tuesday 16 April 2024 01:11:30 +0100 (0:00:00.627) 0:01:26.023 *********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] ***
Tuesday 16 April 2024 01:11:31 +0100 (0:00:00.685) 0:01:26.708 *********
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) start build container] ************
Tuesday 16 April 2024 01:11:32 +0100 (0:00:01.552) 0:01:28.260 *********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir] ***
Tuesday 16 April 2024 01:11:41 +0100 (0:00:08.472) 0:01:36.733 *********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazel cache] ******
Tuesday 16 April 2024 01:11:42 +0100 (0:00:01.232) 0:01:37.965 *********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazelisk cache] ***
Tuesday 16 April 2024 01:11:43 +0100 (0:00:00.843) 0:01:38.809 *********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for pip cache] ********
Tuesday 16 April 2024 01:11:44 +0100 (0:00:00.873) 0:01:39.682 *********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build] ***
Tuesday 16 April 2024 01:11:45 +0100 (0:00:00.840) 0:01:40.523 *********
changed: [localhost]
TASK [tensorflow_in_container : Show list of installed Python packages for build] ***
Tuesday 16 April 2024 01:11:47 +0100 (0:00:02.642) 0:01:43.165 *********
ok: [localhost] =>
pip_list_output.stdout: |-
Package Version Location Installer
------------------- -------------------- -------------------------------------- ---------
auditwheel 5.4.0 /usr/local/lib/python3.9/dist-packages pip
certifi 2019.11.28 /usr/lib/python3/dist-packages
cffi 1.16.0 /usr/local/lib/python3.9/dist-packages pip
chardet 3.0.4 /usr/lib/python3/dist-packages
cryptography 42.0.5 /usr/local/lib/python3.9/dist-packages pip
Cython 3.0.9 /usr/local/lib/python3.9/dist-packages pip
dbus-python 1.2.16 /usr/lib/python3/dist-packages
docutils 0.20.1 /usr/local/lib/python3.9/dist-packages pip
idna 2.8 /usr/lib/python3/dist-packages
importlib-metadata 7.0.1 /usr/local/lib/python3.9/dist-packages pip
jaraco.classes 3.3.1 /usr/local/lib/python3.9/dist-packages pip
jeepney 0.8.0 /usr/local/lib/python3.9/dist-packages pip
keyring 24.3.1 /usr/local/lib/python3.9/dist-packages pip
markdown-it-py 3.0.0 /usr/local/lib/python3.9/dist-packages pip
mdurl 0.1.2 /usr/local/lib/python3.9/dist-packages pip
more-itertools 10.2.0 /usr/local/lib/python3.9/dist-packages pip
nh3 0.2.15 /usr/local/lib/python3.9/dist-packages pip
pip 24.0 /usr/local/lib/python3.9/dist-packages pip
pkginfo 1.10.0 /usr/local/lib/python3.9/dist-packages pip
portpicker 1.6.0 /usr/local/lib/python3.9/dist-packages pip
psutil 5.9.8 /usr/local/lib/python3.9/dist-packages pip
pycparser 2.21 /usr/local/lib/python3.9/dist-packages pip
pyelftools 0.30 /usr/local/lib/python3.9/dist-packages pip
Pygments 2.17.2 /usr/local/lib/python3.9/dist-packages pip
PyGObject 3.36.0 /usr/lib/python3/dist-packages
python-apt 2.0.1+ubuntu0.20.4.1 /usr/lib/python3/dist-packages
readme_renderer 43.0 /usr/local/lib/python3.9/dist-packages pip
requests 2.22.0 /usr/lib/python3/dist-packages
requests-toolbelt 1.0.0 /usr/local/lib/python3.9/dist-packages pip
requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages
rfc3986 2.0.0 /usr/local/lib/python3.9/dist-packages pip
rich 13.7.1 /usr/local/lib/python3.9/dist-packages pip
SecretStorage 3.3.3 /usr/local/lib/python3.9/dist-packages pip
setuptools 69.1.1 /usr/local/lib/python3.9/dist-packages pip
six 1.14.0 /usr/lib/python3/dist-packages
twine 4.0.2 /usr/local/lib/python3.9/dist-packages pip
urllib3 2.2.1 /usr/local/lib/python3.9/dist-packages pip
wheel 0.42.0 /usr/local/lib/python3.9/dist-packages pip
zipp 3.17.0 /usr/local/lib/python3.9/dist-packages pip
TASK [tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git] ***
Tuesday 16 April 2024 01:11:47 +0100 (0:00:00.038) 0:01:43.204 *********
fatal: [localhost]: FAILED! => changed=true
rc: 1
stderr: |-
Extracting Bazel installation...
Starting local Bazel server and connecting to it...
INFO: Invocation ID: 87b5868d-81e1-4350-8962-9af9210f24f3
INFO: Reading 'startup' options from /tf/tensorflow/.bazelrc: --windows_enable_symlinks
INFO: Options provided by the client:
Inherited 'common' options: --isatty=0 --terminal_columns=80
INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc:
Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc:
'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --features=-force_no_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility
INFO: Reading rc options for 'build' from /usertools/aarch64_clang.bazelrc:
'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/local/bin/python3 --python_path=/usr/local/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --linkopt=-fuse-ld=lld --linkopt=-lm --linkopt=-Wl,--undefined-version --host_linkopt=-fuse-ld=lld --host_linkopt=-lm --host_linkopt=-Wl,--undefined-version --distinct_host_configuration=false --copt=-Wno-gnu-offsetof-extensions --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_clang_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3
INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING
INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64_clang.bazelrc: --disk_cache=/tf/cache
INFO: Found applicable config definition build:mkl_aarch64_threadpool in file /tf/tensorflow/.bazelrc: --define=build_with_mkl_aarch64=true -c opt
INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --experimental_guard_against_concurrent_changes
INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading: 0 packages loaded
Analyzing: target //tensorflow/tools/pip_package:wheel (1 packages loaded, 0 targets configured)
Analyzing: target //tensorflow/tools/pip_package:wheel (11 packages loaded, 12 targets configured)
Analyzing: target //tensorflow/tools/pip_package:wheel (157 packages loaded, 302 targets configured)
Analyzing: target //tensorflow/tools/pip_package:wheel (270 packages loaded, 4172 targets configured)
Analyzing: target //tensorflow/tools/pip_package:wheel (270 packages loaded, 4172 targets configured)
Analyzing: target //tensorflow/tools/pip_package:wheel (270 packages loaded, 4172 targets configured)
Analyzing: target //tensorflow/tools/pip_package:wheel (271 packages loaded, 4197 targets configured)
Analyzing: target //tensorflow/tools/pip_package:wheel (271 packages loaded, 4197 targets configured)
Analyzing: target //tensorflow/tools/pip_package:wheel (391 packages loaded, 5027 targets configured)
INFO: Repository dlpack instantiated at:
/tf/tensorflow/WORKSPACE:95:14: in <toplevel>
/tf/tensorflow/tensorflow/workspace2.bzl:931:28: in workspace
/tf/tensorflow/tensorflow/workspace2.bzl:67:11: in _initialize_third_party
/tf/tensorflow/third_party/dlpack/workspace.bzl:6:20: in repo
/tf/tensorflow/third_party/repo.bzl:136:21: in tf_http_archive
Repository rule _tf_http_archive defined at:
/tf/tensorflow/third_party/repo.bzl:89:35: in <toplevel>
INFO: Repository pthreadpool instantiated at:
/tf/tensorflow/WORKSPACE:95:14: in <toplevel>
/tf/tensorflow/tensorflow/workspace2.bzl:938:21: in workspace
/tf/tensorflow/tensorflow/workspace2.bzl:166:20: in _tf_repositories
/tf/tensorflow/third_party/repo.bzl:136:21: in tf_http_archive
Repository rule _tf_http_archive defined at:
/tf/tensorflow/third_party/repo.bzl:89:35: in <toplevel>
INFO: Repository mkl_dnn_acl_compatible instantiated at:
/tf/tensorflow/WORKSPACE:95:14: in <toplevel>
/tf/tensorflow/tensorflow/workspace2.bzl:938:21: in workspace
/tf/tensorflow/tensorflow/workspace2.bzl:213:20: in _tf_repositories
/tf/tensorflow/third_party/repo.bzl:136:21: in tf_http_archive
Repository rule _tf_http_archive defined at:
/tf/tensorflow/third_party/repo.bzl:89:35: in <toplevel>
INFO: Repository riegeli instantiated at:
/tf/tensorflow/WORKSPACE:95:14: in <toplevel>
/tf/tensorflow/tensorflow/workspace2.bzl:938:21: in workspace
/tf/tensorflow/tensorflow/workspace2.bzl:868:20: in _tf_repositories
/tf/tensorflow/third_party/repo.bzl:136:21: in tf_http_archive
Repository rule _tf_http_archive defined at:
/tf/tensorflow/third_party/repo.bzl:89:35: in <toplevel>
INFO: Repository cpuinfo instantiated at:
/tf/tensorflow/WORKSPACE:95:14: in <toplevel>
/tf/tensorflow/tensorflow/workspace2.bzl:938:21: in workspace
/tf/tensorflow/tensorflow/workspace2.bzl:173:20: in _tf_repositories
/tf/tensorflow/third_party/repo.bzl:136:21: in tf_http_archive
Repository rule _tf_http_archive defined at:
/tf/tensorflow/third_party/repo.bzl:89:35: in <toplevel>
INFO: Repository XNNPACK instantiated at:
/tf/tensorflow/WORKSPACE:95:14: in <toplevel>
/tf/tensorflow/tensorflow/workspace2.bzl:938:21: in workspace
/tf/tensorflow/tensorflow/workspace2.bzl:151:20: in _tf_repositories
/tf/tensorflow/third_party/repo.bzl:136:21: in tf_http_archive
Repository rule _tf_http_archive defined at:
/tf/tensorflow/third_party/repo.bzl:89:35: in <toplevel>
INFO: repository @riegeli' used the following cache hits instead of downloading the corresponding file.
* Hash '870ca080cdfc5eba696a72ccc3a54cbf0f2271befc0d459eafa8f065edfaadb2' for https://storage.googleapis.com/mirror.tensorflow.org/github.com/google/rieg…
If the definition of 'repository @riegeli' was updated, verify that the hashes were also updated.
ERROR: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/external/tf_runtime/BUILD:204:16: no such package '@local_tsl//tsl/concurrency': BUILD file not found in directory 'tsl/concurrency' of external repository @local_tsl. Add a BUILD file to a directory to mark it as a package. and referenced by '@tf_runtime//:async_value'
ERROR: Analysis of target '//tensorflow/tools/pip_package:wheel' failed; build aborted:
INFO: Elapsed time: 71.961s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (589 packages loaded, 20499 targets configured)
stderr_lines: <omitted>
stdout: ''
stdout_lines: <omitted>
PLAY RECAP *********************************************************************
localhost : ok=25 changed=17 unreachable=0 failed=1 skipped=6 rescued=0 ignored=0
Tuesday 16 April 2024 01:13:00 +0100 (0:01:12.894) 0:02:56.098 *********
===============================================================================
tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git -- 72.89s
Cleanup after previous build ------------------------------------------- 51.14s
tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 21.57s
tensorflow_in_container : (Python 3.9) start build container ------------ 8.47s
tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 4.83s
tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 2.64s
Gathering Facts --------------------------------------------------------- 1.69s
tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.55s
Create cache dirs ------------------------------------------------------- 1.44s
tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.23s
tensorflow : Save git commit hash to file ------------------------------- 1.11s
tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.87s
tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.84s
tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.84s
tensorflow_in_container : Reset checkout to clean state ----------------- 0.83s
tensorflow : Create linklibs shell script ------------------------------- 0.70s
tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds --- 0.69s
tensorflow : Use nightly package requirements --------------------------- 0.63s
tensorflow : Get oneline version of git log for this checkout ----------- 0.56s
Build TensorFlow for each Python version (dual abi) --------------------- 0.42s
Build step 'Execute shell' marked build as failure
5 months
- 1
- 2
Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #1120
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/1120/dis…>
Changes:
------------------------------------------
[...truncated 27.43 KB...]
TASK [tensorflow_in_container : Reset checkout to clean state] *****************
Monday 25 March 2024 22:49:17 +0000 (0:16:36.585) 4:39:12.976 **********
changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] ***
Monday 25 March 2024 22:49:18 +0000 (0:00:00.698) 4:39:13.674 **********
skipping: [localhost]
TASK [Fetch TensorFlow] ********************************************************
Monday 25 March 2024 22:49:18 +0000 (0:00:00.030) 4:39:13.705 **********
skipping: [localhost]
TASK [(Python 3.11) patch TensorFlow tree] *************************************
Monday 25 March 2024 22:49:18 +0000 (0:00:00.031) 4:39:13.737 **********
TASK [tensorflow : Create linklibs shell script] *******************************
Monday 25 March 2024 22:49:18 +0000 (0:00:00.078) 4:39:13.815 **********
changed: [localhost]
TASK [tensorflow : Use nightly package requirements] ***************************
Monday 25 March 2024 22:49:19 +0000 (0:00:00.729) 4:39:14.545 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) copy upper constraints for hermetic builds] ***
Monday 25 March 2024 22:49:19 +0000 (0:00:00.395) 4:39:14.940 **********
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.11) build Python versioned container] ***
Monday 25 March 2024 22:49:20 +0000 (0:00:00.707) 4:39:15.648 **********
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.11) start build container] ***********
Monday 25 March 2024 22:49:21 +0000 (0:00:01.036) 4:39:16.685 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) create buildslave bazel cache dir] ***
Monday 25 March 2024 22:49:22 +0000 (0:00:01.501) 4:39:18.186 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) create link for bazel cache] *****
Monday 25 March 2024 22:49:23 +0000 (0:00:00.846) 4:39:19.033 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) create link for bazelisk cache] ***
Monday 25 March 2024 22:49:24 +0000 (0:00:00.897) 4:39:19.930 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) create link for pip cache] *******
Monday 25 March 2024 22:49:25 +0000 (0:00:00.881) 4:39:20.811 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) collect list of installed Python packages for build] ***
Monday 25 March 2024 22:49:26 +0000 (0:00:00.811) 4:39:21.622 **********
changed: [localhost]
TASK [tensorflow_in_container : Show list of installed Python packages for build] ***
Monday 25 March 2024 22:49:28 +0000 (0:00:01.978) 4:39:23.601 **********
ok: [localhost] =>
pip_list_output.stdout: |-
Package Version Location Installer
------------------- -------------------- --------------------------------------- ---------
auditwheel 5.4.0 /usr/local/lib/python3.11/dist-packages pip
certifi 2019.11.28 /usr/lib/python3/dist-packages
cffi 1.16.0 /usr/local/lib/python3.11/dist-packages pip
chardet 3.0.4 /usr/lib/python3/dist-packages
cryptography 42.0.5 /usr/local/lib/python3.11/dist-packages pip
Cython 3.0.9 /usr/local/lib/python3.11/dist-packages pip
dbus-python 1.2.16 /usr/lib/python3/dist-packages
docutils 0.20.1 /usr/local/lib/python3.11/dist-packages pip
idna 2.8 /usr/lib/python3/dist-packages
importlib-metadata 7.0.1 /usr/local/lib/python3.11/dist-packages pip
jaraco.classes 3.3.1 /usr/local/lib/python3.11/dist-packages pip
jeepney 0.8.0 /usr/local/lib/python3.11/dist-packages pip
keyring 24.3.1 /usr/local/lib/python3.11/dist-packages pip
markdown-it-py 3.0.0 /usr/local/lib/python3.11/dist-packages pip
mdurl 0.1.2 /usr/local/lib/python3.11/dist-packages pip
more-itertools 10.2.0 /usr/local/lib/python3.11/dist-packages pip
nh3 0.2.15 /usr/local/lib/python3.11/dist-packages pip
pip 24.0 /usr/local/lib/python3.11/dist-packages pip
pkginfo 1.10.0 /usr/local/lib/python3.11/dist-packages pip
portpicker 1.6.0 /usr/local/lib/python3.11/dist-packages pip
psutil 5.9.8 /usr/local/lib/python3.11/dist-packages pip
pycparser 2.21 /usr/local/lib/python3.11/dist-packages pip
pyelftools 0.30 /usr/local/lib/python3.11/dist-packages pip
Pygments 2.17.2 /usr/local/lib/python3.11/dist-packages pip
PyGObject 3.36.0 /usr/lib/python3/dist-packages
python-apt 2.0.1+ubuntu0.20.4.1 /usr/lib/python3/dist-packages
readme_renderer 43.0 /usr/local/lib/python3.11/dist-packages pip
requests 2.22.0 /usr/lib/python3/dist-packages
requests-toolbelt 1.0.0 /usr/local/lib/python3.11/dist-packages pip
requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages
rfc3986 2.0.0 /usr/local/lib/python3.11/dist-packages pip
rich 13.7.1 /usr/local/lib/python3.11/dist-packages pip
SecretStorage 3.3.3 /usr/local/lib/python3.11/dist-packages pip
setuptools 69.1.1 /usr/local/lib/python3.11/dist-packages pip
six 1.14.0 /usr/lib/python3/dist-packages
twine 4.0.2 /usr/local/lib/python3.11/dist-packages pip
urllib3 2.2.1 /usr/local/lib/python3.11/dist-packages pip
wheel 0.42.0 /usr/local/lib/python3.11/dist-packages pip
zipp 3.17.0 /usr/local/lib/python3.11/dist-packages pip
TASK [tensorflow_in_container : (Python 3.11) build TensorFlow git] ************
Monday 25 March 2024 22:49:28 +0000 (0:00:00.038) 4:39:23.640 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) build Python package] ************
Monday 25 March 2024 22:55:00 +0000 (0:05:32.420) 4:44:56.061 **********
skipping: [localhost]
TASK [tensorflow_in_container : (Python 3.11) Copy built wheel] ****************
Monday 25 March 2024 22:55:00 +0000 (0:00:00.033) 4:44:56.094 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) cleanup Bazel install directory] ***
Monday 25 March 2024 22:55:01 +0000 (0:00:00.995) 4:44:57.089 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) create script to run tests] ******
Monday 25 March 2024 22:55:02 +0000 (0:00:00.860) 4:44:57.949 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.11) run TensorFlow git tests] ********
Monday 25 March 2024 22:55:03 +0000 (0:00:00.710) 4:44:58.660 **********
FATAL: command execution failed
java.io.IOException
at hudson.remoting.Channel.close(Channel.java:1494)
at hudson.remoting.Channel.close(Channel.java:1450)
at hudson.slaves.SlaveComputer.closeChannel(SlaveComputer.java:943)
at hudson.slaves.SlaveComputer.kill(SlaveComputer.java:909)
at hudson.model.AbstractCIBase.killComputer(AbstractCIBase.java:97)
at jenkins.model.Jenkins.lambda$_cleanUpDisconnectComputers$11(Jenkins.java:3785)
at hudson.model.Queue._withLock(Queue.java:1401)
at hudson.model.Queue.withLock(Queue.java:1275)
at jenkins.model.Jenkins._cleanUpDisconnectComputers(Jenkins.java:3781)
at jenkins.model.Jenkins.cleanUp(Jenkins.java:3662)
at hudson.WebAppMain.contextDestroyed(WebAppMain.java:374)
at org.eclipse.jetty.server.handler.ContextHandler.callContextDestroyed(ContextHandler.java:1059)
at org.eclipse.jetty.servlet.ServletContextHandler.callContextDestroyed(ServletContextHandler.java:636)
at org.eclipse.jetty.server.handler.ContextHandler.contextDestroyed(ContextHandler.java:1016)
at org.eclipse.jetty.servlet.ServletHandler.doStop(ServletHandler.java:306)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:132)
at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:182)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:205)
at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:97)
at org.eclipse.jetty.security.SecurityHandler.doStop(SecurityHandler.java:412)
at org.eclipse.jetty.security.ConstraintSecurityHandler.doStop(ConstraintSecurityHandler.java:413)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:132)
at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:182)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:205)
at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:97)
at org.eclipse.jetty.server.session.SessionHandler.doStop(SessionHandler.java:497)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:132)
at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:182)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:205)
at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:97)
at org.eclipse.jetty.server.handler.ContextHandler.stopContext(ContextHandler.java:1039)
at org.eclipse.jetty.servlet.ServletContextHandler.stopContext(ServletContextHandler.java:399)
at org.eclipse.jetty.webapp.WebAppContext.stopContext(WebAppContext.java:1311)
at org.eclipse.jetty.server.handler.ContextHandler.doStop(ContextHandler.java:1087)
at org.eclipse.jetty.servlet.ServletContextHandler.doStop(ServletContextHandler.java:312)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:132)
at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:182)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:205)
at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:97)
at org.eclipse.jetty.server.Server.doStop(Server.java:517)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:132)
at winstone.Launcher.shutdown(Launcher.java:442)
at winstone.ShutdownHook.run(ShutdownHook.java:28)
Caused: hudson.remoting.ChannelClosedException: Channel "hudson.remoting.Channel@4ddfcdd8:ldcg-aarch64-02": Remote call on ldcg-aarch64-02 failed. The channel is closing down or has closed down
at hudson.remoting.Channel.call(Channel.java:996)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
at jdk.proxy2/jdk.proxy2.$Proxy153.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1212)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1204)
at hudson.tasks.CommandInterpreter.join(CommandInterpreter.java:195)
at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:145)
at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:92)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:818)
at hudson.model.Build$BuildExecution.build(Build.java:199)
at hudson.model.Build$BuildExecution.doRun(Build.java:164)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:526)
at hudson.model.Run.execute(Run.java:1895)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
FATAL: Unable to delete script file /tmp/jenkins13546237660468929120.sh
java.io.IOException
at hudson.remoting.Channel.close(Channel.java:1494)
at hudson.remoting.Channel.close(Channel.java:1450)
at hudson.slaves.SlaveComputer.closeChannel(SlaveComputer.java:943)
at hudson.slaves.SlaveComputer.kill(SlaveComputer.java:909)
at hudson.model.AbstractCIBase.killComputer(AbstractCIBase.java:97)
at jenkins.model.Jenkins.lambda$_cleanUpDisconnectComputers$11(Jenkins.java:3785)
at hudson.model.Queue._withLock(Queue.java:1401)
at hudson.model.Queue.withLock(Queue.java:1275)
at jenkins.model.Jenkins._cleanUpDisconnectComputers(Jenkins.java:3781)
at jenkins.model.Jenkins.cleanUp(Jenkins.java:3662)
at hudson.WebAppMain.contextDestroyed(WebAppMain.java:374)
at org.eclipse.jetty.server.handler.ContextHandler.callContextDestroyed(ContextHandler.java:1059)
at org.eclipse.jetty.servlet.ServletContextHandler.callContextDestroyed(ServletContextHandler.java:636)
at org.eclipse.jetty.server.handler.ContextHandler.contextDestroyed(ContextHandler.java:1016)
at org.eclipse.jetty.servlet.ServletHandler.doStop(ServletHandler.java:306)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:132)
at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:182)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:205)
at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:97)
at org.eclipse.jetty.security.SecurityHandler.doStop(SecurityHandler.java:412)
at org.eclipse.jetty.security.ConstraintSecurityHandler.doStop(ConstraintSecurityHandler.java:413)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:132)
at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:182)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:205)
at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:97)
at org.eclipse.jetty.server.session.SessionHandler.doStop(SessionHandler.java:497)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:132)
at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:182)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:205)
at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:97)
at org.eclipse.jetty.server.handler.ContextHandler.stopContext(ContextHandler.java:1039)
at org.eclipse.jetty.servlet.ServletContextHandler.stopContext(ServletContextHandler.java:399)
at org.eclipse.jetty.webapp.WebAppContext.stopContext(WebAppContext.java:1311)
at org.eclipse.jetty.server.handler.ContextHandler.doStop(ContextHandler.java:1087)
at org.eclipse.jetty.servlet.ServletContextHandler.doStop(ServletContextHandler.java:312)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:132)
at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:182)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:205)
at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:97)
at org.eclipse.jetty.server.Server.doStop(Server.java:517)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:132)
at winstone.Launcher.shutdown(Launcher.java:442)
at winstone.ShutdownHook.run(ShutdownHook.java:28)
Caused: hudson.remoting.ChannelClosedException: Channel "hudson.remoting.Channel@4ddfcdd8:ldcg-aarch64-02": Remote call on ldcg-aarch64-02 failed. The channel is closing down or has closed down
at hudson.remoting.Channel.call(Channel.java:996)
at hudson.FilePath.act(FilePath.java:1230)
at hudson.FilePath.act(FilePath.java:1219)
at hudson.FilePath.delete(FilePath.java:1766)
at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:163)
at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:92)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:818)
at hudson.model.Build$BuildExecution.build(Build.java:199)
at hudson.model.Build$BuildExecution.doRun(Build.java:164)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:526)
at hudson.model.Run.execute(Run.java:1895)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
Build step 'Execute shell' marked build as failure
5 months, 3 weeks
- 1
- 2
Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #746
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/7…>
Changes:
------------------------------------------
[...truncated 7.98 KB...]
skipping: [localhost]
TASK [Fetch TensorFlow] ********************************************************
Thursday 21 March 2024 00:14:26 +0000 (0:00:00.042) 0:04:19.301 ********
skipping: [localhost]
TASK [(Python 3.9) patch TensorFlow tree] **************************************
Thursday 21 March 2024 00:14:26 +0000 (0:00:00.036) 0:04:19.337 ********
TASK [tensorflow : Create linklibs shell script] *******************************
Thursday 21 March 2024 00:14:26 +0000 (0:00:00.086) 0:04:19.423 ********
changed: [localhost]
TASK [tensorflow : Use nightly package requirements] ***************************
Thursday 21 March 2024 00:14:27 +0000 (0:00:00.818) 0:04:20.242 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds] ***
Thursday 21 March 2024 00:14:28 +0000 (0:00:00.694) 0:04:20.937 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] ***
Thursday 21 March 2024 00:14:29 +0000 (0:00:00.811) 0:04:21.748 ********
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) start build container] ************
Thursday 21 March 2024 00:14:33 +0000 (0:00:03.779) 0:04:25.528 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir] ***
Thursday 21 March 2024 00:23:50 +0000 (0:09:17.875) 0:13:43.403 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazel cache] ******
Thursday 21 March 2024 00:23:53 +0000 (0:00:02.447) 0:13:45.850 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazelisk cache] ***
Thursday 21 March 2024 00:23:55 +0000 (0:00:01.804) 0:13:47.655 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for pip cache] ********
Thursday 21 March 2024 00:23:57 +0000 (0:00:01.875) 0:13:49.531 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build] ***
Thursday 21 March 2024 00:23:59 +0000 (0:00:02.190) 0:13:51.721 ********
changed: [localhost]
TASK [tensorflow_in_container : Show list of installed Python packages for build] ***
Thursday 21 March 2024 00:24:04 +0000 (0:00:04.818) 0:13:56.540 ********
ok: [localhost] =>
pip_list_output.stdout: |-
Package Version Location Installer
------------------- -------------------- -------------------------------------- ---------
auditwheel 5.4.0 /usr/local/lib/python3.9/dist-packages pip
certifi 2019.11.28 /usr/lib/python3/dist-packages
cffi 1.16.0 /usr/local/lib/python3.9/dist-packages pip
chardet 3.0.4 /usr/lib/python3/dist-packages
cryptography 42.0.5 /usr/local/lib/python3.9/dist-packages pip
Cython 3.0.9 /usr/local/lib/python3.9/dist-packages pip
dbus-python 1.2.16 /usr/lib/python3/dist-packages
docutils 0.20.1 /usr/local/lib/python3.9/dist-packages pip
idna 2.8 /usr/lib/python3/dist-packages
importlib-metadata 7.0.1 /usr/local/lib/python3.9/dist-packages pip
jaraco.classes 3.3.1 /usr/local/lib/python3.9/dist-packages pip
jeepney 0.8.0 /usr/local/lib/python3.9/dist-packages pip
keyring 24.3.1 /usr/local/lib/python3.9/dist-packages pip
markdown-it-py 3.0.0 /usr/local/lib/python3.9/dist-packages pip
mdurl 0.1.2 /usr/local/lib/python3.9/dist-packages pip
more-itertools 10.2.0 /usr/local/lib/python3.9/dist-packages pip
nh3 0.2.15 /usr/local/lib/python3.9/dist-packages pip
pip 24.0 /usr/local/lib/python3.9/dist-packages pip
pkginfo 1.10.0 /usr/local/lib/python3.9/dist-packages pip
portpicker 1.6.0 /usr/local/lib/python3.9/dist-packages pip
psutil 5.9.8 /usr/local/lib/python3.9/dist-packages pip
pycparser 2.21 /usr/local/lib/python3.9/dist-packages pip
pyelftools 0.30 /usr/local/lib/python3.9/dist-packages pip
Pygments 2.17.2 /usr/local/lib/python3.9/dist-packages pip
PyGObject 3.36.0 /usr/lib/python3/dist-packages
python-apt 2.0.1+ubuntu0.20.4.1 /usr/lib/python3/dist-packages
readme_renderer 43.0 /usr/local/lib/python3.9/dist-packages pip
requests 2.22.0 /usr/lib/python3/dist-packages
requests-toolbelt 1.0.0 /usr/local/lib/python3.9/dist-packages pip
requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages
rfc3986 2.0.0 /usr/local/lib/python3.9/dist-packages pip
rich 13.7.1 /usr/local/lib/python3.9/dist-packages pip
SecretStorage 3.3.3 /usr/local/lib/python3.9/dist-packages pip
setuptools 69.1.1 /usr/local/lib/python3.9/dist-packages pip
six 1.14.0 /usr/lib/python3/dist-packages
twine 4.0.2 /usr/local/lib/python3.9/dist-packages pip
urllib3 2.2.1 /usr/local/lib/python3.9/dist-packages pip
wheel 0.42.0 /usr/local/lib/python3.9/dist-packages pip
zipp 3.17.0 /usr/local/lib/python3.9/dist-packages pip
TASK [tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git] ***
Thursday 21 March 2024 00:24:04 +0000 (0:00:00.047) 0:13:56.587 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python package] *************
Thursday 21 March 2024 01:25:11 +0000 (1:01:07.766) 1:15:04.354 ********
skipping: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Copy built wheel] *****************
Thursday 21 March 2024 01:25:11 +0000 (0:00:00.033) 1:15:04.387 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) cleanup Bazel install directory] ***
Thursday 21 March 2024 01:25:12 +0000 (0:00:00.919) 1:15:05.307 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create script to run tests] *******
Thursday 21 March 2024 01:25:13 +0000 (0:00:00.901) 1:15:06.208 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) run TensorFlow-oneDNN-ACL git tests] ***
Thursday 21 March 2024 01:25:14 +0000 (0:00:00.718) 1:15:06.927 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages] ***
Thursday 21 March 2024 03:23:33 +0000 (1:58:18.928) 3:13:25.855 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save list of installed Python packages] ***
Thursday 21 March 2024 03:23:35 +0000 (0:00:01.904) 3:13:27.760 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests output to file] ********
Thursday 21 March 2024 03:23:35 +0000 (0:00:00.680) 3:13:28.440 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests stderr output to file] ***
Thursday 21 March 2024 03:23:36 +0000 (0:00:00.743) 3:13:29.184 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Extract number of tests run] ******
Thursday 21 March 2024 03:23:37 +0000 (0:00:00.694) 3:13:29.879 ********
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show number of tests run] *********
Thursday 21 March 2024 03:23:37 +0000 (0:00:00.073) 3:13:29.952 ********
ok: [localhost] =>
ut_tests_line: 'Executed 3069 out of 3069 tests: 3069 tests pass.'
TASK [tensorflow_in_container : (Python 3.9) Extract failed tests] *************
Thursday 21 March 2024 03:23:37 +0000 (0:00:00.038) 3:13:29.991 ********
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show which tests are flaky] *******
Thursday 21 March 2024 03:23:37 +0000 (0:00:00.122) 3:13:30.113 ********
ok: [localhost] =>
tests_flaky: []
TASK [tensorflow_in_container : (Python 3.9) Show which tests failed] **********
Thursday 21 March 2024 03:23:37 +0000 (0:00:00.039) 3:13:30.153 ********
ok: [localhost] =>
tests_failed: []
TASK [tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one] ***
Thursday 21 March 2024 03:23:37 +0000 (0:00:00.063) 3:13:30.217 ********
fatal: [localhost]: FAILED! => changed=true
rc: 1
stderr: |-
+ for wheel in /tf/pkg/*.whl
+ echo 'Checking and renaming /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl...'
+ python3 -m auditwheel repair --plat manylinux2014_aarch64 /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl --wheel-dir /tf/pkg
+ tee check.txt
real 2m55.498s
user 2m8.780s
sys 0m20.375s
++ grep --extended-regexp --only-matching '/tf/pkg/\S+.whl' check.txt
+ new_wheel=/tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
+ [[ /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl != \/\t\f\/\p\k\g\/\t\e\n\s\o\r\f\l\o\w\_\a\a\r\c\h\6\4\-\2\.\1\7\.\0\-\c\p\3\9\-\c\p\3\9\-\l\i\n\u\x\_\a\a\r\c\h\6\4\.\w\h\l ]]
+ rm /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl
+ wheel=/tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
+ TF_WHEEL=/tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
+ bats /usertools/wheel_verification.bats --timing
stderr_lines: <omitted>
stdout: |-
Checking and renaming /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl...
INFO:auditwheel.main_repair:Repairing tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl
INFO:auditwheel.wheeltools:Previous filename tags: linux_aarch64
INFO:auditwheel.wheeltools:New filename tags: manylinux_2_17_aarch64, manylinux2014_aarch64
INFO:auditwheel.wheeltools:Previous WHEEL info tags: cp39-cp39-linux_aarch64
INFO:auditwheel.wheeltools:New WHEEL info tags: cp39-cp39-manylinux_2_17_aarch64, cp39-cp39-manylinux2014_aarch64
INFO:auditwheel.main_repair:
Fixed-up wheel written to /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
1..5
ok 1 Wheel is manylinux2014 (manylinux_2_17) compliant in 73625ms
# Size of /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl is 204 / 580 megabytes.
ok 2 Wheel conforms to upstream size limitations in 16ms
ok 3 Wheel is installable in 58935ms
ok 4 TensorFlow is importable in 4129ms
not ok 5 TensorFlow has Keras in 3715ms
# (in test file /usertools/wheel_verification.bats, line 72)
# `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "keras" in tf.keras.__name__ else 1)'' failed
# Traceback (most recent call last):
# File "/tf/venv/lib/python3.9/site-packages/tensorflow/python/util/lazy_loader.py", line 147, in _initialize
# import keras # pylint: disable=g-import-not-at-top
# File "/tf/venv/lib/python3.9/site-packages/keras/__init__.py", line 8, in <module>
# from keras import _tf_keras
# File "/tf/venv/lib/python3.9/site-packages/keras/_tf_keras/__init__.py", line 1, in <module>
# from keras._tf_keras import keras
# File "/tf/venv/lib/python3.9/site-packages/keras/_tf_keras/keras/__init__.py", line 61, in <module>
# from keras._tf_keras.keras import layers
# File "/tf/venv/lib/python3.9/site-packages/keras/_tf_keras/keras/layers/__init__.py", line 148, in <module>
# from keras.src.utils.jax_layer import FlaxLayer
# File "/tf/venv/lib/python3.9/site-packages/keras/src/utils/jax_layer.py", line 3, in <module>
# import jax
# ModuleNotFoundError: No module named 'jax'
#
# During handling of the above exception, another exception occurred:
#
# Traceback (most recent call last):
# File "<string>", line 1, in <module>
# File "/tf/venv/lib/python3.9/site-packages/tensorflow/python/util/lazy_loader.py", line 181, in __getattr__
# self._initialize()
# File "/tf/venv/lib/python3.9/site-packages/tensorflow/python/util/lazy_loader.py", line 161, in _initialize
# raise ImportError( # pylint: disable=raise-missing-from
# ImportError: Keras cannot be imported. Check that it is installed.
stdout_lines: <omitted>
PLAY RECAP *********************************************************************
localhost : ok=39 changed=26 unreachable=0 failed=1 skipped=7 rescued=0 ignored=0
Thursday 21 March 2024 03:28:56 +0000 (0:05:18.491) 3:18:48.709 ********
===============================================================================
tensorflow_in_container : (Python 3.9) run TensorFlow-oneDNN-ACL git tests 7098.93s
tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git 3667.77s
tensorflow_in_container : (Python 3.9) start build container ---------- 557.88s
tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 318.49s
Cleanup after previous build ------------------------------------------ 195.72s
tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 35.21s
tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build -- 19.63s
tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 4.82s
tensorflow_in_container : (Python 3.9) build Python versioned container --- 3.78s
tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 2.45s
tensorflow_in_container : (Python 3.9) create link for pip cache -------- 2.19s
Create cache dirs ------------------------------------------------------- 2.12s
Gathering Facts --------------------------------------------------------- 2.11s
tensorflow_in_container : (Python 3.9) collect list of installed Python packages --- 1.90s
tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 1.88s
tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 1.80s
tensorflow : Save git commit hash to file ------------------------------- 1.38s
tensorflow_in_container : (Python 3.9) Copy built wheel ----------------- 0.92s
tensorflow_in_container : (Python 3.9) cleanup Bazel install directory --- 0.90s
tensorflow : Create linklibs shell script ------------------------------- 0.82s
Build step 'Execute shell' marked build as failure
6 months
- 1
- 1
Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #735
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/7…>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on ldcg-aarch64-02 (aarch64 leg-aarch64) in workspace <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/w…>
[ldcg-python-manylinux-tensorflow-onednn-nightly] $ /bin/bash /tmp/jenkins15013734083045774886.sh
+ cd <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/w…>
+ rm -rf '*.sh' configs wheels cache_upload
+ mkdir wheels cache_upload
+ git clone --depth 1 https://git.linaro.org/ci/job/configs.git
Cloning into 'configs'...
fatal: unable to access 'https://git.linaro.org/ci/job/configs.git/': Operation timed out after 300000 milliseconds with 0 out of 0 bytes received
Build step 'Execute shell' marked build as failure
6 months, 1 week
- 1
- 1
Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #732
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/7…>
Changes:
------------------------------------------
[...truncated 11.82 KB...]
TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL from git] ***********************
Thursday 07 March 2024 00:10:46 +0000 (0:00:00.035) 0:00:42.175 ********
changed: [localhost]
TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL from git at commit] *************
Thursday 07 March 2024 00:11:08 +0000 (0:00:22.044) 0:01:04.220 ********
skipping: [localhost]
TASK [tensorflow : Set world write access to source] ***************************
Thursday 07 March 2024 00:11:08 +0000 (0:00:00.033) 0:01:04.254 ********
changed: [localhost]
TASK [tensorflow : Get oneline version of git log for this checkout] ***********
Thursday 07 March 2024 00:11:08 +0000 (0:00:00.371) 0:01:04.626 ********
changed: [localhost]
TASK [tensorflow : Show git log] ***********************************************
Thursday 07 March 2024 00:11:09 +0000 (0:00:00.580) 0:01:05.206 ********
ok: [localhost] =>
git_log.stdout: 602b5a016e60ad64b19ba0b143ee4229f44e39dd [XLA:Python] Port several more modules to nanobind.
TASK [tensorflow : Record git commit hash to variable] *************************
Thursday 07 March 2024 00:11:09 +0000 (0:00:00.040) 0:01:05.247 ********
ok: [localhost]
TASK [tensorflow : Save git commit hash to file] *******************************
Thursday 07 March 2024 00:11:09 +0000 (0:00:00.058) 0:01:05.305 ********
changed: [localhost]
TASK [Build Bazel] *************************************************************
Thursday 07 March 2024 00:11:10 +0000 (0:00:01.165) 0:01:06.470 ********
skipping: [localhost]
TASK [Build TensorFlow for each Python version] ********************************
Thursday 07 March 2024 00:11:10 +0000 (0:00:00.033) 0:01:06.503 ********
skipping: [localhost] => (item=3.9)
skipping: [localhost] => (item=3.10)
skipping: [localhost] => (item=3.11)
skipping: [localhost] => (item=3.12)
TASK [Build TensorFlow for each Python version (dual abi)] *********************
Thursday 07 March 2024 00:11:10 +0000 (0:00:00.051) 0:01:06.555 ********
TASK [tensorflow_in_container : Reset checkout to clean state] *****************
Thursday 07 March 2024 00:11:11 +0000 (0:00:00.522) 0:01:07.077 ********
changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow-oneDNN-ACL git sources from previous build] ***
Thursday 07 March 2024 00:11:11 +0000 (0:00:00.649) 0:01:07.726 ********
skipping: [localhost]
TASK [Fetch TensorFlow] ********************************************************
Thursday 07 March 2024 00:11:11 +0000 (0:00:00.033) 0:01:07.760 ********
skipping: [localhost]
TASK [(Python 3.9) patch TensorFlow tree] **************************************
Thursday 07 March 2024 00:11:12 +0000 (0:00:00.034) 0:01:07.795 ********
TASK [tensorflow : Create linklibs shell script] *******************************
Thursday 07 March 2024 00:11:12 +0000 (0:00:00.125) 0:01:07.921 ********
changed: [localhost]
TASK [tensorflow : Create readme file about unit tests] ************************
Thursday 07 March 2024 00:11:12 +0000 (0:00:00.691) 0:01:08.612 ********
changed: [localhost]
TASK [tensorflow : Add to the copied files] ************************************
Thursday 07 March 2024 00:11:13 +0000 (0:00:00.697) 0:01:09.309 ********
changed: [localhost]
TASK [tensorflow : Add to the long_description in setup.py] ********************
Thursday 07 March 2024 00:11:14 +0000 (0:00:00.586) 0:01:09.896 ********
changed: [localhost]
TASK [tensorflow : Use nightly package requirements] ***************************
Thursday 07 March 2024 00:11:14 +0000 (0:00:00.579) 0:01:10.475 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints for non-hermetic builds] ***
Thursday 07 March 2024 00:11:15 +0000 (0:00:00.431) 0:01:10.907 ********
skipping: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds] ***
Thursday 07 March 2024 00:11:15 +0000 (0:00:00.056) 0:01:10.964 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] ***
Thursday 07 March 2024 00:11:15 +0000 (0:00:00.691) 0:01:11.655 ********
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) start build container] ************
Thursday 07 March 2024 00:11:17 +0000 (0:00:01.463) 0:01:13.119 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir] ***
Thursday 07 March 2024 00:11:55 +0000 (0:00:38.642) 0:01:51.761 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazel cache] ******
Thursday 07 March 2024 00:11:57 +0000 (0:00:01.263) 0:01:53.024 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazelisk cache] ***
Thursday 07 March 2024 00:11:58 +0000 (0:00:00.878) 0:01:53.903 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for pip cache] ********
Thursday 07 March 2024 00:11:58 +0000 (0:00:00.831) 0:01:54.734 ********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build] ***
Thursday 07 March 2024 00:11:59 +0000 (0:00:00.839) 0:01:55.573 ********
changed: [localhost]
TASK [tensorflow_in_container : Show list of installed Python packages for build] ***
Thursday 07 March 2024 00:12:01 +0000 (0:00:01.845) 0:01:57.418 ********
ok: [localhost] =>
pip_list_output.stdout: |-
Package Version Location Installer
------------------- -------------------- -------------------------------------- ---------
auditwheel 5.4.0 /usr/local/lib/python3.9/dist-packages pip
certifi 2019.11.28 /usr/lib/python3/dist-packages
cffi 1.16.0 /usr/local/lib/python3.9/dist-packages pip
chardet 3.0.4 /usr/lib/python3/dist-packages
cryptography 42.0.2 /usr/local/lib/python3.9/dist-packages pip
Cython 3.0.8 /usr/local/lib/python3.9/dist-packages pip
dbus-python 1.2.16 /usr/lib/python3/dist-packages
docutils 0.20.1 /usr/local/lib/python3.9/dist-packages pip
idna 2.8 /usr/lib/python3/dist-packages
importlib-metadata 7.0.1 /usr/local/lib/python3.9/dist-packages pip
jaraco.classes 3.3.1 /usr/local/lib/python3.9/dist-packages pip
jeepney 0.8.0 /usr/local/lib/python3.9/dist-packages pip
keyring 24.3.0 /usr/local/lib/python3.9/dist-packages pip
markdown-it-py 3.0.0 /usr/local/lib/python3.9/dist-packages pip
mdurl 0.1.2 /usr/local/lib/python3.9/dist-packages pip
more-itertools 10.2.0 /usr/local/lib/python3.9/dist-packages pip
nh3 0.2.15 /usr/local/lib/python3.9/dist-packages pip
pip 24.0 /usr/local/lib/python3.9/dist-packages pip
pkginfo 1.9.6 /usr/local/lib/python3.9/dist-packages pip
portpicker 1.6.0 /usr/local/lib/python3.9/dist-packages pip
psutil 5.9.8 /usr/local/lib/python3.9/dist-packages pip
pycparser 2.21 /usr/local/lib/python3.9/dist-packages pip
pyelftools 0.30 /usr/local/lib/python3.9/dist-packages pip
Pygments 2.17.2 /usr/local/lib/python3.9/dist-packages pip
PyGObject 3.36.0 /usr/lib/python3/dist-packages
python-apt 2.0.1+ubuntu0.20.4.1 /usr/lib/python3/dist-packages
readme-renderer 42.0 /usr/local/lib/python3.9/dist-packages pip
requests 2.22.0 /usr/lib/python3/dist-packages
requests-toolbelt 1.0.0 /usr/local/lib/python3.9/dist-packages pip
requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages
rfc3986 2.0.0 /usr/local/lib/python3.9/dist-packages pip
rich 13.7.0 /usr/local/lib/python3.9/dist-packages pip
SecretStorage 3.3.3 /usr/local/lib/python3.9/dist-packages pip
setuptools 69.1.0 /usr/local/lib/python3.9/dist-packages pip
six 1.14.0 /usr/lib/python3/dist-packages
twine 4.0.2 /usr/local/lib/python3.9/dist-packages pip
urllib3 2.2.0 /usr/local/lib/python3.9/dist-packages pip
wheel 0.42.0 /usr/local/lib/python3.9/dist-packages pip
zipp 3.17.0 /usr/local/lib/python3.9/dist-packages pip
TASK [tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git] ***
Thursday 07 March 2024 00:12:01 +0000 (0:00:00.042) 0:01:57.461 ********
fatal: [localhost]: FAILED! => changed=true
rc: 1
stderr: |-
Extracting Bazel installation...
Starting local Bazel server and connecting to it...
INFO: Invocation ID: 4fbad0b3-88d4-4b30-b9fc-8da10fe012f3
INFO: Reading 'startup' options from /tf/tensorflow/.bazelrc: --windows_enable_symlinks
INFO: Options provided by the client:
Inherited 'common' options: --isatty=0 --terminal_columns=80
INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc:
Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc:
'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --features=-force_no_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility
INFO: Reading rc options for 'build' from /usertools/aarch64_clang.bazelrc:
'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/local/bin/python3 --python_path=/usr/local/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --linkopt=-fuse-ld=lld --linkopt=-lm --linkopt=-Wl,--undefined-version --host_linkopt=-fuse-ld=lld --host_linkopt=-lm --host_linkopt=-Wl,--undefined-version --distinct_host_configuration=false --copt=-Wno-gnu-offsetof-extensions --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_clang_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3
INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING
INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64_clang.bazelrc: --disk_cache=/tf/cache
INFO: Found applicable config definition build:mkl_aarch64_threadpool in file /tf/tensorflow/.bazelrc: --define=build_with_mkl_aarch64=true -c opt
INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --experimental_guard_against_concurrent_changes
INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading:
Loading: 0 packages loaded
ERROR: Skipping '//tensorflow/tools/pip_package:build_pip_package': no such target '//tensorflow/tools/pip_package:build_pip_package': target 'build_pip_package' not declared in package 'tensorflow/tools/pip_package' defined by /tf/tensorflow/tensorflow/tools/pip_package/BUILD (did you mean 'build_pip_package.py'? Tip: use `query "//tensorflow/tools/pip_package:*"` to see all the targets in that package)
WARNING: Target pattern parsing failed.
ERROR: no such target '//tensorflow/tools/pip_package:build_pip_package': target 'build_pip_package' not declared in package 'tensorflow/tools/pip_package' defined by /tf/tensorflow/tensorflow/tools/pip_package/BUILD (did you mean 'build_pip_package.py'? Tip: use `query "//tensorflow/tools/pip_package:*"` to see all the targets in that package)
INFO: Elapsed time: 68.722s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (1 packages loaded)
stderr_lines: <omitted>
stdout: ''
stdout_lines: <omitted>
PLAY RECAP *********************************************************************
localhost : ok=29 changed=20 unreachable=0 failed=1 skipped=9 rescued=0 ignored=0
Thursday 07 March 2024 00:13:11 +0000 (0:01:09.697) 0:03:07.159 ********
===============================================================================
tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git -- 69.70s
tensorflow_in_container : (Python 3.9) start build container ----------- 38.64s
Cleanup after previous build ------------------------------------------- 33.69s
tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 22.04s
tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.83s
Gathering Facts --------------------------------------------------------- 2.62s
tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 1.85s
tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.46s
Create cache dirs ------------------------------------------------------- 1.43s
tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.26s
tensorflow : Save git commit hash to file ------------------------------- 1.17s
tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.88s
tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.84s
tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.83s
tensorflow : Create readme file about unit tests ------------------------ 0.70s
tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds --- 0.69s
tensorflow : Create linklibs shell script ------------------------------- 0.69s
tensorflow_in_container : Reset checkout to clean state ----------------- 0.65s
tensorflow : Add to the copied files ------------------------------------ 0.59s
tensorflow : Get oneline version of git log for this checkout ----------- 0.58s
Build step 'Execute shell' marked build as failure
6 months, 2 weeks
- 1
- 1
Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #1101
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/1101/dis…>
Changes:
------------------------------------------
[...truncated 2.61 KB...]
TASK [Set dual abi variable] ***************************************************
Wednesday 06 March 2024 18:10:39 +0000 (0:00:01.421) 0:00:34.975 *******
ok: [localhost]
TASK [Go through each TensorFlow version] **************************************
Wednesday 06 March 2024 18:10:39 +0000 (0:00:00.033) 0:00:35.008 *******
skipping: [localhost] => (item={'key': '2.16', 'value': {'tensorflow_version': '2.16.0-rc0', 'bazel_version': 'bazelisk', 'flatbuffers_version': 'n/a', 'gast_version': 'n/a', 'grpcio_version': 'n/a', 'h5py_version': 'n/a', 'numpy_version': 'n/a', 'protobuf_version': 'n/a', 'absl_version': 'n/a', 'scipy_version': 'n/a', 'keras_version': 'n/a', 'tensorboard_version': 'n/a', 'tensorflow_estimator_version': 'n/a', 'hermetic_build': True, 'image_prefix': '2.16', 'python_install_packages': 'n/a', 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...'], 'unit_tests_gcc_exclude': ['//tensorflow/compiler/mlir/lite/debug:debug_test', '//tensorflow/compiler/mlir/quantization/tensorflow/debugging:mlir_dump_test'], 'unit_tests_clang_exclude': ['//tensorflow/core/kernels/image:resize_bicubic_op_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.9', '3.10', '3.11', '3.12']}})
skipping: [localhost] => (item={'key': '2.15', 'value': {'tensorflow_version': '2.15.0', 'bazel_version': 'bazelisk', 'flatbuffers_version': 'n/a', 'gast_version': 'n/a', 'grpcio_version': 'n/a', 'h5py_version': 'n/a', 'numpy_version': 'n/a', 'protobuf_version': 'n/a', 'absl_version': 'n/a', 'scipy_version': 'n/a', 'keras_version': 'n/a', 'tensorboard_version': 'n/a', 'tensorflow_estimator_version': 'n/a', 'hermetic_build': True, 'image_prefix': '2.15', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/core/grappler/optimizers:auto_mixed_precision_test', '//tensorflow/core/grappler/optimizers:remapper_test'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/tools/api/tests:api_compatibility_test'], 'unit_tests_gcc_exclude': ['//tensorflow/compiler/mlir/lite/debug:debug_test'], 'unit_tests_clang_exclude': ['//tensorflow/compiler/mlir/lite/quantization/lite:quantize_model_test', '//tensorflow/compiler/mlir/lite/quantization/lite:quantize_weights_test', '//tensorflow/compiler/mlir/lite/sparsity:sparsify_model_test', '//tensorflow/core/kernels/image:resize_bicubic_op_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.9', '3.10', '3.11']}})
skipping: [localhost] => (item={'key': '2.14', 'value': {'tensorflow_version': '2.14.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 23.5.26', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.14.0', 'tensorboard_version': '==2.14.1', 'tensorflow_estimator_version': '==2.14.0', 'hermetic_build': False, 'image_prefix': '2.14', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test', '//tensorflow/core/grappler/optimizers:remapper_test', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/xla/service/gpu:fusion_merger_test', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test'], 'unit_tests_gcc_exclude': ['//tensorflow/compiler/mlir/lite/debug:debug_test'], 'unit_tests_clang_exclude': ['//tensorflow/compiler/mlir/lite/quantization/lite:quantize_model_test', '//tensorflow/compiler/mlir/lite/quantization/lite:quantize_weights_test', '//tensorflow/compiler/mlir/lite/sparsity:sparsify_model_test', '//tensorflow/compiler/xla/service/cpu/tests:cpu_eigen_dot_operation_test', '//tensorflow/core/kernels/image:resize_bicubic_op_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.9', '3.10', '3.11']}})
skipping: [localhost] => (item={'key': '2.13', 'value': {'tensorflow_version': '2.13.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 23.1.21', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.13.1', 'tensorboard_version': '==2.13.0', 'tensorflow_estimator_version': '==2.13.0', 'hermetic_build': False, 'image_prefix': '2.13', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test', '//tensorflow/core/grappler/optimizers:remapper_test', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test'], 'unit_tests_gcc_exclude': '', 'unit_tests_clang_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.8', '3.9', '3.10', '3.11']}})
skipping: [localhost] => (item={'key': '2.12', 'value': {'tensorflow_version': '2.12.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 2.0, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.12.0', 'tensorboard_version': '==2.12.3', 'tensorflow_estimator_version': '==2.12.0', 'hermetic_build': False, 'image_prefix': '2.12', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tsl/framework/convolution:spatial_convolutions_test'], 'unit_tests_gcc_exclude': '', 'unit_tests_clang_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.8', '3.9', '3.10', '3.11']}})
TASK [tensorflow : Set TensorFlow and other package versions] ******************
Wednesday 06 March 2024 18:10:39 +0000 (0:00:00.189) 0:00:35.198 *******
ok: [localhost]
TASK [tensorflow : Set build dir for TensorFlow git] ***************************
Wednesday 06 March 2024 18:10:39 +0000 (0:00:00.087) 0:00:35.285 *******
ok: [localhost]
TASK [tensorflow : Remove TensorFlow git sources from previous build] **********
Wednesday 06 March 2024 18:10:39 +0000 (0:00:00.043) 0:00:35.328 *******
changed: [localhost]
TASK [tensorflow : Fetch TensorFlow] *******************************************
Wednesday 06 March 2024 18:10:43 +0000 (0:00:04.085) 0:00:39.414 *******
included: <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/confi…> for localhost
TASK [tensorflow : Fetch TensorFlow git source] ********************************
Wednesday 06 March 2024 18:10:43 +0000 (0:00:00.097) 0:00:39.512 *******
skipping: [localhost]
TASK [tensorflow : Unpack TensorFlow git source] *******************************
Wednesday 06 March 2024 18:10:43 +0000 (0:00:00.036) 0:00:39.549 *******
skipping: [localhost]
TASK [tensorflow : Rename source dir for oneDNN build] *************************
Wednesday 06 March 2024 18:10:43 +0000 (0:00:00.034) 0:00:39.583 *******
skipping: [localhost]
TASK [tensorflow : Fetch TensorFlow from git] **********************************
Wednesday 06 March 2024 18:10:43 +0000 (0:00:00.036) 0:00:39.620 *******
changed: [localhost]
TASK [tensorflow : Fetch TensorFlow from git at commit] ************************
Wednesday 06 March 2024 18:11:06 +0000 (0:00:22.523) 0:01:02.143 *******
skipping: [localhost]
TASK [tensorflow : Set world write access to source] ***************************
Wednesday 06 March 2024 18:11:06 +0000 (0:00:00.033) 0:01:02.177 *******
changed: [localhost]
TASK [tensorflow : Get oneline version of git log for this checkout] ***********
Wednesday 06 March 2024 18:11:06 +0000 (0:00:00.371) 0:01:02.548 *******
changed: [localhost]
TASK [tensorflow : Show git log] ***********************************************
Wednesday 06 March 2024 18:11:07 +0000 (0:00:00.584) 0:01:03.133 *******
ok: [localhost] =>
git_log.stdout: ee608086f94326a42c95ac7af884a86387b38b8c Update TFRT dependency to use revision http://github.com/tensorflow/runtime/commit/60cf2ee058a43b5c237aecd8ea257ed….
TASK [tensorflow : Record git commit hash to variable] *************************
Wednesday 06 March 2024 18:11:07 +0000 (0:00:00.040) 0:01:03.174 *******
ok: [localhost]
TASK [tensorflow : Save git commit hash to file] *******************************
Wednesday 06 March 2024 18:11:07 +0000 (0:00:00.058) 0:01:03.232 *******
changed: [localhost]
TASK [Build Bazel] *************************************************************
Wednesday 06 March 2024 18:11:08 +0000 (0:00:01.148) 0:01:04.381 *******
skipping: [localhost]
TASK [Build TensorFlow for each Python version] ********************************
Wednesday 06 March 2024 18:11:08 +0000 (0:00:00.033) 0:01:04.415 *******
skipping: [localhost] => (item=3.9)
skipping: [localhost] => (item=3.10)
skipping: [localhost] => (item=3.11)
skipping: [localhost] => (item=3.12)
TASK [Build TensorFlow for each Python version (dual abi)] *********************
Wednesday 06 March 2024 18:11:08 +0000 (0:00:00.052) 0:01:04.467 *******
TASK [tensorflow_in_container : Reset checkout to clean state] *****************
Wednesday 06 March 2024 18:11:09 +0000 (0:00:00.530) 0:01:04.998 *******
changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] ***
Wednesday 06 March 2024 18:11:09 +0000 (0:00:00.648) 0:01:05.647 *******
skipping: [localhost]
TASK [Fetch TensorFlow] ********************************************************
Wednesday 06 March 2024 18:11:09 +0000 (0:00:00.034) 0:01:05.681 *******
skipping: [localhost]
TASK [(Python 3.9) patch TensorFlow tree] **************************************
Wednesday 06 March 2024 18:11:09 +0000 (0:00:00.034) 0:01:05.716 *******
TASK [tensorflow : Create linklibs shell script] *******************************
Wednesday 06 March 2024 18:11:10 +0000 (0:00:00.126) 0:01:05.842 *******
changed: [localhost]
TASK [tensorflow : Create readme file about unit tests] ************************
Wednesday 06 March 2024 18:11:10 +0000 (0:00:00.688) 0:01:06.531 *******
changed: [localhost]
TASK [tensorflow : Add to the copied files] ************************************
Wednesday 06 March 2024 18:11:11 +0000 (0:00:00.695) 0:01:07.226 *******
changed: [localhost]
TASK [tensorflow : Add to the long_description in setup.py] ********************
Wednesday 06 March 2024 18:11:12 +0000 (0:00:00.587) 0:01:07.814 *******
changed: [localhost]
TASK [tensorflow : Use nightly package requirements] ***************************
Wednesday 06 March 2024 18:11:12 +0000 (0:00:00.577) 0:01:08.392 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints for non-hermetic builds] ***
Wednesday 06 March 2024 18:11:13 +0000 (0:00:00.403) 0:01:08.795 *******
skipping: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds] ***
Wednesday 06 March 2024 18:11:13 +0000 (0:00:00.055) 0:01:08.851 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] ***
Wednesday 06 March 2024 18:11:13 +0000 (0:00:00.688) 0:01:09.539 *******
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) start build container] ************
Wednesday 06 March 2024 18:11:15 +0000 (0:00:01.460) 0:01:11.000 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir] ***
Wednesday 06 March 2024 18:11:22 +0000 (0:00:07.192) 0:01:18.193 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazel cache] ******
Wednesday 06 March 2024 18:11:23 +0000 (0:00:01.249) 0:01:19.442 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazelisk cache] ***
Wednesday 06 March 2024 18:11:24 +0000 (0:00:00.879) 0:01:20.321 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for pip cache] ********
Wednesday 06 March 2024 18:11:25 +0000 (0:00:00.837) 0:01:21.158 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build] ***
Wednesday 06 March 2024 18:11:26 +0000 (0:00:00.843) 0:01:22.002 *******
changed: [localhost]
TASK [tensorflow_in_container : Show list of installed Python packages for build] ***
Wednesday 06 March 2024 18:11:28 +0000 (0:00:02.044) 0:01:24.046 *******
ok: [localhost] =>
pip_list_output.stdout: |-
Package Version Location Installer
------------------- -------------------- -------------------------------------- ---------
auditwheel 5.4.0 /usr/local/lib/python3.9/dist-packages pip
certifi 2019.11.28 /usr/lib/python3/dist-packages
cffi 1.16.0 /usr/local/lib/python3.9/dist-packages pip
chardet 3.0.4 /usr/lib/python3/dist-packages
cryptography 42.0.2 /usr/local/lib/python3.9/dist-packages pip
Cython 3.0.8 /usr/local/lib/python3.9/dist-packages pip
dbus-python 1.2.16 /usr/lib/python3/dist-packages
docutils 0.20.1 /usr/local/lib/python3.9/dist-packages pip
idna 2.8 /usr/lib/python3/dist-packages
importlib-metadata 7.0.1 /usr/local/lib/python3.9/dist-packages pip
jaraco.classes 3.3.1 /usr/local/lib/python3.9/dist-packages pip
jeepney 0.8.0 /usr/local/lib/python3.9/dist-packages pip
keyring 24.3.0 /usr/local/lib/python3.9/dist-packages pip
markdown-it-py 3.0.0 /usr/local/lib/python3.9/dist-packages pip
mdurl 0.1.2 /usr/local/lib/python3.9/dist-packages pip
more-itertools 10.2.0 /usr/local/lib/python3.9/dist-packages pip
nh3 0.2.15 /usr/local/lib/python3.9/dist-packages pip
pip 24.0 /usr/local/lib/python3.9/dist-packages pip
pkginfo 1.9.6 /usr/local/lib/python3.9/dist-packages pip
portpicker 1.6.0 /usr/local/lib/python3.9/dist-packages pip
psutil 5.9.8 /usr/local/lib/python3.9/dist-packages pip
pycparser 2.21 /usr/local/lib/python3.9/dist-packages pip
pyelftools 0.30 /usr/local/lib/python3.9/dist-packages pip
Pygments 2.17.2 /usr/local/lib/python3.9/dist-packages pip
PyGObject 3.36.0 /usr/lib/python3/dist-packages
python-apt 2.0.1+ubuntu0.20.4.1 /usr/lib/python3/dist-packages
readme-renderer 42.0 /usr/local/lib/python3.9/dist-packages pip
requests 2.22.0 /usr/lib/python3/dist-packages
requests-toolbelt 1.0.0 /usr/local/lib/python3.9/dist-packages pip
requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages
rfc3986 2.0.0 /usr/local/lib/python3.9/dist-packages pip
rich 13.7.0 /usr/local/lib/python3.9/dist-packages pip
SecretStorage 3.3.3 /usr/local/lib/python3.9/dist-packages pip
setuptools 69.1.0 /usr/local/lib/python3.9/dist-packages pip
six 1.14.0 /usr/lib/python3/dist-packages
twine 4.0.2 /usr/local/lib/python3.9/dist-packages pip
urllib3 2.2.0 /usr/local/lib/python3.9/dist-packages pip
wheel 0.42.0 /usr/local/lib/python3.9/dist-packages pip
zipp 3.17.0 /usr/local/lib/python3.9/dist-packages pip
TASK [tensorflow_in_container : (Python 3.9) build TensorFlow git] *************
Wednesday 06 March 2024 18:11:28 +0000 (0:00:00.042) 0:01:24.089 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python package] *************
Wednesday 06 March 2024 19:12:23 +0000 (1:00:54.924) 1:02:19.013 *******
fatal: [localhost]: FAILED! => changed=true
rc: 1
stderr: 'chmod: cannot access ''/tmp/tmp.d1JRN0CCms/tensorflow/compiler/mlir/quantization/tensorflow/calibrator/pywrap_calibration.so'': No such file or directory'
stderr_lines: <omitted>
stdout: |-
TensorFlow Version: 2.17.0
TensorFlow Major Version: 2
TMPDIR: /tmp/tmp.d1JRN0CCms
Wed Mar 6 19:12:24 UTC 2024 : === Preparing sources in dir: /tmp/tmp.d1JRN0CCms
/tf/tensorflow /tf/tensorflow
/tf/tensorflow
/tf/tensorflow /tf/tensorflow
/tf/tensorflow
/tf/tensorflow/bazel-bin/tensorflow/tools/pip_package/build_pip_package.runfiles/org_tensorflow /tf/tensorflow
/tf/tensorflow
stdout_lines: <omitted>
PLAY RECAP *********************************************************************
localhost : ok=30 changed=21 unreachable=0 failed=1 skipped=9 rescued=0 ignored=0
Wednesday 06 March 2024 19:12:43 +0000 (0:00:19.810) 1:02:38.824 *******
===============================================================================
tensorflow_in_container : (Python 3.9) build TensorFlow git ---------- 3654.92s
Cleanup after previous build ------------------------------------------- 30.87s
tensorflow : Fetch TensorFlow from git --------------------------------- 22.52s
tensorflow_in_container : (Python 3.9) build Python package ------------ 19.81s
tensorflow_in_container : (Python 3.9) start build container ------------ 7.19s
tensorflow : Remove TensorFlow git sources from previous build ---------- 4.09s
Gathering Facts --------------------------------------------------------- 2.63s
tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 2.04s
tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.46s
Create cache dirs ------------------------------------------------------- 1.42s
tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.25s
tensorflow : Save git commit hash to file ------------------------------- 1.15s
tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.88s
tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.84s
tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.84s
tensorflow : Create readme file about unit tests ------------------------ 0.70s
tensorflow : Create linklibs shell script ------------------------------- 0.69s
tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds --- 0.69s
tensorflow_in_container : Reset checkout to clean state ----------------- 0.65s
tensorflow : Add to the copied files ------------------------------------ 0.59s
Build step 'Execute shell' marked build as failure
6 months, 2 weeks
- 1
- 1