See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/1308/display/redirect
Changes:
------------------------------------------ [...truncated 331.21 KiB...] [19,695 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/quantize.cc; 62s local, remote-cache ... (112 actions running) [19,697 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/quantize.cc; 63s local, remote-cache ... (112 actions running) [19,698 / 20,190] Compiling tensorflow/compiler/mlir/tensorflow/transforms/group_by_dialect.cc; 60s local, remote-cache ... (111 actions, 110 running) [19,701 / 20,190] Compiling tensorflow/compiler/mlir/tensorflow/transforms/group_by_dialect.cc; 61s local, remote-cache ... (112 actions running) [19,703 / 20,190] Compiling tensorflow/compiler/mlir/tensorflow/transforms/group_by_dialect.cc; 62s local, remote-cache ... (112 actions running) [19,707 / 20,190] Compiling tensorflow/compiler/mlir/tensorflow/transforms/group_by_dialect.cc; 63s local, remote-cache ... (112 actions running) [19,708 / 20,190] Compiling tensorflow/compiler/mlir/tensorflow/transforms/group_by_dialect.cc; 64s local, remote-cache ... (112 actions running) [19,709 / 20,190] Compiling tensorflow/compiler/mlir/tensorflow/transforms/group_by_dialect.cc; 66s local, remote-cache ... (111 actions, 110 running) [19,713 / 20,190] Compiling tensorflow/compiler/mlir/tensorflow/transforms/group_by_dialect.cc; 68s local, remote-cache ... (112 actions running) [19,716 / 20,190] Compiling tensorflow/compiler/mlir/tensorflow/transforms/group_by_dialect.cc; 69s local, remote-cache ... (111 actions, 110 running) [19,722 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions_drq.cc; 58s local, remote-cache ... (112 actions running) [19,723 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions_drq.cc; 59s local, remote-cache ... (112 actions running) [19,727 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions_drq.cc; 60s local, remote-cache ... (112 actions running) [19,730 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions_drq.cc; 61s local, remote-cache ... (112 actions running) [19,731 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions_drq.cc; 63s local, remote-cache ... (111 actions, 110 running) [19,733 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions_drq.cc; 64s local, remote-cache ... (111 actions, 110 running) [19,737 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions.cc; 65s local, remote-cache ... (112 actions running) [19,739 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions.cc; 66s local, remote-cache ... (112 actions running) [19,740 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions.cc; 69s local, remote-cache ... (111 actions, 110 running) [19,744 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions.cc; 70s local, remote-cache ... (111 actions, 110 running) [19,745 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions.cc; 71s local, remote-cache ... (112 actions running) [19,747 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions.cc; 72s local, remote-cache ... (111 actions, 110 running) [19,748 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions.cc; 73s local, remote-cache ... (112 actions running) [19,751 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions.cc; 74s local, remote-cache ... (112 actions running) [19,757 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions.cc; 75s local, remote-cache ... (112 actions running) [19,758 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions.cc; 78s local, remote-cache ... (111 actions, 110 running) [19,760 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions.cc; 79s local, remote-cache ... (112 actions running) [19,762 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions.cc; 80s local, remote-cache ... (111 actions, 110 running) [19,762 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/lift_quantizable_spots_as_functions.cc; 81s local, remote-cache ... (112 actions running) [19,765 / 20,190] Compiling tensorflow/compiler/mlir/tensorflow/transforms/executor_tpuv1_island_coarsening.cc; 60s local, remote-cache ... (112 actions running) [19,766 / 20,190] Compiling tensorflow/compiler/mlir/tensorflow/transforms/einsum.cc; 60s local, remote-cache ... (111 actions, 110 running) [19,767 / 20,190] Compiling tensorflow/compiler/mlir/tensorflow/transforms/einsum.cc; 62s local, remote-cache ... (112 actions running) [19,769 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/insert_main_function.cc; 62s local, remote-cache ... (112 actions running) [19,770 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/insert_main_function.cc; 63s local, remote-cache ... (111 actions, 110 running) [19,771 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/insert_main_function.cc; 65s local, remote-cache ... (111 actions, 110 running) [19,772 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/insert_main_function.cc; 66s local, remote-cache ... (112 actions running) [19,775 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/insert_custom_aggregation_ops.cc; 55s local, remote-cache ... (112 actions running) [19,777 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/insert_custom_aggregation_ops.cc; 56s local, remote-cache ... (112 actions running) [19,778 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/insert_custom_aggregation_ops.cc; 58s local, remote-cache ... (111 actions, 110 running) [19,780 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/insert_custom_aggregation_ops.cc; 60s local, remote-cache ... (112 actions running) [19,784 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/insert_custom_aggregation_ops.cc; 61s local, remote-cache ... (112 actions running) [19,787 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/nchw_convolution_to_nhwc.cc; 60s local, remote-cache ... (111 actions, 110 running) [19,789 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/nchw_convolution_to_nhwc.cc; 61s local, remote-cache ... (112 actions running) [19,790 / 20,190] Compiling tensorflow/compiler/mlir/tensorflow/transforms/decompose_optionals.cc; 60s local, remote-cache ... (111 actions, 110 running) [19,793 / 20,190] Compiling tensorflow/compiler/mlir/tensorflow/transforms/decompose_optionals.cc; 61s local, remote-cache ... (111 actions, 110 running) [19,799 / 20,190] Compiling tensorflow/compiler/mlir/tensorflow/transforms/decompose_optionals.cc; 62s local, remote-cache ... (112 actions running) [19,800 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 54s local, remote-cache ... (112 actions running) [19,804 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 55s local, remote-cache ... (112 actions running) [19,809 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 56s local, remote-cache ... (112 actions running) [19,811 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 57s local, remote-cache ... (112 actions running) [19,813 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 58s local, remote-cache ... (112 actions running) [19,815 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 59s local, remote-cache ... (112 actions running) [19,816 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 61s local, remote-cache ... (111 actions, 110 running) [19,820 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 62s local, remote-cache ... (111 actions, 110 running) [19,821 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 63s local, remote-cache ... (112 actions running) [19,827 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 64s local, remote-cache ... (111 actions, 110 running) [19,831 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 65s local, remote-cache ... (112 actions running) [19,832 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 66s local, remote-cache ... (112 actions running) [19,833 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 67s local, remote-cache ... (112 actions running) [19,836 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 68s local, remote-cache ... (112 actions running) [19,838 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 69s local, remote-cache ... (112 actions running) [19,842 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 70s local, remote-cache ... (112 actions running) [19,843 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 72s local, remote-cache ... (111 actions, 110 running) [19,846 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 73s local, remote-cache ... (112 actions running) [19,847 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 75s local, remote-cache ... (111 actions, 110 running) [19,847 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 77s local, remote-cache ... (112 actions running) [19,848 / 20,190] Compiling tensorflow/compiler/mlir/quantization/stablehlo/passes/lift_quantizable_spots_as_functions.cc; 79s local, remote-cache ... (111 actions, 110 running) [19,852 / 20,190] Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/duplicate_shape_determining_constants.cc; 69s local, remote-cache ... (111 actions, 110 running) [19,855 / 20,190] Compiling tensorflow/dtensor/mlir/expansions/strided_slice_spmd_expander.cc; 58s local, remote-cache ... (112 actions running) [19,858 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 52s local, remote-cache ... (112 actions running) [19,860 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 53s local, remote-cache ... (112 actions running) [19,862 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 54s local, remote-cache ... (112 actions running) [19,867 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 55s local, remote-cache ... (112 actions running) [19,871 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 56s local, remote-cache ... (112 actions running) [19,873 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 57s local, remote-cache ... (112 actions running) [19,874 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 58s local, remote-cache ... (112 actions running) [19,878 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 59s local, remote-cache ... (112 actions running) [19,881 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 60s local, remote-cache ... (112 actions running) [19,882 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 61s local, remote-cache ... (111 actions, 110 running) [19,886 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 62s local, remote-cache ... (111 actions, 110 running) [19,890 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 63s local, remote-cache ... (111 actions, 110 running) [19,892 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 65s local, remote-cache ... (111 actions, 110 running) [19,896 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 66s local, remote-cache ... (112 actions running) [19,897 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 67s local, remote-cache ... (111 actions, 110 running) [19,899 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 68s local, remote-cache ... (111 actions, 110 running) [19,901 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 70s local, remote-cache ... (111 actions, 110 running) [19,902 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 71s local, remote-cache ... (112 actions running) [19,904 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 72s local, remote-cache ... (112 actions running) [19,907 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 73s local, remote-cache ... (111 actions, 110 running) [19,908 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 74s local, remote-cache ... (112 actions running) [19,909 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 75s local, remote-cache ... (112 actions running) [19,911 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 76s local, remote-cache ... (112 actions running) [19,916 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 77s local, remote-cache ... (112 actions running) [19,917 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 79s local, remote-cache ... (111 actions, 110 running) [19,920 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 80s local, remote-cache ... (111 actions, 110 running) [19,922 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 82s local, remote-cache ... (110 actions, 108 running) [19,925 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 83s local, remote-cache ... (111 actions, 110 running) [19,927 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 84s local, remote-cache ... (112 actions running) [19,928 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 85s local, remote-cache ... (112 actions running) [19,929 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 86s local, remote-cache ... (112 actions running) [19,930 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 87s local, remote-cache ... (112 actions running) [19,931 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 88s local, remote-cache ... (112 actions running) [19,934 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 89s local, remote-cache ... (112 actions running) [19,939 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 90s local, remote-cache ... (111 actions, 110 running) [19,939 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 91s local, remote-cache ... (112 actions running) [19,941 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 92s local, remote-cache ... (112 actions running) [19,943 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 93s local, remote-cache ... (112 actions running) [19,945 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 94s local, remote-cache ... (112 actions running) [19,946 / 20,190] Compiling tensorflow/compiler/mlir/lite/tf_to_tfl_flatbuffer.cc; 95s local, remote-cache ... (111 actions, 110 running) [19,951 / 20,190] Compiling tensorflow/dtensor/mlir/expansions/nullary_spmd_expander.cc; 55s local, remote-cache ... (110 actions running) [19,954 / 20,190] Compiling tensorflow/dtensor/mlir/expansions/meta_spmd_expander.cc; 47s local, remote-cache ... (112 actions running) [19,955 / 20,190] Compiling tensorflow/dtensor/mlir/expansions/meta_spmd_expander.cc; 48s local, remote-cache ... (111 actions, 110 running) [19,958 / 20,190] Compiling tensorflow/dtensor/mlir/expansions/meta_spmd_expander.cc; 50s local, remote-cache ... (112 actions running) [19,959 / 20,190] Compiling tensorflow/dtensor/mlir/expansions/meta_spmd_expander.cc; 57s local, remote-cache ... (111 actions, 110 running) [19,960 / 20,190] Compiling tensorflow/dtensor/mlir/expansions/meta_spmd_expander.cc; 59s local, remote-cache ... (112 actions running) [19,961 / 20,190] Compiling tensorflow/dtensor/mlir/expansions/meta_spmd_expander.cc; 60s local, remote-cache ... (111 actions, 110 running) [19,962 / 20,190] Compiling tensorflow/dtensor/mlir/expansions/meta_spmd_expander.cc; 61s local, remote-cache ... (111 actions, 110 running) [19,967 / 20,190] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 60s local, remote-cache ... (111 actions, 110 running) [19,969 / 20,190] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 61s local, remote-cache ... (111 actions, 110 running) [19,973 / 20,190] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 62s local, remote-cache ... (112 actions running) [19,974 / 20,190] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 64s local, remote-cache ... (111 actions, 110 running) [19,977 / 20,190] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 65s local, remote-cache ... (112 actions running) [19,979 / 20,190] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 66s local, remote-cache ... (112 actions running) [19,981 / 20,190] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 67s local, remote-cache ... (112 actions running) [19,985 / 20,190] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 68s local, remote-cache ... (112 actions running) [19,987 / 20,190] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 69s local, remote-cache ... (112 actions running) [19,989 / 20,190] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 70s local, remote-cache ... (112 actions running) [19,990 / 20,190] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 73s local, remote-cache ... (111 actions, 110 running) [19,991 / 20,190] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 74s local, remote-cache ... (112 actions running) [19,993 / 20,190] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 75s local, remote-cache ... (112 actions running) [19,996 / 20,190] Compiling tensorflow/dtensor/mlir/op_to_device_cluster.cc; 59s local, remote-cache ... (112 actions running) [19,998 / 20,190] Compiling tensorflow/dtensor/mlir/op_to_device_cluster.cc; 60s local, remote-cache ... (112 actions running) [20,000 / 20,190] Compiling tensorflow/dtensor/mlir/expansions/einsum_spmd_expander.cc; 59s local, remote-cache ... (112 actions running) [20,004 / 20,190] Compiling tensorflow/dtensor/mlir/expansions/einsum_spmd_expander.cc; 60s local, remote-cache ... (112 actions running) [20,008 / 20,190] Compiling tensorflow/dtensor/mlir/expansions/dataparallel_spmd_expander.cc; 59s local, remote-cache ... (112 actions running) [20,009 / 20,190] Compiling tensorflow/dtensor/mlir/expansions/dataparallel_spmd_expander.cc; 60s local, remote-cache ... (111 actions, 110 running) [20,013 / 20,190] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 59s local, remote-cache ... (111 actions, 110 running) [20,014 / 20,190] Compiling tensorflow/dtensor/mlir/expansions/conv_spmd_expander.cc; 60s local, remote-cache ... (111 actions, 110 running) [20,016 / 20,190] Compiling tensorflow/dtensor/mlir/expansions/conv_spmd_expander.cc; 61s local, remote-cache ... (111 actions, 110 running) [20,018 / 20,190] Compiling tensorflow/compiler/jit/kernels/xla_ops.cc; 59s local, remote-cache ... (112 actions running) [20,021 / 20,190] Compiling tensorflow/compiler/jit/kernels/xla_ops.cc; 60s local, remote-cache ... (112 actions running) [20,024 / 20,190] Compiling tensorflow/compiler/jit/kernels/xla_ops.cc; 61s local, remote-cache ... (112 actions running) [20,029 / 20,190] Compiling tensorflow/compiler/jit/kernels/xla_ops.cc; 62s local, remote-cache ... (112 actions running) [20,035 / 20,190] Compiling tensorflow/compiler/jit/kernels/xla_ops.cc; 63s local, remote-cache ... (112 actions running) [20,036 / 20,190] Compiling tensorflow/compiler/jit/kernels/xla_ops.cc; 64s local, remote-cache ... (111 actions, 110 running) [20,040 / 20,190] Compiling tensorflow/dtensor/mlir/mesh_propagation.cc; 57s local, remote-cache ... (108 actions running) [20,046 / 20,190] Compiling tensorflow/dtensor/mlir/mesh_propagation.cc; 58s local, remote-cache ... (98 actions running) [20,050 / 20,190] Compiling tensorflow/dtensor/mlir/mesh_propagation.cc; 60s local, remote-cache ... (94 actions running) [20,054 / 20,190] Compiling tensorflow/dtensor/mlir/merge_clusters.cc; 60s local, remote-cache ... (88 actions running) [20,058 / 20,190] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 56s local, remote-cache ... (82 actions running) [20,061 / 20,190] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 57s local, remote-cache ... (79 actions, 78 running) [20,072 / 20,190] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 59s local, remote-cache ... (67 actions, 66 running) [20,079 / 20,190] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 60s local, remote-cache ... (60 actions running) [20,084 / 20,190] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 61s local, remote-cache ... (55 actions, 54 running) [20,092 / 20,190] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 63s local, remote-cache ... (47 actions, 46 running) [20,093 / 20,190] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 64s local, remote-cache ... (46 actions running) [20,096 / 20,190] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 65s local, remote-cache ... (42 actions running) [20,100 / 20,190] Compiling tensorflow/dtensor/mlir/dtensor_set_hlo_sharding.cc; 54s local, remote-cache ... (36 actions running) [20,103 / 20,190] Compiling tensorflow/dtensor/mlir/dtensor_set_hlo_sharding.cc; 55s local, remote-cache ... (33 actions, 32 running) [20,105 / 20,190] Compiling tensorflow/dtensor/mlir/dtensor_replace_auxiliary_layout_op.cc; 54s local, remote-cache ... (30 actions running) [20,107 / 20,190] Compiling tensorflow/dtensor/mlir/dtensor_multi_device_expansion.cc; 52s local, remote-cache ... (26 actions running) [20,107 / 20,190] Compiling tensorflow/dtensor/mlir/dtensor_multi_device_expansion.cc; 55s local, remote-cache ... (26 actions running) [20,112 / 20,190] Compiling tensorflow/dtensor/mlir/dtensor_multi_device_expansion.cc; 57s local, remote-cache ... (19 actions, 18 running) [20,113 / 20,190] Compiling tensorflow/dtensor/mlir/dtensor_multi_device_expansion.cc; 58s local, remote-cache ... (18 actions running) [20,116 / 20,190] Compiling tensorflow/dtensor/mlir/dtensor_multi_device_expansion.cc; 60s local, remote-cache ... (12 actions running) [20,117 / 20,190] Compiling tensorflow/dtensor/mlir/dtensor_multi_device_expansion.cc; 61s local, remote-cache ... (10 actions running) [20,118 / 20,190] Compiling tensorflow/dtensor/mlir/dtensor_allreduce_combine_optimization.cc; 55s local, remote-cache ... (8 actions running) [20,119 / 20,190] Compiling tensorflow/compiler/mlir/tensorflow/c/c_api_unified_experimental_mlir.cc; 60s local, remote-cache ... (7 actions, 6 running) [20,120 / 20,190] Compiling tensorflow/compiler/mlir/tensorflow/c/c_api_unified_experimental_mlir.cc; 62s local, remote-cache ... (6 actions running) [20,121 / 20,190] Compiling tensorflow/compiler/mlir/python/mlir.cc; 58s local, remote-cache ... (5 actions, 4 running) [20,122 / 20,190] Compiling tensorflow/compiler/mlir/python/mlir.cc; 60s local, remote-cache ... (4 actions running) [20,122 / 20,190] Compiling tensorflow/compiler/mlir/python/mlir.cc; 70s local, remote-cache ... (4 actions running) [20,123 / 20,190] Compiling tensorflow/compiler/mlir/python/mlir.cc; 84s local, remote-cache ... (3 actions, 2 running) [20,124 / 20,190] Compiling tensorflow/compiler/mlir/python/mlir.cc; 86s local, remote-cache [20,124 / 20,190] Compiling tensorflow/compiler/mlir/python/mlir.cc; 96s local, remote-cache [20,124 / 20,190] Compiling tensorflow/compiler/mlir/python/mlir.cc; 122s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 0s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 10s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 40s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 100s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 160s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 220s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 280s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 340s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 400s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 460s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 520s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 580s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 640s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 700s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 760s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 820s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 880s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 894s local, remote-cache [20,126 / 20,190] Linking tensorflow/libtensorflow_cc.so.2.19.0; 903s local, remote-cache [20,130 / 20,190] Linking tensorflow/python/_pywrap_tensorflow_internal.so; 1s local, remote-cache [20,131 / 20,190] [Prepa] action 'SolibSymlink _solib_local/_Utensorflow_Spython/_pywrap_tensorflow_internal.so' [20,184 / 20,190] Linking tensorflow/python/_pywrap_tfcompile.so; 1s local, remote-cache ... (10 actions running) [20,188 / 20,190] Linking tensorflow/python/tpu/_pywrap_tpu_embedding.so; 2s local, remote-cache [20,189 / 20,190] [Prepa] Action tensorflow/tools/pip_package/wheel_house [20,189 / 20,190] Action tensorflow/tools/pip_package/wheel_house; 1s local, remote-cache [20,189 / 20,190] Action tensorflow/tools/pip_package/wheel_house; 11s local, remote-cache ERROR: /tf/tensorflow/tensorflow/tools/pip_package/BUILD:266:9: Action tensorflow/tools/pip_package/wheel_house failed: (Exit 1): build_pip_package_py failed: error executing command (from target //tensorflow/tools/pip_package:wheel) bazel-out/aarch64-opt-exec-50AE0418/bin/tensorflow/tools/pip_package/build_pip_package_py @bazel-out/aarch64-opt/bin/tensorflow/tools/pip_package/wheel_house-0.params Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt-exec-50AE0418/bin/tensorflow/tools/pip_package/build_pip_package_py.runfiles/org_tensorflow/tensorflow/tools/pip_package/build_pip_package.py", line 391, in <module> prepare_wheel_srcs(args.headers, args.srcs, args.xla_aot, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt-exec-50AE0418/bin/tensorflow/tools/pip_package/build_pip_package_py.runfiles/org_tensorflow/tensorflow/tools/pip_package/build_pip_package.py", line 220, in prepare_wheel_srcs prepare_headers(headers, os.path.join(srcs_dir, "tensorflow/include")) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt-exec-50AE0418/bin/tensorflow/tools/pip_package/build_pip_package_py.runfiles/org_tensorflow/tensorflow/tools/pip_package/build_pip_package.py", line 135, in prepare_headers shutil.copytree(os.path.join(srcs_dir, "external/local_config_cuda/cuda"), File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/external/python_aarch64-unknown-linux-gnu/lib/python3.9/shutil.py", line 566, in copytree with os.scandir(src) as itr: FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tensorflow_wheelkjxa2dz0/tensorflow/include/external/local_config_cuda/cuda' Target //tensorflow/tools/pip_package:wheel failed to build Use --verbose_failures to see the command lines of failed build steps. [20,190 / 20,190] checking cached actions INFO: Elapsed time: 4324.891s, Critical Path: 1531.94s INFO: 20190 processes: 1232 internal, 18958 local. FAILED: Build did NOT complete successfully stderr_lines: <omitted> stdout: '' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=25 changed=17 unreachable=0 failed=1 skipped=6 rescued=0 ignored=0
Thursday 03 October 2024 20:23:39 +0100 (1:12:06.325) 1:13:33.504 ****** =============================================================================== tensorflow_in_container : (Python 3.9) build TensorFlow git ---------- 4326.33s Cleanup after previous build ------------------------------------------- 33.45s tensorflow : Fetch TensorFlow from git --------------------------------- 24.60s tensorflow_in_container : (Python 3.9) start build container ------------ 7.76s tensorflow : Remove TensorFlow git sources from previous build ---------- 4.42s Gathering Facts --------------------------------------------------------- 2.86s tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.46s Create cache dirs ------------------------------------------------------- 1.43s tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 1.42s tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.23s tensorflow : Save git commit hash to file ------------------------------- 1.14s tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.84s tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.84s tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.81s tensorflow : Create linklibs shell script ------------------------------- 0.69s tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds --- 0.68s tensorflow_in_container : Reset checkout to clean state ----------------- 0.67s tensorflow : Use nightly package requirements --------------------------- 0.63s tensorflow : Get oneline version of git log for this checkout ----------- 0.58s Build TensorFlow for each Python version (dual abi) --------------------- 0.46s Build step 'Execute shell' marked build as failure