Hello anmar,
I'm sorry I forgot to tell you my email is liuyinsi@163.com, please do not email to liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed?
Where did you execute the commands?In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container?
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much.
Thanks, yinsi
liuyinsi@163.com 发件人: Anmar Oueja 发送日期: 2021年02月18日 02:43 收件人: liuyinsi 抄送人: Cameron,wufengguang,yuchuan,lkq-dev,Dave Pigott,Luca Di Stefano,Jammy Zhou 主题: Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,
Happy Lunar New Year!!!
David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.
Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.
This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307
Can you please work with David and Luca to try and figure this out.
Cheers! anmar
Hi Yinsi,
On 20/02/2021 07:19, [1]liuyinsi@163.com wrote:
Hello anmar,
I'm sorry I forgot to tell you my email is [2]liuyinsi@163.com, please do not email to [3]liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed?
There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:
[4]https://lkft-staging.validation.linaro.org/scheduler/job/100307T
That's an example of the boot process.
Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.
Where did you execute the commands?In the server openEuler OS
that i setup for you, or run a container on the server, then execute commands in the container?
We run everything on a container on the server.
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much.
Does that command need to be run in the background? otherwise i get a new shell opened only.
Thank you
Thanks, yinsi _______________________________________________________________
[5]liuyinsi@163.com
发件人: [6]Anmar Oueja 发送日期: 2021年02月18日 02:43 收件人: [7]liuyinsi 抄送人: [8]Cameron,[9]wufengguang,[10]yuchuan,[11]lkq-dev,[12]Dave Pigott,[13]Luca Di Stefano,[14]Jammy Zhou 主题: Issues with docker on OpenEulerOS
Hello Yinsi/Yuchan, Happy Lunar New Year!!! David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS. Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly. This is QEMU's instance booting log you: [15]https://lkft-staging.validation.linaro.org/scheduler/job/100307 Can you please work with David and Luca to try and figure this out. Cheers! anmar
References
1. mailto:liuyinsi@163.com 2. mailto:liuyinsi@163.com 3. mailto:liuyinsi@huawei.com 4. https://lkft-staging.validation.linaro.org/scheduler/job/100307T 5. mailto:liuyinsi@163.com 6. mailto:anmar.oueja@linaro.org 7. mailto:liuyinsi@huawei.com 8. mailto:jonathan.cameron@huawei.com 9. mailto:wufengguang@huawei.com 10. mailto:13186087857@163.com 11. mailto:lkq-dev@op-lists.linaro.org 12. mailto:dave.pigott@linaro.org 13. mailto:luca.distefano@linaro.org 14. mailto:jammy.zhou@linaro.org 15. https://lkft-staging.validation.linaro.org/scheduler/job/100307
Try specifying gic v3. There is a bug in some firmware versions that makes the host kernel think we are gic v2 compatible which it doesn't.
Jonathan
-------------------------------------------------- Jonathan Cameron Mobile: +44-7870588074 Email: jonathan.cameron@huawei.commailto:jonathan.cameron@huawei.com From:Luca Di Stefano luca.distefano@linaro.org To:liuyinsi liuyinsi@163.com;Oueja anmar.oueja@linaro.org;Pigott dave.pigott@linaro.org Cc:wufengguang wufengguang@huawei.com;Jonathan Cameron jonathan.cameron@huawei.com;jammy.zhou jammy.zhou@linaro.org;lkq-dev lkq-dev@op-lists.linaro.org Date:2021-02-23 12:12:05 Subject:Re: Fw: Issues with docker on OpenEulerOS
Hi Yinsi,
On 20/02/2021 07:19, liuyinsi@163.commailto:liuyinsi@163.com wrote: Hello anmar,
I'm sorry I forgot to tell you my email is liuyinsi@163.commailto:liuyinsi@163.com, please do not email to liuyinsi@huawei.commailto:liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed?
There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:
https://lkft-staging.validation.linaro.org/scheduler/job/100307T
That's an example of the boot process.
Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.
Where did you execute the commands?In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container?
We run everything on a container on the server.
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much.
Does that command need to be run in the background? otherwise i get a new shell opened only.
Thank you
Thanks, yinsi ________________________________ liuyinsi@163.commailto:liuyinsi@163.com 发件人: Anmar Ouejamailto:anmar.oueja@linaro.org 发送日期: 2021年02月18日 02:43 收件人: liuyinsimailto:liuyinsi@huawei.com 抄送人: Cameronmailto:jonathan.cameron@huawei.com,wufengguangmailto:wufengguang@huawei.com,yuchuanmailto:13186087857@163.com,lkq-devmailto:lkq-dev@op-lists.linaro.org,Dave Pigottmailto:dave.pigott@linaro.org,Luca Di Stefanomailto:luca.distefano@linaro.org,Jammy Zhoumailto:jammy.zhou@linaro.org 主题: Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,
Happy Lunar New Year!!!
David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.
Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.
This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307
Can you please work with David and Luca to try and figure this out.
Cheers! anmar
Hi Luca,
liuyinsi@163.com
From: Luca Di Stefano Date: 2021-02-23 20:11 To: liuyinsi@163.com; Oueja; Pigott CC: wufengguang; Cameron; jammy.zhou@linaro.org; lkq-dev Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com wrote: Hello anmar,
I'm sorry I forgot to tell you my email is liuyinsi@163.com, please do not email to liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed? There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:
How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.
https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.
Where did you execute the commands?In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container? We run everything on a container on the server.
which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much. Does that command need to be run in the background? otherwise i get a new shell opened only.
yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'.
Thanks, Yinsi
Thank you
Thanks, yinsi
liuyinsi@163.com 发件人: Anmar Oueja 发送日期: 2021年02月18日 02:43 收件人: liuyinsi 抄送人: Cameron,wufengguang,yuchuan,lkq-dev,Dave Pigott,Luca Di Stefano,Jammy Zhou 主题: Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,
Happy Lunar New Year!!!
David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.
Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.
This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307
Can you please work with David and Luca to try and figure this out.
Cheers! anmar
On 01/03/2021 06:56, [1]liuyinsi@163.com wrote:
Hi Luca, __________________________________________________________________
[2]liuyinsi@163.com
From: [3]Luca Di Stefano Date: 2021-02-23 20:11 To: [4]liuyinsi@163.com; [5]Oueja; [6]Pigott CC: [7]wufengguang; [8]Cameron; [9]jammy.zhou@linaro.org; [10]lkq-dev Subject: Re: Fw: Issues with docker on OpenEulerOS
Hi Yinsi, On 20/02/2021 07:19, [11]liuyinsi@163.com wrote:
Hello anmar,
I'm sorry I forgot to tell you my email is [12]liuyinsi@163.com, please do not email to [13]liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed?
There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:
How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.
[14]https://lkft-staging.validation.linaro.org/scheduler/job/100307T
That's an example of the boot process.
Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.
Where did you execute the commands?In the server openEuler OS
that i setup for you, or run a container on the server, then execute commands in the container?
We run everything on a container on the server.
which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?
As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ),
yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.
Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads
We see also other issues with qemu jobs that we are currently investigating.
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much.
Does that command need to be run in the background? otherwise i get a new shell opened only.
yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux,
you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'.
In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'
Thank you
Thanks,
Yinsi
Thank you
Thanks, yinsi _______________________________________________________________
[15]liuyinsi@163.com
发件人: [16]Anmar Oueja 发送日期: 2021年02月18日 02:43 收件人: [17]liuyinsi 抄送人: [18]Cameron,[19]wufengguang,[20]yuchuan,[21]lkq-dev,[22]Dave Pigott,[23]Luca Di Stefano,[24]Jammy Zhou 主题: Issues with docker on OpenEulerOS
Hello Yinsi/Yuchan, Happy Lunar New Year!!! David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS. Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly. This is QEMU's instance booting log you: [25]https://lkft-staging.validation.linaro.org/scheduler/job/100307 Can you please work with David and Luca to try and figure this out. Cheers! anmar
References
1. mailto:liuyinsi@163.com 2. mailto:liuyinsi@163.com 3. mailto:luca.distefano@linaro.org 4. mailto:liuyinsi@163.com 5. mailto:anmar.oueja@linaro.org 6. mailto:dave.pigott@linaro.org 7. mailto:wufengguang@huawei.com 8. mailto:jonathan.cameron@huawei.com 9. mailto:jammy.zhou@linaro.org 10. mailto:lkq-dev@op-lists.linaro.org 11. mailto:liuyinsi@163.com 12. mailto:liuyinsi@163.com 13. mailto:liuyinsi@huawei.com 14. https://lkft-staging.validation.linaro.org/scheduler/job/100307T 15. mailto:liuyinsi@163.com 16. mailto:anmar.oueja@linaro.org 17. mailto:liuyinsi@huawei.com 18. mailto:jonathan.cameron@huawei.com 19. mailto:wufengguang@huawei.com 20. mailto:13186087857@163.com 21. mailto:lkq-dev@op-lists.linaro.org 22. mailto:dave.pigott@linaro.org 23. mailto:luca.distefano@linaro.org 24. mailto:jammy.zhou@linaro.org 25. https://lkft-staging.validation.linaro.org/scheduler/job/100307
Hi Luca,
On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano luca.distefano@linaro.org wrote:
On 01/03/2021 06:56, liuyinsi@163.com wrote:
Hi Luca,
liuyinsi@163.com
*From:* Luca Di Stefano luca.distefano@linaro.org *Date:* 2021-02-23 20:11 *To:* liuyinsi@163.com; Oueja anmar.oueja@linaro.org; Pigott dave.pigott@linaro.org *CC:* wufengguang wufengguang@huawei.com; Cameron jonathan.cameron@huawei.com; jammy.zhou@linaro.org; lkq-dev lkq-dev@op-lists.linaro.org *Subject:* Re: Fw: Issues with docker on OpenEulerOS
Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com wrote:
Hello anmar,
I'm sorry I forgot to tell you my email is liuyinsi@163.com, please do not email to liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed?
There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:
How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service .
https://lkft-staging.validation.linaro.org/scheduler/job/100307T
That's an example of the boot process.
Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.
Where did you execute the commands?In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container?
We run everything on a container on the server.
which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?
As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ),
Sounds great.
yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.
Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads
Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.
We see also other issues with qemu jobs that we are currently investigating.
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much.
Does that command need to be run in the background? otherwise i get a new shell opened only.
yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux,
you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'.
In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'
Thank you
Thanks,
Yinsi
Thank you
Thanks, yinsi
liuyinsi@163.com
发件人: Anmar Oueja anmar.oueja@linaro.org 发送日期: 2021年02月18日 02:43 收件人: liuyinsi liuyinsi@huawei.com 抄送人: Cameron jonathan.cameron@huawei.com,wufengguang wufengguang@huawei.com,yuchuan 13186087857@163.com,lkq-dev lkq-dev@op-lists.linaro.org,Dave Pigott dave.pigott@linaro.org,Luca Di Stefano luca.distefano@linaro.org,Jammy Zhou jammy.zhou@linaro.org 主题: Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,
Happy Lunar New Year!!!
David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.
Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.
This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307
Can you please work with David and Luca to try and figure this out.
Cheers! anmar
Hi Jammy,
On Tue, Mar 2, 2021 at 7:30 AM Jammy Zhou jammy.zhou@linaro.org wrote:
Hi Luca,
On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano luca.distefano@linaro.org wrote:
On 01/03/2021 06:56, liuyinsi@163.com wrote:
Hi Luca,
liuyinsi@163.com
*From:* Luca Di Stefano luca.distefano@linaro.org *Date:* 2021-02-23 20:11 *To:* liuyinsi@163.com; Oueja anmar.oueja@linaro.org; Pigott dave.pigott@linaro.org *CC:* wufengguang wufengguang@huawei.com; Cameron jonathan.cameron@huawei.com; jammy.zhou@linaro.org; lkq-dev lkq-dev@op-lists.linaro.org *Subject:* Re: Fw: Issues with docker on OpenEulerOS
Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com wrote:
Hello anmar,
I'm sorry I forgot to tell you my email is liuyinsi@163.com, please do not email to liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed?
There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:
How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.
https://lkft-staging.validation.linaro.org/scheduler/job/100307T
That's an example of the boot process.
Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.
Where did you execute the commands?In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container?
We run everything on a container on the server.
which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?
As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ),
Sounds great.
yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.
Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads
Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.
Here are some examples:
https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313641#L197
Here's the list of jobs we ran so far: https://lkft.validation.linaro.org/scheduler/device/qemu-h01
We see also other issues with qemu jobs that we are currently investigating.
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much.
Does that command need to be run in the background? otherwise i get a new shell opened only.
yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux,
you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'.
In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'
Thank you
Thanks,
Yinsi
Thank you
Thanks, yinsi
liuyinsi@163.com
发件人: Anmar Oueja anmar.oueja@linaro.org 发送日期: 2021年02月18日 02:43 收件人: liuyinsi liuyinsi@huawei.com 抄送人: Cameron jonathan.cameron@huawei.com,wufengguang wufengguang@huawei.com,yuchuan 13186087857@163.com,lkq-dev lkq-dev@op-lists.linaro.org,Dave Pigott dave.pigott@linaro.org,Luca Di Stefano luca.distefano@linaro.org,Jammy Zhou jammy.zhou@linaro.org 主题: Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,
Happy Lunar New Year!!!
David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.
Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.
This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307
Can you please work with David and Luca to try and figure this out.
Cheers! anmar
Hi anmar/luca,
http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... https://github.com/Linaro/test-definitions.git
1. http download: How many HTTP files do you have to download? If not many, please provide http files download links, we can download all http files at first time, then we can use http proxy cache at next time to fix download timeout.
2. https download: use "git" instead of "https" can work well. git clone git://github.com/Linaro/test-definitions.git
Thanks Yinsi
liuyinsi@163.com
From: Anmar Oueja Date: 2021-03-03 07:03 To: Jammy Zhou CC: Luca Di Stefano; liuyinsi@163.com; wufengguang; Cameron; lkq-dev; Pigott Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,
On Tue, Mar 2, 2021 at 7:30 AM Jammy Zhou jammy.zhou@linaro.org wrote: Hi Luca,
On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano luca.distefano@linaro.org wrote:
On 01/03/2021 06:56, liuyinsi@163.com wrote: Hi Luca,
liuyinsi@163.com
From: Luca Di Stefano Date: 2021-02-23 20:11 To: liuyinsi@163.com; Oueja; Pigott CC: wufengguang; Cameron; jammy.zhou@linaro.org; lkq-dev Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com wrote: Hello anmar,
I'm sorry I forgot to tell you my email is liuyinsi@163.com, please do not email to liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed? There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:
How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.
https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.
Where did you execute the commands?In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container? We run everything on a container on the server.
which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?
As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ), Sounds great.
yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.
Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.
Here are some examples:
https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313641#L197
Here's the list of jobs we ran so far: https://lkft.validation.linaro.org/scheduler/device/qemu-h01
We see also other issues with qemu jobs that we are currently investigating.
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much. Does that command need to be run in the background? otherwise i get a new shell opened only.
yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'
Thank you
Thanks, Yinsi
Thank you
Thanks, yinsi
liuyinsi@163.com 发件人: Anmar Oueja 发送日期: 2021年02月18日 02:43 收件人: liuyinsi 抄送人: Cameron,wufengguang,yuchuan,lkq-dev,Dave Pigott,Luca Di Stefano,Jammy Zhou 主题: Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,
Happy Lunar New Year!!!
David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.
Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.
This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307
Can you please work with David and Luca to try and figure this out.
Cheers! anmar
Hi Yinsi,
The files that we download change every day based on builds that are uploaded to snapshots.linaro.org. We test the latest builds, not the same build over and over.
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
Thanks
Dave
On 4 Mar 2021, at 09:11, liuyinsi@163.com wrote:
Hi anmar/luca,
http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 https://github.com/Linaro/test-definitions.git https://github.com/Linaro/test-definitions.git
- http download:
How many HTTP files do you have to download? If not many, please provide http files download links, we can download all http files at first time, then we can use http proxy cache at next time to fix download timeout.
- https download:
use "git" instead of "https" can work well. git clone git:// git://github.com/Linaro/test-definitions.gitgithub.com/Linaro/test-definitions.git git://github.com/Linaro/test-definitions.git
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: Anmar Oueja mailto:anmar.oueja@linaro.org Date: 2021-03-03 07:03 To: Jammy Zhou mailto:jammy.zhou@linaro.org CC: Luca Di Stefano mailto:luca.distefano@linaro.org; liuyinsi@163.com mailto:liuyinsi@163.com; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Pigott mailto:dave.pigott@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,
On Tue, Mar 2, 2021 at 7:30 AM Jammy Zhou <jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> wrote: Hi Luca,
On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org> wrote:
On 01/03/2021 06:56, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Luca, liuyinsi@163.com mailto:liuyinsi@163.com From: Luca Di Stefano mailto:luca.distefano@linaro.org Date: 2021-02-23 20:11 To: liuyinsi@163.com mailto:liuyinsi@163.com; Oueja mailto:anmar.oueja@linaro.org; Pigott mailto:dave.pigott@linaro.org CC: wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; lkq-dev mailto:lkq-dev@op-lists.linaro.org Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hello anmar,
I'm sorry I forgot to tell you my email is liuyinsi@163.com mailto:liuyinsi@163.com, please do not email to liuyinsi@huawei.com mailto:liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed?
There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:
How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.
https://lkft-staging.validation.linaro.org/scheduler/job/100307T https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.
Where did you execute the commands?In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container?
We run everything on a container on the server.
which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?
As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ), Sounds great.
yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.
Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.
Here are some examples:
https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313641#L197 https://lkft.validation.linaro.org/scheduler/job/2313641#L197
Here's the list of jobs we ran so far: https://lkft.validation.linaro.org/scheduler/device/qemu-h01 https://lkft.validation.linaro.org/scheduler/device/qemu-h01
We see also other issues with qemu jobs that we are currently investigating.
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much.
Does that command need to be run in the background? otherwise i get a new shell opened only.
yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'
Thank you
Thanks, Yinsi
Thank you
Thanks, yinsi liuyinsi@163.com mailto:liuyinsi@163.com 发件人: Anmar Oueja mailto:anmar.oueja@linaro.org 发送日期: 2021年02月18日 02:43 收件人: liuyinsi mailto:liuyinsi@huawei.com 抄送人: Cameron mailto:jonathan.cameron@huawei.com,wufengguang mailto:wufengguang@huawei.com,yuchuan mailto:13186087857@163.com,lkq-dev mailto:lkq-dev@op-lists.linaro.org,Dave Pigott mailto:dave.pigott@linaro.org,Luca Di Stefano mailto:luca.distefano@linaro.org,Jammy Zhou mailto:jammy.zhou@linaro.org 主题: Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,
Happy Lunar New Year!!!
David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.
Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.
This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307 https://lkft-staging.validation.linaro.org/scheduler/job/100307
Can you please work with David and Luca to try and figure this out.
Cheers! anmar
Hi Dave,
liuyinsi@163.com
From: Dave Pigott Date: 2021-03-04 18:04 To: liuyinsi@163.com CC: Anmar Oueja; Luca Di Stefano; wufengguang; Jonathan Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
The files that we download change every day based on builds that are uploaded to snapshots.linaro.org. We test the latest builds, not the same build over and over.
1. What the amount of updates.? What percentage of it we'll actually use? 2. how do you run qemu kvm in a container, i log in a debian container and fail to use qemu-system-aarch64 command, but i can run success in the physical machine, error as the follows:
root@87a2c3380232:/# ./kvm-debian.sh macaddr: 02-ff-e8-78-e2-ed Could not access KVM kernel module: No such file or directory qemu-system-aarch64: failed to initialize KVM: No such file or directory
Thanks Yinsi
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
Thanks
Dave
On 4 Mar 2021, at 09:11, liuyinsi@163.com wrote:
Hi anmar/luca,
http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... https://github.com/Linaro/test-definitions.git
1. http download: How many HTTP files do you have to download? If not many, please provide http files download links, we can download all http files at first time, then we can use http proxy cache at next time to fix download timeout.
2. https download: use "git" instead of "https" can work well. git clone git://github.com/Linaro/test-definitions.git
Thanks Yinsi
liuyinsi@163.com
From: Anmar Oueja Date: 2021-03-03 07:03 To: Jammy Zhou CC: Luca Di Stefano; liuyinsi@163.com; wufengguang; Cameron; lkq-dev; Pigott Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,
On Tue, Mar 2, 2021 at 7:30 AM Jammy Zhou jammy.zhou@linaro.org wrote: Hi Luca,
On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano luca.distefano@linaro.org wrote:
On 01/03/2021 06:56, liuyinsi@163.com wrote: Hi Luca,
liuyinsi@163.com
From: Luca Di Stefano Date: 2021-02-23 20:11 To: liuyinsi@163.com; Oueja; Pigott CC: wufengguang; Cameron; jammy.zhou@linaro.org; lkq-dev Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com wrote: Hello anmar,
I'm sorry I forgot to tell you my email is liuyinsi@163.com, please do not email to liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed? There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:
How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.
https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.
Where did you execute the commands?In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container? We run everything on a container on the server.
which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?
As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ), Sounds great.
yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.
Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.
Here are some examples:
https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313641#L197
Here's the list of jobs we ran so far: https://lkft.validation.linaro.org/scheduler/device/qemu-h01
We see also other issues with qemu jobs that we are currently investigating.
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much. Does that command need to be run in the background? otherwise i get a new shell opened only.
yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'
Thank you
Thanks, Yinsi
Thank you
Thanks, yinsi
liuyinsi@163.com 发件人: Anmar Oueja 发送日期: 2021年02月18日 02:43 收件人: liuyinsi 抄送人: Cameron,wufengguang,yuchuan,lkq-dev,Dave Pigott,Luca Di Stefano,Jammy Zhou 主题: Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,
Happy Lunar New Year!!!
David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.
Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.
This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307
Can you please work with David and Luca to try and figure this out.
Cheers! anmar
Hi Dave,
"The QEMU instances are failing to boot from NFS", has this problem been solved by add "gic-version=3" in qemu command? I try and it can work.
boot command: qemu-system-aarch64 -cpu host -machine virt-2.10,accel=kvm,gic-version=3 -nographic ....
Thanks Yinsi
liuyinsi@163.com
From: Dave Pigott Date: 2021-03-04 18:04 To: liuyinsi@163.com CC: Anmar Oueja; Luca Di Stefano; wufengguang; Jonathan Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
The files that we download change every day based on builds that are uploaded to snapshots.linaro.org. We test the latest builds, not the same build over and over.
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
Thanks
Dave
On 4 Mar 2021, at 09:11, liuyinsi@163.com wrote:
Hi anmar/luca,
http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... https://github.com/Linaro/test-definitions.git
1. http download: How many HTTP files do you have to download? If not many, please provide http files download links, we can download all http files at first time, then we can use http proxy cache at next time to fix download timeout.
2. https download: use "git" instead of "https" can work well. git clone git://github.com/Linaro/test-definitions.git
Thanks Yinsi
liuyinsi@163.com
From: Anmar Oueja Date: 2021-03-03 07:03 To: Jammy Zhou CC: Luca Di Stefano; liuyinsi@163.com; wufengguang; Cameron; lkq-dev; Pigott Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,
On Tue, Mar 2, 2021 at 7:30 AM Jammy Zhou jammy.zhou@linaro.org wrote: Hi Luca,
On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano luca.distefano@linaro.org wrote:
On 01/03/2021 06:56, liuyinsi@163.com wrote: Hi Luca,
liuyinsi@163.com
From: Luca Di Stefano Date: 2021-02-23 20:11 To: liuyinsi@163.com; Oueja; Pigott CC: wufengguang; Cameron; jammy.zhou@linaro.org; lkq-dev Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com wrote: Hello anmar,
I'm sorry I forgot to tell you my email is liuyinsi@163.com, please do not email to liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed? There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:
How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.
https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.
Where did you execute the commands?In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container? We run everything on a container on the server.
which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?
As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ), Sounds great.
yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.
Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.
Here are some examples:
https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313641#L197
Here's the list of jobs we ran so far: https://lkft.validation.linaro.org/scheduler/device/qemu-h01
We see also other issues with qemu jobs that we are currently investigating.
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much. Does that command need to be run in the background? otherwise i get a new shell opened only.
yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'
Thank you
Thanks, Yinsi
Thank you
Thanks, yinsi
liuyinsi@163.com 发件人: Anmar Oueja 发送日期: 2021年02月18日 02:43 收件人: liuyinsi 抄送人: Cameron,wufengguang,yuchuan,lkq-dev,Dave Pigott,Luca Di Stefano,Jammy Zhou 主题: Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,
Happy Lunar New Year!!!
David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.
Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.
This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307
Can you please work with David and Luca to try and figure this out.
Cheers! anmar
Hi Yinsi,
Well, yes. It solved the problem for OpenEuler. Unfortunately it broke it for our Raspberry Pi based qemu workers so we had to revert the health check while we do some more digging.
Thanks
Dave
---------------- Dave Pigott LAVA Lab Lead Linaro Ltd t: (+44) (0) 1223 400063
On 15 Mar 2021, at 10:18, liuyinsi@163.com wrote:
Hi Dave,
"The QEMU instances are failing to boot from NFS", has this problem been solved by add "gic-version=3" in qemu command? I try and it can work.
boot command: qemu-system-aarch64 -cpu host -machine virt-2.10,accel=kvm,gic-version=3 -nographic ....
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-04 18:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
The files that we download change every day based on builds that are uploaded to snapshots.linaro.org http://snapshots.linaro.org/. We test the latest builds, not the same build over and over.
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
Thanks
Dave
On 4 Mar 2021, at 09:11, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi anmar/luca,
http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 https://github.com/Linaro/test-definitions.git https://github.com/Linaro/test-definitions.git
- http download:
How many HTTP files do you have to download? If not many, please provide http files download links, we can download all http files at first time, then we can use http proxy cache at next time to fix download timeout.
- https download:
use "git" instead of "https" can work well. git clone git:// git://github.com/Linaro/test-definitions.gitgithub.com/Linaro/test-definitions.git git://github.com/Linaro/test-definitions.git
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: Anmar Oueja mailto:anmar.oueja@linaro.org Date: 2021-03-03 07:03 To: Jammy Zhou mailto:jammy.zhou@linaro.org CC: Luca Di Stefano mailto:luca.distefano@linaro.org; liuyinsi@163.com mailto:liuyinsi@163.com; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Pigott mailto:dave.pigott@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,
On Tue, Mar 2, 2021 at 7:30 AM Jammy Zhou <jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> wrote: Hi Luca,
On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org> wrote:
On 01/03/2021 06:56, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Luca, liuyinsi@163.com mailto:liuyinsi@163.com From: Luca Di Stefano mailto:luca.distefano@linaro.org Date: 2021-02-23 20:11 To: liuyinsi@163.com mailto:liuyinsi@163.com; Oueja mailto:anmar.oueja@linaro.org; Pigott mailto:dave.pigott@linaro.org CC: wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; lkq-dev mailto:lkq-dev@op-lists.linaro.org Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hello anmar,
I'm sorry I forgot to tell you my email is liuyinsi@163.com mailto:liuyinsi@163.com, please do not email to liuyinsi@huawei.com mailto:liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed?
There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:
How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.
https://lkft-staging.validation.linaro.org/scheduler/job/100307T https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.
Where did you execute the commands?In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container?
We run everything on a container on the server.
which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?
As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ), Sounds great.
yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.
Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.
Here are some examples:
https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313641#L197 https://lkft.validation.linaro.org/scheduler/job/2313641#L197
Here's the list of jobs we ran so far: https://lkft.validation.linaro.org/scheduler/device/qemu-h01 https://lkft.validation.linaro.org/scheduler/device/qemu-h01
We see also other issues with qemu jobs that we are currently investigating.
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much.
Does that command need to be run in the background? otherwise i get a new shell opened only.
yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'
Thank you
Thanks, Yinsi
Thank you
Thanks, yinsi liuyinsi@163.com mailto:liuyinsi@163.com 发件人: Anmar Oueja mailto:anmar.oueja@linaro.org 发送日期: 2021年02月18日 02:43 收件人: liuyinsi mailto:liuyinsi@huawei.com 抄送人: Cameron mailto:jonathan.cameron@huawei.com,wufengguang mailto:wufengguang@huawei.com,yuchuan mailto:13186087857@163.com,lkq-dev mailto:lkq-dev@op-lists.linaro.org,Dave Pigott mailto:dave.pigott@linaro.org,Luca Di Stefano mailto:luca.distefano@linaro.org,Jammy Zhou mailto:jammy.zhou@linaro.org 主题: Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,
Happy Lunar New Year!!!
David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.
Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.
This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307 https://lkft-staging.validation.linaro.org/scheduler/job/100307
Can you please work with David and Luca to try and figure this out.
Cheers! anmar
Hi Dave,
"http download timeout", is it more appropriate for us to choose http proxy cache or set up a mirror? At present, there are two solutions.
"https download timeout", there seems to be no better way to replace HTTPS with GIT.
Thanks Yinsi
liuyinsi@163.com
From: Dave Pigott Date: 2021-03-15 18:29 To: liuyinsi@163.com CC: Oueja; luca; wufengguang; Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
Well, yes. It solved the problem for OpenEuler. Unfortunately it broke it for our Raspberry Pi based qemu workers so we had to revert the health check while we do some more digging.
Thanks
Dave
---------------- Dave Pigott LAVA Lab Lead Linaro Ltd t: (+44) (0) 1223 400063
On 15 Mar 2021, at 10:18, liuyinsi@163.com wrote:
Hi Dave,
"The QEMU instances are failing to boot from NFS", has this problem been solved by add "gic-version=3" in qemu command? I try and it can work.
boot command: qemu-system-aarch64 -cpu host -machine virt-2.10,accel=kvm,gic-version=3 -nographic ....
Thanks Yinsi
liuyinsi@163.com
From: Dave Pigott Date: 2021-03-04 18:04 To: liuyinsi@163.com CC: Anmar Oueja; Luca Di Stefano; wufengguang; Jonathan Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
The files that we download change every day based on builds that are uploaded to snapshots.linaro.org. We test the latest builds, not the same build over and over.
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
Thanks
Dave
On 4 Mar 2021, at 09:11, liuyinsi@163.com wrote:
Hi anmar/luca,
http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... https://github.com/Linaro/test-definitions.git
1. http download: How many HTTP files do you have to download? If not many, please provide http files download links, we can download all http files at first time, then we can use http proxy cache at next time to fix download timeout.
2. https download: use "git" instead of "https" can work well. git clone git://github.com/Linaro/test-definitions.git
Thanks Yinsi
liuyinsi@163.com
From: Anmar Oueja Date: 2021-03-03 07:03 To: Jammy Zhou CC: Luca Di Stefano; liuyinsi@163.com; wufengguang; Cameron; lkq-dev; Pigott Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,
On Tue, Mar 2, 2021 at 7:30 AM Jammy Zhou jammy.zhou@linaro.org wrote: Hi Luca,
On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano luca.distefano@linaro.org wrote:
On 01/03/2021 06:56, liuyinsi@163.com wrote: Hi Luca,
liuyinsi@163.com
From: Luca Di Stefano Date: 2021-02-23 20:11 To: liuyinsi@163.com; Oueja; Pigott CC: wufengguang; Cameron; jammy.zhou@linaro.org; lkq-dev Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com wrote: Hello anmar,
I'm sorry I forgot to tell you my email is liuyinsi@163.com, please do not email to liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed? There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:
How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.
https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.
Where did you execute the commands?In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container? We run everything on a container on the server.
which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?
As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ), Sounds great.
yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.
Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.
Here are some examples:
https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313641#L197
Here's the list of jobs we ran so far: https://lkft.validation.linaro.org/scheduler/device/qemu-h01
We see also other issues with qemu jobs that we are currently investigating.
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much. Does that command need to be run in the background? otherwise i get a new shell opened only.
yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'
Thank you
Thanks, Yinsi
Thank you
Thanks, yinsi
liuyinsi@163.com 发件人: Anmar Oueja 发送日期: 2021年02月18日 02:43 收件人: liuyinsi 抄送人: Cameron,wufengguang,yuchuan,lkq-dev,Dave Pigott,Luca Di Stefano,Jammy Zhou 主题: Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,
Happy Lunar New Year!!!
David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.
Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.
This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307
Can you please work with David and Luca to try and figure this out.
Cheers! anmar
Fix / workaround is upstream now.. https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/ar...
Looks like it didn’t get a stable tag though. I’ll find out if there is a reason and get Shameer to request a backport if not.
Thanks,
Jonathan
From: Dave Pigott [mailto:dave.pigott@linaro.org] Sent: 15 March 2021 10:30 To: liuyinsi@163.com Cc: Oueja anmar.oueja@linaro.org; luca luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; Jonathan Cameron jonathan.cameron@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS
Hi Yinsi,
Well, yes. It solved the problem for OpenEuler. Unfortunately it broke it for our Raspberry Pi based qemu workers so we had to revert the health check while we do some more digging.
Thanks
Dave
---------------- Dave Pigott LAVA Lab Lead Linaro Ltd t: (+44) (0) 1223 400063
On 15 Mar 2021, at 10:18, liuyinsi@163.commailto:liuyinsi@163.com wrote:
Hi Dave,
"The QEMU instances are failing to boot from NFS", has this problem been solved by add "gic-version=3" in qemu command? I try and it can work.
boot command: qemu-system-aarch64 -cpu host -machine virt-2.10,accel=kvm,gic-version=3 -nographic ....
Thanks Yinsi
liuyinsi@163.commailto:liuyinsi@163.com
From: Dave Pigottmailto:dave.pigott@linaro.org Date: 2021-03-04 18:04 To: liuyinsi@163.commailto:liuyinsi@163.com CC: Anmar Ouejamailto:anmar.oueja@linaro.org; Luca Di Stefanomailto:luca.distefano@linaro.org; wufengguangmailto:wufengguang@huawei.com; Jonathan Cameronmailto:jonathan.cameron@huawei.com; lkq-devmailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
The files that we download change every day based on builds that are uploaded to snapshots.linaro.orghttp://snapshots.linaro.org/. We test the latest builds, not the same build over and over.
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
Thanks
Dave
On 4 Mar 2021, at 09:11, liuyinsi@163.commailto:liuyinsi@163.com wrote:
Hi anmar/luca,
http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... https://github.com/Linaro/test-definitions.git
1. http download: How many HTTP files do you have to download? If not many, please provide http files download links, we can download all http files at first time, then we can use http proxy cache at next time to fix download timeout.
2. https download: use "git" instead of "https" can work well. git clone git://git://github.com/Linaro/test-definitions.gitgithub.com/Linaro/test-definitions.gitgit://github.com/Linaro/test-definitions.git
Thanks Yinsi
________________________________ liuyinsi@163.commailto:liuyinsi@163.com
From: Anmar Ouejamailto:anmar.oueja@linaro.org Date: 2021-03-03 07:03 To: Jammy Zhoumailto:jammy.zhou@linaro.org CC: Luca Di Stefanomailto:luca.distefano@linaro.org; liuyinsi@163.commailto:liuyinsi@163.com; wufengguangmailto:wufengguang@huawei.com; Cameronmailto:jonathan.cameron@huawei.com; lkq-devmailto:lkq-dev@op-lists.linaro.org; Pigottmailto:dave.pigott@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,
On Tue, Mar 2, 2021 at 7:30 AM Jammy Zhou <jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org> wrote: Hi Luca,
On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano <luca.distefano@linaro.orgmailto:luca.distefano@linaro.org> wrote:
On 01/03/2021 06:56, liuyinsi@163.commailto:liuyinsi@163.com wrote: Hi Luca, ________________________________ liuyinsi@163.commailto:liuyinsi@163.com
From: Luca Di Stefanomailto:luca.distefano@linaro.org Date: 2021-02-23 20:11 To: liuyinsi@163.commailto:liuyinsi@163.com; Ouejamailto:anmar.oueja@linaro.org; Pigottmailto:dave.pigott@linaro.org CC: wufengguangmailto:wufengguang@huawei.com; Cameronmailto:jonathan.cameron@huawei.com; jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org; lkq-devmailto:lkq-dev@op-lists.linaro.org Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.commailto:liuyinsi@163.com wrote: Hello anmar,
I'm sorry I forgot to tell you my email is liuyinsi@163.commailto:liuyinsi@163.com, please do not email to liuyinsi@huawei.commailto:liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed? There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:
How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.
https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.
Where did you execute the commands?In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container? We run everything on a container on the server.
which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?
As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ), Sounds great.
yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.
Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.
Here are some examples:
https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313641#L197
Here's the list of jobs we ran so far: https://lkft.validation.linaro.org/scheduler/device/qemu-h01
We see also other issues with qemu jobs that we are currently investigating.
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much. Does that command need to be run in the background? otherwise i get a new shell opened only.
yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'
Thank you
Thanks, Yinsi
Thank you
Thanks, yinsi ________________________________ liuyinsi@163.commailto:liuyinsi@163.com 发件人: Anmar Ouejamailto:anmar.oueja@linaro.org 发送日期: 2021年02月18日 02:43 收件人: liuyinsimailto:liuyinsi@huawei.com 抄送人: Cameronmailto:jonathan.cameron@huawei.com,wufengguangmailto:wufengguang@huawei.com,yuchuanmailto:13186087857@163.com,lkq-devmailto:lkq-dev@op-lists.linaro.org,Dave Pigottmailto:dave.pigott@linaro.org,Luca Di Stefanomailto:luca.distefano@linaro.org,Jammy Zhoumailto:jammy.zhou@linaro.org 主题: Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,
Happy Lunar New Year!!!
David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.
Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.
This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307
Can you please work with David and Luca to try and figure this out.
Cheers! anmar
What is the host kernel on that machine? Any chance of patching it in the meantime to get things moving?
Jonathan
From: Jonathan Cameron Sent: 15 March 2021 12:07 To: 'Dave Pigott' dave.pigott@linaro.org; liuyinsi@163.com Cc: Oueja anmar.oueja@linaro.org; luca luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org Subject: RE: Issues with docker on OpenEulerOS
Fix / workaround is upstream now.. https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/ar...
Looks like it didn’t get a stable tag though. I’ll find out if there is a reason and get Shameer to request a backport if not.
Thanks,
Jonathan
From: Dave Pigott [mailto:dave.pigott@linaro.org] Sent: 15 March 2021 10:30 To: liuyinsi@163.commailto:liuyinsi@163.com Cc: Oueja <anmar.oueja@linaro.orgmailto:anmar.oueja@linaro.org>; luca <luca.distefano@linaro.orgmailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.commailto:wufengguang@huawei.com>; Jonathan Cameron <jonathan.cameron@huawei.commailto:jonathan.cameron@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.orgmailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS
Hi Yinsi,
Well, yes. It solved the problem for OpenEuler. Unfortunately it broke it for our Raspberry Pi based qemu workers so we had to revert the health check while we do some more digging.
Thanks
Dave
---------------- Dave Pigott LAVA Lab Lead Linaro Ltd t: (+44) (0) 1223 400063
On 15 Mar 2021, at 10:18, liuyinsi@163.commailto:liuyinsi@163.com wrote:
Hi Dave,
"The QEMU instances are failing to boot from NFS", has this problem been solved by add "gic-version=3" in qemu command? I try and it can work.
boot command: qemu-system-aarch64 -cpu host -machine virt-2.10,accel=kvm,gic-version=3 -nographic ....
Thanks Yinsi
liuyinsi@163.commailto:liuyinsi@163.com
From: Dave Pigottmailto:dave.pigott@linaro.org Date: 2021-03-04 18:04 To: liuyinsi@163.commailto:liuyinsi@163.com CC: Anmar Ouejamailto:anmar.oueja@linaro.org; Luca Di Stefanomailto:luca.distefano@linaro.org; wufengguangmailto:wufengguang@huawei.com; Jonathan Cameronmailto:jonathan.cameron@huawei.com; lkq-devmailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
The files that we download change every day based on builds that are uploaded to snapshots.linaro.orghttp://snapshots.linaro.org/. We test the latest builds, not the same build over and over.
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
Thanks
Dave
On 4 Mar 2021, at 09:11, liuyinsi@163.commailto:liuyinsi@163.com wrote:
Hi anmar/luca,
http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... https://github.com/Linaro/test-definitions.git
1. http download: How many HTTP files do you have to download? If not many, please provide http files download links, we can download all http files at first time, then we can use http proxy cache at next time to fix download timeout.
2. https download: use "git" instead of "https" can work well. git clone git://git://github.com/Linaro/test-definitions.gitgithub.com/Linaro/test-definitions.gitgit://github.com/Linaro/test-definitions.git
Thanks Yinsi
________________________________ liuyinsi@163.commailto:liuyinsi@163.com
From: Anmar Ouejamailto:anmar.oueja@linaro.org Date: 2021-03-03 07:03 To: Jammy Zhoumailto:jammy.zhou@linaro.org CC: Luca Di Stefanomailto:luca.distefano@linaro.org; liuyinsi@163.commailto:liuyinsi@163.com; wufengguangmailto:wufengguang@huawei.com; Cameronmailto:jonathan.cameron@huawei.com; lkq-devmailto:lkq-dev@op-lists.linaro.org; Pigottmailto:dave.pigott@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,
On Tue, Mar 2, 2021 at 7:30 AM Jammy Zhou <jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org> wrote: Hi Luca,
On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano <luca.distefano@linaro.orgmailto:luca.distefano@linaro.org> wrote:
On 01/03/2021 06:56, liuyinsi@163.commailto:liuyinsi@163.com wrote: Hi Luca, ________________________________ liuyinsi@163.commailto:liuyinsi@163.com
From: Luca Di Stefanomailto:luca.distefano@linaro.org Date: 2021-02-23 20:11 To: liuyinsi@163.commailto:liuyinsi@163.com; Ouejamailto:anmar.oueja@linaro.org; Pigottmailto:dave.pigott@linaro.org CC: wufengguangmailto:wufengguang@huawei.com; Cameronmailto:jonathan.cameron@huawei.com; jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org; lkq-devmailto:lkq-dev@op-lists.linaro.org Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.commailto:liuyinsi@163.com wrote: Hello anmar,
I'm sorry I forgot to tell you my email is liuyinsi@163.commailto:liuyinsi@163.com, please do not email to liuyinsi@huawei.commailto:liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed? There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:
How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.
https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.
Where did you execute the commands?In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container? We run everything on a container on the server.
which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?
As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ), Sounds great.
yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.
Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.
Here are some examples:
https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313641#L197
Here's the list of jobs we ran so far: https://lkft.validation.linaro.org/scheduler/device/qemu-h01
We see also other issues with qemu jobs that we are currently investigating.
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much. Does that command need to be run in the background? otherwise i get a new shell opened only.
yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'
Thank you
Thanks, Yinsi
Thank you
Thanks, yinsi ________________________________ liuyinsi@163.commailto:liuyinsi@163.com 发件人: Anmar Ouejamailto:anmar.oueja@linaro.org 发送日期: 2021年02月18日 02:43 收件人: liuyinsimailto:liuyinsi@huawei.com 抄送人: Cameronmailto:jonathan.cameron@huawei.com,wufengguangmailto:wufengguang@huawei.com,yuchuanmailto:13186087857@163.com,lkq-devmailto:lkq-dev@op-lists.linaro.org,Dave Pigottmailto:dave.pigott@linaro.org,Luca Di Stefanomailto:luca.distefano@linaro.org,Jammy Zhoumailto:jammy.zhou@linaro.org 主题: Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,
Happy Lunar New Year!!!
David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.
Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.
This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307
Can you please work with David and Luca to try and figure this out.
Cheers! anmar
Hi Jonathan,
the openEulerOS host kernel is 4.19.90-2003.4.0.0036.oe1.aarch64, I am not sure how to patching it. Which version do you want to upgrade to?
Thanks Yinsi
liuyinsi@163.com
From: Jonathan Cameron Date: 2021-03-15 20:36 To: Dave Pigott; liuyinsi@163.com CC: Oueja; luca; wufengguang; lkq-dev; jammy.zhou@linaro.org; Shameerali Kolothum Thodi Subject: RE: Issues with docker on OpenEulerOS What is the host kernel on that machine? Any chance of patching it in the meantime to get things moving?
Jonathan
From: Jonathan Cameron Sent: 15 March 2021 12:07 To: 'Dave Pigott' dave.pigott@linaro.org; liuyinsi@163.com Cc: Oueja anmar.oueja@linaro.org; luca luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org Subject: RE: Issues with docker on OpenEulerOS
Fix / workaround is upstream now.. https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/ar...
Looks like it didn’t get a stable tag though. I’ll find out if there is a reason and get Shameer to request a backport if not.
Thanks,
Jonathan
From: Dave Pigott [mailto:dave.pigott@linaro.org] Sent: 15 March 2021 10:30 To: liuyinsi@163.com Cc: Oueja anmar.oueja@linaro.org; luca luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; Jonathan Cameron jonathan.cameron@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS
Hi Yinsi,
Well, yes. It solved the problem for OpenEuler. Unfortunately it broke it for our Raspberry Pi based qemu workers so we had to revert the health check while we do some more digging.
Thanks
Dave
---------------- Dave Pigott LAVA Lab Lead Linaro Ltd t: (+44) (0) 1223 400063
On 15 Mar 2021, at 10:18, liuyinsi@163.com wrote:
Hi Dave,
"The QEMU instances are failing to boot from NFS", has this problem been solved by add "gic-version=3" in qemu command? I try and it can work.
boot command: qemu-system-aarch64 -cpu host -machine virt-2.10,accel=kvm,gic-version=3 -nographic ....
Thanks Yinsi
liuyinsi@163.com
From: Dave Pigott Date: 2021-03-04 18:04 To: liuyinsi@163.com CC: Anmar Oueja; Luca Di Stefano; wufengguang; Jonathan Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
The files that we download change every day based on builds that are uploaded to snapshots.linaro.org. We test the latest builds, not the same build over and over.
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
Thanks
Dave
On 4 Mar 2021, at 09:11, liuyinsi@163.com wrote:
Hi anmar/luca,
http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... https://github.com/Linaro/test-definitions.git
1. http download: How many HTTP files do you have to download? If not many, please provide http files download links, we can download all http files at first time, then we can use http proxy cache at next time to fix download timeout.
2. https download: use "git" instead of "https" can work well. git clone git://github.com/Linaro/test-definitions.git
Thanks Yinsi
liuyinsi@163.com
From: Anmar Oueja Date: 2021-03-03 07:03 To: Jammy Zhou CC: Luca Di Stefano; liuyinsi@163.com; wufengguang; Cameron; lkq-dev; Pigott Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,
On Tue, Mar 2, 2021 at 7:30 AM Jammy Zhou jammy.zhou@linaro.org wrote: Hi Luca,
On Tue, 2 Mar 2021 at 19:59, Luca Di Stefano luca.distefano@linaro.org wrote:
On 01/03/2021 06:56, liuyinsi@163.com wrote: Hi Luca,
liuyinsi@163.com
From: Luca Di Stefano Date: 2021-02-23 20:11 To: liuyinsi@163.com; Oueja; Pigott CC: wufengguang; Cameron; jammy.zhou@linaro.org; lkq-dev Subject: Re: Fw: Issues with docker on OpenEulerOS Hi Yinsi, On 20/02/2021 07:19, liuyinsi@163.com wrote: Hello anmar,
I'm sorry I forgot to tell you my email is liuyinsi@163.com, please do not email to liuyinsi@huawei.com.
Thank you for providing me the QEMU's instance booting log, I'm sorry I still don't know how to reproduce the issues.
Hello David and Luca,
Which command did it report errors when it was executed? There was not a specific error as much as the qemu not being able to mount the rootfs as in other equivalent aarch64 jobs on other dispatchers:
How does your NFS service used, if just failed mount the rootfs, maybe we can login the container and execute 'mount -t nfs ...' to test nfs service.
https://lkft-staging.validation.linaro.org/scheduler/job/100307T That's an example of the boot process. Tried the same qemu command manually with the same kernel and initrd in a container on the server and had the same result.
Where did you execute the commands?In the server openEuler OS that i setup for you, or run a container on the server, then execute commands in the container? We run everything on a container on the server.
which container you run qemu kvm command, i see the container name 'docker-compose_lava-dispatcher_1', is this one?
As of now we managed to to have jobs running as expected by passing a kernel option to the health checks ( gic-version=3 ), Sounds great.
yes the container where the qemu commans is run is docker-compose_lava-dispatcher_1.
Right now the one of the issues we have is that actual jobs running there fail because of timeouts due to not being able to download artifacts or very slow downloads Can we set the timeout longer for a try? or can you post the links to the artifacts so that we can try the downloading in China? I ran into similar issues before when I tried to setup a remote lab.
Here are some examples:
https://lkft.validation.linaro.org/scheduler/job/2313644#L52 https://lkft.validation.linaro.org/scheduler/job/2313641#L197
Here's the list of jobs we ran so far: https://lkft.validation.linaro.org/scheduler/device/qemu-h01
We see also other issues with qemu jobs that we are currently investigating.
Could you help me to reappear question on tmux 'tm lys', it is convenient to locate the problem, thank you very much. Does that command need to be run in the background? otherwise i get a new shell opened only.
yes, as long as you don't execute 'exit' or 'ctrl D' in the tmux shell window, it wil always run in the background, if you don't want use in tmux, you can close current session, and create a new session, then when you use 'tm lys', you will get the old shell opened with user 'lys'. In addition to, you can create your own tmux, like 'tm luca', then you can open a new shell with user 'linaro'
Thank you
Thanks, Yinsi
Thank you
Thanks, yinsi
liuyinsi@163.com 发件人: Anmar Oueja 发送日期: 2021年02月18日 02:43 收件人: liuyinsi 抄送人: Cameron,wufengguang,yuchuan,lkq-dev,Dave Pigott,Luca Di Stefano,Jammy Zhou 主题: Issues with docker on OpenEulerOS Hello Yinsi/Yuchan,
Happy Lunar New Year!!!
David and Luca (on CC) are hitting a few bumps trying to get the QEMU instances running in a docker container on the OpenEuler OS install you setup for us. The QEMU instances are failing to boot from NFS.
Thinking it might be a permission problem, we confirmed that the containers are run as root and SELinux is disabled yet the problem persists. We did replicate the setup on a Debian Aarch64 system and it worked so we suspect there's something in OpenEuler OS we haven't configured correctly.
This is QEMU's instance booting log you: https://lkft-staging.validation.linaro.org/scheduler/job/100307
Can you please work with David and Luca to try and figure this out.
Cheers! anmar
Hi Dave,
liuyinsi@163.com
From: Dave Pigott Date: 2021-03-04 18:04 To: liuyinsi@163.com CC: Anmar Oueja; Luca Di Stefano; wufengguang; Jonathan Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
The files that we download change every day based on builds that are uploaded to snapshots.linaro.org. We test the latest builds, not the same build over and over.
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
vi ~/.gitconfig
[url "git://github.com"] insteadOf = https://github.com
This will change from https to git.
Thanks Yinsi
Thanks
Dave
anmar
On 16 Mar 2021, at 03:11, liuyinsi@163.com wrote:
Hi Dave,
liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-04 18:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
The files that we download change every day based on builds that are uploaded to snapshots.linaro.org http://snapshots.linaro.org/. We test the latest builds, not the same build over and over.
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
vi ~/.gitconfig
[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Thanks Yinsi
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Dave
Thanks
Dave
anmar
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
vi ~/.gitconfig
[url "git://github.com"] insteadOf = https://github.com
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
Thanks
Dave
anmar
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com
From: liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott CC: Oueja; luca; wufengguang; Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
vi ~/.gitconfig
[url "git://github.com"] insteadOf = https://github.com
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
Thanks
Dave
anmar
Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
vi ~/.gitconfig
[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
Thanks
Dave
anmar
Hi Dave,
I notice the job 2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com
From: Dave Pigott Date: 2021-03-18 17:04 To: liuyinsi@163.com CC: Anmar Oueja; Luca Di Stefano; wufengguang; Jonathan Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com
From: liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott CC: Oueja; luca; wufengguang; Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
vi ~/.gitconfig
[url "git://github.com"] insteadOf = https://github.com
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
Thanks
Dave
anmar
Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
vi ~/.gitconfig
[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
Thanks
Dave
> > > anmar
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
On 03/18/2021 19:28, Dave Pigott wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com
From: Dave Pigott Date: 2021-03-18 17:04 To: liuyinsi@163.com CC: Anmar Oueja; Luca Di Stefano; wufengguang; Jonathan Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com
From: liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott CC: Oueja; luca; wufengguang; Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
vi ~/.gitconfig
[url "git://github.com"] insteadOf = https://github.com
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
Thanks
Dave
anmar
Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
vi ~/.gitconfig
[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
Thanks
Dave
>> >> >> anmar
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
On 03/18/2021 19:47, Dave Pigott wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
On 03/18/2021 19:28, Dave Pigott wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com
From: Dave Pigott Date: 2021-03-18 17:04 To: liuyinsi@163.com CC: Anmar Oueja; Luca Di Stefano; wufengguang; Jonathan Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com
From: liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott CC: Oueja; luca; wufengguang; Cameron; lkq-dev; jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
vi ~/.gitconfig
[url "git://github.com"] insteadOf = https://github.com
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
Thanks
Dave
anmar
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git.
vi ~/.gitconfig
[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
Thanks
Dave
>>> >>> >>> anmar
@yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
> > Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > vi ~/.gitconfig
[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar
Good points! openEuler 5.10 kernel may be ready for testing. It's worth trying it out. Then consider backporting the patch.
-------------------------------------------------- Wu Fengguang Mobile: +86-13661699374tel:+86-13661699374 Email: wufengguang@huawei.commailto:wufengguang@huawei.com 发件人:Jonathan Cameron jonathan.cameron@huawei.com 收件人:Dave Pigott dave.pigott@linaro.org 抄 送:liuyinsi liuyinsi@163.com;Anmar Oueja anmar.oueja@linaro.org;Luca Di Stefano luca.distefano@linaro.org;wufengguang wufengguang@huawei.com;lkq-dev lkq-dev@op-lists.linaro.org;jammy.zhou jammy.zhou@linaro.org;Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com 时 间:2021-03-19 00:33:49 主 题:Re: Issues with docker on OpenEulerOS
@yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott < dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.commailto:liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱: liuyinsi@163.commailto:liuyinsi@163.com < https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... 网易邮箱大师 < https://mail.163.com/dashi/dlpro.html?from=mail88%3E 定制
On 03/18/2021 19:47, Dave Pigott < mailto:dave.pigott@linaro.org> wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.commailto:liuyinsi@163.com < mailto:liuyinsi@163.com> wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱: liuyinsi@163.commailto:liuyinsi@163.com < https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... 网易邮箱大师 < https://mail.163.com/dashi/dlpro.html?from=mail88%3E 定制
On 03/18/2021 19:28, Dave Pigott < mailto:dave.pigott@linaro.org> wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.commailto:liuyinsi@163.com < mailto:liuyinsi@163.com> wrote:
Hi Dave,
I notice the job 2313644 < https://lkft.validation.linaro.org/scheduler/job/2313644%3E is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... < http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.commailto:liuyinsi@163.com < mailto:liuyinsi@163.com>
From: Dave Pigott < mailto:dave.pigott@linaro.org> Date: 2021-03-18 17:04 To: liuyinsi@163.commailto:liuyinsi@163.com < mailto:liuyinsi@163.com> CC: Anmar Oueja < mailto:anmar.oueja@linaro.org>; Luca Di Stefano < mailto:luca.distefano@linaro.org>; wufengguang < mailto:wufengguang@huawei.com>; Jonathan Cameron < mailto:jonathan.cameron@huawei.com>; lkq-dev < mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org < mailto:jammy.zhou@linaro.org> Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 < https://lkft.validation.linaro.org/scheduler/job/2313644%3E - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.commailto:liuyinsi@163.com < mailto:liuyinsi@163.com> wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.commailto:liuyinsi@163.com < mailto:liuyinsi@163.com>
From: liuyinsi@163.commailto:liuyinsi@163.com < mailto:liuyinsi@163.com> Date: 2021-03-17 10:19 To: Dave Pigott < mailto:dave.pigott@linaro.org> CC: Oueja < mailto:anmar.oueja@linaro.org>; luca < mailto:luca.distefano@linaro.org>; wufengguang < mailto:wufengguang@huawei.com>; Cameron < mailto:jonathan.cameron@huawei.com>; lkq-dev < mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org < mailto:jammy.zhou@linaro.org> Subject: Re: Re: Issues with docker on OpenEulerOS
> > Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > vi ~/.gitconfig
[url "git://github.com git://github.com"] insteadOf = https://github.com < https://github.com/%3E
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... < https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar
+Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron Jonathan.Cameron@huawei.com wrote:
@yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re
back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about
docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com <
https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org
wrote:
Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com
wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com <
https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org
wrote:
Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and
we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com
wrote:
Hi Dave,
I notice the job 2313644 <
https://lkft.validation.linaro.org/scheduler/job/2313644%3E is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... < http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow
network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com
From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano
mailto:luca.distefano@linaro.org; wufengguang mailto: wufengguang@huawei.com; Jonathan Cameron mailto: jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org
Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g.
https://lkft.validation.linaro.org/scheduler/job/2313644 < https://lkft.validation.linaro.org/scheduler/job/2313644%3E - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com
wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit
~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com
From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca <mailto:
luca.distefano@linaro.org>; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto: lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto: jammy.zhou@linaro.org
Subject: Re: Re: Issues with docker on OpenEulerOS
>> >> Locally, in the lab, we use KissCache for https cacheing. We
would have to go through every test definition submitted by every bot and developer to change from https to git.
>> > vi ~/.gitconfig > > [url "git://github.com git://github.com"] > insteadOf = https://github.com https://github.com/ > > This will change from https to git. >
Hi Yinsi,
If you look at the job definitions, e.g.
https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... < https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the
clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone,
then it will automatically change https to git.
Thanks Yinsi
Dave >> >> >> >> Thanks >> >> Dave >> >> >>>>> >>>>> >>>>> anmar
@Jammy,
Our dailybuild already make v5.10 for openEuler 21.03.
@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.
Thanks Yinsi
liuyinsi@163.com
From: Jammy Zhou Date: 2021-03-19 08:29 To: Jonathan Cameron; Guohanjun (Hanjun Guo) CC: Dave Pigott; liuyinsi; Anmar Oueja; Luca Di Stefano; wufengguang; lkq-dev; Shameerali Kolothum Thodi Subject: Re: Issues with docker on OpenEulerOS +Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron Jonathan.Cameron@huawei.com wrote: @yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
> > Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > vi ~/.gitconfig
[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar
We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.
Thanks,
Jonathan
From: liuyinsi@163.com [mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: jammy.zhou@linaro.org; Jonathan Cameron jonathan.cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: Re: Re: Issues with docker on OpenEulerOS
@Jammy,
Our dailybuild already make v5.10 for openEuler 21.03.
@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.
Thanks Yinsi ________________________________ liuyinsi@163.commailto:liuyinsi@163.com
From: Jammy Zhoumailto:jammy.zhou@linaro.org Date: 2021-03-19 08:29 To: Jonathan Cameronmailto:Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo)mailto:guohanjun@huawei.com CC: Dave Pigottmailto:dave.pigott@linaro.org; liuyinsimailto:liuyinsi@163.com; Anmar Ouejamailto:anmar.oueja@linaro.org; Luca Di Stefanomailto:luca.distefano@linaro.org; wufengguangmailto:wufengguang@huawei.com; lkq-devmailto:lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodimailto:shameerali.kolothum.thodi@huawei.com Subject: Re: Issues with docker on OpenEulerOS +Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <Jonathan.Cameron@huawei.commailto:Jonathan.Cameron@huawei.com> wrote: @yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott <dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.commailto:liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.commailto:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:47, Dave Pigott <mailto:dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com> wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.commailto:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott <mailto:dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com> wrote:
Hi Dave,
I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com>
From: Dave Pigott <mailto:dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> Date: 2021-03-18 17:04 To: liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com> CC: Anmar Oueja <mailto:anmar.oueja@linaro.orgmailto:anmar.oueja@linaro.org>; Luca Di Stefano <mailto:luca.distefano@linaro.orgmailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.commailto:wufengguang@huawei.com>; Jonathan Cameron <mailto:jonathan.cameron@huawei.commailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.orgmailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org> Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com> wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com>
From: liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com> Date: 2021-03-17 10:19 To: Dave Pigott <mailto:dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> CC: Oueja <mailto:anmar.oueja@linaro.orgmailto:anmar.oueja@linaro.org>; luca <mailto:luca.distefano@linaro.orgmailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.commailto:wufengguang@huawei.com>; Cameron <mailto:jonathan.cameron@huawei.commailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.orgmailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org> Subject: Re: Re: Issues with docker on OpenEulerOS
> > Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > vi ~/.gitconfig
[url "git://github.comhttp://github.com <git://github.comhttp://github.com>"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar
Ok, I have backported the fix to 5.10.
Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3
Sanity testing at my end shows it working. Please try and let me know.
Thanks, Shameer
From: Jonathan Cameron Sent: 19 March 2021 09:13 To: liuyinsi@163.com; jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: RE: Re: Issues with docker on OpenEulerOS
We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.
Thanks,
Jonathan
From: liuyinsi@163.commailto:liuyinsi@163.com [mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org; Jonathan Cameron <jonathan.cameron@huawei.commailto:jonathan.cameron@huawei.com>; Guohanjun (Hanjun Guo) <guohanjun@huawei.commailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> Cc: Anmar Oueja <anmar.oueja@linaro.orgmailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.orgmailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.commailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.orgmailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.commailto:shameerali.kolothum.thodi@huawei.com> Subject: Re: Re: Issues with docker on OpenEulerOS
@Jammy,
Our dailybuild already make v5.10 for openEuler 21.03.
@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.
Thanks Yinsi ________________________________ liuyinsi@163.commailto:liuyinsi@163.com
From: Jammy Zhoumailto:jammy.zhou@linaro.org Date: 2021-03-19 08:29 To: Jonathan Cameronmailto:Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo)mailto:guohanjun@huawei.com CC: Dave Pigottmailto:dave.pigott@linaro.org; liuyinsimailto:liuyinsi@163.com; Anmar Ouejamailto:anmar.oueja@linaro.org; Luca Di Stefanomailto:luca.distefano@linaro.org; wufengguangmailto:wufengguang@huawei.com; lkq-devmailto:lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodimailto:shameerali.kolothum.thodi@huawei.com Subject: Re: Issues with docker on OpenEulerOS +Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <Jonathan.Cameron@huawei.commailto:Jonathan.Cameron@huawei.com> wrote: @yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott <dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.commailto:liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.commailto:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:47, Dave Pigott <mailto:dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com> wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.commailto:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott <mailto:dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com> wrote:
Hi Dave,
I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com>
From: Dave Pigott <mailto:dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> Date: 2021-03-18 17:04 To: liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com> CC: Anmar Oueja <mailto:anmar.oueja@linaro.orgmailto:anmar.oueja@linaro.org>; Luca Di Stefano <mailto:luca.distefano@linaro.orgmailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.commailto:wufengguang@huawei.com>; Jonathan Cameron <mailto:jonathan.cameron@huawei.commailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.orgmailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org> Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com> wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com>
From: liuyinsi@163.commailto:liuyinsi@163.com <mailto:liuyinsi@163.commailto:liuyinsi@163.com> Date: 2021-03-17 10:19 To: Dave Pigott <mailto:dave.pigott@linaro.orgmailto:dave.pigott@linaro.org> CC: Oueja <mailto:anmar.oueja@linaro.orgmailto:anmar.oueja@linaro.org>; luca <mailto:luca.distefano@linaro.orgmailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.commailto:wufengguang@huawei.com>; Cameron <mailto:jonathan.cameron@huawei.commailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.orgmailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.orgmailto:jammy.zhou@linaro.org> Subject: Re: Re: Issues with docker on OpenEulerOS
> > Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > vi ~/.gitconfig
[url "git://github.comhttp://github.com <git://github.comhttp://github.com>"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar
On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi < shameerali.kolothum.thodi@huawei.com> wrote:
Ok, I have backported the fix to 5.10.
Please find the patches here,
https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3
Sanity testing at my end shows it working. Please try and let me know.
Thanks Shmeer.
On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.
Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.
anmar
*From:* Jonathan Cameron
*Sent:* 19 March 2021 09:13 *To:* liuyinsi@163.com; jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) < guohanjun@huawei.com>; Pigott dave.pigott@linaro.org *Cc:* Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano < luca.distefano@linaro.org>; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi < shameerali.kolothum.thodi@huawei.com> *Subject:* RE: Re: Issues with docker on OpenEulerOS
We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major.
@Shameer, let us know if you hit any problems.
Thanks,
Jonathan
*From:* liuyinsi@163.com [mailto:liuyinsi@163.com liuyinsi@163.com] *Sent:* 19 March 2021 08:29 *To:* jammy.zhou@linaro.org; Jonathan Cameron jonathan.cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott < dave.pigott@linaro.org> *Cc:* Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano < luca.distefano@linaro.org>; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi < shameerali.kolothum.thodi@huawei.com> *Subject:* Re: Re: Issues with docker on OpenEulerOS
@Jammy,
Our dailybuild already make v5.10 for openEuler 21.03.
@Dave
The openeuler OS host kernel has been updated to v5.10, because I have restarted the host,
the previously running container has stopped.
Thanks
Yinsi
liuyinsi@163.com
*From:* Jammy Zhou jammy.zhou@linaro.org
*Date:* 2021-03-19 08:29
*To:* Jonathan Cameron Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com
*CC:* Dave Pigott dave.pigott@linaro.org; liuyinsi liuyinsi@163.com; Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com
*Subject:* Re: Issues with docker on OpenEulerOS
+Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron < Jonathan.Cameron@huawei.com> wrote:
@yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re
back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about
docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com <
https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am...
签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org
wrote:
Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com
wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com <
https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am...
签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org
wrote:
Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and
we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com
wrote:
Hi Dave,
I notice the job 2313644 <
https://lkft.validation.linaro.org/scheduler/job/2313644%3E is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... < http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow
network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com
From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano
mailto:luca.distefano@linaro.org; wufengguang mailto: wufengguang@huawei.com; Jonathan Cameron mailto: jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org
Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g.
https://lkft.validation.linaro.org/scheduler/job/2313644 < https://lkft.validation.linaro.org/scheduler/job/2313644%3E - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com
wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit
~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com
From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca <mailto:
luca.distefano@linaro.org>; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto: lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto: jammy.zhou@linaro.org
Subject: Re: Re: Issues with docker on OpenEulerOS
>> >> Locally, in the lab, we use KissCache for https cacheing. We
would have to go through every test definition submitted by every bot and developer to change from https to git.
>> > vi ~/.gitconfig > > [url "git://github.com git://github.com"] > insteadOf = https://github.com https://github.com/ > > This will change from https to git. >
Hi Yinsi,
If you look at the job definitions, e.g.
https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... < https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the
clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone,
then it will automatically change https to git.
Thanks Yinsi
Dave >> >> >> >> Thanks >> >> Dave >> >> >>>>> >>>>> >>>>> anmar
Ok,done. Please try to test QEMU again.
Thanks Yinsi
On 04/01/2021 20:57, Anmar Oueja wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com wrote: Ok, I have backported the fix to 5.10.
Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3
Sanity testing at my end shows it working. Please try and let me know.
Thanks Shmeer.
On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.
Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.
anmar
From: Jonathan Cameron Sent: 19 March 2021 09:13 To:liuyinsi@163.com; jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: RE: Re: Issues with docker on OpenEulerOS
We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.
Thanks,
Jonathan
From:liuyinsi@163.com [mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To:jammy.zhou@linaro.org; Jonathan Cameron jonathan.cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: Re: Re: Issues with docker on OpenEulerOS
@Jammy,
Our dailybuild already make v5.10 for openEuler 21.03.
@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.
Thanks Yinsi liuyinsi@163.com
From: Jammy Zhou Date: 2021-03-19 08:29 To: Jonathan Cameron; Guohanjun (Hanjun Guo) CC: Dave Pigott; liuyinsi; Anmar Oueja; Luca Di Stefano; wufengguang; lkq-dev; Shameerali Kolothum Thodi Subject: Re: Issues with docker on OpenEulerOS +Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron Jonathan.Cameron@huawei.com wrote: @yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com
From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com
From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
> > Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > vi ~/.gitconfig
[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
Hi Yinsi,
We can no longer ssh to the server. Can you resolve this please?
Thanks
Dave
On 7 Apr 2021, at 10:17, liuyinsi@163.com wrote:
Ok,done. Please try to test QEMU again.
Thanks Yinsi
On 04/01/2021 20:57, Anmar Oueja mailto:anmar.oueja@linaro.org wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> wrote: Ok, I have backported the fix to 5.10. Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 Sanity testing at my end shows it working. Please try and let me know.
Thanks Shmeer.
On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.
Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.
anmar
From: Jonathan Cameron Sent: 19 March 2021 09:13 To: liuyinsi@163.com mailto:liuyinsi@163.com; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> Subject: RE: Re: Issues with docker on OpenEulerOS We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems. Thanks, Jonathan From: liuyinsi@163.com mailto:liuyinsi@163.com [mailto:liuyinsi@163.com mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Jonathan Cameron <jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> Subject: Re: Re: Issues with docker on OpenEulerOS @Jammy, Our dailybuild already make v5.10 for openEuler 21.03. @Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped. Thanks Yinsi liuyinsi@163.com mailto:liuyinsi@163.com From: Jammy Zhou mailto:jammy.zhou@linaro.org Date: 2021-03-19 08:29 To: Jonathan Cameron mailto:Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo) mailto:guohanjun@huawei.com CC: Dave Pigott mailto:dave.pigott@linaro.org; liuyinsi mailto:liuyinsi@163.com; Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi mailto:shameerali.kolothum.thodi@huawei.com Subject: Re: Issues with docker on OpenEulerOS +Hanjun As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19. On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <Jonathan.Cameron@huawei.com mailto:Jonathan.Cameron@huawei.com> wrote: @yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com mailto:liuyinsi@163.com < https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5Dhttps://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 < https://mail.163.com/dashi/dlpro.html?from=mail88https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制
On 03/18/2021 19:47, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com mailto:liuyinsi@163.com < https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5Dhttps://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 < https://mail.163.com/dashi/dlpro.html?from=mail88https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制
On 03/18/2021 19:28, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote:
Hi Dave,
I notice the job 2313644 < https://lkft.validation.linaro.org/scheduler/job/2313644https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 < http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64> on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> From: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> CC: Anmar Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Jonathan Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 < https://lkft.validation.linaro.org/scheduler/job/2313644https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> From: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> Date: 2021-03-17 10:19 To: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> CC: Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; luca <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> Subject: Re: Re: Issues with docker on OpenEulerOS
>> >> Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. >> > vi ~/.gitconfig > > [url "git://github.com http://github.com/ <git://github.com http://github.com/>"] > insteadOf = https://github.com/https://github.com https://github.com/ < https://github.com/https://github.com/ https://github.com/> > > This will change from https to git. >
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40 < https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40>, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave >> >> >> >> Thanks >> >> Dave >> >> >>>>> >>>>> >>>>> anmar
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
Hi Dave/Anmar,
The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.
Thanks Yinsi
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
On 04/07/2021 18:21, Dave Pigott wrote: Hi Yinsi,
We can no longer ssh to the server. Can you resolve this please?
Thanks
Dave
On 7 Apr 2021, at 10:17, liuyinsi@163.com wrote:
Ok,done. Please try to test QEMU again.
Thanks Yinsi
On 04/01/2021 20:57, Anmar Oueja wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com wrote: Ok, I have backported the fix to 5.10.
Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3
Sanity testing at my end shows it working. Please try and let me know.
Thanks Shmeer.
On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.
Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.
anmar
From: Jonathan Cameron Sent: 19 March 2021 09:13 To:liuyinsi@163.com; jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: RE: Re: Issues with docker on OpenEulerOS
We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.
Thanks,
Jonathan
From:liuyinsi@163.com [mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To:jammy.zhou@linaro.org; Jonathan Cameron jonathan.cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: Re: Re: Issues with docker on OpenEulerOS
@Jammy,
Our dailybuild already make v5.10 for openEuler 21.03.
@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.
Thanks Yinsi liuyinsi@163.com
From: Jammy Zhou Date: 2021-03-19 08:29 To: Jonathan Cameron; Guohanjun (Hanjun Guo) CC: Dave Pigott; liuyinsi; Anmar Oueja; Luca Di Stefano; wufengguang; lkq-dev; Shameerali Kolothum Thodi Subject: Re: Issues with docker on OpenEulerOS +Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron Jonathan.Cameron@huawei.com wrote: @yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com
From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com
From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
> > Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > vi ~/.gitconfig
[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
Hi Yinsi,
The Lab IP is 51.148.40.1
Thanks
Dave
On 8 Apr 2021, at 12:30, liuyinsi@163.com wrote:
Hi Dave/Anmar,
The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 04/07/2021 18:21, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
We can no longer ssh to the server. Can you resolve this please?
Thanks
Dave
On 7 Apr 2021, at 10:17, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Ok,done. Please try to test QEMU again.
Thanks Yinsi
On 04/01/2021 20:57, Anmar Oueja mailto:anmar.oueja@linaro.org wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> wrote: Ok, I have backported the fix to 5.10. Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 Sanity testing at my end shows it working. Please try and let me know.
Thanks Shmeer.
On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.
Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.
anmar
From: Jonathan Cameron Sent: 19 March 2021 09:13 To: liuyinsi@163.com mailto:liuyinsi@163.com; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> Subject: RE: Re: Issues with docker on OpenEulerOS We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems. Thanks, Jonathan From: liuyinsi@163.com mailto:liuyinsi@163.com [mailto:liuyinsi@163.com mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Jonathan Cameron <jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> Subject: Re: Re: Issues with docker on OpenEulerOS @Jammy, Our dailybuild already make v5.10 for openEuler 21.03. @Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped. Thanks Yinsi liuyinsi@163.com mailto:liuyinsi@163.com From: Jammy Zhou mailto:jammy.zhou@linaro.org Date: 2021-03-19 08:29 To: Jonathan Cameron mailto:Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo) mailto:guohanjun@huawei.com CC: Dave Pigott mailto:dave.pigott@linaro.org; liuyinsi mailto:liuyinsi@163.com; Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi mailto:shameerali.kolothum.thodi@huawei.com Subject: Re: Issues with docker on OpenEulerOS +Hanjun As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19. On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <Jonathan.Cameron@huawei.com mailto:Jonathan.Cameron@huawei.com> wrote: @yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com mailto:liuyinsi@163.com < https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5Dhttps://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 < https://mail.163.com/dashi/dlpro.html?from=mail88https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制
On 03/18/2021 19:47, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com mailto:liuyinsi@163.com < https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5Dhttps://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 < https://mail.163.com/dashi/dlpro.html?from=mail88https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制
On 03/18/2021 19:28, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote:
Hi Dave,
I notice the job 2313644 < https://lkft.validation.linaro.org/scheduler/job/2313644https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 < http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64> on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> From: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> CC: Anmar Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Jonathan Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 < https://lkft.validation.linaro.org/scheduler/job/2313644https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
> On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: > > Hi Dave, > > "http download timeout", does it happen often? > "https download timeout", has this problem been solved by edit ~/.gitconfig? > > Thanks > Yinsi > > liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > > From: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > Date: 2021-03-17 10:19 > To: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> > CC: Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; luca <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> > Subject: Re: Re: Issues with docker on OpenEulerOS > > >>> >>> Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. >>> >> vi ~/.gitconfig >> >> [url "git://github.com http://github.com/ <git://github.com http://github.com/>"] >> insteadOf = https://github.com/https://github.com https://github.com/ < https://github.com/https://github.com/ https://github.com/> >> >> This will change from https to git. >> > > Hi Yinsi, > > If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40 < https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40>, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git. > > Hi Dave, > > You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, > then it will automatically change https to git. > > Thanks > Yinsi > > Dave >>> >>> >>> >>> Thanks >>> >>> Dave >>> >>> >>>>>> >>>>>> >>>>>> anmar
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
Hi Yinsi,
Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are:
- 51.148.40.18
- 51.148.40.7
- 51.148.40.11
Thank you.
Luca
On 08/04/2021 13:02, Dave Pigott wrote:
Hi Yinsi,
The Lab IP is 51.148.40.1
Thanks
Dave
On 8 Apr 2021, at 12:30, [1]liuyinsi@163.com wrote:
Hi Dave/Anmar, The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist. Thanks Yinsi [defaultAvatar.png] liuyinsi 邮箱:liuyinsi@163.com
签名由 [2]网易邮箱大师 定制
On 04/07/2021 18:21, [3]Dave Pigott wrote:
Hi Yinsi, We can no longer ssh to the server. Can you resolve this please? Thanks Dave
On 7 Apr 2021, at 10:17, [4]liuyinsi@163.com wrote:
Ok,done. Please try to test QEMU again. Thanks Yinsi On 04/01/2021 20:57, [5]Anmar Oueja wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi <[6]shameerali.kolothum.thodi@huawei.com> wrote: Ok, I have backported the fix to 5.10.
Please find the patches here, [7]https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2- on-v3
Sanity testing at my end shows it working. Please try and let me know. Thanks Shmeer. On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix. Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help. anmar From: Jonathan Cameron Sent: 19 March 2021 09:13 To: [8]liuyinsi@163.com; [9]jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) <[10]guohanjun@huawei.com>; Pigott <[11]dave.pigott@linaro.org> Cc: Anmar Oueja <[12]anmar.oueja@linaro.org>; Luca Di Stefano <[13]luca.distefano@linaro.org>; wufengguang <[14]wufengguang@huawei.com>; lkq-dev <[15]lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <[16]shameerali.kolothum.thodi@huawei.com> Subject: RE: Re: Issues with docker on OpenEulerOS
We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.
Thanks,
Jonathan
From: [17]liuyinsi@163.com [[18]mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: [19]jammy.zhou@linaro.org; Jonathan Cameron <[20]jonathan.cameron@huawei.com>; Guohanjun (Hanjun Guo) <[21]guohanjun@huawei.com>; Pigott <[22]dave.pigott@linaro.org> Cc: Anmar Oueja <[23]anmar.oueja@linaro.org>; Luca Di Stefano <[24]luca.distefano@linaro.org>; wufengguang <[25]wufengguang@huawei.com>; lkq-dev <[26]lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <[27]shameerali.kolothum.thodi@huawei.com> Subject: Re: Re: Issues with docker on OpenEulerOS
@Jammy,
Our dailybuild already make v5.10 for openEuler 21.03.
@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.
Thanks Yinsi [28]liuyinsi@163.com
From: [29]Jammy Zhou Date: 2021-03-19 08:29 To: [30]Jonathan Cameron; [31]Guohanjun (Hanjun Guo) CC: [32]Dave Pigott; [33]liuyinsi; [34]Anmar Oueja; [35]Luca Di Stefano; [36]wufengguang; [37]lkq-dev; [38]Shameerali Kolothum Thodi Subject: Re: Issues with docker on OpenEulerOS +Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <[39]Jonathan.Cameron@huawei.com> wrote: @yinsi What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5 Or can we ask openEuler to carry a backport of this set directly? Another alternative is to see if there is an available BIOS with the fix in place and upgrade. Jonathan On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott <[40]dave.pigott@linaro.org> wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed.
We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, [41]liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about
docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:[42]liuyinsi@163.com
<[43]https://maas.mail.163.com/dashi-web-extend/html/proSignature.html? ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail -online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82 %AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <[44]https://mail.163.com/dashi/dlpro.html?from=mail88%3E 定制
On 03/18/2021 19:47, Dave Pigott
mailto:[45]dave.pigott@linaro.org wrote:
Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, [46]liuyinsi@163.com
mailto:[47]liuyinsi@163.com wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:[48]liuyinsi@163.com
<[49]https://maas.mail.163.com/dashi-web-extend/html/proSignature.html? ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail -online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82 %AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <[50]https://mail.163.com/dashi/dlpro.html?from=mail88%3E 定制
On 03/18/2021 19:28, Dave Pigott
mailto:[51]dave.pigott@linaro.org wrote:
Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release
and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, [52]liuyinsi@163.com
mailto:[53]liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644
<[54]https://lkft.validation.linaro.org/scheduler/job/2313644%3E is created 2 weeks, 6 days ago, can you test a new job, test wget [55]http://images.validation.linaro.org/snapshots.linaro.org/components /lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 <[56]http://images.validation.linaro.org/snapshots.linaro.org/component s/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64> on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and
slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
[57]liuyinsi@163.com mailto:[58]liuyinsi@163.com
From: Dave Pigott mailto:[59]dave.pigott@linaro.org Date: 2021-03-18 17:04 To: [60]liuyinsi@163.com mailto:[61]liuyinsi@163.com CC: Anmar Oueja mailto:[62]anmar.oueja@linaro.org; Luca Di
Stefano mailto:[63]luca.distefano@linaro.org; wufengguang mailto:[64]wufengguang@huawei.com; Jonathan Cameron mailto:[65]jonathan.cameron@huawei.com; lkq-dev mailto:[66]lkq-dev@op-lists.linaro.org; [67]jammy.zhou@linaro.org mailto:[68]jammy.zhou@linaro.org
Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g.
[69]https://lkft.validation.linaro.org/scheduler/job/2313644 <[70]https://lkft.validation.linaro.org/scheduler/job/2313644%3E - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, [71]liuyinsi@163.com
mailto:[72]liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit
~/.gitconfig?
Thanks Yinsi
[73]liuyinsi@163.com mailto:[74]liuyinsi@163.com
From: [75]liuyinsi@163.com mailto:[76]liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:[77]dave.pigott@linaro.org CC: Oueja mailto:[78]anmar.oueja@linaro.org; luca
mailto:[79]luca.distefano@linaro.org; wufengguang mailto:[80]wufengguang@huawei.com; Cameron mailto:[81]jonathan.cameron@huawei.com; lkq-dev mailto:[82]lkq-dev@op-lists.linaro.org; [83]jammy.zhou@linaro.org mailto:[84]jammy.zhou@linaro.org
Subject: Re: Re: Issues with docker on OpenEulerOS
> > Locally, in the lab, we use KissCache for https cacheing. We
would have to go through every test definition submitted by every bot and developer to change from https to git.
> vi ~/.gitconfig
[url "git://[85]github.com git://[86]github.com"] insteadOf = [87]https://github.com
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g.
[89]https://lkft.validation.linaro.org/scheduler/job/2409008/definition #defline40 <[90]https://lkft.validation.linaro.org/scheduler/job/2409008/definitio n#defline40>, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the
clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone,
then it will automatically change https to git.
Thanks Yinsi
Dave
> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar
[defaultAvatar.png] liuyinsi 邮箱:liuyinsi@163.com
签名由 [91]网易邮箱大师 定制
References
Visible links 1. mailto:liuyinsi@163.com 2. https://mail.163.com/dashi/dlpro.html?from=mail88 3. mailto:dave.pigott@linaro.org 4. mailto:liuyinsi@163.com 5. mailto:anmar.oueja@linaro.org 6. mailto:shameerali.kolothum.thodi@huawei.com 7. https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 8. mailto:liuyinsi@163.com 9. mailto:jammy.zhou@linaro.org 10. mailto:guohanjun@huawei.com 11. mailto:dave.pigott@linaro.org 12. mailto:anmar.oueja@linaro.org 13. mailto:luca.distefano@linaro.org 14. mailto:wufengguang@huawei.com 15. mailto:lkq-dev@op-lists.linaro.org 16. mailto:shameerali.kolothum.thodi@huawei.com 17. mailto:liuyinsi@163.com 18. mailto:liuyinsi@163.com 19. mailto:jammy.zhou@linaro.org 20. mailto:jonathan.cameron@huawei.com 21. mailto:guohanjun@huawei.com 22. mailto:dave.pigott@linaro.org 23. mailto:anmar.oueja@linaro.org 24. mailto:luca.distefano@linaro.org 25. mailto:wufengguang@huawei.com 26. mailto:lkq-dev@op-lists.linaro.org 27. mailto:shameerali.kolothum.thodi@huawei.com 28. mailto:liuyinsi@163.com 29. mailto:jammy.zhou@linaro.org 30. mailto:Jonathan.Cameron@huawei.com 31. mailto:guohanjun@huawei.com 32. mailto:dave.pigott@linaro.org 33. mailto:liuyinsi@163.com 34. mailto:anmar.oueja@linaro.org 35. mailto:luca.distefano@linaro.org 36. mailto:wufengguang@huawei.com 37. mailto:lkq-dev@op-lists.linaro.org 38. mailto:shameerali.kolothum.thodi@huawei.com 39. mailto:Jonathan.Cameron@huawei.com 40. mailto:dave.pigott@linaro.org 41. mailto:liuyinsi@163.com 42. mailto:liuyinsi@163.com 43. https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am..."] 44. https://mail.163.com/dashi/dlpro.html?from=mail88 45. mailto:dave.pigott@linaro.org 46. mailto:liuyinsi@163.com 47. mailto:liuyinsi@163.com 48. mailto:liuyinsi@163.com 49. https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am..."] 50. https://mail.163.com/dashi/dlpro.html?from=mail88 51. mailto:dave.pigott@linaro.org 52. mailto:liuyinsi@163.com 53. mailto:liuyinsi@163.com 54. https://lkft.validation.linaro.org/scheduler/job/2313644 55. http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... 56. http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... 57. mailto:liuyinsi@163.com 58. mailto:liuyinsi@163.com 59. mailto:dave.pigott@linaro.org 60. mailto:liuyinsi@163.com 61. mailto:liuyinsi@163.com 62. mailto:anmar.oueja@linaro.org 63. mailto:luca.distefano@linaro.org 64. mailto:wufengguang@huawei.com 65. mailto:jonathan.cameron@huawei.com 66. mailto:lkq-dev@op-lists.linaro.org 67. mailto:jammy.zhou@linaro.org 68. mailto:jammy.zhou@linaro.org 69. https://lkft.validation.linaro.org/scheduler/job/2313644 70. https://lkft.validation.linaro.org/scheduler/job/2313644 71. mailto:liuyinsi@163.com 72. mailto:liuyinsi@163.com 73. mailto:liuyinsi@163.com 74. mailto:liuyinsi@163.com 75. mailto:liuyinsi@163.com 76. mailto:liuyinsi@163.com 77. mailto:dave.pigott@linaro.org 78. mailto:anmar.oueja@linaro.org 79. mailto:luca.distefano@linaro.org 80. mailto:wufengguang@huawei.com 81. mailto:jonathan.cameron@huawei.com 82. mailto:lkq-dev@op-lists.linaro.org 83. mailto:jammy.zhou@linaro.org 84. mailto:jammy.zhou@linaro.org 85. http://github.com/ 86. http://github.com/ 87. https://github.com/ 88. https://github.com/ 89. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... 90. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... 91. https://mail.163.com/dashi/dlpro.html?from=mail88
Hidden links: 93. https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... 94. https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am...
OK,done. Please try to login.
Thanks Yinsi
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
On 04/08/2021 20:06, Luca Di Stefano wrote:
Hi Yinsi,
Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are:
- 51.148.40.18
- 51.148.40.7
- 51.148.40.11
Thank you.
Luca
On 08/04/2021 13:02, Dave Pigott wrote:
Hi Yinsi,
The Lab IP is 51.148.40.1
Thanks
Dave
On 8 Apr 2021, at 12:30, liuyinsi@163.com wrote:
Hi Dave/Anmar,
The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.
Thanks Yinsi
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
On 04/07/2021 18:21, Dave Pigott wrote: Hi Yinsi,
We can no longer ssh to the server. Can you resolve this please?
Thanks
Dave
On 7 Apr 2021, at 10:17, liuyinsi@163.com wrote:
Ok,done. Please try to test QEMU again.
Thanks Yinsi
On 04/01/2021 20:57, Anmar Oueja wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com wrote: Ok, I have backported the fix to 5.10.
Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3
Sanity testing at my end shows it working. Please try and let me know.
Thanks Shmeer.
On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.
Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.
anmar
From: Jonathan Cameron Sent: 19 March 2021 09:13 To:liuyinsi@163.com; jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: RE: Re: Issues with docker on OpenEulerOS
We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.
Thanks,
Jonathan
From:liuyinsi@163.com [mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To:jammy.zhou@linaro.org; Jonathan Cameron jonathan.cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: Re: Re: Issues with docker on OpenEulerOS
@Jammy,
Our dailybuild already make v5.10 for openEuler 21.03.
@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.
Thanks Yinsi liuyinsi@163.com
From: Jammy Zhou Date: 2021-03-19 08:29 To: Jonathan Cameron; Guohanjun (Hanjun Guo) CC: Dave Pigott; liuyinsi; Anmar Oueja; Luca Di Stefano; wufengguang; lkq-dev; Shameerali Kolothum Thodi Subject: Re: Issues with docker on OpenEulerOS +Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron Jonathan.Cameron@huawei.com wrote: @yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com
From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com
From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
> > Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > vi ~/.gitconfig
[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
Okay - great news. The Kungpen server is now online and the qemu devices are passing their health checks and now processing jobs.
Thank you all!
Dave
On 9 Apr 2021, at 04:57, liuyinsi@163.com wrote:
OK,done. Please try to login.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 04/08/2021 20:06, Luca Di Stefano mailto:luca.distefano@linaro.org wrote: Hi Yinsi,
Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are:
51.148.40.18
51.148.40.7
51.148.40.11
Thank you.
Luca
On 08/04/2021 13:02, Dave Pigott wrote:
Hi Yinsi,
The Lab IP is 51.148.40.1
Thanks
Dave
On 8 Apr 2021, at 12:30, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave/Anmar,
The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 04/07/2021 18:21, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
We can no longer ssh to the server. Can you resolve this please?
Thanks
Dave
On 7 Apr 2021, at 10:17, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Ok,done. Please try to test QEMU again.
Thanks Yinsi
On 04/01/2021 20:57, Anmar Oueja mailto:anmar.oueja@linaro.org wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> wrote: Ok, I have backported the fix to 5.10. Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 Sanity testing at my end shows it working. Please try and let me know.
Thanks Shmeer.
On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.
Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.
anmar
From: Jonathan Cameron Sent: 19 March 2021 09:13 To: liuyinsi@163.com mailto:liuyinsi@163.com; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> Subject: RE: Re: Issues with docker on OpenEulerOS We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems. Thanks, Jonathan From: liuyinsi@163.com mailto:liuyinsi@163.com [mailto:liuyinsi@163.com mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Jonathan Cameron <jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> Subject: Re: Re: Issues with docker on OpenEulerOS @Jammy, Our dailybuild already make v5.10 for openEuler 21.03. @Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped. Thanks Yinsi liuyinsi@163.com mailto:liuyinsi@163.com From: Jammy Zhou mailto:jammy.zhou@linaro.org Date: 2021-03-19 08:29 To: Jonathan Cameron mailto:Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo) mailto:guohanjun@huawei.com CC: Dave Pigott mailto:dave.pigott@linaro.org; liuyinsi mailto:liuyinsi@163.com; Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi mailto:shameerali.kolothum.thodi@huawei.com Subject: Re: Issues with docker on OpenEulerOS +Hanjun As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19. On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <Jonathan.Cameron@huawei.com mailto:Jonathan.Cameron@huawei.com> wrote: @yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com mailto:liuyinsi@163.com <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制
On 03/18/2021 19:47, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave > On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: > > Hi Dave, > > What is the docker images name you want to pull from dockerhub? > > Thanks > Yinsi > > > > > > > liuyinsi > 邮箱:liuyinsi@163.com mailto:liuyinsi@163.com > <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制 > > On 03/18/2021 19:28, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: > Hi Yinsi, > > We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas? > > Thanks > > Dave > > >> On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: >> >> Hi Dave, >> >> I notice the job 2313644 <https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64<http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64> on openEulerOS machine is ok, first download speed about 2.63MB/s. >> >> It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries. >> >> Thanks >> Yinsi >> >> liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> >> >> From: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> >> Date: 2021-03-18 17:04 >> To: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> >> CC: Anmar Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Jonathan Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> >> Subject: Re: Issues with docker on OpenEulerOS >> Hi Yinsi, >> >> If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 <https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> - you’ll see it’s not failing on a git clone, it’s failing on a wget. >> >> Dave >> >> >>> On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: >>> >>> Hi Dave, >>> >>> "http download timeout", does it happen often? >>> "https download timeout", has this problem been solved by edit ~/.gitconfig? >>> >>> Thanks >>> Yinsi >>> >>> liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> >>> >>> From: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> >>> Date: 2021-03-17 10:19 >>> To: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> >>> CC: Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; luca <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> >>> Subject: Re: Re: Issues with docker on OpenEulerOS >>> >>> >>>>> >>>>> Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. >>>>> >>>> vi ~/.gitconfig >>>> >>>> [url "git://github.com http://github.com/ <git://github.com http://github.com/>"] >>>> insteadOf = https://github.com https://github.com/ <https://github.com/ https://github.com/> >>>> >>>> This will change from https to git. >>>> >>> >>> Hi Yinsi, >>> >>> If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40<https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40>, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git. >>> >>> Hi Dave, >>> >>> You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, >>> then it will automatically change https to git. >>> >>> Thanks >>> Yinsi >>> >>> Dave >>>>> >>>>> >>>>> >>>>> Thanks >>>>> >>>>> Dave >>>>> >>>>> >>>>>>>> >>>>>>>> >>>>>>>> anmar >
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
Hi All,
Thank you Yinsi for all the support.
Just as a note, to have a working setup for LAVA dispatcher through docker-compose both the backported kernel fix and the Qemu version from debian backports repo were needed in order to achieve this.
Thank you all.
Luca
On 09/04/2021 12:46, Dave Pigott wrote:
Okay - great news. The Kungpen server is now online and the qemu devices are passing their health checks and now processing jobs.
Thank you all!
Dave
On 9 Apr 2021, at 04:57, [1]liuyinsi@163.com wrote:
OK,done. Please try to login. Thanks Yinsi [defaultAvatar.png] liuyinsi 邮箱:liuyinsi@163.com
签名由 [2]网易邮箱大师 定制
On 04/08/2021 20:06, [3]Luca Di Stefano wrote:
Hi Yinsi,
Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are:
- 51.148.40.18
- 51.148.40.7
- 51.148.40.11
Thank you.
Luca
On 08/04/2021 13:02, Dave Pigott wrote:
Hi Yinsi,
The Lab IP is 51.148.40.1
Thanks
Dave
On 8 Apr 2021, at 12:30, [4]liuyinsi@163.com wrote:
Hi Dave/Anmar, The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist. Thanks Yinsi [defaultAvatar.png] liuyinsi 邮箱:liuyinsi@163.com
签名由 [5]网易邮箱大师 定制
On 04/07/2021 18:21, [6]Dave Pigott wrote:
Hi Yinsi, We can no longer ssh to the server. Can you resolve this please? Thanks Dave
On 7 Apr 2021, at 10:17, [7]liuyinsi@163.com wrote:
Ok,done. Please try to test QEMU again. Thanks Yinsi On 04/01/2021 20:57, [8]Anmar Oueja wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi <[9]shameerali.kolothum.thodi@huawei.com> wrote: Ok, I have backported the fix to 5.10.
Please find the patches here, [10]https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2 -on-v3
Sanity testing at my end shows it working. Please try and let me know. Thanks Shmeer. On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix. Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help. anmar From: Jonathan Cameron Sent: 19 March 2021 09:13 To: [11]liuyinsi@163.com; [12]jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) <[13]guohanjun@huawei.com>; Pigott <[14]dave.pigott@linaro.org> Cc: Anmar Oueja <[15]anmar.oueja@linaro.org>; Luca Di Stefano <[16]luca.distefano@linaro.org>; wufengguang <[17]wufengguang@huawei.com>; lkq-dev <[18]lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <[19]shameerali.kolothum.thodi@huawei.com> Subject: RE: Re: Issues with docker on OpenEulerOS
We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.
Thanks,
Jonathan
From: [20]liuyinsi@163.com [[21]mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: [22]jammy.zhou@linaro.org; Jonathan Cameron <[23]jonathan.cameron@huawei.com>; Guohanjun (Hanjun Guo) <[24]guohanjun@huawei.com>; Pigott <[25]dave.pigott@linaro.org> Cc: Anmar Oueja <[26]anmar.oueja@linaro.org>; Luca Di Stefano <[27]luca.distefano@linaro.org>; wufengguang <[28]wufengguang@huawei.com>; lkq-dev <[29]lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <[30]shameerali.kolothum.thodi@huawei.com> Subject: Re: Re: Issues with docker on OpenEulerOS
@Jammy,
Our dailybuild already make v5.10 for openEuler 21.03.
@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.
Thanks Yinsi [31]liuyinsi@163.com
From: [32]Jammy Zhou Date: 2021-03-19 08:29 To: [33]Jonathan Cameron; [34]Guohanjun (Hanjun Guo) CC: [35]Dave Pigott; [36]liuyinsi; [37]Anmar Oueja; [38]Luca Di Stefano; [39]wufengguang; [40]lkq-dev; [41]Shameerali Kolothum Thodi Subject: Re: Issues with docker on OpenEulerOS +Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <[42]Jonathan.Cameron@huawei.com> wrote: @yinsi What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5 Or can we ask openEuler to carry a backport of this set directly? Another alternative is to see if there is an available BIOS with the fix in place and upgrade. Jonathan On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott <[43]dave.pigott@linaro.org> wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed.
We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, [44]liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about
docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:[45]liuyinsi@163.com
<[46]https://maas.mail.163.com/dashi-web-extend/html/proSignature.html? ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail -online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82 %AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <[47]https://mail.163.com/dashi/dlpro.html?from=mail88%3E 定制
On 03/18/2021 19:47, Dave Pigott
mailto:[48]dave.pigott@linaro.org wrote:
Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, [49]liuyinsi@163.com
mailto:[50]liuyinsi@163.com wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:[51]liuyinsi@163.com
<[52]https://maas.mail.163.com/dashi-web-extend/html/proSignature.html? ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail -online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82 %AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <[53]https://mail.163.com/dashi/dlpro.html?from=mail88%3E 定制
On 03/18/2021 19:28, Dave Pigott
mailto:[54]dave.pigott@linaro.org wrote:
Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release
and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, [55]liuyinsi@163.com
mailto:[56]liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644
<[57]https://lkft.validation.linaro.org/scheduler/job/2313644%3E is created 2 weeks, 6 days ago, can you test a new job, test wget [58]http://images.validation.linaro.org/snapshots.linaro.org/components /lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 <[59]http://images.validation.linaro.org/snapshots.linaro.org/component s/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64> on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and
slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
[60]liuyinsi@163.com mailto:[61]liuyinsi@163.com
From: Dave Pigott mailto:[62]dave.pigott@linaro.org Date: 2021-03-18 17:04 To: [63]liuyinsi@163.com mailto:[64]liuyinsi@163.com CC: Anmar Oueja mailto:[65]anmar.oueja@linaro.org; Luca Di
Stefano mailto:[66]luca.distefano@linaro.org; wufengguang mailto:[67]wufengguang@huawei.com; Jonathan Cameron mailto:[68]jonathan.cameron@huawei.com; lkq-dev mailto:[69]lkq-dev@op-lists.linaro.org; [70]jammy.zhou@linaro.org mailto:[71]jammy.zhou@linaro.org
Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g.
[72]https://lkft.validation.linaro.org/scheduler/job/2313644 <[73]https://lkft.validation.linaro.org/scheduler/job/2313644%3E - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, [74]liuyinsi@163.com
mailto:[75]liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit
~/.gitconfig?
Thanks Yinsi
[76]liuyinsi@163.com mailto:[77]liuyinsi@163.com
From: [78]liuyinsi@163.com mailto:[79]liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:[80]dave.pigott@linaro.org CC: Oueja mailto:[81]anmar.oueja@linaro.org; luca
mailto:[82]luca.distefano@linaro.org; wufengguang mailto:[83]wufengguang@huawei.com; Cameron mailto:[84]jonathan.cameron@huawei.com; lkq-dev mailto:[85]lkq-dev@op-lists.linaro.org; [86]jammy.zhou@linaro.org mailto:[87]jammy.zhou@linaro.org
Subject: Re: Re: Issues with docker on OpenEulerOS
> > Locally, in the lab, we use KissCache for https cacheing. We
would have to go through every test definition submitted by every bot and developer to change from https to git.
> vi ~/.gitconfig
[url "git://[88]github.com git://[89]github.com"] insteadOf = [90]https://github.com
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g.
[92]https://lkft.validation.linaro.org/scheduler/job/2409008/definition #defline40 <[93]https://lkft.validation.linaro.org/scheduler/job/2409008/definitio n#defline40>, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the
clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone,
then it will automatically change https to git.
Thanks Yinsi
Dave
> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar
[defaultAvatar.png] liuyinsi 邮箱:liuyinsi@163.com
签名由 [94]网易邮箱大师 定制
References
Visible links 1. mailto:liuyinsi@163.com 2. https://mail.163.com/dashi/dlpro.html?from=mail88 3. mailto:luca.distefano@linaro.org 4. mailto:liuyinsi@163.com 5. https://mail.163.com/dashi/dlpro.html?from=mail88 6. mailto:dave.pigott@linaro.org 7. mailto:liuyinsi@163.com 8. mailto:anmar.oueja@linaro.org 9. mailto:shameerali.kolothum.thodi@huawei.com 10. https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 11. mailto:liuyinsi@163.com 12. mailto:jammy.zhou@linaro.org 13. mailto:guohanjun@huawei.com 14. mailto:dave.pigott@linaro.org 15. mailto:anmar.oueja@linaro.org 16. mailto:luca.distefano@linaro.org 17. mailto:wufengguang@huawei.com 18. mailto:lkq-dev@op-lists.linaro.org 19. mailto:shameerali.kolothum.thodi@huawei.com 20. mailto:liuyinsi@163.com 21. mailto:liuyinsi@163.com 22. mailto:jammy.zhou@linaro.org 23. mailto:jonathan.cameron@huawei.com 24. mailto:guohanjun@huawei.com 25. mailto:dave.pigott@linaro.org 26. mailto:anmar.oueja@linaro.org 27. mailto:luca.distefano@linaro.org 28. mailto:wufengguang@huawei.com 29. mailto:lkq-dev@op-lists.linaro.org 30. mailto:shameerali.kolothum.thodi@huawei.com 31. mailto:liuyinsi@163.com 32. mailto:jammy.zhou@linaro.org 33. mailto:Jonathan.Cameron@huawei.com 34. mailto:guohanjun@huawei.com 35. mailto:dave.pigott@linaro.org 36. mailto:liuyinsi@163.com 37. mailto:anmar.oueja@linaro.org 38. mailto:luca.distefano@linaro.org 39. mailto:wufengguang@huawei.com 40. mailto:lkq-dev@op-lists.linaro.org 41. mailto:shameerali.kolothum.thodi@huawei.com 42. mailto:Jonathan.Cameron@huawei.com 43. mailto:dave.pigott@linaro.org 44. mailto:liuyinsi@163.com 45. mailto:liuyinsi@163.com 46. https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am..."] 47. https://mail.163.com/dashi/dlpro.html?from=mail88 48. mailto:dave.pigott@linaro.org 49. mailto:liuyinsi@163.com 50. mailto:liuyinsi@163.com 51. mailto:liuyinsi@163.com 52. https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am..."] 53. https://mail.163.com/dashi/dlpro.html?from=mail88 54. mailto:dave.pigott@linaro.org 55. mailto:liuyinsi@163.com 56. mailto:liuyinsi@163.com 57. https://lkft.validation.linaro.org/scheduler/job/2313644 58. http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... 59. http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... 60. mailto:liuyinsi@163.com 61. mailto:liuyinsi@163.com 62. mailto:dave.pigott@linaro.org 63. mailto:liuyinsi@163.com 64. mailto:liuyinsi@163.com 65. mailto:anmar.oueja@linaro.org 66. mailto:luca.distefano@linaro.org 67. mailto:wufengguang@huawei.com 68. mailto:jonathan.cameron@huawei.com 69. mailto:lkq-dev@op-lists.linaro.org 70. mailto:jammy.zhou@linaro.org 71. mailto:jammy.zhou@linaro.org 72. https://lkft.validation.linaro.org/scheduler/job/2313644 73. https://lkft.validation.linaro.org/scheduler/job/2313644 74. mailto:liuyinsi@163.com 75. mailto:liuyinsi@163.com 76. mailto:liuyinsi@163.com 77. mailto:liuyinsi@163.com 78. mailto:liuyinsi@163.com 79. mailto:liuyinsi@163.com 80. mailto:dave.pigott@linaro.org 81. mailto:anmar.oueja@linaro.org 82. mailto:luca.distefano@linaro.org 83. mailto:wufengguang@huawei.com 84. mailto:jonathan.cameron@huawei.com 85. mailto:lkq-dev@op-lists.linaro.org 86. mailto:jammy.zhou@linaro.org 87. mailto:jammy.zhou@linaro.org 88. http://github.com/ 89. http://github.com/ 90. https://github.com/ 91. https://github.com/ 92. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... 93. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... 94. https://mail.163.com/dashi/dlpro.html?from=mail88
Hidden links: 96. https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... 97. https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... 98. https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am...
Hi All,
It's great to collaborate. :)
Thank you all.
Yinsi
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
On 04/09/2021 19:52, Luca Di Stefano wrote:
Hi All,
Thank you Yinsi for all the support.
Just as a note, to have a working setup for LAVA dispatcher through docker-compose both the backported kernel fix and the Qemu version from debian backports repo were needed in order to achieve this.
Thank you all.
Luca
On 09/04/2021 12:46, Dave Pigott wrote:
Okay - great news. The Kungpen server is now online and the qemu devices are passing their health checks and now processing jobs.
Thank you all!
Dave
On 9 Apr 2021, at 04:57, liuyinsi@163.com wrote:
OK,done. Please try to login.
Thanks Yinsi
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
On 04/08/2021 20:06, Luca Di Stefano wrote:
Hi Yinsi,
Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are:
- 51.148.40.18
- 51.148.40.7
- 51.148.40.11
Thank you.
Luca
On 08/04/2021 13:02, Dave Pigott wrote:
Hi Yinsi,
The Lab IP is 51.148.40.1
Thanks
Dave
On 8 Apr 2021, at 12:30, liuyinsi@163.com wrote:
Hi Dave/Anmar,
The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.
Thanks Yinsi
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
On 04/07/2021 18:21, Dave Pigott wrote: Hi Yinsi,
We can no longer ssh to the server. Can you resolve this please?
Thanks
Dave
On 7 Apr 2021, at 10:17, liuyinsi@163.com wrote:
Ok,done. Please try to test QEMU again.
Thanks Yinsi
On 04/01/2021 20:57, Anmar Oueja wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com wrote: Ok, I have backported the fix to 5.10.
Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3
Sanity testing at my end shows it working. Please try and let me know.
Thanks Shmeer.
On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.
Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.
anmar
From: Jonathan Cameron Sent: 19 March 2021 09:13 To:liuyinsi@163.com; jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: RE: Re: Issues with docker on OpenEulerOS
We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.
Thanks,
Jonathan
From:liuyinsi@163.com [mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To:jammy.zhou@linaro.org; Jonathan Cameron jonathan.cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: Re: Re: Issues with docker on OpenEulerOS
@Jammy,
Our dailybuild already make v5.10 for openEuler 21.03.
@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.
Thanks Yinsi liuyinsi@163.com
From: Jammy Zhou Date: 2021-03-19 08:29 To: Jonathan Cameron; Guohanjun (Hanjun Guo) CC: Dave Pigott; liuyinsi; Anmar Oueja; Luca Di Stefano; wufengguang; lkq-dev; Shameerali Kolothum Thodi Subject: Re: Issues with docker on OpenEulerOS +Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron Jonathan.Cameron@huawei.com wrote: @yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com
From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com
From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
> > Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > vi ~/.gitconfig
[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
Hi Yinsi,
I had to offline the worker over the weekend because the download speed was making jobs fail due to timeouts cloning and wgetting
Not much we as the lab team can do about that.
Dave
On 9 Apr 2021, at 15:19, liuyinsi@163.com wrote:
Hi All,
It's great to collaborate. :)
Thank you all.
Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 04/09/2021 19:52, Luca Di Stefano mailto:luca.distefano@linaro.org wrote: Hi All,
Thank you Yinsi for all the support.
Just as a note, to have a working setup for LAVA dispatcher through docker-compose both the backported kernel fix and the Qemu version from debian backports repo were needed in order to achieve this.
Thank you all.
Luca
On 09/04/2021 12:46, Dave Pigott wrote:
Okay - great news. The Kungpen server is now online and the qemu devices are passing their health checks and now processing jobs.
Thank you all!
Dave
On 9 Apr 2021, at 04:57, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
OK,done. Please try to login.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 04/08/2021 20:06, Luca Di Stefano mailto:luca.distefano@linaro.org wrote: Hi Yinsi,
Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are:
51.148.40.18
51.148.40.7
51.148.40.11
Thank you.
Luca
On 08/04/2021 13:02, Dave Pigott wrote:
Hi Yinsi,
The Lab IP is 51.148.40.1
Thanks
Dave
On 8 Apr 2021, at 12:30, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave/Anmar,
The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 04/07/2021 18:21, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
We can no longer ssh to the server. Can you resolve this please?
Thanks
Dave
On 7 Apr 2021, at 10:17, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Ok,done. Please try to test QEMU again.
Thanks Yinsi
On 04/01/2021 20:57, Anmar Oueja mailto:anmar.oueja@linaro.org wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> wrote: Ok, I have backported the fix to 5.10. Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 Sanity testing at my end shows it working. Please try and let me know.
Thanks Shmeer.
On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.
Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.
anmar
From: Jonathan Cameron Sent: 19 March 2021 09:13 To: liuyinsi@163.com mailto:liuyinsi@163.com; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> Subject: RE: Re: Issues with docker on OpenEulerOS We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems. Thanks, Jonathan From: liuyinsi@163.com mailto:liuyinsi@163.com [mailto:liuyinsi@163.com mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Jonathan Cameron <jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> Subject: Re: Re: Issues with docker on OpenEulerOS @Jammy, Our dailybuild already make v5.10 for openEuler 21.03. @Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped. Thanks Yinsi liuyinsi@163.com mailto:liuyinsi@163.com From: Jammy Zhou mailto:jammy.zhou@linaro.org Date: 2021-03-19 08:29 To: Jonathan Cameron mailto:Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo) mailto:guohanjun@huawei.com CC: Dave Pigott mailto:dave.pigott@linaro.org; liuyinsi mailto:liuyinsi@163.com; Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi mailto:shameerali.kolothum.thodi@huawei.com Subject: Re: Issues with docker on OpenEulerOS +Hanjun As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19. On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <Jonathan.Cameron@huawei.com mailto:Jonathan.Cameron@huawei.com> wrote: @yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote:
> Hi Yinsi, > > Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this. > > Thanks for your help! > > Dave > > > On 18 Mar 2021, at 12:11, liuyinsi@163.com mailto:liuyinsi@163.com wrote: > > > > Hi Dave, > > > > I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work. > > > > Thanks > > Yinsi > > > > > > > > liuyinsi > > 邮箱:liuyinsi@163.com mailto:liuyinsi@163.com > > <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制 > > > > On 03/18/2021 19:47, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: > > Hi Yinsi, > > > > It’s lavasoftware/lava-dispatcher:2021.03 > > > > Dave > > > >> On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: > >> > >> Hi Dave, > >> > >> What is the docker images name you want to pull from dockerhub? > >> > >> Thanks > >> Yinsi > >> > >> > >> > >> > >> > >> > >> liuyinsi > >> 邮箱:liuyinsi@163.com mailto:liuyinsi@163.com > >> <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制 > >> > >> On 03/18/2021 19:28, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: > >> Hi Yinsi, > >> > >> We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas? > >> > >> Thanks > >> > >> Dave > >> > >> > >>> On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: > >>> > >>> Hi Dave, > >>> > >>> I notice the job 2313644 <https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 <http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64> on openEulerOS machine is ok, first download speed about 2.63MB/s. > >>> > >>> It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries. > >>> > >>> Thanks > >>> Yinsi > >>> > >>> liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > >>> > >>> From: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> > >>> Date: 2021-03-18 17:04 > >>> To: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > >>> CC: Anmar Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Jonathan Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> > >>> Subject: Re: Issues with docker on OpenEulerOS > >>> Hi Yinsi, > >>> > >>> If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 <https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> - you’ll see it’s not failing on a git clone, it’s failing on a wget. > >>> > >>> Dave > >>> > >>> > >>>> On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: > >>>> > >>>> Hi Dave, > >>>> > >>>> "http download timeout", does it happen often? > >>>> "https download timeout", has this problem been solved by edit ~/.gitconfig? > >>>> > >>>> Thanks > >>>> Yinsi > >>>> > >>>> liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > >>>> > >>>> From: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > >>>> Date: 2021-03-17 10:19 > >>>> To: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> > >>>> CC: Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; luca <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> > >>>> Subject: Re: Re: Issues with docker on OpenEulerOS > >>>> > >>>> > >>>>>> > >>>>>> Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > >>>>>> > >>>>> vi ~/.gitconfig > >>>>> > >>>>> [url "git://github.com http://github.com/ <git://github.com http://github.com/>"] > >>>>> insteadOf = https://github.com https://github.com/ <https://github.com/ https://github.com/> > >>>>> > >>>>> This will change from https to git. > >>>>> > >>>> > >>>> Hi Yinsi, > >>>> > >>>> If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40 <https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40>, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git. > >>>> > >>>> Hi Dave, > >>>> > >>>> You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, > >>>> then it will automatically change https to git. > >>>> > >>>> Thanks > >>>> Yinsi > >>>> > >>>> Dave > >>>>>> > >>>>>> > >>>>>> > >>>>>> Thanks > >>>>>> > >>>>>> Dave > >>>>>> > >>>>>> > >>>>>>>>> > >>>>>>>>> > >>>>>>>>> anmar > >> > > > >
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
I checked with Chase who has good experience of LAVA in China. It looks like a cache/mirror server is helpful in this context.
The download speed from S3 often is a problem for China. We may need to setup a mirror/cache server (e.g. jfrog artifactory) in the lab to mirror or cache the files that LAVA test jobs need. Once we have a cache/mirror server set, the test plan should be updated to download file from mirror/cache server instead of the original S3 server. A local mirror/cache server will improve both reliability and speed of CI.
Regards, Jammy
On Mon, 12 Apr 2021 at 17:34, Dave Pigott dave.pigott@linaro.org wrote:
Hi Yinsi,
I had to offline the worker over the weekend because the download speed was making jobs fail due to timeouts cloning and wgetting
Not much we as the lab team can do about that.
Dave
On 9 Apr 2021, at 15:19, liuyinsi@163.com wrote:
Hi All,
It's great to collaborate. :)
Thank you all.
Yinsi
liuyinsi 邮箱:liuyinsi@163.com
签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 04/09/2021 19:52, Luca Di Stefano luca.distefano@linaro.org wrote:
Hi All,
Thank you Yinsi for all the support.
Just as a note, to have a working setup for LAVA dispatcher through docker-compose both the backported kernel fix and the Qemu version from debian backports repo were needed in order to achieve this.
Thank you all.
Luca
On 09/04/2021 12:46, Dave Pigott wrote:
Okay - great news. The Kungpen server is now online and the qemu devices are passing their health checks and now processing jobs.
Thank you all!
Dave
On 9 Apr 2021, at 04:57, liuyinsi@163.com wrote:
OK,done. Please try to login.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com
签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 04/08/2021 20:06, Luca Di Stefano luca.distefano@linaro.org wrote:
Hi Yinsi,
Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are:
51.148.40.18
51.148.40.7
51.148.40.11
Thank you.
Luca
On 08/04/2021 13:02, Dave Pigott wrote:
Hi Yinsi,
The Lab IP is 51.148.40.1
Thanks
Dave
On 8 Apr 2021, at 12:30, liuyinsi@163.com wrote:
Hi Dave/Anmar,
The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com
签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 04/07/2021 18:21, Dave Pigott dave.pigott@linaro.org wrote: Hi Yinsi,
We can no longer ssh to the server. Can you resolve this please?
Thanks
Dave
On 7 Apr 2021, at 10:17, liuyinsi@163.com wrote:
Ok,done. Please try to test QEMU again.
Thanks Yinsi
On 04/01/2021 20:57, Anmar Oueja anmar.oueja@linaro.org wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi < shameerali.kolothum.thodi@huawei.com> wrote: Ok, I have backported the fix to 5.10.
Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3
Sanity testing at my end shows it working. Please try and let me know.
Thanks Shmeer.
On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.
Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.
anmar
*From:* Jonathan Cameron *Sent:* 19 March 2021 09:13 *To:* liuyinsi@163.com; jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) < guohanjun@huawei.com>; Pigott dave.pigott@linaro.org *Cc:* Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano < luca.distefano@linaro.org>; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi < shameerali.kolothum.thodi@huawei.com> *Subject:* RE: Re: Issues with docker on OpenEulerOS
We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.
Thanks,
Jonathan
*From:* liuyinsi@163.com [mailto:liuyinsi@163.com liuyinsi@163.com] *Sent:* 19 March 2021 08:29 *To:* jammy.zhou@linaro.org; Jonathan Cameron jonathan.cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott < dave.pigott@linaro.org> *Cc:* Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano < luca.distefano@linaro.org>; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi < shameerali.kolothum.thodi@huawei.com> *Subject:* Re: Re: Issues with docker on OpenEulerOS
@Jammy,
Our dailybuild already make v5.10 for openEuler 21.03.
@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.
Thanks Yinsi liuyinsi@163.com
*From:* Jammy Zhou jammy.zhou@linaro.org *Date:* 2021-03-19 08:29 *To:* Jonathan Cameron Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com *CC:* Dave Pigott dave.pigott@linaro.org; liuyinsi liuyinsi@163.com; Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com *Subject:* Re: Issues with docker on OpenEulerOS +Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron < Jonathan.Cameron@huawei.com> wrote: @yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re
back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about
docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com <
https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am...
签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org
wrote:
Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com
wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com <
https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am...
签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org
wrote:
Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and
we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com
wrote:
Hi Dave,
I notice the job 2313644 <
https://lkft.validation.linaro.org/scheduler/job/2313644%3E is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... < http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow
network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com
From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano
mailto:luca.distefano@linaro.org; wufengguang mailto: wufengguang@huawei.com; Jonathan Cameron mailto: jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org
Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g.
https://lkft.validation.linaro.org/scheduler/job/2313644 < https://lkft.validation.linaro.org/scheduler/job/2313644%3E - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com
wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit
~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com
From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca <mailto:
luca.distefano@linaro.org>; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto: lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto: jammy.zhou@linaro.org
Subject: Re: Re: Issues with docker on OpenEulerOS
>> >> Locally, in the lab, we use KissCache for https cacheing. We
would have to go through every test definition submitted by every bot and developer to change from https to git.
>> > vi ~/.gitconfig > > [url "git://github.com git://github.com"] > insteadOf = https://github.com https://github.com/ > > This will change from https to git. >
Hi Yinsi,
If you look at the job definitions, e.g.
https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... < https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4..., you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the
clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone,
then it will automatically change https to git.
Thanks Yinsi
Dave >> >> >> >> Thanks >> >> Dave >> >> >>>>> >>>>> >>>>> anmar
liuyinsi 邮箱:liuyinsi@163.com
签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
Hi Jammy,
This is all good - not sure what, if anything, the Lab can do to fix these problems. This would appear to be a CI/Front end issue.
Thanks
Dave
On 13 Apr 2021, at 03:07, Jammy Zhou jammy.zhou@linaro.org wrote:
I checked with Chase who has good experience of LAVA in China. It looks like a cache/mirror server is helpful in this context.
The download speed from S3 often is a problem for China. We may need to setup a mirror/cache server (e.g. jfrog artifactory) in the lab to mirror or cache the files that LAVA test jobs need. Once we have a cache/mirror server set, the test plan should be updated to download file from mirror/cache server instead of the original S3 server. A local mirror/cache server will improve both reliability and speed of CI.
Regards, Jammy
On Mon, 12 Apr 2021 at 17:34, Dave Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: Hi Yinsi,
I had to offline the worker over the weekend because the download speed was making jobs fail due to timeouts cloning and wgetting
Not much we as the lab team can do about that.
Dave
On 9 Apr 2021, at 15:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi All,
It's great to collaborate. :)
Thank you all.
Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 04/09/2021 19:52, Luca Di Stefano mailto:luca.distefano@linaro.org wrote: Hi All,
Thank you Yinsi for all the support.
Just as a note, to have a working setup for LAVA dispatcher through docker-compose both the backported kernel fix and the Qemu version from debian backports repo were needed in order to achieve this.
Thank you all.
Luca
On 09/04/2021 12:46, Dave Pigott wrote:
Okay - great news. The Kungpen server is now online and the qemu devices are passing their health checks and now processing jobs.
Thank you all!
Dave
On 9 Apr 2021, at 04:57, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
OK,done. Please try to login.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 04/08/2021 20:06, Luca Di Stefano mailto:luca.distefano@linaro.org wrote: Hi Yinsi,
Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are:
51.148.40.18
51.148.40.7
51.148.40.11
Thank you.
Luca
On 08/04/2021 13:02, Dave Pigott wrote:
Hi Yinsi,
The Lab IP is 51.148.40.1
Thanks
Dave
On 8 Apr 2021, at 12:30, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave/Anmar,
The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 04/07/2021 18:21, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
We can no longer ssh to the server. Can you resolve this please?
Thanks
Dave
> On 7 Apr 2021, at 10:17, liuyinsi@163.com mailto:liuyinsi@163.com wrote: > > > Ok,done. Please try to test QEMU again. > > Thanks > Yinsi > > > > > On 04/01/2021 20:57, Anmar Oueja mailto:anmar.oueja@linaro.org wrote: > On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> wrote: > Ok, I have backported the fix to 5.10. > > Please find the patches here, > https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 > > Sanity testing at my end shows it working. Please try and let me know. > > Thanks Shmeer. > > On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix. > > Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help. > > anmar > > From: Jonathan Cameron > Sent: 19 March 2021 09:13 > To: liuyinsi@163.com mailto:liuyinsi@163.com; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> > Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> > Subject: RE: Re: Issues with docker on OpenEulerOS > > We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. > @Shameer, let us know if you hit any problems. > > Thanks, > > Jonathan > > > From: liuyinsi@163.com mailto:liuyinsi@163.com [mailto:liuyinsi@163.com mailto:liuyinsi@163.com] > Sent: 19 March 2021 08:29 > To: jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Jonathan Cameron <jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> > Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> > Subject: Re: Re: Issues with docker on OpenEulerOS > > @Jammy, > > Our dailybuild already make v5.10 for openEuler 21.03. > > @Dave > The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, > the previously running container has stopped. > > Thanks > Yinsi > liuyinsi@163.com mailto:liuyinsi@163.com > > From: Jammy Zhou mailto:jammy.zhou@linaro.org > Date: 2021-03-19 08:29 > To: Jonathan Cameron mailto:Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo) mailto:guohanjun@huawei.com > CC: Dave Pigott mailto:dave.pigott@linaro.org; liuyinsi mailto:liuyinsi@163.com; Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi mailto:shameerali.kolothum.thodi@huawei.com > Subject: Re: Issues with docker on OpenEulerOS > +Hanjun > > As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19. > > On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <Jonathan.Cameron@huawei.com mailto:Jonathan.Cameron@huawei.com> wrote: > @yinsi > > What are chances of upgrading the host os to a more recent openEuler kernel. > 4.19 is a bit of a stretch for a backport of the fix. > I guess it might be easy, but would feel more comfortable with 5.10 or 5.5 > > Or can we ask openEuler to carry a backport of this set directly? > > Another alternative is to see if there is an available BIOS with the fix > in place and upgrade. > > Jonathan > > On Thu, 18 Mar 2021 13:38:28 +0000 > Dave Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: > > > Hi Yinsi, > > > > Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this. > > > > Thanks for your help! > > > > Dave > > > > > On 18 Mar 2021, at 12:11, liuyinsi@163.com mailto:liuyinsi@163.com wrote: > > > > > > Hi Dave, > > > > > > I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work. > > > > > > Thanks > > > Yinsi > > > > > > > > > > > > liuyinsi > > > 邮箱:liuyinsi@163.com mailto:liuyinsi@163.com > > > <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制 > > > > > > On 03/18/2021 19:47, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: > > > Hi Yinsi, > > > > > > It’s lavasoftware/lava-dispatcher:2021.03 > > > > > > Dave > > > > > >> On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: > > >> > > >> Hi Dave, > > >> > > >> What is the docker images name you want to pull from dockerhub? > > >> > > >> Thanks > > >> Yinsi > > >> > > >> > > >> > > >> > > >> > > >> > > >> liuyinsi > > >> 邮箱:liuyinsi@163.com mailto:liuyinsi@163.com > > >> <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制 > > >> > > >> On 03/18/2021 19:28, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: > > >> Hi Yinsi, > > >> > > >> We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas? > > >> > > >> Thanks > > >> > > >> Dave > > >> > > >> > > >>> On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: > > >>> > > >>> Hi Dave, > > >>> > > >>> I notice the job 2313644 <https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 <http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64> on openEulerOS machine is ok, first download speed about 2.63MB/s. > > >>> > > >>> It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries. > > >>> > > >>> Thanks > > >>> Yinsi > > >>> > > >>> liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > > >>> > > >>> From: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> > > >>> Date: 2021-03-18 17:04 > > >>> To: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > > >>> CC: Anmar Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Jonathan Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> > > >>> Subject: Re: Issues with docker on OpenEulerOS > > >>> Hi Yinsi, > > >>> > > >>> If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 <https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> - you’ll see it’s not failing on a git clone, it’s failing on a wget. > > >>> > > >>> Dave > > >>> > > >>> > > >>>> On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: > > >>>> > > >>>> Hi Dave, > > >>>> > > >>>> "http download timeout", does it happen often? > > >>>> "https download timeout", has this problem been solved by edit ~/.gitconfig? > > >>>> > > >>>> Thanks > > >>>> Yinsi > > >>>> > > >>>> liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > > >>>> > > >>>> From: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> > > >>>> Date: 2021-03-17 10:19 > > >>>> To: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> > > >>>> CC: Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; luca <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> > > >>>> Subject: Re: Re: Issues with docker on OpenEulerOS > > >>>> > > >>>> > > >>>>>> > > >>>>>> Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > > >>>>>> > > >>>>> vi ~/.gitconfig > > >>>>> > > >>>>> [url "git://github.com http://github.com/ <git://github.com http://github.com/>"] > > >>>>> insteadOf = https://github.com https://github.com/ <https://github.com/ https://github.com/> > > >>>>> > > >>>>> This will change from https to git. > > >>>>> > > >>>> > > >>>> Hi Yinsi, > > >>>> > > >>>> If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40 <https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40>, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git. > > >>>> > > >>>> Hi Dave, > > >>>> > > >>>> You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, > > >>>> then it will automatically change https to git. > > >>>> > > >>>> Thanks > > >>>> Yinsi > > >>>> > > >>>> Dave > > >>>>>> > > >>>>>> > > >>>>>> > > >>>>>> Thanks > > >>>>>> > > >>>>>> Dave > > >>>>>> > > >>>>>> > > >>>>>>>>> > > >>>>>>>>> > > >>>>>>>>> anmar > > >> > > > > > > > > > > liuyinsi > 邮箱:liuyinsi@163.com > https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制 >
Hi Dave/Anmar,
Such as the title, our openeulerOS server will be power down at May 1st, just one day, 8:00 -- 18:00.
Thanks Yinsi
On Fri, Apr 23, 2021 at 6:10 AM liuyinsi@163.com liuyinsi@163.com wrote:
Hi Dave/Anmar,
Such as the title, our openeulerOS server will be power down at May 1st, just one day, 8:00 -- 18:00.
Thanks for letting us know Yinsi.
Have a good weekend,
anmar
Thanks Yinsi
Hi Dave,
Liu Xinliang will help us to fix the issue about download speed from S3, his email is xinliang.liuxinliang.liu@linaro.org.
http://images.validation.linaro.org/snapshots.linaro.org/, how is a job triggered? Is it triggered after image compilation?
@Jammy
Even we have a cache/mirror server set, we still need to download firstly from S3 on the cache/mirror server, and the files that we download change every day, this doesn't seem to solve the problem.
Thanks Yinsi
liuyinsi@163.com
From: Dave Pigott Date: 2021-04-13 17:39 To: Jammy Zhou CC: liuyinsi; Luca Di Stefano; Anmar Oueja; Shameerali Kolothum Thodi; wufengguang; Guohanjun (Hanjun Guo); Jonathan Cameron; lkq-dev; Chase Qi Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,
This is all good - not sure what, if anything, the Lab can do to fix these problems. This would appear to be a CI/Front end issue.
Thanks
Dave
On 13 Apr 2021, at 03:07, Jammy Zhou jammy.zhou@linaro.org wrote:
I checked with Chase who has good experience of LAVA in China. It looks like a cache/mirror server is helpful in this context.
The download speed from S3 often is a problem for China. We may need to setup a mirror/cache server (e.g. jfrog artifactory) in the lab to mirror or cache the files that LAVA test jobs need. Once we have a cache/mirror server set, the test plan should be updated to download file from mirror/cache server instead of the original S3 server. A local mirror/cache server will improve both reliability and speed of CI.
Regards, Jammy
On Mon, 12 Apr 2021 at 17:34, Dave Pigott dave.pigott@linaro.org wrote: Hi Yinsi,
I had to offline the worker over the weekend because the download speed was making jobs fail due to timeouts cloning and wgetting
Not much we as the lab team can do about that.
Dave
On 9 Apr 2021, at 15:19, liuyinsi@163.com wrote:
Hi All,
It's great to collaborate. :)
Thank you all.
Yinsi
liuyinsi 邮箱:liuyinsi@163.com 签名由 网易邮箱大师 定制 On 04/09/2021 19:52, Luca Di Stefano wrote: Hi All, Thank you Yinsi for all the support. Just as a note, to have a working setup for LAVA dispatcher through docker-compose both the backported kernel fix and the Qemu version from debian backports repo were needed in order to achieve this. Thank you all. Luca
On 09/04/2021 12:46, Dave Pigott wrote: Okay - great news. The Kungpen server is now online and the qemu devices are passing their health checks and now processing jobs.
Thank you all!
Dave
On 9 Apr 2021, at 04:57, liuyinsi@163.com wrote:
OK,done. Please try to login.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com 签名由 网易邮箱大师 定制 On 04/08/2021 20:06, Luca Di Stefano wrote: Hi Yinsi, Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are: - 51.148.40.18 - 51.148.40.7 - 51.148.40.11 Thank you. Luca
On 08/04/2021 13:02, Dave Pigott wrote: Hi Yinsi,
The Lab IP is 51.148.40.1
Thanks
Dave
On 8 Apr 2021, at 12:30, liuyinsi@163.com wrote:
Hi Dave/Anmar,
The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com 签名由 网易邮箱大师 定制 On 04/07/2021 18:21, Dave Pigott wrote: Hi Yinsi,
We can no longer ssh to the server. Can you resolve this please?
Thanks
Dave
On 7 Apr 2021, at 10:17, liuyinsi@163.com wrote:
Ok,done. Please try to test QEMU again.
Thanks Yinsi
On 04/01/2021 20:57, Anmar Oueja wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com wrote: Ok, I have backported the fix to 5.10.
Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3
Sanity testing at my end shows it working. Please try and let me know.
Thanks Shmeer.
On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.
Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.
anmar
From: Jonathan Cameron Sent: 19 March 2021 09:13 To: liuyinsi@163.com; jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: RE: Re: Issues with docker on OpenEulerOS
We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.
Thanks,
Jonathan
From: liuyinsi@163.com [mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: jammy.zhou@linaro.org; Jonathan Cameron jonathan.cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: Re: Re: Issues with docker on OpenEulerOS
@Jammy,
Our dailybuild already make v5.10 for openEuler 21.03.
@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.
Thanks Yinsi liuyinsi@163.com
From: Jammy Zhou Date: 2021-03-19 08:29 To: Jonathan Cameron; Guohanjun (Hanjun Guo) CC: Dave Pigott; liuyinsi; Anmar Oueja; Luca Di Stefano; wufengguang; lkq-dev; Shameerali Kolothum Thodi Subject: Re: Issues with docker on OpenEulerOS +Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron Jonathan.Cameron@huawei.com wrote: @yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
> > Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > vi ~/.gitconfig
[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar
liuyinsi 邮箱:liuyinsi@163.com 签名由 网易邮箱大师 定制
Hi Dave,
http download failed: it's better to improve your download code, increase timeout and add retries. https download failed: use "git clone git" instead of "git clone https".
Thanks Yinsi.
liuyinsi@163.com
From: Dave Pigott Date: 2021-04-13 17:39 To: Jammy Zhou CC: liuyinsi; Luca Di Stefano; Anmar Oueja; Shameerali Kolothum Thodi; wufengguang; Guohanjun (Hanjun Guo); Jonathan Cameron; lkq-dev; Chase Qi Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,
This is all good - not sure what, if anything, the Lab can do to fix these problems. This would appear to be a CI/Front end issue.
Thanks
Dave
On 13 Apr 2021, at 03:07, Jammy Zhou jammy.zhou@linaro.org wrote:
I checked with Chase who has good experience of LAVA in China. It looks like a cache/mirror server is helpful in this context.
The download speed from S3 often is a problem for China. We may need to setup a mirror/cache server (e.g. jfrog artifactory) in the lab to mirror or cache the files that LAVA test jobs need. Once we have a cache/mirror server set, the test plan should be updated to download file from mirror/cache server instead of the original S3 server. A local mirror/cache server will improve both reliability and speed of CI.
Regards, Jammy
On Mon, 12 Apr 2021 at 17:34, Dave Pigott dave.pigott@linaro.org wrote: Hi Yinsi,
I had to offline the worker over the weekend because the download speed was making jobs fail due to timeouts cloning and wgetting
Not much we as the lab team can do about that.
Dave
On 9 Apr 2021, at 15:19, liuyinsi@163.com wrote:
Hi All,
It's great to collaborate. :)
Thank you all.
Yinsi
liuyinsi 邮箱:liuyinsi@163.com 签名由 网易邮箱大师 定制 On 04/09/2021 19:52, Luca Di Stefano wrote: Hi All, Thank you Yinsi for all the support. Just as a note, to have a working setup for LAVA dispatcher through docker-compose both the backported kernel fix and the Qemu version from debian backports repo were needed in order to achieve this. Thank you all. Luca
On 09/04/2021 12:46, Dave Pigott wrote: Okay - great news. The Kungpen server is now online and the qemu devices are passing their health checks and now processing jobs.
Thank you all!
Dave
On 9 Apr 2021, at 04:57, liuyinsi@163.com wrote:
OK,done. Please try to login.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com 签名由 网易邮箱大师 定制 On 04/08/2021 20:06, Luca Di Stefano wrote: Hi Yinsi, Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are: - 51.148.40.18 - 51.148.40.7 - 51.148.40.11 Thank you. Luca
On 08/04/2021 13:02, Dave Pigott wrote: Hi Yinsi,
The Lab IP is 51.148.40.1
Thanks
Dave
On 8 Apr 2021, at 12:30, liuyinsi@163.com wrote:
Hi Dave/Anmar,
The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com 签名由 网易邮箱大师 定制 On 04/07/2021 18:21, Dave Pigott wrote: Hi Yinsi,
We can no longer ssh to the server. Can you resolve this please?
Thanks
Dave
On 7 Apr 2021, at 10:17, liuyinsi@163.com wrote:
Ok,done. Please try to test QEMU again.
Thanks Yinsi
On 04/01/2021 20:57, Anmar Oueja wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com wrote: Ok, I have backported the fix to 5.10.
Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3
Sanity testing at my end shows it working. Please try and let me know.
Thanks Shmeer.
On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.
Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.
anmar
From: Jonathan Cameron Sent: 19 March 2021 09:13 To: liuyinsi@163.com; jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: RE: Re: Issues with docker on OpenEulerOS
We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.
Thanks,
Jonathan
From: liuyinsi@163.com [mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: jammy.zhou@linaro.org; Jonathan Cameron jonathan.cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: Re: Re: Issues with docker on OpenEulerOS
@Jammy,
Our dailybuild already make v5.10 for openEuler 21.03.
@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.
Thanks Yinsi liuyinsi@163.com
From: Jammy Zhou Date: 2021-03-19 08:29 To: Jonathan Cameron; Guohanjun (Hanjun Guo) CC: Dave Pigott; liuyinsi; Anmar Oueja; Luca Di Stefano; wufengguang; lkq-dev; Shameerali Kolothum Thodi Subject: Re: Issues with docker on OpenEulerOS +Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron Jonathan.Cameron@huawei.com wrote: @yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
> > Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > vi ~/.gitconfig
[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar
liuyinsi 邮箱:liuyinsi@163.com 签名由 网易邮箱大师 定制
Hi Dave,
Fix git clone failed: Please try to use http://gitee.com/liu-yinsi/test-definitions,
it's a mirror of http://github.com/Linaro/test-definitions, and it will update automatically once a day.
Thanks Yinsi
liuyinsi@163.com
From: Dave Pigott Date: 2021-04-13 17:39 To: Jammy Zhou CC: liuyinsi; Luca Di Stefano; Anmar Oueja; Shameerali Kolothum Thodi; wufengguang; Guohanjun (Hanjun Guo); Jonathan Cameron; lkq-dev; Chase Qi Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,
This is all good - not sure what, if anything, the Lab can do to fix these problems. This would appear to be a CI/Front end issue.
Thanks
Dave
On 13 Apr 2021, at 03:07, Jammy Zhou jammy.zhou@linaro.org wrote:
I checked with Chase who has good experience of LAVA in China. It looks like a cache/mirror server is helpful in this context.
The download speed from S3 often is a problem for China. We may need to setup a mirror/cache server (e.g. jfrog artifactory) in the lab to mirror or cache the files that LAVA test jobs need. Once we have a cache/mirror server set, the test plan should be updated to download file from mirror/cache server instead of the original S3 server. A local mirror/cache server will improve both reliability and speed of CI.
Regards, Jammy
On Mon, 12 Apr 2021 at 17:34, Dave Pigott dave.pigott@linaro.org wrote:
Hi Yinsi,
I had to offline the worker over the weekend because the download speed was making jobs fail due to timeouts cloning and wgetting
Not much we as the lab team can do about that.
Dave
On 9 Apr 2021, at 15:19, liuyinsi@163.com wrote:
Hi All,
It's great to collaborate. :)
Thank you all.
Yinsi
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
On 04/09/2021 19:52, Luca Di Stefano wrote:
Hi All,
Thank you Yinsi for all the support.
Just as a note, to have a working setup for LAVA dispatcher through docker-compose both the backported kernel fix and the Qemu version from debian backports repo were needed in order to achieve this.
Thank you all.
Luca
On 09/04/2021 12:46, Dave Pigott wrote:
Okay - great news. The Kungpen server is now online and the qemu devices are passing their health checks and now processing jobs.
Thank you all!
Dave
On 9 Apr 2021, at 04:57, liuyinsi@163.com wrote:
OK,done. Please try to login.
Thanks Yinsi
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
On 04/08/2021 20:06, Luca Di Stefano wrote:
Hi Yinsi,
Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are:
- 51.148.40.18
- 51.148.40.7
- 51.148.40.11
Thank you.
Luca
On 08/04/2021 13:02, Dave Pigott wrote:
Hi Yinsi,
The Lab IP is 51.148.40.1
Thanks
Dave
On 8 Apr 2021, at 12:30, liuyinsi@163.com wrote:
Hi Dave/Anmar,
The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.
Thanks Yinsi
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
On 04/07/2021 18:21, Dave Pigott wrote: Hi Yinsi,
We can no longer ssh to the server. Can you resolve this please?
Thanks
Dave
On 7 Apr 2021, at 10:17, liuyinsi@163.com wrote:
Ok,done. Please try to test QEMU again.
Thanks Yinsi
On 04/01/2021 20:57, Anmar Oueja wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com wrote: Ok, I have backported the fix to 5.10.
Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3
Sanity testing at my end shows it working. Please try and let me know.
Thanks Shmeer.
On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.
Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.
anmar
From: Jonathan Cameron Sent: 19 March 2021 09:13 To:liuyinsi@163.com; jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: RE: Re: Issues with docker on OpenEulerOS
We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.
Thanks,
Jonathan
From:liuyinsi@163.com [mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To:jammy.zhou@linaro.org; Jonathan Cameron jonathan.cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: Re: Re: Issues with docker on OpenEulerOS
@Jammy,
Our dailybuild already make v5.10 for openEuler 21.03.
@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.
Thanks Yinsi liuyinsi@163.com
From: Jammy Zhou Date: 2021-03-19 08:29 To: Jonathan Cameron; Guohanjun (Hanjun Guo) CC: Dave Pigott; liuyinsi; Anmar Oueja; Luca Di Stefano; wufengguang; lkq-dev; Shameerali Kolothum Thodi Subject: Re: Issues with docker on OpenEulerOS +Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron Jonathan.Cameron@huawei.com wrote: @yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com
From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com
From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
> > Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > vi ~/.gitconfig
[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar
| | liuyinsi | | 邮箱:liuyinsi@163.com |
签名由 网易邮箱大师 定制
Hi Yinsi,
The trouble with this is we would have to change the test definitions for the Kungpen server - which would make life complicated for the CI front end because when a job is submitted LAVA scheduler just picks then first available device. You never know which worker it’s going to end up on.
Dave
On 30 Apr 2021, at 09:14, liuyinsi@163.com wrote:
Hi Dave,
Fix git clone failed: Please try to use http://gitee.com/liu-yinsi/test-definitions http://gitee.com/liu-yinsi/test-definitions, it's a mirror of http://github.com/Linaro/test-definitions, http://github.com/Linaro/test-definitions, and it will update automatically once a day.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-04-13 17:39 To: Jammy Zhou mailto:jammy.zhou@linaro.org CC: liuyinsi mailto:liuyinsi@163.com; Luca Di Stefano mailto:luca.distefano@linaro.org; Anmar Oueja mailto:anmar.oueja@linaro.org; Shameerali Kolothum Thodi mailto:shameerali.kolothum.thodi@huawei.com; wufengguang mailto:wufengguang@huawei.com; Guohanjun (Hanjun Guo) mailto:guohanjun@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Chase Qi mailto:chase.qi@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,
This is all good - not sure what, if anything, the Lab can do to fix these problems. This would appear to be a CI/Front end issue.
Thanks
Dave
On 13 Apr 2021, at 03:07, Jammy Zhou <jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> wrote:
I checked with Chase who has good experience of LAVA in China. It looks like a cache/mirror server is helpful in this context.
The download speed from S3 often is a problem for China. We may need to setup a mirror/cache server (e.g. jfrog artifactory) in the lab to mirror or cache the files that LAVA test jobs need. Once we have a cache/mirror server set, the test plan should be updated to download file from mirror/cache server instead of the original S3 server. A local mirror/cache server will improve both reliability and speed of CI.
Regards, Jammy
On Mon, 12 Apr 2021 at 17:34, Dave Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: Hi Yinsi,
I had to offline the worker over the weekend because the download speed was making jobs fail due to timeouts cloning and wgetting
Not much we as the lab team can do about that.
Dave
On 9 Apr 2021, at 15:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi All,
It's great to collaborate. :)
Thank you all.
Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制 On 04/09/2021 19:52, Luca Di Stefano mailto:luca.distefano@linaro.org wrote: Hi All, Thank you Yinsi for all the support. Just as a note, to have a working setup for LAVA dispatcher through docker-compose both the backported kernel fix and the Qemu version from debian backports repo were needed in order to achieve this. Thank you all. Luca
On 09/04/2021 12:46, Dave Pigott wrote:
Okay - great news. The Kungpen server is now online and the qemu devices are passing their health checks and now processing jobs.
Thank you all!
Dave
On 9 Apr 2021, at 04:57, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
OK,done. Please try to login.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制 On 04/08/2021 20:06, Luca Di Stefano mailto:luca.distefano@linaro.org wrote: Hi Yinsi, Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are:
- 51.148.40.18
- 51.148.40.7
- 51.148.40.11
Thank you. Luca
On 08/04/2021 13:02, Dave Pigott wrote:
Hi Yinsi,
The Lab IP is 51.148.40.1
Thanks
Dave
> On 8 Apr 2021, at 12:30, liuyinsi@163.com mailto:liuyinsi@163.com wrote: > > Hi Dave/Anmar, > > The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist. > > Thanks > Yinsi > > > > > liuyinsi > 邮箱:liuyinsi@163.com > https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制 > On 04/07/2021 18:21, Dave Pigott mailto:dave.pigott@linaro.org wrote: > Hi Yinsi, > > We can no longer ssh to the server. Can you resolve this please? > > Thanks > > Dave > >> On 7 Apr 2021, at 10:17, liuyinsi@163.com mailto:liuyinsi@163.com wrote: >> >> >> Ok,done. Please try to test QEMU again. >> >> Thanks >> Yinsi >> >> >> >> >> On 04/01/2021 20:57, Anmar Oueja mailto:anmar.oueja@linaro.org wrote: >> On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> wrote: >> Ok, I have backported the fix to 5.10. >> >> Please find the patches here, >> https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 >> >> Sanity testing at my end shows it working. Please try and let me know. >> >> Thanks Shmeer. >> >> On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix. >> >> Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help. >> >> anmar >> >> From: Jonathan Cameron >> Sent: 19 March 2021 09:13 >> To: liuyinsi@163.com mailto:liuyinsi@163.com; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> >> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> >> Subject: RE: Re: Issues with docker on OpenEulerOS >> >> We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. >> @Shameer, let us know if you hit any problems. >> >> Thanks, >> >> Jonathan >> >> >> From: liuyinsi@163.com mailto:liuyinsi@163.com [mailto:liuyinsi@163.com mailto:liuyinsi@163.com] >> Sent: 19 March 2021 08:29 >> To: jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Jonathan Cameron <jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> >> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> >> Subject: Re: Re: Issues with docker on OpenEulerOS >> >> @Jammy, >> >> Our dailybuild already make v5.10 for openEuler 21.03. >> >> @Dave >> The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, >> the previously running container has stopped. >> >> Thanks >> Yinsi >> liuyinsi@163.com mailto:liuyinsi@163.com >> >> From: Jammy Zhou mailto:jammy.zhou@linaro.org >> Date: 2021-03-19 08:29 >> To: Jonathan Cameron mailto:Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo) mailto:guohanjun@huawei.com >> CC: Dave Pigott mailto:dave.pigott@linaro.org; liuyinsi mailto:liuyinsi@163.com; Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi mailto:shameerali.kolothum.thodi@huawei.com >> Subject: Re: Issues with docker on OpenEulerOS >> +Hanjun >> >> As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19. >> >> On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <Jonathan.Cameron@huawei.com mailto:Jonathan.Cameron@huawei.com> wrote: >> @yinsi >> >> What are chances of upgrading the host os to a more recent openEuler kernel. >> 4.19 is a bit of a stretch for a backport of the fix. >> I guess it might be easy, but would feel more comfortable with 5.10 or 5.5 >> >> Or can we ask openEuler to carry a backport of this set directly? >> >> Another alternative is to see if there is an available BIOS with the fix >> in place and upgrade. >> >> Jonathan >> >> On Thu, 18 Mar 2021 13:38:28 +0000 >> Dave Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: >> >> > Hi Yinsi, >> > >> > Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this. >> > >> > Thanks for your help! >> > >> > Dave >> > >> > > On 18 Mar 2021, at 12:11, liuyinsi@163.com mailto:liuyinsi@163.com wrote: >> > > >> > > Hi Dave, >> > > >> > > I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work. >> > > >> > > Thanks >> > > Yinsi >> > > >> > > >> > > >> > > liuyinsi >> > > 邮箱:liuyinsi@163.com mailto:liuyinsi@163.com >> > > <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制 >> > > >> > > On 03/18/2021 19:47, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: >> > > Hi Yinsi, >> > > >> > > It’s lavasoftware/lava-dispatcher:2021.03 >> > > >> > > Dave >> > > >> > >> On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: >> > >> >> > >> Hi Dave, >> > >> >> > >> What is the docker images name you want to pull from dockerhub? >> > >> >> > >> Thanks >> > >> Yinsi >> > >> >> > >> >> > >> >> > >> >> > >> >> > >> >> > >> liuyinsi >> > >> 邮箱:liuyinsi@163.com mailto:liuyinsi@163.com >> > >> <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制 >> > >> >> > >> On 03/18/2021 19:28, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: >> > >> Hi Yinsi, >> > >> >> > >> We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas? >> > >> >> > >> Thanks >> > >> >> > >> Dave >> > >> >> > >> >> > >>> On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: >> > >>> >> > >>> Hi Dave, >> > >>> >> > >>> I notice the job 2313644 <https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64<http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64> on openEulerOS machine is ok, first download speed about 2.63MB/s. >> > >>> >> > >>> It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries. >> > >>> >> > >>> Thanks >> > >>> Yinsi >> > >>> >> > >>> liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> >> > >>> >> > >>> From: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> >> > >>> Date: 2021-03-18 17:04 >> > >>> To: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> >> > >>> CC: Anmar Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Jonathan Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> >> > >>> Subject: Re: Issues with docker on OpenEulerOS >> > >>> Hi Yinsi, >> > >>> >> > >>> If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644<https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> - you’ll see it’s not failing on a git clone, it’s failing on a wget. >> > >>> >> > >>> Dave >> > >>> >> > >>> >> > >>>> On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: >> > >>>> >> > >>>> Hi Dave, >> > >>>> >> > >>>> "http download timeout", does it happen often? >> > >>>> "https download timeout", has this problem been solved by edit ~/.gitconfig? >> > >>>> >> > >>>> Thanks >> > >>>> Yinsi >> > >>>> >> > >>>> liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> >> > >>>> >> > >>>> From: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> >> > >>>> Date: 2021-03-17 10:19 >> > >>>> To: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> >> > >>>> CC: Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; luca <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> >> > >>>> Subject: Re: Re: Issues with docker on OpenEulerOS >> > >>>> >> > >>>> >> > >>>>>> >> > >>>>>> Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. >> > >>>>>> >> > >>>>> vi ~/.gitconfig >> > >>>>> >> > >>>>> [url "git://github.com http://github.com/ <git://github.com http://github.com/>"] >> > >>>>> insteadOf = https://github.com https://github.com/ <https://github.com/ https://github.com/> >> > >>>>> >> > >>>>> This will change from https to git. >> > >>>>> >> > >>>> >> > >>>> Hi Yinsi, >> > >>>> >> > >>>> If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40<https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40>, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git. >> > >>>> >> > >>>> Hi Dave, >> > >>>> >> > >>>> You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, >> > >>>> then it will automatically change https to git. >> > >>>> >> > >>>> Thanks >> > >>>> Yinsi >> > >>>> >> > >>>> Dave >> > >>>>>> >> > >>>>>> >> > >>>>>> >> > >>>>>> Thanks >> > >>>>>> >> > >>>>>> Dave >> > >>>>>> >> > >>>>>> >> > >>>>>>>>> >> > >>>>>>>>> >> > >>>>>>>>> anmar >> > >> >> > > >> > >> > >> >> liuyinsi >> 邮箱:liuyinsi@163.com >> https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
Hi Dave,
Do you mean LAVA scheduler couldn't pick the device to consume the job? If scheduler couldn't pick device, it's too simple and strange, a job will run on any device, whether x86_64 or aarch64, Kunpeng or other server.
Thanks Yinsi
liuyinsi@163.com
From: Dave Pigott Date: 2021-04-30 18:11 To: liuyinsi@163.com CC: Luca Di Stefano; Anmar Oueja; wufengguang; Jonathan Cameron; lkq-dev; Chase Qi; jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
The trouble with this is we would have to change the test definitions for the Kungpen server - which would make life complicated for the CI front end because when a job is submitted LAVA scheduler just picks then first available device. You never know which worker it’s going to end up on.
Dave
On 30 Apr 2021, at 09:14, liuyinsi@163.com wrote:
Hi Dave,
Fix git clone failed: Please try to use http://gitee.com/liu-yinsi/test-definitions, it's a mirror of http://github.com/Linaro/test-definitions, and it will update automatically once a day.
Thanks Yinsi
liuyinsi@163.com
From: Dave Pigott Date: 2021-04-13 17:39 To: Jammy Zhou CC: liuyinsi; Luca Di Stefano; Anmar Oueja; Shameerali Kolothum Thodi; wufengguang; Guohanjun (Hanjun Guo); Jonathan Cameron; lkq-dev; Chase Qi Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,
This is all good - not sure what, if anything, the Lab can do to fix these problems. This would appear to be a CI/Front end issue.
Thanks
Dave
On 13 Apr 2021, at 03:07, Jammy Zhou jammy.zhou@linaro.org wrote:
I checked with Chase who has good experience of LAVA in China. It looks like a cache/mirror server is helpful in this context.
The download speed from S3 often is a problem for China. We may need to setup a mirror/cache server (e.g. jfrog artifactory) in the lab to mirror or cache the files that LAVA test jobs need. Once we have a cache/mirror server set, the test plan should be updated to download file from mirror/cache server instead of the original S3 server. A local mirror/cache server will improve both reliability and speed of CI.
Regards, Jammy
On Mon, 12 Apr 2021 at 17:34, Dave Pigott dave.pigott@linaro.org wrote: Hi Yinsi,
I had to offline the worker over the weekend because the download speed was making jobs fail due to timeouts cloning and wgetting
Not much we as the lab team can do about that.
Dave
On 9 Apr 2021, at 15:19, liuyinsi@163.com wrote:
Hi All,
It's great to collaborate. :)
Thank you all.
Yinsi
liuyinsi 邮箱:liuyinsi@163.com 签名由 网易邮箱大师 定制 On 04/09/2021 19:52, Luca Di Stefano wrote: Hi All, Thank you Yinsi for all the support. Just as a note, to have a working setup for LAVA dispatcher through docker-compose both the backported kernel fix and the Qemu version from debian backports repo were needed in order to achieve this. Thank you all. Luca
On 09/04/2021 12:46, Dave Pigott wrote: Okay - great news. The Kungpen server is now online and the qemu devices are passing their health checks and now processing jobs.
Thank you all!
Dave
On 9 Apr 2021, at 04:57, liuyinsi@163.com wrote:
OK,done. Please try to login.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com 签名由 网易邮箱大师 定制 On 04/08/2021 20:06, Luca Di Stefano wrote: Hi Yinsi, Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are: - 51.148.40.18 - 51.148.40.7 - 51.148.40.11 Thank you. Luca
On 08/04/2021 13:02, Dave Pigott wrote: Hi Yinsi,
The Lab IP is 51.148.40.1
Thanks
Dave
On 8 Apr 2021, at 12:30, liuyinsi@163.com wrote:
Hi Dave/Anmar,
The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com 签名由 网易邮箱大师 定制 On 04/07/2021 18:21, Dave Pigott wrote: Hi Yinsi,
We can no longer ssh to the server. Can you resolve this please?
Thanks
Dave
On 7 Apr 2021, at 10:17, liuyinsi@163.com wrote:
Ok,done. Please try to test QEMU again.
Thanks Yinsi
On 04/01/2021 20:57, Anmar Oueja wrote: On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com wrote: Ok, I have backported the fix to 5.10.
Please find the patches here, https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3
Sanity testing at my end shows it working. Please try and let me know.
Thanks Shmeer.
On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix.
Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help.
anmar
From: Jonathan Cameron Sent: 19 March 2021 09:13 To: liuyinsi@163.com; jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: RE: Re: Issues with docker on OpenEulerOS
We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. @Shameer, let us know if you hit any problems.
Thanks,
Jonathan
From: liuyinsi@163.com [mailto:liuyinsi@163.com] Sent: 19 March 2021 08:29 To: jammy.zhou@linaro.org; Jonathan Cameron jonathan.cameron@huawei.com; Guohanjun (Hanjun Guo) guohanjun@huawei.com; Pigott dave.pigott@linaro.org Cc: Anmar Oueja anmar.oueja@linaro.org; Luca Di Stefano luca.distefano@linaro.org; wufengguang wufengguang@huawei.com; lkq-dev lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi shameerali.kolothum.thodi@huawei.com Subject: Re: Re: Issues with docker on OpenEulerOS
@Jammy,
Our dailybuild already make v5.10 for openEuler 21.03.
@Dave The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, the previously running container has stopped.
Thanks Yinsi liuyinsi@163.com
From: Jammy Zhou Date: 2021-03-19 08:29 To: Jonathan Cameron; Guohanjun (Hanjun Guo) CC: Dave Pigott; liuyinsi; Anmar Oueja; Luca Di Stefano; wufengguang; lkq-dev; Shameerali Kolothum Thodi Subject: Re: Issues with docker on OpenEulerOS +Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron Jonathan.Cameron@huawei.com wrote: @yinsi
What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5
Or can we ask openEuler to carry a backport of this set directly?
Another alternative is to see if there is an available BIOS with the fix in place and upgrade.
Jonathan
On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott dave.pigott@linaro.org wrote:
Hi Yinsi,
Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this.
Thanks for your help!
Dave
On 18 Mar 2021, at 12:11, liuyinsi@163.com wrote:
Hi Dave,
I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:47, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
It’s lavasoftware/lava-dispatcher:2021.03
Dave
On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
What is the docker images name you want to pull from dockerhub?
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
On 03/18/2021 19:28, Dave Pigott mailto:dave.pigott@linaro.org wrote: Hi Yinsi,
We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas?
Thanks
Dave
On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
I notice the job 2313644 https://lkft.validation.linaro.org/scheduler/job/2313644 is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta...http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 on openEulerOS machine is ok, first download speed about 2.63MB/s.
It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-03-18 17:04 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644https://lkft.validation.linaro.org/scheduler/job/2313644 - you’ll see it’s not failing on a git clone, it’s failing on a wget.
Dave
On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
"http download timeout", does it happen often? "https download timeout", has this problem been solved by edit ~/.gitconfig?
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: liuyinsi@163.com mailto:liuyinsi@163.com Date: 2021-03-17 10:19 To: Dave Pigott mailto:dave.pigott@linaro.org CC: Oueja mailto:anmar.oueja@linaro.org; luca mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Re: Issues with docker on OpenEulerOS
> > Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > vi ~/.gitconfig
[url "git://github.com git://github.com"] insteadOf = https://github.com https://github.com/
This will change from https to git.
Hi Yinsi,
If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4...https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git.
Hi Dave,
You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, then it will automatically change https to git.
Thanks Yinsi
Dave
> > > > Thanks > > Dave > > >>>> >>>> >>>> anmar
liuyinsi 邮箱:liuyinsi@163.com 签名由 网易邮箱大师 定制
Hi Yinsi,
No, that’s not the way the LAVA scheduler and job descriptions work.
When you submit a job the job specifies the device type, in this case qemu-arm. The scheduler then finds the first non-busy qemu-arm device and dispatches it to that device, regardless of which worker it’s on. The job specifies where to get all the job artefacts. The scheduler knows only about the device type - it can’t rewrite the job specification to choose a different source for the artefacts.
Dave
On 30 Apr 2021, at 11:59, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
Do you mean LAVA scheduler couldn't pick the device to consume the job? If scheduler couldn't pick device, it's too simple and strange, a job will run on any device, whether x86_64 or aarch64, Kunpeng or other server.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-04-30 18:11 To: liuyinsi@163.com mailto:liuyinsi@163.com CC: Luca Di Stefano mailto:luca.distefano@linaro.org; Anmar Oueja mailto:anmar.oueja@linaro.org; wufengguang mailto:wufengguang@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Chase Qi mailto:chase.qi@linaro.org; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Yinsi,
The trouble with this is we would have to change the test definitions for the Kungpen server - which would make life complicated for the CI front end because when a job is submitted LAVA scheduler just picks then first available device. You never know which worker it’s going to end up on.
Dave
On 30 Apr 2021, at 09:14, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi Dave,
Fix git clone failed: Please try to use http://gitee.com/liu-yinsi/test-definitions http://gitee.com/liu-yinsi/test-definitions, it's a mirror of http://github.com/Linaro/test-definitions, http://github.com/Linaro/test-definitions, and it will update automatically once a day.
Thanks Yinsi
liuyinsi@163.com mailto:liuyinsi@163.com From: Dave Pigott mailto:dave.pigott@linaro.org Date: 2021-04-13 17:39 To: Jammy Zhou mailto:jammy.zhou@linaro.org CC: liuyinsi mailto:liuyinsi@163.com; Luca Di Stefano mailto:luca.distefano@linaro.org; Anmar Oueja mailto:anmar.oueja@linaro.org; Shameerali Kolothum Thodi mailto:shameerali.kolothum.thodi@huawei.com; wufengguang mailto:wufengguang@huawei.com; Guohanjun (Hanjun Guo) mailto:guohanjun@huawei.com; Jonathan Cameron mailto:jonathan.cameron@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Chase Qi mailto:chase.qi@linaro.org Subject: Re: Issues with docker on OpenEulerOS Hi Jammy,
This is all good - not sure what, if anything, the Lab can do to fix these problems. This would appear to be a CI/Front end issue.
Thanks
Dave
On 13 Apr 2021, at 03:07, Jammy Zhou <jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> wrote:
I checked with Chase who has good experience of LAVA in China. It looks like a cache/mirror server is helpful in this context.
The download speed from S3 often is a problem for China. We may need to setup a mirror/cache server (e.g. jfrog artifactory) in the lab to mirror or cache the files that LAVA test jobs need. Once we have a cache/mirror server set, the test plan should be updated to download file from mirror/cache server instead of the original S3 server. A local mirror/cache server will improve both reliability and speed of CI.
Regards, Jammy
On Mon, 12 Apr 2021 at 17:34, Dave Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: Hi Yinsi,
I had to offline the worker over the weekend because the download speed was making jobs fail due to timeouts cloning and wgetting
Not much we as the lab team can do about that.
Dave
On 9 Apr 2021, at 15:19, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
Hi All,
It's great to collaborate. :)
Thank you all.
Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制 On 04/09/2021 19:52, Luca Di Stefano mailto:luca.distefano@linaro.org wrote: Hi All, Thank you Yinsi for all the support. Just as a note, to have a working setup for LAVA dispatcher through docker-compose both the backported kernel fix and the Qemu version from debian backports repo were needed in order to achieve this. Thank you all. Luca
On 09/04/2021 12:46, Dave Pigott wrote:
Okay - great news. The Kungpen server is now online and the qemu devices are passing their health checks and now processing jobs.
Thank you all!
Dave
On 9 Apr 2021, at 04:57, liuyinsi@163.com mailto:liuyinsi@163.com wrote:
OK,done. Please try to login.
Thanks Yinsi
liuyinsi 邮箱:liuyinsi@163.com https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制 On 04/08/2021 20:06, Luca Di Stefano mailto:luca.distefano@linaro.org wrote: Hi Yinsi, Other IP addresses that are relevant to the LAVA lab in addition to what Dave already said are:
- 51.148.40.18
- 51.148.40.7
- 51.148.40.11
Thank you. Luca
On 08/04/2021 13:02, Dave Pigott wrote: > Hi Yinsi, > > The Lab IP is 51.148.40.1 > > Thanks > > Dave > > >> On 8 Apr 2021, at 12:30, liuyinsi@163.com mailto:liuyinsi@163.com wrote: >> >> Hi Dave/Anmar, >> >> The firewall is enabled for some reasons. Please send your public IP address to me, i need to add your public IP address to the trustlist. >> >> Thanks >> Yinsi >> >> >> >> >> liuyinsi >> 邮箱:liuyinsi@163.com >> https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制 >> On 04/07/2021 18:21, Dave Pigott mailto:dave.pigott@linaro.org wrote: >> Hi Yinsi, >> >> We can no longer ssh to the server. Can you resolve this please? >> >> Thanks >> >> Dave >> >>> On 7 Apr 2021, at 10:17, liuyinsi@163.com mailto:liuyinsi@163.com wrote: >>> >>> >>> Ok,done. Please try to test QEMU again. >>> >>> Thanks >>> Yinsi >>> >>> >>> >>> >>> On 04/01/2021 20:57, Anmar Oueja mailto:anmar.oueja@linaro.org wrote: >>> On Fri, Mar 19, 2021 at 12:26 PM Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> wrote: >>> Ok, I have backported the fix to 5.10. >>> >>> Please find the patches here, >>> https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 https://github.com/hisilicon/kernel-dev/commits/private-v5.10-GICv2-on-v3 >>> >>> Sanity testing at my end shows it working. Please try and let me know. >>> >>> Thanks Shmeer. >>> >>> On our side, we tried the newest stable version of QEMU and it didn't work unfortunately. The only way to fix this is either deploying the kernel above or a firmware fix. >>> >>> Yinsi: Are you able to build and install the kernel in the above tree? Hanjun of Fengguang might be able to help. >>> >>> anmar >>> >>> From: Jonathan Cameron >>> Sent: 19 March 2021 09:13 >>> To: liuyinsi@163.com mailto:liuyinsi@163.com; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> >>> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> >>> Subject: RE: Re: Issues with docker on OpenEulerOS >>> >>> We’ll still need the backport as I think the fix only went in during 5.11 but hopefully not to major. >>> @Shameer, let us know if you hit any problems. >>> >>> Thanks, >>> >>> Jonathan >>> >>> >>> From: liuyinsi@163.com mailto:liuyinsi@163.com [mailto:liuyinsi@163.com mailto:liuyinsi@163.com] >>> Sent: 19 March 2021 08:29 >>> To: jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org; Jonathan Cameron <jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; Guohanjun (Hanjun Guo) <guohanjun@huawei.com mailto:guohanjun@huawei.com>; Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> >>> Cc: Anmar Oueja <anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <wufengguang@huawei.com mailto:wufengguang@huawei.com>; lkq-dev <lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; Shameerali Kolothum Thodi <shameerali.kolothum.thodi@huawei.com mailto:shameerali.kolothum.thodi@huawei.com> >>> Subject: Re: Re: Issues with docker on OpenEulerOS >>> >>> @Jammy, >>> >>> Our dailybuild already make v5.10 for openEuler 21.03. >>> >>> @Dave >>> The openeuler OS host kernel has been updated to v5.10, because I have restarted the host, >>> the previously running container has stopped. >>> >>> Thanks >>> Yinsi >>> liuyinsi@163.com mailto:liuyinsi@163.com >>> >>> From: Jammy Zhou mailto:jammy.zhou@linaro.org >>> Date: 2021-03-19 08:29 >>> To: Jonathan Cameron mailto:Jonathan.Cameron@huawei.com; Guohanjun (Hanjun Guo) mailto:guohanjun@huawei.com >>> CC: Dave Pigott mailto:dave.pigott@linaro.org; liuyinsi mailto:liuyinsi@163.com; Anmar Oueja mailto:anmar.oueja@linaro.org; Luca Di Stefano mailto:luca.distefano@linaro.org; wufengguang mailto:wufengguang@huawei.com; lkq-dev mailto:lkq-dev@op-lists.linaro.org; Shameerali Kolothum Thodi mailto:shameerali.kolothum.thodi@huawei.com >>> Subject: Re: Issues with docker on OpenEulerOS >>> +Hanjun >>> >>> As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19. >>> >>> On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <Jonathan.Cameron@huawei.com mailto:Jonathan.Cameron@huawei.com> wrote: >>> @yinsi >>> >>> What are chances of upgrading the host os to a more recent openEuler kernel. >>> 4.19 is a bit of a stretch for a backport of the fix. >>> I guess it might be easy, but would feel more comfortable with 5.10 or 5.5 >>> >>> Or can we ask openEuler to carry a backport of this set directly? >>> >>> Another alternative is to see if there is an available BIOS with the fix >>> in place and upgrade. >>> >>> Jonathan >>> >>> On Thu, 18 Mar 2021 13:38:28 +0000 >>> Dave Pigott <dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: >>> >>> > Hi Yinsi, >>> > >>> > Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this. >>> > >>> > Thanks for your help! >>> > >>> > Dave >>> > >>> > > On 18 Mar 2021, at 12:11, liuyinsi@163.com mailto:liuyinsi@163.com wrote: >>> > > >>> > > Hi Dave, >>> > > >>> > > I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work. >>> > > >>> > > Thanks >>> > > Yinsi >>> > > >>> > > >>> > > >>> > > liuyinsi >>> > > 邮箱:liuyinsi@163.com mailto:liuyinsi@163.com >>> > > <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制 >>> > > >>> > > On 03/18/2021 19:47, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: >>> > > Hi Yinsi, >>> > > >>> > > It’s lavasoftware/lava-dispatcher:2021.03 >>> > > >>> > > Dave >>> > > >>> > >> On 18 Mar 2021, at 11:44, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: >>> > >> >>> > >> Hi Dave, >>> > >> >>> > >> What is the docker images name you want to pull from dockerhub? >>> > >> >>> > >> Thanks >>> > >> Yinsi >>> > >> >>> > >> >>> > >> >>> > >> >>> > >> >>> > >> >>> > >> liuyinsi >>> > >> 邮箱:liuyinsi@163.com mailto:liuyinsi@163.com >>> > >> <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&am... https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail88 https://mail.163.com/dashi/dlpro.html?from=mail88> 定制 >>> > >> >>> > >> On 03/18/2021 19:28, Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> wrote: >>> > >> Hi Yinsi, >>> > >> >>> > >> We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas? >>> > >> >>> > >> Thanks >>> > >> >>> > >> Dave >>> > >> >>> > >> >>> > >>> On 18 Mar 2021, at 10:47, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: >>> > >>> >>> > >>> Hi Dave, >>> > >>> >>> > >>> I notice the job 2313644 <https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64<http://images.validation.linaro.org/snapshots.linaro.org/components/lava/sta... http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64> on openEulerOS machine is ok, first download speed about 2.63MB/s. >>> > >>> >>> > >>> It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries. >>> > >>> >>> > >>> Thanks >>> > >>> Yinsi >>> > >>> >>> > >>> liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> >>> > >>> >>> > >>> From: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> >>> > >>> Date: 2021-03-18 17:04 >>> > >>> To: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> >>> > >>> CC: Anmar Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; Luca Di Stefano <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Jonathan Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> >>> > >>> Subject: Re: Issues with docker on OpenEulerOS >>> > >>> Hi Yinsi, >>> > >>> >>> > >>> If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644<https://lkft.validation.linaro.org/scheduler/job/2313644 https://lkft.validation.linaro.org/scheduler/job/2313644> - you’ll see it’s not failing on a git clone, it’s failing on a wget. >>> > >>> >>> > >>> Dave >>> > >>> >>> > >>> >>> > >>>> On 18 Mar 2021, at 08:19, liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> wrote: >>> > >>>> >>> > >>>> Hi Dave, >>> > >>>> >>> > >>>> "http download timeout", does it happen often? >>> > >>>> "https download timeout", has this problem been solved by edit ~/.gitconfig? >>> > >>>> >>> > >>>> Thanks >>> > >>>> Yinsi >>> > >>>> >>> > >>>> liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> >>> > >>>> >>> > >>>> From: liuyinsi@163.com mailto:liuyinsi@163.com <mailto:liuyinsi@163.com mailto:liuyinsi@163.com> >>> > >>>> Date: 2021-03-17 10:19 >>> > >>>> To: Dave Pigott <mailto:dave.pigott@linaro.org mailto:dave.pigott@linaro.org> >>> > >>>> CC: Oueja <mailto:anmar.oueja@linaro.org mailto:anmar.oueja@linaro.org>; luca <mailto:luca.distefano@linaro.org mailto:luca.distefano@linaro.org>; wufengguang <mailto:wufengguang@huawei.com mailto:wufengguang@huawei.com>; Cameron <mailto:jonathan.cameron@huawei.com mailto:jonathan.cameron@huawei.com>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org mailto:lkq-dev@op-lists.linaro.org>; jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org mailto:jammy.zhou@linaro.org> >>> > >>>> Subject: Re: Re: Issues with docker on OpenEulerOS >>> > >>>> >>> > >>>> >>> > >>>>>> >>> > >>>>>> Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. >>> > >>>>>> >>> > >>>>> vi ~/.gitconfig >>> > >>>>> >>> > >>>>> [url "git://github.com http://github.com/ <git://github.com http://github.com/>"] >>> > >>>>> insteadOf = https://github.com https://github.com/ <https://github.com/ https://github.com/> >>> > >>>>> >>> > >>>>> This will change from https to git. >>> > >>>>> >>> > >>>> >>> > >>>> Hi Yinsi, >>> > >>>> >>> > >>>> If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40<https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline4... https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40>, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git. >>> > >>>> >>> > >>>> Hi Dave, >>> > >>>> >>> > >>>> You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, >>> > >>>> then it will automatically change https to git. >>> > >>>> >>> > >>>> Thanks >>> > >>>> Yinsi >>> > >>>> >>> > >>>> Dave >>> > >>>>>> >>> > >>>>>> >>> > >>>>>> >>> > >>>>>> Thanks >>> > >>>>>> >>> > >>>>>> Dave >>> > >>>>>> >>> > >>>>>> >>> > >>>>>>>>> >>> > >>>>>>>>> >>> > >>>>>>>>> anmar >>> > >> >>> > > >>> > >>> > >>> >>> liuyinsi >>> 邮箱:liuyinsi@163.com >>> https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9%82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D签名由 网易邮箱大师 https://mail.163.com/dashi/dlpro.html?from=mail88 定制
Hi,
LTS will be based on 4.19 kernel, but 21.03 innovation version will use 5.10 kernel.
Thanks Hanjun
On 2021/3/19 8:29, Jammy Zhou wrote:
+Hanjun
As I know, the kernel will be based on v5.10 for openEuler 21.09, but for 21.03 and 20.03 LTS, it is still based on v4.19.
On Fri, 19 Mar 2021 at 00:33, Jonathan Cameron <Jonathan.Cameron@huawei.com mailto:Jonathan.Cameron@huawei.com> wrote:
@yinsi What are chances of upgrading the host os to a more recent openEuler kernel. 4.19 is a bit of a stretch for a backport of the fix. I guess it might be easy, but would feel more comfortable with 5.10 or 5.5 Or can we ask openEuler to carry a backport of this set directly? Another alternative is to see if there is an available BIOS with the fix in place and upgrade. Jonathan On Thu, 18 Mar 2021 13:38:28 +0000 Dave Pigott <dave.pigott@linaro.org <mailto:dave.pigott@linaro.org>> wrote: > Hi Yinsi, > > Okay - that fixed it. We’ve now got an excellent download speed. We’re back to the problems with qemu compatibility. Working on this. > > Thanks for your help! > > Dave > > > On 18 Mar 2021, at 12:11, liuyinsi@163.com <mailto:liuyinsi@163.com> wrote: > > > > Hi Dave, > > > > I pull the images in openEulerOS, though you got the message about docker pull limit, you still can pull successfully, ignore the message if not block our work. > > > > Thanks > > Yinsi > > > > > > > > liuyinsi > > 邮箱:liuyinsi@163.com <mailto:liuyinsi@163.com> > > <https://maas.mail.163.com/dashi-web-extend/html /proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com& iconUrl=https%3A%2F%2Fmail- online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9 %82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail88> 定制 > > > > On 03/18/2021 19:47, Dave Pigott <mailto:dave.pigott@linaro.org <mailto:dave.pigott@linaro.org>> wrote: > > Hi Yinsi, > > > > It’s lavasoftware/lava-dispatcher:2021.03 > > > > Dave > > > >> On 18 Mar 2021, at 11:44, liuyinsi@163.com <mailto:liuyinsi@163.com> <mailto:liuyinsi@163.com <mailto:liuyinsi@163.com>> wrote: > >> > >> Hi Dave, > >> > >> What is the docker images name you want to pull from dockerhub? > >> > >> Thanks > >> Yinsi > >> > >> > >> > >> > >> > >> > >> liuyinsi > >> 邮箱:liuyinsi@163.com <mailto:liuyinsi@163.com> > >> <https://maas.mail.163.com/dashi-web-extend/html /proSignature.html?ftlId=1&name=liuyinsi&uid=liuyinsi%40163.com& iconUrl=https%3A%2F%2Fmail- online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22%E9 %82%AE%E7%AE%B1%EF%BC%9Aliuyinsi%40163.com%22%5D>签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail88> 定制 > >> > >> On 03/18/2021 19:28, Dave Pigott <mailto:dave.pigott@linaro.org <mailto:dave.pigott@linaro.org>> wrote: > >> Hi Yinsi, > >> > >> We’re trying to upgrade the docker worker to the latest release and we got the message that we’ve hit our docker pull limit. We’ve only done two pulls. Any ideas? > >> > >> Thanks > >> > >> Dave > >> > >> > >>> On 18 Mar 2021, at 10:47, liuyinsi@163.com <mailto:liuyinsi@163.com> <mailto:liuyinsi@163.com <mailto:liuyinsi@163.com>> wrote: > >>> > >>> Hi Dave, > >>> > >>> I notice the job 2313644 <https://lkft.validation.linaro.org/scheduler/job/2313644> is created 2 weeks, 6 days ago, can you test a new job, test wget http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64 <http://images.validation.linaro.org/snapshots.linaro.org/components/lava/standard/debian/sid/arm64/2/vmlinuz-4.6.0-1-arm64> on openEulerOS machine is ok, first download speed about 2.63MB/s. > >>> > >>> It's better to improve your download code, to face unstable and slow network issues, for example, increase timeout and add retries. > >>> > >>> Thanks > >>> Yinsi > >>> > >>> liuyinsi@163.com <mailto:liuyinsi@163.com> <mailto:liuyinsi@163.com <mailto:liuyinsi@163.com>> > >>> > >>> From: Dave Pigott <mailto:dave.pigott@linaro.org <mailto:dave.pigott@linaro.org>> > >>> Date: 2021-03-18 17:04 > >>> To: liuyinsi@163.com <mailto:liuyinsi@163.com> <mailto:liuyinsi@163.com <mailto:liuyinsi@163.com>> > >>> CC: Anmar Oueja <mailto:anmar.oueja@linaro.org <mailto:anmar.oueja@linaro.org>>; Luca Di Stefano <mailto:luca.distefano@linaro.org <mailto:luca.distefano@linaro.org>>; wufengguang <mailto:wufengguang@huawei.com <mailto:wufengguang@huawei.com>>; Jonathan Cameron <mailto:jonathan.cameron@huawei.com <mailto:jonathan.cameron@huawei.com>>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org <mailto:lkq-dev@op-lists.linaro.org>>; jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org> <mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org>> > >>> Subject: Re: Issues with docker on OpenEulerOS > >>> Hi Yinsi, > >>> > >>> If you look at a failed example - e.g. https://lkft.validation.linaro.org/scheduler/job/2313644 <https://lkft.validation.linaro.org/scheduler/job/2313644> - you’ll see it’s not failing on a git clone, it’s failing on a wget. > >>> > >>> Dave > >>> > >>> > >>>> On 18 Mar 2021, at 08:19, liuyinsi@163.com <mailto:liuyinsi@163.com> <mailto:liuyinsi@163.com <mailto:liuyinsi@163.com>> wrote: > >>>> > >>>> Hi Dave, > >>>> > >>>> "http download timeout", does it happen often? > >>>> "https download timeout", has this problem been solved by edit ~/.gitconfig? > >>>> > >>>> Thanks > >>>> Yinsi > >>>> > >>>> liuyinsi@163.com <mailto:liuyinsi@163.com> <mailto:liuyinsi@163.com <mailto:liuyinsi@163.com>> > >>>> > >>>> From: liuyinsi@163.com <mailto:liuyinsi@163.com> <mailto:liuyinsi@163.com <mailto:liuyinsi@163.com>> > >>>> Date: 2021-03-17 10:19 > >>>> To: Dave Pigott <mailto:dave.pigott@linaro.org <mailto:dave.pigott@linaro.org>> > >>>> CC: Oueja <mailto:anmar.oueja@linaro.org <mailto:anmar.oueja@linaro.org>>; luca <mailto:luca.distefano@linaro.org <mailto:luca.distefano@linaro.org>>; wufengguang <mailto:wufengguang@huawei.com <mailto:wufengguang@huawei.com>>; Cameron <mailto:jonathan.cameron@huawei.com <mailto:jonathan.cameron@huawei.com>>; lkq-dev <mailto:lkq-dev@op-lists.linaro.org <mailto:lkq-dev@op-lists.linaro.org>>; jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org> <mailto:jammy.zhou@linaro.org <mailto:jammy.zhou@linaro.org>> > >>>> Subject: Re: Re: Issues with docker on OpenEulerOS > >>>> > >>>> > >>>>>> > >>>>>> Locally, in the lab, we use KissCache for https cacheing. We would have to go through every test definition submitted by every bot and developer to change from https to git. > >>>>>> > >>>>> vi ~/.gitconfig > >>>>> > >>>>> [url "git://github.com <http://github.com> <git://github.com <http://github.com>>"] > >>>>> insteadOf = https://github.com <https://github.com/> > >>>>> > >>>>> This will change from https to git. > >>>>> > >>>> > >>>> Hi Yinsi, > >>>> > >>>> If you look at the job definitions, e.g. https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40 <https://lkft.validation.linaro.org/scheduler/job/2409008/definition#defline40>, you’ll see the URL is defined there. I’m not sure where you are suggesting this could be universally changed to use git. > >>>> > >>>> Hi Dave, > >>>> > >>>> You can edit the file in any environment where you execute the clone command, for example, i get the URL and will git clone in a qemu, if i edit ~/.gitconfig in qemu before clone, > >>>> then it will automatically change https to git. > >>>> > >>>> Thanks > >>>> Yinsi > >>>> > >>>> Dave > >>>>>> > >>>>>> > >>>>>> > >>>>>> Thanks > >>>>>> > >>>>>> Dave > >>>>>> > >>>>>> > >>>>>>>>> > >>>>>>>>> > >>>>>>>>> anmar > >> > > > >