Re: [printk] 8e27473211: hwsim.ap_ft_pmf_bip_cmac_128.fail
From: Oliver Sang
Date: Thu Jun 02 2022 - 03:10:51 EST
Hi John Ogness,
On Tue, May 31, 2022 at 05:35:26PM +0206, John Ogness wrote:
> Hi Oliver,
>
> I am having great difficulties trying to reproduce this test. It seems I
> need to setup real hardware with multiple access points. Can you point
> me to some detailed documentation about preparing this test? Thanks.
we got this test suite from https://github.com/bcopeland/wmediumd. there is
a detail README there, hope it would be helpful to you.
_but_, since you mentioned it's difficult to reproduce, we did more tests,
and found this could be platform specific.
first, we queued more jobs to platform from which the original report was made,
model: Skylake
nr_cpu: 4
memory: 32G
brand: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz
and confirmed the parent is still clean, and tests still failed on 8e27473211
========================================================================================
compiler/kconfig/rootfs/tbox_group/test/testcase/ucode:
gcc-11/x86_64-rhel-8.3-func/debian-10.4-x86_64-20200603.cgz/lkp-skl-d03/group-18/hwsim/0xec
09c5ba0aa2fcfdad 8e274732115f63c1d0913628443
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:10 190% 19:20 hwsim.ap_ft_eap_cui.fail
10:10 -90% 1:20 hwsim.ap_ft_eap_cui.pass <-- just saw one pass for 8e27473211 which seems random
:10 200% 20:20 hwsim.ap_ft_many.fail
10:10 -100% :20 hwsim.ap_ft_many.pass
:10 200% 20:20 hwsim.ap_ft_pmf_bip_cmac_128.fail
10:10 -100% :20 hwsim.ap_ft_pmf_bip_cmac_128.pass
secondly, we tested on another very similar Skylake desktop platform, confirmed
similar results:
=========================================================================================
compiler/kconfig/rootfs/tbox_group/test/testcase/ucode:
gcc-11/x86_64-rhel-8.3-func/debian-10.4-x86_64-20200603.cgz/lkp-skl-d05/group-18/hwsim/0xec
09c5ba0aa2fcfdad 8e274732115f63c1d0913628443
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:3 100% 3:3 hwsim.ap_ft_eap_cui.fail
3:3 -100% :3 hwsim.ap_ft_eap_cui.pass
:3 100% 3:3 hwsim.ap_ft_many.fail
3:3 -100% :3 hwsim.ap_ft_many.pass
:3 100% 3:3 hwsim.ap_ft_pmf_bip_cmac_128.fail
3:3 -100% :3 hwsim.ap_ft_pmf_bip_cmac_128.pass
_but_, when we tested on one Ivy Bridge desktop platform:
model: Ivy Bridge
nr_node: 1
nr_cpu: 4
memory: 8G
brand: Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz
we found ap_ft_eap_cui/ap_ft_many/ap_ft_pmf_bip_cmac_128 can pass on both
8e27473211 and its parent:
=========================================================================================
compiler/kconfig/rootfs/tbox_group/test/testcase/ucode:
gcc-11/x86_64-rhel-8.3-func/debian-10.4-x86_64-20200603.cgz/lkp-ivb-d02/group-18/hwsim/0x21
09c5ba0aa2fcfdad 8e274732115f63c1d0913628443
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
3:3 0% 3:3 hwsim.ap_ft_eap_cui.pass
:3 33% 1:3 hwsim.ap_ft_many.fail <-- here is a fail, but maybe random
3:3 -33% 2:3 hwsim.ap_ft_many.pass
3:3 0% 3:3 hwsim.ap_ft_pmf_bip_cmac_128.pass
from above, the issue could be reproduced persistently on Skylake desktop
platform, but not surely for others.
hope these information could give you some hints and please request us for
further tests if you have some ideas or doubts. Thanks a lot!
>
> John Ogness
>
> On 2022-05-31, kernel test robot <oliver.sang@xxxxxxxxx> wrote:
> > (please be noted we reported
> > "[printk] 8e27473211: hwsim.ap_ft_pmf_bip_gmac_256.fail"
> > on
> > https://lore.kernel.org/all/20220430143056.GA27004@xsang-OptiPlex-9020/
> > when this commit is on linux-next/master
> > now we noticed there are other hwsim tests failures while
> > ap_ft_pmf_bip_gmac_256 problem is still existing, after this commit is on
> > mainline now.
> > FYI)