Re: [PATCH v4 03/11] drm/ci: uprev IGT and update testlist

[Vignesh Raman]

Hi Dmitry,

On 15/03/24 17:07, Dmitry Baryshkov wrote:
> On Wed, 6 Mar 2024 at 05:08, Vignesh Raman <vignesh.raman@xxxxxxxxxxxxx> wrote:
> > Uprev IGT and add amd, v3d, vc4 and vgem specific
> > tests to testlist. Have testlist.txt per driver
> > and include a base testlist so that the driver
> > specific tests will run only on those hardware.
> > Also add testlists to the MAINTAINERS file.
>
> I think we should move away from specifying tests explicitly. They can
> easily get out of sync. A month ago I had to manually go through the
> list of the tests and update it to follow changes in the IGT.
>
> I think we should directly use testlist.txt from IGT and then filter
> it out using skips.

So we use the test-list-full.txt or test-list.txt from IGT and generate 
a single testlist for drm-ci when we uprev IGT?

Instead of adding the below to skips file for different driver,
msm_.*
^amdgpu.*
panfrost_.*
v3d_.*
vc4_.*

If we have a separate testlist for each driver, we can update the main 
testlist.txt along with individual testlist for each driver. We just 
need to move the driver specific tests from main testlist to individual
driver testlist file. Please let me know your thoughts.

Thanks.

Regards,
Vignesh