Re: kernelci.org transitioning to functional testing
From: Greg KH
Date: Wed May 13 2020 - 08:51:57 EST
On Wed, May 13, 2020 at 12:13:24PM +0100, Guillaume Tucker wrote:
> As kernelci.org is expanding its functional testing
> capabilities, the concept of boot testing is now being
> deprecated.
>
> Next Monday 18th May, the web dashboard on https://kernelci.org
> will be updated to primarily show functional test results
> rather than boot results. The Boots tab will still be
> available until 5th June to ease the transition.
>
> The new equivalent to boot testing is the *baseline* test suite
> which also runs sanity checks using dmesg and bootrr[1].
>
> Boot email reports will eventually be replaced with baseline
> reports. For those of you already familiar with the test email
> reports, they will be simplified to only show regressions with
> links to the dashboard for all the details.
>
> Some functional tests are already being run by kernelci.org,
> results have only been shared by email so far but they will
> become visible on the web dashboard next week. In particular:
> v4l2-compliance, i-g-t for DRM/KMS and Panfrost,
> suspend/resume...
>
> And of course, a lot of functional test suites are in the
> process of being added: kselftest, KUnit, LTP, xfstests,
> extended i-g-t coverage and many more.
>
> The detailed schedule is available on a GitHub issue[2].
Very cool stuff, thanks so much to everyone involved for making this
happen, it's really helpful.
greg k-h