Testing Quality Call notes - 2024-07-25

[Laura Nao]

Hello,

KernelCI is hosting a bi-weekly call on Thursday to discuss improvements 
to existing upstream tests, the development of new tests to increase 
kernel testing coverage, and the enablement of these tests in KernelCI. 
In recent months, we at Collabora have focused on various kernel areas,
assessing the tests already available upstream and contributing patches 
to make them easily runnable in CIs.

Below is a list of the tests we've been working on and their latest 
status updates, as discussed in the last meeting held on 2024-07-25:

*USB/PCI devices kselftest*

- Upstream test to detect unprobed devices on discoverable buses: 
  https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=dacf1d7a78bf8a131346c47bfba7fe1f3ff44beb 
- Test location changed 
  (https://lore.kernel.org/all/20240705-dev-err-log-selftest-v2-1-163b9cd7b3c1@xxxxxxxxxxxxx/), 
  updated KernelCI PRs accordingly: 
  https://github.com/kernelci/kernelci-core/pull/2577 and https://github.com/kernelci/kernelci-pipeline/pull/642
- Will need to figure out how to structure the files to ensure 
  scalability. A YAML schema would be useful too.

*Error log test*

- Proposing new kselftest to report device log errors: 
  https://lore.kernel.org/all/20240423-dev-err-log-selftest-v1-0-690c1741d68b@xxxxxxxxxxxxx/
- Now merged upstream

*Missing devices kselftest*

- Proposing new kselftest to report devices that go missing in the system: 
  https://lore.kernel.org/all/20240724-kselftest-dev-exist-v1-1-9bc21aa761b5@xxxxxxxxxxxxx/#r
- The test checks the number of devices present against a reference file, 
  generated by the program at a previous point on a known-good kernel, 
  and reports any missing device.
- Helps identifying missing kernel configs or broken driver features

*Suspend/resume in cpufreq kselftest*

- Enabling suspend/resume test within the cpufreq kselftest in KernelCI
- Sent v2 for patch adding RTC wakeup alarm in the cpufreq kselftest: 
  https://lore.kernel.org/lkml/20240715192634.19272-1-shreeya.patel@xxxxxxxxxxxxx/
- The test now uses rtcwake, as suggested by Rafael J. Wysocki in the 
  first review. There's no easy way to declare the dependency in the 
  kselftest itself.
- Patch got acked by the cpufreq kselftest author Viresh Kumar

*Boot time test*

- Sent first RFC:
  https://lore.kernel.org/all/20240725110622.96301-1-laura.nao@xxxxxxxxxxxxx/T/#ma568382acdc81af65c30fe3823a7be3e49f98108

*TAP conformance in kselftests*

- Ongoing discussion upstream on TAP headers: 
  https://lore.kernel.org/all/87fbfba4-8d4d-44ff-9fe5-e101cce3d6cb@xxxxxxxxxxxxx
- Working to convert test modules used by kselftests into kunit. Cleanup 
  patches sent:
  https://lore.kernel.org/all/20240725110817.659099-1-usama.anjum@xxxxxxxxxxxxx 
  and https://lore.kernel.org/all/20240725121212.808206-1-usama.anjum@xxxxxxxxxxxxx

Please reply to this thread if you'd like to join the call or discuss 
any of the topics further. We look forward to collaborating with the 
community to improve upstream tests and expand coverage to more areas 
of interest within the kernel.

Best regards,

Laura Nao