Re: Linux Testing Microconference at LPC

[Dmitry Vyukov]

On Fri, Apr 26, 2019 at 11:03 PM Tim Bird <tbird20d@xxxxxxxxx> wrote:
>
> I'm in the process now of planning Automated Testing Summit 2019,
> which is tentatively planned for Lyon, France on October 31.  This is

This is _November_ 1, right?

> the day after Embedded Linux Conference Europe and Open Source Summit
> Europe, in Lyon.  I've been working with the
> Linux Foundation event staff to set this up.
>
> The focus of that event is test standards, including standards for
> test definition, results formats, lab and board management, and APIs
> between elements of the Automated Testing and CI stack.
>
> I think that the set of things to discuss is somewhat different
> between the Plumbers testing microconference and ATS.  But I hope that
> I'm not fragmenting the space too much.
>
> With regards to the Testing microconference at Plumbers, I would like
> to do a presentation on the current status of test standards and test
> framework interoperability.  We recently had some good meetings
> between the LAVA and Fuego people at Linaro Connect
> on this topic.
>
> Let me know what you think.
>  -- Tim
>
> On Thu, Apr 25, 2019 at 6:37 AM Veronika Kabatova <vkabatov@xxxxxxxxxx> wrote:
> >
> >
> >
> > ----- Original Message -----
> > > From: "Dhaval Giani" <dhaval.giani@xxxxxxxxx>
> > > To: "Sasha Levin" <alexander.levin@xxxxxxxxxxxxx>, "shuah" <shuah@xxxxxxxxxx>, "Kevin Hilman" <khilman@xxxxxxxxxxxx>,
> > > "Tim Bird" <tbird20d@xxxxxxxxx>, "LKML" <linux-kernel@xxxxxxxxxxxxxxx>
> > > Cc: "Steven Rostedt" <rostedt@xxxxxxxxxxx>, "Dan Carpenter" <dan.carpenter@xxxxxxxxxx>, willy@xxxxxxxxxxxxx, "gustavo
> > > padovan" <gustavo.padovan@xxxxxxxxxxxxxxx>, "Dmitry Vyukov" <dvyukov@xxxxxxxxxx>, "knut omang"
> > > <knut.omang@xxxxxxxxxx>
> > > Sent: Thursday, April 11, 2019 7:37:51 PM
> > > Subject: Linux Testing Microconference at LPC
> > >
> > > Hi Folks,
> > >
> > > This is a call for participation for the Linux Testing microconference
> > > at LPC this year.
> > >
> > > For those who were at LPC last year, as the closing panel mentioned,
> > > testing is probably the next big push needed to improve quality. From
> > > getting more selftests in, to regression testing to ensure we don't
> > > break realtime as more of PREEMPT_RT comes in, to more stable distros,
> > > we need more testing around the kernel.
> > >
> > > We have talked about different efforts around testing, such as fuzzing
> > > (using syzkaller and trinity), automating fuzzing with syzbot, 0day
> > > testing, test frameworks such as ktests, smatch to find bugs in the
> > > past. We want to push this discussion further this year and are
> > > interested in hearing from you what you want to talk about, and where
> > > kernel testing needs to go next.
> > >
> > > Please let us know what topics you believe should be a part of the
> > > micro conference this year.
> > >
> >
> > Hi,
> >
> > as CKI team, we would like to join the Plumbers discussions about CI for
> > kernel. We obviously have our own working pipeline but would like to get
> > more involved with the other upstream projects working on the same and
> > collaborate on common solutions.
> >
> > I already started some of these discussions on automated-testing mailing
> > list and got in contact with Kevin about the possibility of joining forces
> > with KernelCI project.
> >
> > Our team planned to organize a 'hackfest' for upstream CI during the
> > conference but I heard that the Automated Testing Summit should likely take
> > place during that time too. If that's the case, we should meet up and
> > discuss everything there instead of organizing a separate event.
> >
> >
> > Information and links about CKI Project can be be found at [1] in case
> > people are curious. Some of the things we'd like to achieve is having a
> > single source for all upstream kernel test results where anyone doing the
> > testing can publish them and collaborate on solving common problems (like
> > interpreting test results, making build times faster, increasing the test
> > coverage, detecting regressions etc.)
> >
> > With one of my colleagues, we will submit a microconference proposal that
> > could serve as the starting point for the followup discussions about these
> > topics.
> >
> >
> > We would like to get feedback from kernel developers and maintainers about
> > their expectations for testing and receiving results, as well as discuss
> > the collaboration with other testing/CI projects.
> >
> >
> >
> > Veronika Kabatova
> > CKI Project
> >
> >
> > [1] https://cki-project.org/
> >
> >
> > > Thanks!
> > > Sasha and Dhaval
> > >
>
>
>
> --
>  -- Tim Bird
> Senior Staff Software Engineer, Sony Corporation
> Architecture Group Chair, Core Embedded Linux Project, Linux Foundation