Detlef
______________________________ Reply Separator _________________________________
Subject: Re: Kernel testing
Author: "Seth M. Landsman" <seth@job.cs.brandeis.edu> at Internet
Date: 4/11/97 4:57 PM
On Fri, 11 Apr 1997, Pavel Machek wrote:
> > > confidence.
> > >
> > > > But, let me suggest the Posix conformance suites as a good first past
> > > > test for stupid brokeness.
> > >
> > > This was something I was considering, and looking at the redistribution
> > > license (http://www.itl.nist.gov/div897/ctg/softagre.htm), it looks like
> > > the NIST code could be incorporated into a GPLed test suite because it's
> > > produced by the government and therefore not protected by copyright.
> >
> > A sick thought crossed my mind ... What if we doing something
> > similar to what the cryptography folks are doing. Have people run the
> > stress test when they want, how ever long they want, and have it
> > communicate with a main server someplace which will keep track of these
> > things ...
> > What do you people think?
> >
> > -Seth
>
> That it is unnecesarily complex, and you can only report success, anyway.
> If it crashes, you can't expect that machine to report it :-).
> [You need human beings in this process...]
We could use an ACK type of system. If we have an identical test
suite for every system, we can have the suite send something to the effect
of "Starting test 1" and then "Test 1 succeeded", etc. If we get a
"Starting test x", but no "Test x succeeded", we know exactly where things
went wrong. Also, diagnostic messages that get spit up every so often
could contain important information which will get transmitted.
Also, what is a daemon or some such is placed in the rc.M file
when this processes starts. We have the system run and run and run until
it crashes, logging all the way. When the system is rebooted, this file is
sent to the developers ...
Yes, we will need the people in the process to catch things that
we didn't think about ("My monitor exploded on test 4", for example, could
not be reported by the system, same with "My hard disk now talks in
tongues", for obvious reasons). But this will a) ensure that incomplete
information isn't given (i.e., my computer? It's white.) and b)
information is sent for glitches that the user might not see if he didn't
go into the syslog.
-Seth
--IMA.Boundary.506008068
Content-Type: text/plain; charset=US-ASCII; name="RFC822 message headers"
Content-Transfer-Encoding: 7bit
Content-Description: cc:Mail note part
Content-Disposition: inline; filename="RFC822 message headers"
Received: from internet.turner.com (157.166.2.3) by ccmail.turner.com with SMTP
(IMA Internet Exchange 2.1 Enterprise) id 0008F28B; Fri, 11 Apr 97 17:44:21
-0400
Received: from smap@localhost by internet.turner.com
for <Detlef.Scholz@turner.com> via smapdV1.3
id RAA16442; Fri, 11 Apr 1997 17:43:19 -0400
Received: from ns.osn.de by interlock.turner.com
for <Detlef.Scholz@turner.com> via SMTP (smap V1.3)
id sma016407; Fri Apr 11 17:43:09 1997
Received: from nic.funet.fi (nic.funet.fi [128.214.248.6]) by osn.de
(8.8.2/8.7.3) with ESMTP id XAA16371 for <ds@osn.de>; Fri, 11 Apr 1997 23:43:06
+0200 (MET DST)
Received: from vger.rutgers.edu ([128.6.190.2]) by nic.funet.fi with ESMTP id
<2118-31899>; Sat, 12 Apr 1997 00:06:24 +0300
Received: by vger.rutgers.edu id <970983-254>; Fri, 11 Apr 1997 16:56:28 -0400
Date: Fri, 11 Apr 1997 16:57:45 -0400 (EDT)
From: "Seth M. Landsman" <seth@job.cs.brandeis.edu>
To: Pavel Machek <pavel@atrey.karlin.mff.cuni.cz>
cc: Oliver Xymoron <oxymoron@waste.org>, Eric.Schenk@dna.lth.se,
linux-kernel@vger.rutgers.edu
Subject: Re: Kernel testing
In-Reply-To: <Pine.LNX.3.94.970411210515.5452A-100000@atrey.karlin.mff.cuni.cz>
Message-ID: <Pine.LNX.3.96.970411165011.26790C-100000@job.cs.brandeis.edu>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: owner-linux-kernel@vger.rutgers.edu
Precedence: bulk
--IMA.Boundary.506008068--