Re: [Ksummit-discuss] [CORE TOPIC] kernel testing standard

[Steven Rostedt <rostedt@goodmis.org>]

On Mon, 26 May 2014 20:33:38 +0900
Masami Hiramatsu <masami.hiramatsu.pt@hitachi.com> wrote:

 
> If we force to unify the test frameworks, it will neither be maintained
> nor used. Instead, if maintainers state what test they will run and how
> to maintain it, we are sure that each test will be done on the each
> subsystem branch, and before release, we can avoid to run all tests which
> requires many hardware and long time but just run a small number of tests
> (e.g. LTP, trinity, etc.)

I agree with this. Just having a single place to put tests or tell
people where the tests are would be a huge improvement. If I wanted to
run my own tests on ext file systems, I should be able to set up the
same environment that Ted uses. If someone wants to run my ftrace
tests, then they should be able to as well (which I need to make
available to the general public). Better yet, this can open up a door
for people to contribute to new tests for a particular subsystem. I
would love it if people added tests for me to run on ftrace. I have a
bunch of hacks to test various functionality (as they are hacky, that's
the reason I haven't posted them yet).

This shouldn't be about "make tests" which I think is silly. But a way
to standardize tests, or at least have a single repository to show how
different parts of the kernel is tested. My tests require running as
root, other tests should not require that. This is just an example of
how different tests have different requirements and no one size fits
all.

-- Steve