[LTP] [ANNOUNCE] The Linux Test Project has been released for MAY 2018

[Cyril Hrubis]

Good news everyone,

the Linux Test Project test suite stable release for *May 2018* has been
released.

Since the last release 297 patches by 38 authors were merged.

NOTABLE CHANGES
===============

 * New testcases:

   - two inotify regression tests for:
     764baba80168 ("ovl: hash non-dir by lower inode for fsnotify")
     31747eda41ef ("ovl: hash directory inodes for fsnotify")

   - sysclt01 a regression test for:
     5ccba44ba118 ("sched/sysctl: Check user input value of sysctl_sched_time_avg")

   - CVE regression tests for:
     * CVE-2017-17053 - ccd5b3235180 ("x86/mm: Fix use-after-free of ldt_struct")
     * CVE-2017-16939 - 1137b5e2529a ("ipsec: Fix aborted xfrm policy dump crash")
     * CVE-2015-3290  - 9b6e6a8334d5 ("x86/nmi/64: Switch stacks on userspace NMI entry")
     * CVE-2017-17052 - 2b7e8665b4ff ("fork: fix incorrect fput of ->exe_file causing use-after-free")
     * CVE-2017-17807 - 4dca6ea1d943 ("KEYS: add missing permission check for request_key() destination")

   - read_all

     Test that aims to stress test /proc, /sys, and safe subset of /dev
     filesystems by reading by reading each readable file using several
     threads.

   - The pwritev03 and preadv03 tests with O_DIRECT executed on all supported filesystems.
     (https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines#2214-testing-with-a-block-device)

   - Pids controller tests fixed a race that made them fail sporadically and
     the the coverage was increased.

   - pwrite03, write02

     Write syscall tests for special case with NULL buffer and len 0
     where the call is expected to return 0 i.e. success.

 * Removed outdated and broken tests
   - sssd daemon test
   - mail command test
   - ht_interrupt -- hyperthreading interrupt balancing test

 * 54 testcases were cleaned up and converted to the new test library

 * The syscalls testrun has been speeded up by about a minute which is 5% of the runtime.

 * Several Android fixes have been applied.

 * New macro for automatic retry with exponential backoff has been added to the
   test library, which should replace all the ad-hoc retry loops we do have all
   around the codebase.

 * IMA (Integrity Measurement Architecture) tests
   - Were rewritten to use new API, updated, and various bugs has been fixed.
   - The most important changes:
     * Avoid running on tmpfs ima_measurements.sh and ima_violations.sh
     * ima_measurements.sh: support new IMA measurement templates, support testing
       most of IMA supported hash algorithms, fix & update iversion check
     * tpm.sh: replace ima_measure with evmctl (external)
     * ima_policy.sh: improve check of policy writability
     * ima_boot_aggregate: fixing event size for modern BIOS

     Many thanks to Mimi Zohar for her review and testing of IMA test cases.

  + The usual number of fixes and cleanups all over the place

NETWORK TESTS
=============

 Changelog for network tests brought to you by Peter Vorel.

 * New testcases:
   - for IP_BIND_ADDRESS_NO_PORT, DCCP and UDP ipsec and for UDPLITE protocol
   - regression test sctp_big_chunk aka CVE-2018-5803
   - netstress gained support for IP_BIND_ADDRESS_NO_PORT, SO_ZEROCOPY flags
     and UDPLITE protocol
   - Use libtirpc for all RPC tests

  * Test cases rewritten into new shell API:
    - interface and multicast tests cases
    - in6_02

  * Removed tests cases
    - route{4,6}-ifdown

  + Various fixes and doc cleanups


TODO LIST AND ISSUE TRACKER
===========================

Just recently we started to maintain a LTP TODO list in the form GitHub issues,
so far there is very coarse list of missing, mostly syscall, coverage:

https://github.com/linux-test-project/ltp/labels/missing%20coverage

Which I suppose will expand quite a bit soon.

And also nearly empty list of reproducers:

https://github.com/linux-test-project/ltp/labels/reproducer

Which I'm about to feed with a list of CVE reproducers I have, that
can be converted into regression testcases.

Lastly but not least I would like to ask everyone to contribute to that list.

DOWNLOAD AND LINKS
==================

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20180515

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial
https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines
https://github.com/linux-test-project/ltp/wiki/BuildSystem

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@xxxxxxxxxxxxxxx

CREDITS
=======

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20180118..
    76  Petr Vorel <pvorel@xxxxxxx>
    38  Cyril Hrubis <chrubis@xxxxxxx>
    37  Michael Moese <mmoese@xxxxxxx>
    30  Alexey Kodanev <alexey.kodanev@xxxxxxxxxx>
    21  Xiao Yang <yangx.jy@xxxxxxxxxxxxxx>
    12  yang xu <xuyang.jy@xxxxxxxxxxxxxx>
     9  Yixin Zhang <yixin.zhang@xxxxxxxxx>
     7  Jinhui Huang <huangjh.jy@xxxxxxxxxxxxxx>
     7  Richard Palethorpe <rpalethorpe@xxxxxxxx>
     6  Jan Stancek <jstancek@xxxxxxxxxx>
     6  Li Wang <liwang@xxxxxxxxxx>
     5  Amir Goldstein <amir73il@xxxxxxxxx>
     4  Carlo Marcelo Arenas Belon <carenas@xxxxxxxxx>
     4  Stanislav Kholmanskikh <stanislav.kholmanskikh@xxxxxxxxxx>
     3  Petr Vorel <petr.vorel@xxxxxxxxx>
     3  Steve Muckle <smuckle.linux@xxxxxxxxx>
     2  Anders Roxell <anders.roxell@xxxxxxxxxx>
     2  Eric Biggers <ebiggers@xxxxxxxxxx>
     2  Khem Raj <raj.khem@xxxxxxxxx>
     2  Sandeep Patil <sspatil@xxxxxxxxxx>
     2  Sebastian Chlad <schlad@xxxxxxx>
     2  xiao yang <yangx.jy@xxxxxxxxxxxxxx>
     1  Christian Lanig <clanig@xxxxxxxx>
     1  Dmitry Safonov <dima@xxxxxxxxxx>
     1  Erick Reyes <erickreyes@xxxxxxxxxx>
     1  Greg Hackmann <ghackmann@xxxxxxxxxx>
     1  Harish <harish@xxxxxxxxxxxxxxxxxx>
     1  Hoang Van Tuyen <tuyen.hoangvan@xxxxxxxxxxxxxxxx>
     1  Hridya Valsaraju <hridya@xxxxxxxxxx>
     1  Joe Konno <joe.konno@xxxxxxxxx>
     1  Lars Persson <larper@xxxxxxxx>
     1  Lianwen Sun <sunlw.fnst@xxxxxxxxxxxxxx>
     1  Pavel Boldin <pboldin@xxxxxxxxxxxxxx>
     1  Qiao Zhao <qiaozqjhsy@xxxxxxxxx>
     1  Xiong Zhou <xzhou@xxxxxxxxxx>
     1  Yang Pengfei <yangpengfei4@xxxxxxxxxx>
     1  akodanev <akodanev@xxxxxxxxx>
     1  xie hui <xieh.jy@xxxxxxxxxxxxxx>
     1  yosun <yosun@xxxxxxxx>

And also thanks to patch reviewers:

git log 20180118.. | grep -Ei '(reviewed|acked)-by:' | \
    sed 's/.*by: //' | sort | uniq -c | sort -n -r
     34 Cyril Hrubis <chrubis@xxxxxxx>
     15 Petr Vorel <pvorel@xxxxxxx>
     15 Alexey Kodanev <alexey.kodanev@xxxxxxxxxx>
     11 Jan Stancek <jstancek@xxxxxxxxxx>
      7 Richard Palethorpe <rpalethorpe@xxxxxxx>
      4 Li Wang <liwang@xxxxxxxxxx>
      3 Mimi Zohar <zohar@xxxxxxxxxxxxxxxxxx>
      2 Petr Vorel <petr.vorel@xxxxxxxxx>
      2 James Morris <james.l.morris@xxxxxxxxxx>
      1 yang xu <xuyang.jy@xxxxxxxxxxxxxx>
      1 Xiao Yang <yangx.jy@xxxxxxxxxxxxxx>

-- 
Cyril Hrubis
chrubis@xxxxxxx