Skip to content

Releases: linux-test-project/ltp

LTP 20240930

30 Sep 10:48
@metan-ucw metan-ucw
20240930
This tag was signed with the committer’s verified signature.
metan-ucw Cyril Hrubis
SSH Key Fingerprint: ehRNv18ffnUsjJTr/qVnFvOBiEglWUf4cRFBtjgnrWw Learn about vigilant mode.
60f8141
This commit was signed with the committer’s verified signature.
metan-ucw Cyril Hrubis
SSH Key Fingerprint: ehRNv18ffnUsjJTr/qVnFvOBiEglWUf4cRFBtjgnrWw Learn about vigilant mode.
Compare
Choose a tag to compare
LTP 20240930 Latest
Latest

NOTABLE CHANGES

  • New tests

    • chown09 regression test for 5d1f903f75a8 ("attr: block mode changes of symlinks")
    • request_key06 Negative tests for request_key() syscall
    • signalfd02 Negative tests for signalfd() syscall
    • mseal02 Negative tests for mseal() syscall
    • hugeshmget06 A hugepage shm test
    • landlock07 Landlock Houdini reproducer aka CVE-2024-42318
    • getcpu02 Negative tests for getcpu() syscall
    • landlock06 Tests for LANDLOCK_ACCESS_FS_IOCTL_DEV
    • landlock05 Tests for LONDLOCK_ACCESS_FS_REFER
    • landlock04 Tests that syscalls are enabled/disable accordingly to the ruleset
    • landlock03 Negative tests for landlock_restrict_self() syscall
    • landlock02 Negative tests for landlock_add_rule() syscall
    • landlock01 Negative tests for landlock_create_ruleset() syscall
    • mseal01 Tests that memory is protected from being changed after it's sealed
    • fchmodat2_02 Negative tests for fchmodat2()
    • fchmodat2_01 Tests for AT_SYMLINK_NOFOLLOW for fchmodat2()
    • cachestat04 Checks that cachestat() syscall either reports EBADF or zeroed
      statistics on all kinds of unsupported fds
    • cachestat03 Negative tests for cachestat() syscall
    • cachestat02 Basic cachestat tests with fd pointing to shared memory
    • cachestat01 Basic cachestat tests for regular files
    • shutdown01 Basic shutdown tests
    • shutdown02 Negative tests for shutdown() sycall

  • The symlink01 mess is being split into separate testcases

    • open15 A test that open() syscall works correctly with symlinks
    • lstat03 A basic lstat() test.
    • rename15 Tests that rename works correctly with symlinks
    • chmod08 Tests that chmod() works correctly with symlinks

  • Increased coverage

    • readdir and getdents tests were enabled to run on all supported filesystems
      after we found that bcachefs had sublty broken implementation
    • gedent02 Adds more negative tests
    • timer_settime01 Now checks for premature timer expiration as well
    • pkey01 Now includes tests for PKEY_DISABLE_EXECUTE
    • request_key01 Added more negative tests
    • acct02 Added more negative tests
    • prctl04 has been renamed to seccomp01 and now covers also the seccomp()
      syscall along with the older prctl(PR_SET_SECCOMP) calls
    • msync04 now uses direct I/O to verify that data have been written to disk

  • Rewritten tests

    • fork05 was rewritten and correctly reports TCONF on non i386 hardware
    • fcnt14 a file locking test was rewriten to generate subtests at runtime
    • sched_starvation now autocallibrates expected runtime based on CPU speed
    • sched_footbal was rewritten and is now executed as part of the sched
      runtest file

  • The test library now supports specifying mkfs and mount options per a
    filesystem

  • Bunch of checks for kernels older than 4.4 were removed from the tests since
    the currently minimal kernel version LTP supports is 4.4

  • We have a new shell test library that:

    • makes shell code seamlessly interoperable with C
    • reuses most of the C test library
    • makes use shared memory to report test results
    • there are currently no tests using this library, we will start rewriting
      existing tests after the release

  • 3 testcases were converted to the new test library

  • The usual amount of fixes and cleanups

REMOVED SCRIPTS AND FILES

  • Removed old and outdated man pages.

  • Removed ltpmenu an legacy script that was unmaintained for a decade.

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • nfsstat02.sh new test for per-NS NFS client statistics
    (checks that /proc/net/rpc/nfs exists in nested network namespaces)

  • nfsstat01.sh read client stats from netns rhost
    (fix for kernel 6.9, backported up to 5.10 so far)

  • nfs02.sh Added subtest for O_DIRECT

KIRK

  • Kirk has been update to 1.4
  • Kirk can now be installed from pypi

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20240930

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/test_case_tutorial.html

And our library API documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/api_c_tests.html

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@lists.linux.it.

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20240524..

93  Petr Vorel <pvorel@suse.cz>
58  Andrea Cervesato <andrea.cervesato@suse.com>
22  Xinjian Ma (Fujitsu) <maxj.fnst@fujitsu.com>
17  Martin Doucha <mdoucha@suse.cz>
15  Cyril Hrubis <chrubis@suse.cz>
15  Li Wang <liwang@redhat.com>
 7  Wei Gao <wegao@suse.com>
 6  John Stultz <jstultz@google.com>
 3  Andreas Schwab <schwab@suse.de>
 3  Edward Liaw <edliaw@google.com>
 3  Jan Stancek <jstancek@redhat.com>
 3  Xiao Yang <ice_yangxiao@163.com>
 2  Jiwei Sun <sunjw10@lenovo.com>
 2  Po-Hsu Lin <po-hsu.lin@canonical.com>
 1  Ajay Kaher <ajay.kaher@broadcom.com>
 1  Avinesh Kumar <akumar@suse.de>
 1  Chen Haonan <chen.haonan2@zte.com.cn>
 1  Chuck Lever <chuck.lever@oracle.com>
 1  Haifeng Xu <haifeng.xu@shopee.com>
 1  Jingyi Song <jingyisong@hust.edu.cn>
 1  Kuan-Ying Lee <kuan-ying.lee@canonical.com>
 1  Li Xiaosong <rj45usb@163.com>
 1  Madadi Vineeth Reddy <vineethr@linux.ibm.com>
 1  Nirjhar Roy <nirjhar@linux.ibm.com>
 1  Remi Peuvergne <remi.peuvergne@kaizen-solutions.net>
 1  Sachin P Bappalige <sachinpb@linux.ibm.com>
 1  Shizhao Chen <shichen@redhat.com>
 1  Yiwei Lin <s921975628@gmail.com>
 1  Zizhi Wo <wozizhi@huawei.com>
 1  lufei <lufei@uniontech.com>

And also thanks to patch reviewers:

git log 20240524.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

 87 Petr Vorel <pvorel@suse.cz>
 87 Cyril Hrubis <chrubis@suse.cz>
 77 Li Wang <liwang@redhat.com>
 28 Avinesh Kumar <akumar@suse.de>
 13 Andrea Cervesato <andrea.cervesato@suse.com>
  4 Martin Doucha <mdoucha@suse.cz>
  3 Wei Gao <wegao@suse.com>
  3 Richard Palethorpe <io@richiejp.com>
  3 Jan Stancek <jstancek@redhat.com>
  3 Jan Kara <jack@suse.cz>
  2 Adrian Huang <ahuang12@lenovo.com>
  1 Po-Hsu Lin <po-hsu.lin@canonical.com>
  1 Amir Goldstein <amir73il@gmail.com>
Assets 11
Loading

LTP 20240524

24 May 12:08
@pevik pevik
20240524
This tag was signed with the committer’s verified signature.
pevik Petr Vorel
GPG key ID: C0DEC2EE72F33A5F
Learn about vigilant mode.
8f21ebb
This commit was signed with the committer’s verified signature.
pevik Petr Vorel
GPG key ID: C0DEC2EE72F33A5F
Learn about vigilant mode.
Compare
Choose a tag to compare
LTP 20240524

NOTABLE CHANGES

  • New tests

    • mlock05 Test for pre-faulting locked memory
    • kvm_svm04 Functional test for VMSAVE/VMLOAD instructions
    • arch_prctl01 Test for ARCH_SET_CPUID and ARCH_GET_CPUID
    • kallsyms A test to check that it's impossible to read kernel memory from userspace
    • unlink09 Negative tests for unlink()
    • getrandom05 Negative tests for getrandom()
    • gethostname02 Negative tests for gethostname()
    • splice08 Test for splicing from /dev/zero and /dev/full
    • splice09 Test for splicing to /dev/zero and /dev/null
    • shmat04 A regression test for fc0c8f9089c2
      ("mm, mmap: fix vma_merge() case 7 with vma_ops->close")
    • aslr01 Tests that hugepages, that cause addesses to be aligned to higher
      order of 2, are not used for libraries when ASLR is enabled.

  • Increased coverage

    • getsockname01 More negative testcases
    • getsockopt01 More negative testcases
    • bind01 More negative testcases
    • swapon01 Runs on all supported filesystems now
    • waitpid01 Tests all deadly signals now
    • fanotify01 Tests setting two marks on different filesystems

  • Rewritten tests

    • msgstress testcases were rewritten into a single msgstress01 test
      this should finally fix the test to scale well from small embedded boards
      towards big servers

    • symlink01 has been split into several testcases, previously several different
      testcases were build from the source based on different messy ifdefs

  • UCLINUX support was completely removed from LTP

    It was unmaintained and partially broken and nobody stepped up to maintain
    the support.

  • Small runtest files cleanup

    • runtest/io was merged into ltp-aiodio.part4
    • runtest/cap_bounds and runtest/filecaps were merged into single runtest file

  • 32 testcases were converted to the new test library

  • The usual amount of fixes and cleanups

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • New tests

    • nfs09 Regression test for file truncation on NFS.

  • Increased coverage

    • nfsstat01.sh: Add support for NFSv4*

  • Removed tests

    • clockdiff01.sh Testing clockdiff is not relevant nowadays.
    • telnet01.sh Testing telnet not make sense nowadays, remove it.
    • xinetd_tests.sh Testing xinetd is not relevant nowadays.
    • host01.sh The test does not work in all cases since testing host require
      proper DNS setup or internet connection. Rather than fixing this
      it makes sense to remove the test.

New documentation

We have finally started working on a comprehensive documentation for LTP and
it's test library, the current state can be seen at:

https://linux-test-project.readthedocs.io/en/latest/

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20240524

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/test_case_tutorial.html

And our library API documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/api_c_tests.html

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@lists.linux.it.

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20240129..

140  Petr Vorel <pvorel@suse.cz>
22  Martin Doucha <mdoucha@suse.cz>
25  Yang Xu <xuyang2018.jy@fujitsu.com>
21  Li Wang <liwang@redhat.com>
16  Andrea Cervesato <andrea.cervesato@suse.com>
15  Andrea Manzini <andrea.manzini@suse.com>
14  Wei Gao <wegao@suse.com>
10  Cyril Hrubis <chrubis@suse.cz>
 5  Avinesh Kumar <akumar@suse.de>
 2  Detlef Riekenberg <wine.dev@web.de>
 2  Edward Liaw <edliaw@google.com>
 4  Hui Min Mina Chou <minachou@andestech.com>
 2  lufei <lufei@uniontech.com>
 1  Amir Goldstein <amir73il@gmail.com>
 1  Dennis Brendel <dbrendel@redhat.com>
 1  Filippo Storniolo <fstornio@redhat.com>
 1  Jan Stancek <jstancek@redhat.com>
 1  Khem Raj <raj.khem@gmail.com>
 1  Mete Durlu <meted@linux.ibm.com>
 1  Murphy Zhou <jencce.kernel@gmail.com>
 1  Samasth Norway Ananda <samasth.norway.ananda@oracle.com>
 1  Sebastian Chlad <sebastianchlad@gmail.com>
 1  Sergey Ulanov via ltp <ltp@lists.linux.it>
 1  Shiyang Ruan <ruansy.fnst@fujitsu.com>
 1  Wenjie Xu <xuwenjie04@baidu.com>

And also thanks to patch reviewers:

git log 20240129.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

125 Petr Vorel <pvorel@suse.cz>
  94 Cyril Hrubis <chrubis@suse.cz>
  31 Li Wang <liwang@redhat.com>
  15 Andrea Cervesato <andrea.cervesato@suse.com>
  12 Martin Doucha <mdoucha@suse.cz>
  11 Avinesh Kumar <akumar@suse.de>
   7 Jan Stancek <jstancek@redhat.com>
   3 Marius Kittler <mkittler@suse.de>
   3 Jan Kara <jack@suse.cz>
   2 Amir Goldstein <amir73il@gmail.com>
   1 Wei Gao <wegao@suse.com>
   1 Vlastimil Babka <vbabka@suse.cz>
   1 Richard Palethorpe <rpalethorpe@suse.com>
   1 Matt Bobrowski <mattbobrowski@google.com>
   1 Kent Overstreet <kent.overstreet@linux.dev>
   1 Joerg Vehlow <joerg.vehlow@aox.de>
Assets 11
Loading

LTP 20240129

29 Jan 17:20
@pevik pevik
20240129
This tag was signed with the committer’s verified signature.
pevik Petr Vorel
GPG key ID: C0DEC2EE72F33A5F
Learn about vigilant mode.
68737d2
This commit was signed with the committer’s verified signature.
pevik Petr Vorel
GPG key ID: C0DEC2EE72F33A5F
Learn about vigilant mode.
Compare
Choose a tag to compare
LTP 20240129

NOTABLE CHANGES

  • New tests

  • Increased coverage

    • ioctl02 cover more modern termios ioctls() as well.

    • fanotify13 More test coverage for overlayfs.

    • input* test now check UI_GET_NAME ioctl() too.

  • Removed tests

    • fork12 Which was a naive fork bomb test, we do have other tests
      (setrlimit01.c, ...) that better cover this scenario.

    • mongo test framework

      Which was test reiser, ext2 and jfs unmaintained for a decade.

    • simple_tracer.c Tracing test from 2009 that does not compile anymore.

    • runtest/fsx-linux This is consolidation of runtest files, since these test
      duplicated in ltp-aiodio.part3.

    • testscripts/autofs{1,4}.sh, testscripts/sysfs.sh,
      testscripts/ltp-scsi_debug.sh, testscripts/ltpdmmapper.sh

      These were unmaintained and unused scripts.

    • scsi/* A testsuite with a custom kernel module for kernel 2.5 that didn't
      compile cleanly for decades.

    • load_stress_all_kernel_modules.sh Broken for quite some time.

  • The LTP library now has a functions to iterate over different
    file descriptors. That allows us to easily implement more comprehensive tests
    that feed various syscalls all possible file descriptors and check that the
    syscall fails properly with invalid combinations. Most notable use of this
    library is the newly introduced splice07.c test.

  • The minimal size of the device for a few filesystem tests was increased to
    1GB because modern filesystems, most notably Btrfs does not work properly on
    smaller devices.

  • LTP now tests bcachefs if kernel support and bcache.mkfs is present

  • 30 testcases were converted to the new test library

  • The usual amount of fixes and cleanups

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

The performance tests in net.features can be now skipped by setting
LTP_NET_FEATURES_IGNORE_PERFORMANCE_FAILURE=1 which is useful when testing is
executed on VMs on a overloaded host or if we are running tests with a
background load.

KIRK (previously RUNLTP-NG)

Kirk was updated to v1.2

This version brings the following updates:

  • show both stdout and stderr when executing tests on host
  • support for external commands on different SUTs
  • warning message when SUT doesn't support parallel execution
  • more stable epoll() communication with LTX
  • minor fixes
  • updated documentation

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20240129

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/Build-System

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@lists.linux.it.

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20230929..

147  Petr Vorel <pvorel@suse.cz>
25  Yang Xu <xuyang2018.jy@fujitsu.com>
21  Andrea Cervesato <andrea.cervesato@suse.com>
18  Martin Doucha <mdoucha@suse.cz>
12  Cyril Hrubis <chrubis@suse.cz>
11  Marius Kittler <mkittler@suse.de>
 8  Wei Gao <wegao@suse.com>
 7  Amir Goldstein <amir73il@gmail.com>
 7  Richard Palethorpe <rpalethorpe@suse.com>
 6  Avinesh Kumar <akumar@suse.de>
 6  Edward Liaw <edliaw@google.com>
 6  Jan Kara <jack@suse.cz>
 5  Jan Stancek <jstancek@redhat.com>
 4  Hongchen Zhang <zhanghongchen@loongson.cn>
 4  Kevin Brodsky <kevin.brodsky@arm.com>
 4  Xiao Yang <yangx.jy@fujitsu.com>
 3  Shiyang Ruan <ruansy.fnst@fujitsu.com>
 2  Li Wang <liwang@redhat.com>
 2  Li Zhijian <lizhijian@fujitsu.com>
 2  Pengfei Xu <pengfei.xu@intel.com>
 2  Stefan Roesch <shr@devkernel.io>
 1  Alexander Kanavin <alex@linutronix.de>
 1  Brennan Ashton <bashton@brennanashton.com>
 1  Korobeynikov Gleb <mathkgd@mail.ru>
 1  Marcos Paulo de Souza <mpdesouza@suse.com>
 1  Mengchi Cheng <mengcc@amazon.com>
 1  Murphy Zhou <jencce.kernel@gmail.com>
 1  Shizhao Chen <shichen@redhat.com>
 1  Shoukui Zhang <zhangshoukui@xiaomi.com>
 1  Subramanya Swamy <subramanya.swamy.linux@gmail.com>
 1  haopengxiang <haopengxiang@xiaomi.com>
 1  nietingting <nietingting@xiaomi.com>
 1  wangxuewen <wangxuewen@kylinos.cn>
 1  ybonatakis <ybonatakis@suse.com>

And also thanks to patch reviewers:

git log 20230929.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

111 Petr Vorel <pvorel@suse.cz>
 70 Cyril Hrubis <chrubis@suse.cz>
 47 Li Wang <liwang@redhat.com>
 35 Richard Palethorpe <rpalethorpe@suse.com>
 14 Martin Doucha <mdoucha@suse.cz>
  8 Amir Goldstein <amir73il@gmail.com>
  7 Xiao Yang <yangx.jy@fujitsu.com>
  7 Marius Kittler <mkittler@suse.de>
  6 Jan Kara <jack@suse.cz>
  4 Avinesh Kumar <akumar@suse.de>
  3 Andrea Cervesato <andrea.cervesato@suse.com>
  3 Jan Stancek <jstancek@redhat.com>
  2 Yang Xu <xuyang2018.jy@fujitsu.com>
  1 Petr Vorel <petr.vorel@gmail.com>
  1 Christian Brauner <brauner@kernel.org>
Assets 11
Loading

LTP 20230929

29 Sep 09:20
@pevik pevik
20230929
This tag was signed with the committer’s verified signature.
pevik Petr Vorel
GPG key ID: C0DEC2EE72F33A5F
Learn about vigilant mode.
110d3be
This commit was signed with the committer’s verified signature.
pevik Petr Vorel
GPG key ID: C0DEC2EE72F33A5F
Learn about vigilant mode.
Compare
Choose a tag to compare
LTP 20230929

NOTABLE CHANGES

  • New tests

    • epoll_wait07 for EPOLLONESHOT
    • epoll_wait06 for EPOLLET
    • epoll_wait05 for EPOLLRDHUP
    • process_madvise01 for MADV_PAGEOUT
    • faccessat201 basic faccessat2() test
    • faccessat202 checks that the syscall fails correctly
    • tcindex01 aka CVE-2023-1829
    • mremap06 reproducer for 7e7757876f25 ("mm/mremap: fix vm_pgoff in vma_merge() case 3")
    • starvation a simple test case for sched starvation https://lwn.net/ml/linux-kernel/9fd2c37a05713c206dcbd5866f67ce779f315e9e.camel@gmx.de/
    • pipe14 for end-of-file (read() returns 0) in a case the write end is closed
    • statx12 basic test for STATX_ATTR_MOUNT_ROOT
    • kvm_svm03 KVM test for CPU lockup through malicous SVM guest
    • kvm_svm02 test that KVM correctly intercepts VMSAVE and VMLOAD instructions
      in a nested virtual machine aka CVE-2021-3656
    • statx11 a basic test for STATX_DIOALIGN on block device
    • statx10 a basic test for STATX_DIOALIGN on regular file

  • Increased coverage

    • fanotify13 added test variant for overalfs upper fs
    • mmap05 increased coverage for EINVAL
    • mmap06 increased coverage for EACCES
    • bind03 now includes regression test for
      c0c3b8d380a8 ("unix_bind_bsd(): unlink if we fail after successful mknod")
    • stack_clash added test for mmap() minding gap

  • ebizzy benchmark counter increment races and overflows were fixed

  • A few more testcases were converted to guarded buffers
    that is data passed by pointer to kernel are immediatelly
    following a PROT_NONE page and followed by canaries
    to catch off-by-one errors

  • Tests that modprobe kernel modules are now skipped when secure boot is
    enabled on x86 and ppc64le

  • ioprio tests now use IOPRIO_PRIO_NUM instead of hardcoded value
    to check for prio range

  • 35 testcases were converted to the new test library

    • we finally got rid of the old and messy libclone library
  • The usual amount of fixes and cleanups

KIRK (previously RUNLTP-NG)

  • The new runltp-ng version is now called kirk

    • The name was changed since kirk now supports different testsuites as well
    • Apart from the name changes the internals were rewritten and cleaned up
    • Prototype for parallel testruns is included as well
    • https://github.com/linux-test-project/kirk/#readme

  • There is now experimental LTX support implemented

    • Beware this is VERY EXPERIMENTAL at the moment
    • LTX is tiny binary that runs on system under test
    • LTX communicates with kirk over serial using messages packed in msgpack
    • LTX is going to be locked in memory and executed with realtime priority
    • LTX allows advanced features such as running tests in parallel
    • https://github.com/linux-test-project/ltx

REMOVED TESTS

  • mmap07 (included in mmap06)
  • setgroups04 (included in setgroups03)

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/YYYYMMDD

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/Build-System

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@lists.linux.it.

CREDITS

Many thanks to the people contributing to this release:

$ git shortlog -s -e -n 20230516..
    71	Petr Vorel <pvorel@suse.cz>
    32	Yang Xu <xuyang2018.jy@fujitsu.com>
    26	Avinesh Kumar <akumar@suse.de>
    22	Andrea Cervesato <andrea.cervesato@suse.com>
    22	Martin Doucha <mdoucha@suse.cz>
    13	Cyril Hrubis <chrubis@suse.cz>
    13	Li Wang <liwang@redhat.com>
     6	Wei Gao <wegao@suse.com>
     5	Souta Kawahara <souta.kawahara@miraclelinux.com>
     4	Amir Goldstein <amir73il@gmail.com>
     4	Marius Kittler <mkittler@suse.de>
     3	Richard Palethorpe <rpalethorpe@suse.com>
     3	Ci Zhou <zhouci@ruijie.com.cn>
     2	Damien Le Moal <dlemoal@kernel.org>
     2	Jan Kara <jack@suse.cz>
     2	Konstantin Khorenko <khorenko@virtuozzo.com>
     2	Min Li <limin154@huawei.com>
     2	Murphy Zhou <jencce.kernel@gmail.com>
     2	Vishal Chourasia <vishalc@linux.ibm.com>
     1	Ashwin Dayanand Kamat <kashwindayan@vmware.com>
     1	Duncan.chu <wqhaicyj@163.com>
     1	Dylan Jhong <dylan@andestech.com>
     1	Edward Liaw <edliaw@google.com>
     1	Hongchen Zhang <zhanghongchen@loongson.cn>
     1	Jeff Layton <jlayton@kernel.org>
     1	Leo Yu-Chi Liang <ycliang@andestech.com>
     1	Nageswara R Sastry <rnsastry@linux.ibm.com>
     1	Randolph <randolph@andestech.com>
     1	Rick Edgecombe <rick.p.edgecombe@intel.com>
     1	Shizhao Chen <shichen@redhat.com>
     1	Takuya Wakazono <pastalian46@gmail.com>
     1	Zachary Leaf <zachary.leaf@arm.com>
     1	Li Qiang <liqiang64@huawei.com>
     1	Ioannis Bonatakis <ybonatakis@suse.com>

And also thanks to patch reviewers:

$ git log 20230516.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r
    104 Cyril Hrubis <chrubis@suse.cz>
     66 Petr Vorel <pvorel@suse.cz>
     46 Li Wang <liwang@redhat.com>
     15 Martin Doucha <mdoucha@suse.cz>
     14 Avinesh Kumar <akumar@suse.de>
     14 Richard Palethorpe <rpalethorpe@suse.com>
      8 Xiao Yang <yangx.jy@fujitsu.com>
      3 Niklas Cassel <niklas.cassel@wdc.com>
      3 Marius Kittler <mkittler@suse.de>
      3 Damien Le Moal <dlemoal@kernel.org>
      2 Srikar Dronamraju <srikar@linux.vnet.ibm.com>
      2 Shrikanth Hegde <sshegde@linux.vnet.ibm.com>
      2 Linus Walleij <linus.walleij@linaro.org>
      2 Amir Goldstein <amir73il@gmail.com>
      1 Yang Xu <xuyang2018.jy@fujitsu.com>
      1 Vlastimil Babka <vbabka@suse.cz>
      1 Murphy Zhou <jencce.kernel@gmail.com>
      1 Jeff Moyer <jmoyer@redhat.com>
      1 Andrea Cervesato <andrea.cervesato@suse.com>
Assets 11
Loading

LTP 20230516

16 May 05:27
@pevik pevik
20230516
This tag was signed with the committer’s verified signature.
pevik Petr Vorel
GPG key ID: C0DEC2EE72F33A5F
Learn about vigilant mode.
3ebc2df
This commit was signed with the committer’s verified signature.
pevik Petr Vorel
GPG key ID: C0DEC2EE72F33A5F
Learn about vigilant mode.
Compare
Choose a tag to compare
LTP 20230516

NOTABLE CHANGES

  • New tests

    • kvm_svm01 aka CVE-2021-3653
    • cgroup_core03 test case for the cgroup kill
    • hugetlb32 regression test for:
      • ba9c1201beaa (mm/hugetlb: clear compound_nr before freeing gigantic pages)
      • a01f43901cfb (hugetlb: be sure to free demoted CMA pages to CMA)
    • mmap20 test for mmap() with MAP_SHARED_VALIDATE
    • mqnotify03 aka CVE-2021-38604
    • mprotect05 regression test for:
      • 2fcd07b7ccd5 (mm/mprotect: Fix successful vma_merge() of next in do_mprotect_pkey())
    • fsconfig03 aka CVE-2022-0185
    • madvise11 regression test for:
      • d4ae9916ea29 (mm: soft-offline: close the race against page allocation)
    • mount07 test case for MS_NOSYMFOLLOW

  • Increased coverage

    • NFS tests now run on btrfs, ext4 and xfs
    • setpgid were rewritten and increased coverage in a few corner cases
    • ioctl01 added more termios coverage

  • fs_fill test was fixed on 256+ CPUs

  • loongarch support was added

  • The usual amount of fixes and cleanups

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • NFS tests now run on btrfs, ext4, xfs
    (might be extended to more filesystems later)
  • nfs08.sh a new test for NFS cache invalidation

RUNLTP-NG

REMOVED TESTS

  • tomoyo testsuite which is maintained elsewhere by tomoyo devs

  • execltp script which was unmaintained for years

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20230516

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/Build-System

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@lists.linux.it.

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20230127..

58  Petr Vorel <pvorel@suse.cz>
20  Andrea Cervesato via ltp <ltp@lists.linux.it>
19  Yang Xu <xuyang2018.jy@fujitsu.com>
15  Martin Doucha <mdoucha@suse.cz>
11  Andrea Cervesato <andrea.cervesato@suse.com>
11  Edward Liaw <edliaw@google.com>
10  Wei Gao <wegao@suse.com>
 8  Avinesh Kumar <akumar@suse.de>
 5  Cyril Hrubis <chrubis@suse.cz>
 5  Teo Couprie Diaz <teo.coupriediaz@arm.com>
 4  Li Wang <liwang@redhat.com>
 3  Hao Ge <gehao@kylinos.cn>
 3  Ping Fang <pifang@redhat.com>
 3  Richard Palethorpe <rpalethorpe@suse.com>
 3  Tarun Sahu <tsahu@linux.ibm.com>
 2  Hao Zeng <zenghao@kylinos.cn>
 2  Leo Yu-Chi Liang <ycliang@andestech.com>
 2  Sowmya Indranna <reachmesowmyati@gmail.com>
 1  Andrei Gherzan <andrei.gherzan@canonical.com>
 1  Ashwin Dayanand Kamat via ltp <ltp@lists.linux.it>
 1  David Hildenbrand <david@redhat.com>
 1  Enze Li <lienze@kylinos.cn>
 1  Fabrice Fontaine <fontaine.fabrice@gmail.com>
 1  Frank He <hexiaoxiao@kylinos.cn>
 1  Hui Min Mina Chou <minachou@andestech.com>
 1  Jan Stancek <jstancek@redhat.com>
 1  Liam R. Howlett <Liam.Howlett@oracle.com>
 1  Mahesh Kumar G <maheshkumar657g@gmail.com>
 1  Nikita Yushchenko <nikita.yushchenko@virtuozzo.com>
 1  Paulson Raja L <paulson@zilogic.com>
 1  Seth Forshee (DigitalOcean) <sforshee@kernel.org>
 1  Vignesh Raman <vignesh.raman@collabora.com>
 1  William Roche <william.roche@oracle.com>

And also thanks to patch reviewers:

git log 20230127.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

 68 Cyril Hrubis <chrubis@suse.cz>
 60 Petr Vorel <pvorel@suse.cz>
 36 Richard Palethorpe <rpalethorpe@suse.com>
 35 Li Wang <liwang@redhat.com>
  7 Jan Stancek <jstancek@redhat.com>
  4 Avinesh Kumar <akumar@suse.de>
  3 Yang Xu <xuyang2018.jy@fujitsu.com>
  2 Andrea Cervesato <andrea.cervesato@suse.com>
  1 Tetsuo Handa <penguin-kernel@I-love.SAKURA.ne.jp>
Assets 11
Loading

LTP 20230127

27 Jan 14:50
@pevik pevik
20230127
This tag was signed with the committer’s verified signature.
pevik Petr Vorel
GPG key ID: C0DEC2EE72F33A5F
Learn about vigilant mode.
dd2d61a
This commit was signed with the committer’s verified signature.
pevik Petr Vorel
GPG key ID: C0DEC2EE72F33A5F
Learn about vigilant mode.
Compare
Choose a tag to compare
LTP 20230127

NOTABLE CHANGES

  • New tests

    • 31 hugetlb tests were cleaned up and ported from libhugetlbfs
    • test for cve-2022-4378 /proc/sys/ files overflow on writing
    • cgroup_core02 regression test for e57457641613 aka CVE-2021-4197
    • dirtyc0w_shmem aka CVE-2022-2590
    • openat04 regression test for ac6800e279a2
    • nice05 basic functional test for nice()
    • madvise03 new test for MADV_DONTNEED
    • prctl10 basic test for PR_SET/GET_TSC

  • Increased coverage

    • mount03 add tests for MS_STRICTATIME, MS_NODIRATIME validate f_flags
    • getitimer01 add check for nonzero timer
    • setitimer01 add interval timer test
    • getitimer02 add ITIMER_VIRTUAL timer error check
    • madvise01 add tests for MADV_COLD and MADV_PAGEOUT

  • The minimal supported kernel version was raised to 3.10

    • LTP is no longer tested on older kernels
    • various checks for old kernels were removed from the test code

  • The AIO test cleanup was finished with rewrite of aiocp and aio-stress

  • LTP is now compiled with explicit -std=gnu99 which forces reasonably
    modern C even on oldest distributions we still have to support

  • LTP build system now forces LC_{COLLATE, NUMERIC}=C in order to have
    reproducible builds

  • 31 tests were cleaned up and converted for the new test API

  • The usual amount of fixes and cleanups

RUNLTP-NG

REMOVED TESTS

  • fs-bench which was broken beyond repair and not worth of keeping

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20230127

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/BuildSystem

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@lists.linux.it.

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20220930..

50  Petr Vorel <pvorel@suse.cz>
34  Yang Xu <xuyang2018.jy@fujitsu.com>
33  Tarun Sahu <tsahu@linux.ibm.com>
28  Avinesh Kumar <akumar@suse.de>
21  Richard Palethorpe <rpalethorpe@suse.com>
13  Martin Doucha <mdoucha@suse.cz>
15  Andrea Cervesato <andrea.cervesato@suse.com>
 9  Li Wang <liwang@redhat.com>
 9  Zhao Gongyi <zhaogongyi@huawei.com>
 6  Akihiko Odaki <akihiko.odaki@daynix.com>
 6  David Hildenbrand <david@redhat.com>
 6  Jan Stancek <jstancek@redhat.com>
 6  Tudor Cretu <tudor.cretu@arm.com>
 6  Luo xiaoyu <luoxiaoyu9@huawei.com>
 4  Wei Gao <wegao@suse.com>
 3  Edward Liaw via ltp <ltp@lists.linux.it>
 3  Jan Kara <jack@suse.cz>
 2  Alessandro Carminati <alessandro.carminati@gmail.com>
 2  Alex <aleksandrosansan@gmail.com>
 2  Cyril Hrubis <chrubis@suse.cz>
 2  Pengfei Xu <pengfei.xu@intel.com>
 2  Rong Tao <rongtao@cestc.cn>
 2  Teo Couprie Diaz <teo.coupriediaz@arm.com>     1  He Zhe <zhe.he@windriver.com>
 1  Huangjie Liao <liaohj.jy@fujitsu.com>
 1  Ilya Kurdyukov <59548320+ilyakurdyukov@users.noreply.github.com>
 1  Jie2x Zhou <jie2x.zhou@intel.com>
 1  Joerg Vehlow <joerg.vehlow@aox.de>
 1  Khem Raj <raj.khem@gmail.com>
 1  Murphy Zhou <jencce.kernel@gmail.com>
 1  Nikolaus Voss <nikolaus.voss@haag-streit.com>
 1  Randolph <randolph@andestech.com>
 1  Sven Schnelle <svens@linux.ibm.com>
 1  Vitaly Chikunov <vt@altlinux.org>
 1  chenhx.fnst@fujitsu.com <chenhx.fnst@fujitsu.com>
 1  wangkaiyuan <wangkaiyuan@inspur.com>
 1  zijunzhao <zijunzhao@google.com>

And also thanks to patch reviewers:

git log 20220930.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

106 Richard Palethorpe <rpalethorpe@suse.com>
 70 Petr Vorel <pvorel@suse.cz>
 47 Cyril Hrubis <chrubis@suse.cz>
 45 Li Wang <liwang@redhat.com>
 14 Yang Xu <xuyang2018.jy@fujitsu.com>
  7 Jan Stancek <jstancek@redhat.com>
  8 Martin Doucha <mdoucha@suse.cz>
  3 Avinesh Kumar <akumar@suse.de>
  2 Pengfei Xu <pengfei.xu@intel.com>
  1 Richard Purdie <richard.purdie@linuxfoundation.org>
  1 Khem Raj <raj.khem@gmail.com>
  1 Christian Brauner (Microsoft) <brauner@kernel.org>
  1 Chang S. Bae <chang.seok.bae@intel.com>
  1 Andrea Cervesato <andrea.cervesato@suse.de>
  1 Akihiko Odaki <akihiko.odaki@daynix.com>
Assets 10
Loading

LTP 20220930

30 Sep 14:50
@pevik pevik
20220930
This tag was signed with the committer’s verified signature.
pevik Petr Vorel
GPG key ID: C0DEC2EE72F33A5F
Learn about vigilant mode.
b763f81
This commit was signed with the committer’s verified signature.
pevik Petr Vorel
GPG key ID: C0DEC2EE72F33A5F
Learn about vigilant mode.
Compare
Choose a tag to compare
LTP 20220930

NOTABLE CHANGES

  • New tests

  • Increased coverage

    • creat09 added test for another variant of the CVE-2018-13405
    • fanotify10 test for FAN_MARK_IGNORE with FAN_ONDIR
    • fanotify10 test for FAN_MARK_IGNORE with FAN_EVENT_ON_CHILD
    • fanotify09, fanotify14 add test cases for FAN_MARK_IGNORE
    • fanotify14 add test cases for events not allowed on non-dir
    • fanotify09 add test cases for merge of ignore mask
    • fanotify23 test for FAN_MARK_EVICTABLE
    • fanotify12 test for inotify mask flags IN_ONESHOT and IN_EXCL_UNLINK
    • futex_waitv01 test for EAGIN/ETIMEDOUT
    • mount_setattr01 basic functional test

  • Minimal filesystem size was increased from 256MB to 300MB in order to be able to format it with XFS (mkfs.xfs 5.19)

  • More testcaseses were made runtime aware + runtime fixes

  • Improvements in the shell test library

    • filesystem detection have been improved
    • added $TST_SKIP_FILESYSTEMS support to match C API
    • added $TST_ALL_FILESYSTEMS support to match C API

  • Improvements in open posix testsuite build and installation

  • Shell cgroup testcases were rewritten and cleaned up

  • 46 tests were rewritten to the new library

  • The usual amount of fixes and cleanups

WHAT IS IN THE QUEUE

  • Tracking of minimal device sizes per filesystem, which will allow to run test with smaller device sizes for a subset of filesystems

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • Removed old RPC tests: rup01.sh, rusers01.sh
  • Moved rpc01.sh and rpcinfo01.sh to runtest/net.rpc_tests and deleted runtest/net.rpc
  • The tst_net.sh library was fixed for cases when IPv6 was disabled
  • netns tests were rewritten to use tst_net.sh

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20220930

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/BuildSystem

Patches, new tests, bugs, comments or questions should go to to our mailing list at ltp@lists.linux.it.

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20220527..

97  Petr Vorel <pvorel@suse.cz>
50  Avinesh Kumar <akumar@suse.de>
26  Martin Doucha <mdoucha@suse.cz>
22  Amir Goldstein <amir73il@gmail.com>
19  Luke Nowakowski-Krijger <luke.nowakowskikrijger@canonical.com>
12  Cyril Hrubis <chrubis@suse.cz>
12  Yang Xu <xuyang2018.jy@fujitsu.com>
10  Andrea Cervesato <andrea.cervesato@suse.de>
10  Li Wang <liwang@redhat.com>
 9  Richard Palethorpe <rpalethorpe@suse.com>
 7  Jan Stancek <jstancek@redhat.com>
 6  Andrea Cervesato via ltp <ltp@lists.linux.it>
 6  Edward Liaw <edliaw@google.com>
 5  Joerg Vehlow <joerg.vehlow@aox.de>
 5  Tudor Cretu <tudor.cretu@arm.com>
 5  Zhao Gongyi <zhaogongyi@huawei.com>
 3  Dylan Jhong <dylan@andestech.com>
 2  Andrea Cervesato <andrea.cervesato@suse.com>
 2  Chen Hanxiao <chenhx.fnst@fujitsu.com>
 2  Hongchen Zhang <zhanghongchen@loongson.cn>
 2  Rong Tao <rongtao@cestc.cn>
 1  Bogdan Lezhepekov <blezhepekov@suse.de>
 1  Cristian Marussi <cristian.marussi@arm.com>
 1  Huangjie Liao <liaohj.jy@fujitsu.com>
 1  Jan Kara <jack@suse.cz>
 1  Jun Huang <huangjuniter@foxmail.com>
 1  Khem Raj <raj.khem@gmail.com>
 1  Leo Yu-Chi Liang <ycliang@andestech.com>
 1  Luo xiaoyu <luoxiaoyu9@huawei.com>
 1  Ross Burton <ross.burton@arm.com>
 1  Sharan Turlapati <sturlapati@vmware.com>
 1  Xiao Liang <xiliang@redhat.com>
 1  Xiao Yang <yangx.jy@cn.fujitsu.com>
 1  Zhao Gongyi via ltp <ltp@lists.linux.it>

And also thanks to patch reviewers:

git log 20220527.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

118 Petr Vorel <pvorel@suse.cz>
114 Cyril Hrubis <chrubis@suse.cz>
 77 Li Wang <liwang@redhat.com>
 65 Richard Palethorpe <rpalethorpe@suse.com>
 18 Jan Kara <jack@suse.cz>
 13 Martin Doucha <mdoucha@suse.cz>
  6 Yang Xu <xuyang2018.jy@fujitsu.com>
  5 Matthew Bobrowski <repnop@google.com>
  4 Amir Goldstein <amir73il@gmail.com>
  2 Jan Stancek <jstancek@redhat.com>
  1 Thomas Petazzoni <thomas.petazzoni@bootlin.com>
  1 Joerg Vehlow <joerg.vehlow@aox-tech.de>
  1 Christian Brauner (Microsoft) <brauner@kernel.org>
  1 Avinesh Kumar <akumar@suse.de>
Assets 10
Loading

LTP 20220527

27 May 09:26
@metan-ucw metan-ucw
20220527
6f88e0f
Compare
Choose a tag to compare
LTP 20220527

NOTABLE CHANGES

  • New tests

    • kvm_pagefault01: aka CVE-2021-38198
    • fcntl39: test for DN_RENAME (dnotify)
    • io_control01: first cgroup IO controller test
    • keyctl09: test encrypted keys with provided decrypted data
    • memcontrol03, memcontrol04: tests that cgroup memory is partitioned correctly under pressure
    • setsockopt09: regression test for use-after-free in prb_retire_rx_blk_timer_expired()
    • setsockopt09: regression test for double free of rx_owner_map aka CVE-2021-22600
    • pty07: regression test for use-after-free in vt_ioctl()
    • pty06: regression test for VT_DISALLOCATE freeing in-use virtual console
    • pidfd_getfd01 basic functional test
    • pidfd_getfd02 basic error test
    • pidfd_open04 test with PIDFD_NONBLOCK flag
    • futex_waitv01 error tests
    • futex_waitv02 basic functional test with private memory
    • futex_waitv03 basic functional test with shared memory
    • inotify11: test opening files after receiving IN_DELETE
      regression test for a37d9a17f099 (fsnotify: invalidate dcache before IN_DELETE event)
    • statx09 test for STATX_ATTR_VERITY
    • wqueue09 tests WATCH_META_LOSS_NOTIFICATION event
    • wqueue08 tests WATCH_META_REMOVAL_NOTIFICATION event
    • wqueue07 tests NOTIFY_KEY_SETATTR event
    • wqueue06 tests NOTIFY_KEY_CLEARED event
    • wqueue05 tests NOTIFY_KEY_INVALIDATED event
    • wqueue04 tests NOTIFY_KEY_LINKED event
    • wqueue03 tests NOTIFY_KEY_REVOKED event
    • wqueue02 tests NOTIFY_KEY_UNLINKED event
    • wqueue01 tests NOTIFY_KEY_UPDATED event

  • Increased coverage

    • fanotify14, fanotify16: Add tests for FAN_REPORT_TARGET_FID and FAN_RENAME
    • futex_waitv01: Add test verifies EINVAL for invalid nr_futexes
    • getcontext01: Test rewritten so that it actually jumps back
    • fstat02: Validate st_nlink as well
    • sched_get_priority_max01, sched_get_priority_min01: Add missing policies

  • KVM library was written for LTP

  • The concept of test runtime was introduced

  • Removed tests

    • syslog tests as these were testing mostly userspace syslog daemon
      and were broken for most of the syslog daemon implementations

  • The test library was fixed to terminate all leftover processes in the case
    that the main test process dies or exits

  • New sparse check for {} terminator for struct arrays in tst_test has been
    implemented

  • Shell library improvements

    • added support for $TST_FORMAT_DEVICE (.format_device in C API)
    • preparations for shell API get support for testing on all filesystems (.all_filesystems in C API)
    • getopts cleanup and changes how is the library sources,
      which resulted in much simpler library code

  • Userns tests were rewritten into the new test API

  • Mountns tests were rewritten into the new test API

  • 33 tests were rewritten to the new library

  • The usual amount of fixes and cleanups

WHAT IS IN THE QUEUE

In-flight patches include:

  • CGroup shell test rewrite that should fix many problems

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • Several fixes (e.g. important nfs_lib: Fix fsid randomisation)

  • Ongoing discussion where should be SCTP testsuite home

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20220527

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/BuildSystem
Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@lists.linux.it.

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20220121..

72  Petr Vorel <pvorel@suse.cz>
51  Cyril Hrubis <chrubis@suse.cz>
42  Andrea Cervesato <andrea.cervesato@suse.de>
22  Li Wang <liwang@redhat.com>
21  Richard Palethorpe <rpalethorpe@suse.com>
17  Martin Doucha <mdoucha@suse.cz>
15  Yang Xu <xuyang2018.jy@fujitsu.com>
10  Jan Stancek <jstancek@redhat.com>
10  Zhao Gongyi <zhaogongyi@huawei.com>
 7  Amir Goldstein <amir73il@gmail.com>
 6  Dai Shili <daisl.fnst@fujitsu.com>
 6  Bogdan Lezhepekov <blezhepekov@suse.de>
 4  tangmeng <tangmeng@uniontech.com>
 2  Chunyu Hu <chuhu@redhat.com>
 2  Kushal Chand <kushalkataria5@gmail.com>
 2  xiaoshoukui <xiaoshoukui@ruijie.com.cn>
 1  Alexander Ivanov <alexander.ivanov@virtuozzo.com>
 1  Alexander Kanavin <alex@linutronix.de>
 1  Andrea Arcangeli <aarcange@redhat.com>
 1  Edward Liaw via ltp <ltp@lists.linux.it>
 1  Fabrice Fontaine <fontaine.fabrice@gmail.com>
 1  Pavel Tikhomirov <ptikhomirov@virtuozzo.com>
 1  Wang Kunfeng via ltp <ltp@lists.linux.it>
 1  Yael Tzur via ltp <ltp@lists.linux.it>
 1  ihsinme <ihsinme@gmail.com>

And also thanks to patch reviewers:

git log 20220121.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

148 Cyril Hrubis <chrubis@suse.cz>
105 Petr Vorel <pvorel@suse.cz>
 73 Li Wang <liwang@redhat.com>
 21 Yang Xu <xuyang2018.jy@fujitsu.com>
 17 Richard Palethorpe <rpalethorpe@suse.com>
 10 Martin Doucha <mdoucha@suse.cz>
  6 Jan Stancek <jstancek@redhat.com>
  1 Waiman Long <longman@redhat.com>
  1 Jan Kara <jack@suse.cz>
  1 Gabriel Krisman Bertazi <krisman@collabora.com>
  1 Andrea Cervesato <andrea.cervesato@suse.de>
  1 Alexey Kodanev <aleksei.kodanev@bell-sw.com>
Assets 8
Loading

LTP 20220121

21 Jan 20:03
@metan-ucw metan-ucw
20220121
b0561ad
Compare
Choose a tag to compare
LTP 20220121

Since the last release 269 patches by 32 authors were merged.

Patch review is what most of the projects struggle with and LTP is no
different. If you can spare some effort helping with the patch review is more
than welcomed.

NOTABLE CHANGES

  • New tests

    • quotactl{08,09} tests for quota info hidden in filesystem.
    • fanotify22 test for FAN_FS_ERROR events by intentionally corrupting a fs image
    • memcontrol02 test for cgroup memory.current and memory.stat
    • memcontrol01 test for cgroup subtree_control and memory controller
    • write06 test if write() works correctly with O_APPEND fd
    • statx08 statx test for the stx_attributes_mask
    • fanotify{20,21} tests for FAN_REPORT_PIDFD
    • irqbalance01 test that tries to assert that IRQ are spread between CPUs reasonably
    • dup207 tests that file offset is correct for both original and dup()ed fds
    • dup206 tests special case where oldfd == newfd
    • ima_conditionals.sh test uid, gid, fowner, and fgroup options added
      in kernel commit 40224c41661b ("ima: add gid support") from v5.16

  • Increased coverage

    • quotactl* tests added support for quotactl_fd and hidden quota files
    • quotaclt* tests also test with vfsv1 format
    • statx01 added check for stx_mnt_id
    • statx01 added check for nlink
    • stat01 added check for nlink
    • finit_module02 added ETXTBSY check
    • epoll_create added two test variants (libc wrapper and raw syscall)
    • creat09 runs on all filesystems now
    • dup202 added check that file mode is same after it has been changed on dup()ed fd

  • The test library process, that watches over timeouts and carries on with the
    test cleanup, now adjusts it's own OOM score so that it's more likely that it
    outlives the child process that runs the test

  • First half of the ltp-aiodio testcases was rewritten and cleaned up

    • the rewritten tests are free of runtest file hacks that were problematic for years
    • the second half should get fixed during the next development cycle
    • the rewritten tests so far are:
      • dio_truncate
      • dio_read (previously ltp-diorh)
      • dio_append
      • dio_sparse
      • aiodio_append

  • 39 tests were rewritten to the new library

  • 'make check' improvements

    • added check if test.tags is properly NULL terminated
    • added check if test global functions and variables are static
    • fixed not to report tst_ prefixed static inline functions

  • The test library gained support for 'known-fail' tag

    • to mark kernel bugs that are unfixed for a long time
    • this is similar to the existing tags
    • the first use of the interface are ustat() tests that are failing on Btrfs
      ever since the introduction of the filesystem

  • The test library gained support for version check when a tool is required to
    be installed on a system, e.g. .needs_cmds = {"mkfs.ext4 >= 1.43.0", NULL} will
    skip the test unless the mkfs.ext4 is present and the version is at least 1.43.0

  • The test library added .supported_archs field to the test_test structure
    which can be used to limit the test to a subset of CPU architectures

  • The test library added .skip_in_compat flag to skip tests in compat (-m32) mode

  • The shell library gained support boolean expressions on kernel .config
    variables

  • New environment variable KCONFIG_SKIP_CHECK was added that allows users to
    skip kernel config checks

  • New environment variable LTP_SINGLE_FS_TYPE was added that can be
    used to limit tests that run against all filesystem to a single one

  • The new library testcases now print environment variables in help (-h)

  • The test metadata are parsed during the build and installed by default now,
    which is another step towards making the test executor smarter.

  • The usual amount of fixes and cleanups

WHAT IS IN THE QUEUE

In-flight patchse include:

  • KVM test infrastructure that would allow us implement KVM regression tests
  • watchqueue (pipe based kernel notification) testsuite
  • futex_waitv tests
  • CGroup testcases and fixes
  • Test runtime API for the test library that would allow us to controll
    testrun runtime explicitly and fix a few tests that run into timeouts
    on older/slower hardware

Unfortunately the runltp-ng is still not included in LTP, we will try to work
on it during the next development cycle as well, but we can't promise it will
be rock stable to be included in the next release either.

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • NFS tests get support for emulating external server activity
  • fix: run exportfs at "server side" in LTP_NETNS case
  • new test: nfs07.sh - NFS directory listing regression

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20220121

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/BuildSystem

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@lists.linux.it.

CREDITS

Many thanks to the people contributing to this release:
git shortlog -s -e -n 20210927..

51  Petr Vorel <pvorel@suse.cz>
47  Yang Xu <xuyang2018.jy@fujitsu.com>
31  Richard Palethorpe <rpalethorpe@suse.com>
24  Joerg Vehlow <joerg.vehlow@aox-tech.de>
17  Cyril Hrubis <chrubis@suse.cz>
15  Andrea Cervesato <andrea.cervesato@suse.com>
14  tangmeng <tangmeng@uniontech.com>
 9  Gabriel Krisman Bertazi <krisman@collabora.com>
 7  zhanglianjie <zhanglianjie@uniontech.com>
 6  Dai Shili <daisl.fnst@fujitsu.com>
 6  Li Wang <liwang@redhat.com>
 6  Martin Doucha <mdoucha@suse.cz>
 4  Jan Stancek <jstancek@redhat.com>
 3  Alex Henrie <alexh@vpitech.com>
 3  Matthew Bobrowski <repnop@google.com>
 3  Zhao Gongyi <zhaogongyi@huawei.com>
 3  sujiaxun <sujiaxun@uniontech.com>
 2  Krzysztof Kozlowski <krzysztof.kozlowski@canonical.com>
 2  QI Fuli <qi.fuli@fujitsu.com>
 2  Ralph Siemsen <ralph.siemsen@linaro.org>
 2  YiLin.Li <YiLin.Li@linux.alibaba.com>
 2  wenyehai <wenyehai@huawei.com>
 1  Bogdan Lezhepekov <bogdan.lezhepekov@suse.com>
 1  Egor Petrov <egor.petrov@oracle.com>
 1  Fabian Vogt <fvogt@suse.de>
 1  Fabrice Fontaine <fontaine.fabrice@gmail.com>
 1  Masayoshi Mizuma <m.mizuma@jp.fujitsu.com>
 1  Nikita Yushchenko <nikita.yushchenko@virtuozzo.com>
 1  Thadeu Lima de Souza Cascardo <cascardo@canonical.com>
 1  Wang Kunfeng <threefifteen.wangkunfeng@huawei.com>
 1  chengweibin <chengweibin@uniontech.com>
 1  sujiauxn <sujiaxun@uniontech.com>

And also thanks to patch reviewers:

git log 20210927.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

154 Cyril Hrubis <chrubis@suse.cz>
 71 Petr Vorel <pvorel@suse.cz>
 29 Li Wang <liwang@redhat.com>
 24 Richard Palethorpe <rpalethorpe@suse.com>
 12 Amir Goldstein <amir73il@gmail.com>
 11 Yang Xu <xuyang2018.jy@fujitsu.com>
  9 Martin Doucha <mdoucha@suse.cz>
  3 Tim Bird <tim.bird@sony.com>
  3 Matthew Bobrowski <repnop@google.com>
  3 Jan Stancek <jstancek@redhat.com>
  3 Eric Biggers <ebiggers@google.com>
  3 Alexey Kodanev <aleksei.kodanev@bell-sw.com>
  2 Liu Xinpeng <liuxp11@chinatelecom.cn>
  2 Andrea Cervesato <andrea.cervesato@suse.com>
  1 Petr Vorel <petr.vorel@gmail.com>
  1 Mimi Zohar <zohar@linux.ibm.com>
Assets 10
Loading

LTP 20210927

27 Sep 14:51
@metan-ucw metan-ucw
20210927
12beeda
Compare
Choose a tag to compare
LTP 20210927

Since the last release 483 patches by 40 authors were merged.

This is a record breaking release by the number of patches as well as by the
amount of newly implemented functionality. Many thanks to all contributors!

And even more thanks to the reviewers!

Patch review is what most of the projects struggle with and LTP is no
different. If you can spare some effort helping with the patch review is more
than welcomed.

NOTABLE CHANGES

  • New tests

    • epoll_ctl05 checks for ELOOP error for circular loop of epolls
    • epoll_ctl04 checks for EINVAL when epoll nesting is too deep
    • epoll_ctl02 checks for EPERM when epoll is not supported for fd
    • epoll_create01 checks that epoll create returns a valid fd
    • epoll_create1_02 checks for EINVAL when epoll_create1() is passed invalid flags
    • epoll_pwait02 test if events are reported properly
    • epoll_pwait03 tests if epoll_pwait/epoll_pwait2 timeouts correctly
    • epoll_pwait04 adds tests for zero timeout and invalid timespec values
    • shmget05 test for /proc/sys/kernel/shm_next_id
    • shmget06 test when shm_next_id is already in use
    • io_getevents02 checks for EINVAL errors via libaio
    • io_cancel02 checks for EFAULT errors via libaio
    • io_submit03 checks for invalid input via syscall
    • io_submit02 checks if correct operation via syscall
    • io_setup02 checks for invalid inputs via syscall
    • io_destroy02 checks for invalid inputs via syscall
    • cfs_bandwidth01 a multi-level cgroup cpu controller test

  • New regression tests

    • creat09 privilege escalation using setgid directory aka CVE-2018-13405
    • can_bcm01 race condition vulnerability in CAN BCM aka CVE-2021-3609
    • setsockopt08 out-of-bounds write corrupting aka CVE-2021-22555
    • perf_event_open03 kernel memory leak aka CVE-2020-25704
    • squashfs01 regression test for broken sanity checks
    • set_mempolicy05 information leak aka CVE-2017-7616
    • userns08 broken id mappings in nested namespaces CVE-2018-18955
    • tc01.sh regression test for tc qdisc command
    • fanotify19 added regression test for:
      a8b98c808eab ("fanotify: fix permission model of unprivileged group")
    • kill13 INT_MIN negation reproducer aka CVE-2018-10124
    • wait403 INT_MIN negation reproducer
    • vsock01 race condition reproducer aka CVE-2021-26708
    • icmp_rate_limit01 DNS cache poisoning attack aka CVE-2020-25705

  • Increased coverage

    • epoll_create02 checks for more EINVAL failures
    • epoll_ctl03 checks that the syscall works with all valid flags combinations
    • mbind01 more tests for MPOL_LOCAL
    • epoll_pwait01 adds test variants for epoll_pwait2()

  • 75 tests were rewritten to the new library

  • Removed tests

    • sched/stress as it was unmaintained and unused for years
    • stress_cd and stress_floppy since these scripts were broken and unmaintained for years
    • disktest as it was unmaintained and unused for years

  • The CI was moved from Travis to GitHub actions

  • 'make check' was introduced to the LTP build system

    • which is a tool for developers that runs various sanity checks on the source code
    • this includes:
      • checkpatch.pl, custom set of sparse rules for C
      • checkbashism.pl for shell
    • please make sure you run 'make check' or 'make check-testname' and fix the
      warnings before submitting patches

  • Subset of our library tests i.e. tests for the test library is now executed
    CI in github actions, this is ongoing effort to make sure that the test library
    used by the testcases is working as expected

  • The test library was fixed to print all messages to stderr

  • Testcases were fixed not to expect certain users and groups to be present on the system

    • some tests were expecting bin, daemon and similar groups and users to exist on the system
    • now LTP depends only on user 'nobody' and group 'nogroup'

  • New environment variable LTP_VIRT_OVERRIDE was added

  • Fixed (again) timeouts in shell test library

    • turns out you cannot make timeouts in shell race-free so the timeout logic
      is now implemented in a small C helper binary

  • Finally after the years we are slowly making tests limits-aware

    • cgropup tests and a few others are now aware of pid limits imposed by the system
    • next step would be doing rough estimates on the number of processes we can run
      based on the free system memory

  • There is ongoing effort to fix LTP cgroup tests, this release includes many
    small fixes and improvements in the cgroup tests

  • The aarch64 system call table was fixed not to include 32bit only syscall numbers

  • The TST_EXP_*() macros were improved and a few bugs were fixed

  • The test library developer documentation and tutorials were reorganized and improved

  • The more that the usual amount of fixes and cleanups

WHAT IS IN THE QUEUE

Next release will hopefully include runltp-ng which is new and improved LTP
testrunner. The current runltp script will be maintained alongside with the
new solution for some time but removed after a few releases.

You are more than welcome to try it and make sure that it works for you before
it becomes the official LTP testrunner.

See: https://github.com/metan-ucw/runltp-ng

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • C network library

  • Shell network library

    • Allow to skip initialization with TST_NET_SKIP_VARIABLE_INIT=1
    • Disable IPv6 Duplicate Address Detection on link-local addresses

  • Tests rewritten to the new library

    • getaddrinfo01
    • ssh-stress

  • Removed tests

    • broken_ip-totlen
  • More busybox and general fixes

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20210927

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/BuildSystem

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@lists.linux.it.

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20210927..

87  Petr Vorel <pvorel@suse.cz>
51  Xie Ziyao <xieziyao@huawei.com>
51  Richard Palethorpe <rpalethorpe@suse.com>
50  Martin Doucha <mdoucha@suse.cz>
30  Krzysztof Kozlowski <krzysztof.kozlowski@canonical.com>
29  Cyril Hrubis <chrubis@suse.cz>
28  Alexey Kodanev <aleksei.kodanev@bell-sw.com>
27  Yang Xu <xuyang2018.jy@fujitsu.com>
20  Li Wang <liwang@redhat.com>
18  zhanglianjie <zhanglianjie@uniontech.com>
17  Joerg Vehlow <joerg.vehlow@aox-tech.de>
12  Vinay Kumar <vinay.m.engg@gmail.com>
 8  Xie Ziyao <ziyaoxie@outlook.com>
 7  sujiaxun <sujiaxun@uniontech.com>
 5  Bogdan Lezhepekov <bogdan.lezhepekov@suse.com>
 5  Dai Shili <daisl.fnst@fujitsu.com>
 5  Jan Stancek <jstancek@redhat.com>
 5  QI Fuli <qi.fuli@fujitsu.com>
 4  Leo Liang <ycliang@andestech.com>
 2  Alexander Egorenkov <egorenar@linux.ibm.com>
 2  Amir Goldstein <amir73il@gmail.com>
 2  Shiyang Ruan <ruansy.fnst@fujitsu.com>
 2  Thadeu Lima de Souza Cascardo <cascardo@canonical.com>
 2  Zhao Gongyi <zhaogongyi@huawei.com>
 1  Alessio Balsini <balsini@android.com>
 1  Bogdan Lezhepekov via ltp <ltp@lists.linux.it>
 1  Cao jin <caojin@uniontech.com>
 1  Egor Petrov <egor.petrov@oracle.com>
 1  Ian May <ian.s.may@gmail.com>
 1  John Stultz <john.stultz@linaro.org>
 1  Leo Yu-Chi Liang <ycliang@andestech.com>
 1  Marius Hillenbrand <mhillen@linux.ibm.com>
 1  Naresh Kamboju <naresh.kamboju@linaro.org>
 1  Radoslav Kolev <radoslav.kolev@suse.com>
 1  Wang Xin <wangxin410@huawei.com>
 1  Xiao Yang <yangx.jy@fujitsu.com>
 1  Zou Wei <zou_wei@huawei.com>
 1  dongshijiang <dongshijiang@inspur.com>

And also thanks to patch reviewers:

git log 20210927.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

289 Cyril Hrubis <chrubis@suse.cz>
113 Petr Vorel <pvorel@suse.cz>
 75 Li Wang <liwang@redhat.com>
 25 Richard Palethorpe <rpalethorpe@suse.com>
 16 Yang Xu <xuyang2018.jy@fujitsu.com>
 12 Alexey Kodanev <aleksei.kodanev@bell-sw.com>
  7 Jan Stancek <jstancek@redhat.com>
  6 Richard Palethorpe <rpalethorpe@suse.de>
  5 Xiao Yang <yangx.jy@fujitsu.com>
  5 Martin Doucha <mdoucha@suse.cz>
  3 Joerg Vehlow <joerg.vehlow@aox-tech.de>
  3 Enji Cooper <yaneurabeya@gmail.com>
  2 Krzysztof Kozlowski <krzysztof.kozlowski@canonical.com>
  1 Yang Xu <xuyang2018.jy@fujitsu.com
  1 Xie Ziyao <xieziyao@huawei.com>
  1 Stephen Kitt <steve@sk2.org>
  1...
Read more
Assets 10
Loading