Skip to content

Conversation

@spoorthys1303
Copy link
Collaborator

No description provided.

spoorthys1303 and others added 30 commits March 11, 2025 21:26
Support --break-system-packages, introduced in pip 23.1,
ensuring graceful handling for compatibility.
https://peps.python.org/pep-0668/

Fixes: d647422 ("Fix for pip issue with Ubuntu")
d647422

Reviewed-by: Narasimhan V <[email protected]>
Reviewed-and-tested-by: Srikanth Aithal <[email protected]>
Signed-off-by: Ayush Jain <[email protected]>
Fix pip based installation in helper
Currently branch checkout fails for tests. This
commit fixes it.

Signed-off-by: Srikanth Aithal <[email protected]>
As expected tests path in cfg should be
	<repo_name>/<test_file_path>

currently this is broken and needs to pass "tests/" along with it
	tests/<repo_name>/<test_file_path>

Fix that by joining TEST_DIR with tests path making it
	TEST_DIR/<tests_path> (TEST_DIR="$BASE_PATH/tests")

Signed-off-by: Ayush Jain <[email protected]>
Adds a final count summary at the end of the test run, displaying the
total number of tests and their statuses (e.g., PASS, FAILURES, SKIP).

Example output:

Final count summary for tests run:

  TOTAL                4
  PASS                 2
  CANCEL               2
  ERRORS               0
  FAILURES             0
  SKIP                 0
  WARN                 0
  INTERRUPT            0

Signed-off-by: Ayush Jain <[email protected]>
There are following possible testsuite run status
"Run" "Not_Run" "Cant_Run"

Print summary of testsuites post completion

Examples Output:

    TestSuite                                                                                TestRun    Summary

    host_sanity_test_linsched                                                                Run        Successfully executed
    /home/Avocadotests/results/job-2025-04-12T13.29-b585cfe/job.log
    | PASS 1 || CANCEL 0 || ERRORS 0 || FAILURES 0 || SKIP 0 || WARN 0 || INTERRUPT 0 |

    host_sanity_test_numactl_Numactl_test_localalloc_numa_fc                                 Run        Successfully executed
    /home/Avocadotests/results/job-2025-04-12T13.29-6d7be4d/job.log
    | PASS 0 || CANCEL 1 || ERRORS 0 || FAILURES 0 || SKIP 0 || WARN 0 || INTERRUPT 0 |

    host_sanity_test2_sanity_test2                                                           Not_Run    Command execution failed

    host_sanity_test3                                                                        Cant_Run   Config file not present

    Test suites status:

    TOTAL                4
    RUN                  2
    NOT_RUN              1
    CANT_RUN             1

Signed-off-by: Ayush Jain <[email protected]>
Replaced all direct string usages of test suite run statuses
("Run", "Not_Run", "Cant_Run") with their corresponding
Testsuite_status enum values for consistency and improved type safety.

Signed-off-by: Ayush Jain <[email protected]>
Handle tests repo clone and update gracefully

Signed-off-by: Ayush Jain <[email protected]>
Add helper comments for branch and subdirectory argument to base
framework and tests

Signed-off-by: Ayush Jain <[email protected]>
Add helper comments to env.conf
Fix tests file path from test cfg
Print Testsummary for testsuites and testruns post results
Add following config options to extend config support to allow
user-defined options in addition to default values.
1. "--config-env" : Specify env config path
2. "--config-norun" : Specify no run tests config path

Signed-off-by: Ayush Jain <[email protected]>
Update README helper statement
Added new config-env and config-norun options documentation

Signed-off-by: Ayush Jain <[email protected]>
Add config option for env and norun configurations and Update README
…the patch.

Usage:
    ./Gentest.py PATCH_NAME

Example:
    ./Gentest.py fs-patch

Description:
    - Takes the patch file name as an argument in the same location.
    - User can pass CLI commands to history argument
    - Generates a test code file for the patch using avocado-misc-tests style.
    - Extracts only the relevant Python code (like import statements, function and class blocks)
      from the generated output file and writes it to a final Python file.

Signed-off-by: yeswanth <[email protected]>
script runs the WCA_CLI commands and can also generate test code
Introducing a wild character "$", for marking that package_name
is not a absolute package name ie substrings.

Also update package check in ubuntu distro to
`apt list --installed | grep -i 'package_name'"
to avoid mischeck of packages uninstalleted package's stale cfg file.

Reported-by: Dheeraj Kumar Srivastava <[email protected]>
Signed-off-by: Ayush Jain <[email protected]>
Fix package install for non ubuntu systems like rhel.

Fixes: 67b11f1("Fix package install")

Signed-off-by: Ayush Jain <[email protected]>
Fix package install in tests for non ubuntu system
Move paths like test config path, results path, and more to env.conf.
This makes it configurable via env.conf rather than changing the
script.

Signed-off-by: Narasimhan V <[email protected]>
Move paths to env.conf to make it configurable
…347)

1. Added missing configs to run the existing tests
2. Added new configs to run the newly added tests for pci passthrough

Signed-off-by: Tasmiya Nalatwad <[email protected]>
Enable installation of prerequisite pip packages listed in the pip-package section
of the config file.

Signed-off-by: Srikanth Aithal <[email protected]>
Enable prerequisite pip packages installation
bssrikanth and others added 18 commits September 29, 2025 10:24
Enhance wrapper to work with either branch/tag for the tests, along with minor
error handling improvements.

Signed-off-by: Srikanth Aithal <[email protected]>
Add branch/tag handling for tests
Removing 16M hugepage related tests from memory test bucket as 16M hugepage size only support with Hash. And hash guests are not supported with KVM on PowerVM
Hence removing them for now.

Signed-off-by: Tasmiya Nalatwad <[email protected]>
Created new config files divided as P1, P2 & P3 priorities. I have added
all the passed tests to run and for now removed the FAILED and ERRORED tests.
Mentioned those tests as "no" in the config files..
Signed-off-by: Anushree-Mathur <[email protected]>
…#378)

Created new config files divided as P1, P2 & P3 priorities. I
have added all the passed tests to run and for now removed the
FAILED, CANCELLED and ERRORED tests. Mentioned those tests as "no"
in the config files.

Signed-off-by: Anushree-Mathur <[email protected]>
Co-authored-by: Anushree-Mathur <[email protected]>
Adding P1, P2 and P3 priority config files for CPU Test Bucket
Removing the memory parameters to take the default
parameters from subtest cfg
Add cpu and other topology values to match the libvirt
mem subtest script

Signed-off-by: Misbah Anjum N <[email protected]>
The virsh.snapshot_create_as.negative_tests.network_disk.iscsi.device_lun
requires bus as "scsi" and target as "sdb"
The default bus "virtio" (virtio-blk) and default disk "sda" are leading
to error since virtio-blk is not support for iscsi emulation and default
disk sda is leading to duplicacy.

Signed-off-by: Misbah Anjum N <[email protected]>
Some tests were failing because of the nfs-utils library not being
present. With this PR merged, the presence of the library will be
checked during bootstrapping. This should help avoid further
issues of tests running without the module being present.
Update env.conf file to add nfs-utils for Fedora
Test cases in memory test bucket are prioritised and divided in P1 P2 and P3 priority cfgs. Running each cfg seperately will help execute only that particular priority tests cases from Memory test bucket.

Signed-off-by: Tasmiya Nalatwad <[email protected]>
…ucket

Test cases in vfio test bucket are prioritised and divided in P1 P2 and P3 priority cfgs. Running each cfg seperately will help execute only that particular priority test cases from pci passthrough test bucket.

Signed-off-by: Tasmiya Nalatwad <[email protected]>
Test cases in storage test bucket are prioritised and divided in P1 P2 and P3 priority cfgs. Running each cfg seperately will help execute only that particular priority test cases from storage test bucket.

Signed-off-by: Tasmiya Nalatwad <[email protected]>
Add network_p1 test bucket with 218 p1 test cases
Add network_p2 test bucket with 118 p2 test cases
Add network_p3 test bucket with 488 p3 test cases

Signed-off-by: Misbah Anjum N <[email protected]>
preallocate doesn't support encrypted raw and qcow2

Signed-off-by: Sneh Shikha Yadav <[email protected]>
@spoorthys1303 spoorthys1303 merged commit 3c13e3f into KVMCI Jan 6, 2026
0 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.