Commit graph

1292 commits

Author SHA1 Message Date
Tomáš Hozza
a610bc3843 test/koji.sh: refactor and extend testing of build metadata
Refactor koji.sh:
- Store Koji hub URL in a variable and use it instead of a literal.
- Do not inspect builinfo output and don't parse it using grep and sed,
  but instead directly call Koji XMLRPC functions (using `koji call`)
  with JSON output.

In addition, test that the image archive extra metadata are the same as
those stored in the build extra metadata, stored under the image
filename.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-09-27 12:39:28 +02:00
yih
2c65ee228b add test case for iot-qcow2-image 2023-09-20 13:43:24 +08:00
Sanne Raymaekers
1e7e1308ab test/cases/api: don't print command traces
Causes some secrets to be dumped into the logs.
2023-09-19 22:57:06 +02:00
Sanne Raymaekers
522a54188a test/api: add oci test 2023-09-19 22:57:06 +02:00
Xiaofeng Wang
7259deea3a test: add workaround for bug https://issues.redhat.com/browse/RHEL-4992 2023-09-19 11:34:48 +02:00
Xiaofeng Wang
44e6278c9d test: remove workaround for bug BZ#2234390 2023-09-18 18:14:58 -07:00
Gianluca Zuccarelli
0311ef449d test/cases: OpenSCAP cloudapi tests
Run a basic check to see that the tailoring file has been created when
adding tailoring rules to the OpenSCAP config. Since the OpenSCAP scan
requires more memory and breaks some of the API tests, a full scan is
not run in the cloudapi tests.
2023-09-18 20:46:49 +02:00
Gianluca Zuccarelli
9af8579eb5 test/cases: add tailoring to oscap test
Add relevant checks to test for OpenSCAP tailoring features. The test
removes (unselects) a single rule.
2023-09-18 20:46:49 +02:00
Sanne Raymaekers
360df12548 test/cases/ubi-wsl: set --os-type when creating vm
Solves `invalid usage for storage profile: attach existing managed OS disk`.
2023-09-15 15:03:48 +02:00
Sanne Raymaekers
e698e104d9 test/cases/ubi-wsl: fix waiting for a valid ipv4
The counter never made it past 10.
2023-09-01 14:04:37 +02:00
Alexander Todorov
f2f1c8d0f0 Remove deprecated --os-type cli argument
test logs print:

[2023-08-22T10:18:14-04:00] 💿 Install image via installer(ISO) on VM
WARNING  --os-type is deprecated and does nothing. Please stop using it.
2023-09-01 13:22:30 +02:00
Xiaofeng Wang
f0c1fe2d98 test: fix "Waiter SnapshotImported failed: Max attempts exceeded" 2023-08-31 11:54:18 +02:00
Xiaofeng Wang
f0eb8e9738 test: add workaround for bug BZ#2234390 2023-08-30 09:29:50 +02:00
Sanne Raymaekers
b26458f1f1 oci/upload: create image capability schema
After creating the custom image, make sure the capabilities default to
paravirtualized.
2023-08-28 10:29:14 +02:00
Sanne Raymaekers
adf2d5b22a test/cases/oci: add oci integration test 2023-08-28 10:29:14 +02:00
Sanne Raymaekers
93fc55f98a test/cases/ubi-wsl: public ip fixes
Use the "Standard" public ip sku, as "Basic" produces warnings.

Spin until the vm gets assigned a valid ipv4 address.
2023-08-28 08:44:12 +02:00
Alexander Todorov
8aca402dff Add softlockup_all_cpu_backtrace=1 boot argument
should trigger a kernel trace instead of only warnings
2023-08-28 08:36:07 +03:00
Sanne Raymaekers
e92ead5449 test/cases/koji: build nightlies 2023-08-17 15:07:20 +02:00
Sanne Raymaekers
a82e3c38c8 diff-manifests: CRB is enabled in the prepareScript 2023-08-17 15:07:20 +02:00
Sanne Raymaekers
757ca2f51a test/data/repositories: use the cdn for rhel-88 and rhel92 2023-08-17 15:07:20 +02:00
Sanne Raymaekers
e7e6a9095a test/cases/ubi-wsl: double ssh timeout
This times out on occasion, give azure and windows a bit more time.
2023-08-17 15:44:07 +03:00
Xiaofeng Wang
dc5583b382 test: add aws ec2 wait commands for instance terminate, image
register, and instance running
2023-08-14 18:30:06 +02:00
Xiaofeng Wang
84728ea85d test: re-format some long shell commands shorter 2023-08-14 18:30:06 +02:00
Xiaofeng Wang
37faf0d929 test: run greenboot rollback test on ostree.sh, ami and vsphere
Do not need to run greenboot rollback test on all tests to save
some time
2023-08-14 11:12:14 +02:00
Xiaofeng Wang
16e27dad1b test: update edge-ami test to support aarch64 2023-08-11 22:52:14 +02:00
Xiaofeng Wang
8678125f89 test: add workaround for bug 2230537 and 2229722 2023-08-11 20:55:35 +08:00
Xiaofeng Wang
336842d7bb test: update ostree.sh to test ostree commit as value of --parent 2023-08-10 12:49:44 +02:00
Tomáš Hozza
4ac6a7a11d Koji: expose boot mode in image extra metadata
Also extend the Koji test case to verify that the boot mode information
is in the build extra metadata and that it contains valid value.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-08-08 15:53:07 +02:00
Tomáš Hozza
af1c373407 Koji: expose image output metadata in build extra metadata
Expose the extra metadata information for each image output stored in
`ImageExtraInfo` also in the build extra metadata. The extra metadata
for each image is nested under key corresponding to the image filename.

Extend the Koji test case to check information in the buildinfo output
and specifically check for all expected metadata in the build Extra
metadata field.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-08-08 15:53:07 +02:00
Sanne Raymaekers
1b04a78120 test/cases/api: add check for subscription-manager facts 2023-08-07 20:47:20 +02:00
Achilleas Koutsou
6a3b0af934 test: update repositories for building Fedora images
Update the rpmrepo snapshots used in tests for building Fedora images.
2023-08-03 10:35:21 +02:00
Achilleas Koutsou
d3ef361dd5 test: update repos and manifests
Summary of changes:
- ova image type uses ustar format
    - https://github.com/osbuild/images/pull/16
- New image type "minimal-raw"
    - https://github.com/osbuild/images/pull/29
- Fedora repositories and test manifests updated
    - https://github.com/osbuild/images/pull/57
- Distro aliases for major version without minor updated
    - https://github.com/osbuild/images/pull/59
2023-08-03 10:35:21 +02:00
Brian C. Lane
4c7b3dd25a test: Make log errors easier to find
We were using greenprint for failures, which makes it hard to quickly
find where the tests failed. This switches errors to use redprint, and
adds it to places that were simply using echo before doing an exit 1.
2023-08-02 14:46:35 +02:00
yih
f889be9e05 test edge-vsphere image 2023-08-01 14:18:17 +08:00
Xiaofeng Wang
967570a2a6 test: Add workaround for BZ#2213660 and #2225667 2023-07-26 22:23:41 +08:00
Brian C. Lane
2e7afcffe1 test: Fix Fedora 39 snapshot urls in test repo 2023-07-26 12:16:24 +02:00
Sanne Raymaekers
b2451c6247 test: add ubi-wsl test 2023-07-25 10:53:21 +02:00
Alexander Todorov
38ed9a39be Start collecting logs from virt-install 2023-07-21 12:11:02 +02:00
Achilleas Koutsou
ee0c7b53dc test/README: update test manifest generation instructions 2023-07-21 12:05:50 +02:00
Achilleas Koutsou
52234c5fd1 test/README: describe vendoring of modified images repo
Add instructions for how to test an updated osbuild/images repo against
osbuild-composer.
2023-07-21 12:05:50 +02:00
Xiaofeng Wang
8ba6487b82 test: update for minimal raw new xz format 2023-07-21 12:05:00 +02:00
Achilleas Koutsou
3bbcc8a7cc Remove test that depends on removed code from images
Manifest tests can no longer run and also aren't needed.
All image type manifests are generated and built in the obsuild/images
CI tests and the test function in images
(distro_test_common.TestDistro_Manifest()) has been removed.
2023-07-21 12:05:00 +02:00
Mario Cattamo
5b42eeb8b3 Include test for edge-ami image type 2023-07-20 17:18:35 +08:00
Diaa Sami
cb0734145d remove old prometheus listener 2023-07-19 10:56:36 +02:00
Alexander Todorov
d59199670f Remove Juan from the list of QE associates 2023-07-10 17:33:31 +02:00
Simon de Vlieger
e7557f6086 live-installer: enable aarch64 for fedora 2023-06-30 16:42:56 +02:00
Tomáš Hozza
6db01ab6de test/repos: use EUS CDN repos for RHEL 8.4 / 8.6 / 9.0
Use EUS repositories for these RHEL versions, since the content of
non-EUS repos is too old for CIV to pass on images built using them.
This is caused by some bugs which are tested by CIV being fixed only in
EUS.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-06-30 09:01:14 +02:00
Xiaofeng Wang
2baaa20859 test: Four fixes for RHEL for Edge tests
1. Remove ansible-blocking-io.py workaround. It's not required.
2. Variable should be PROD_REPO_URL, not STAGE_REPO_URL in
ostree-raw-image.sh
3. Use --reboot in rpm-ostree install to reboot VM instead of
a reboot ansible task
4. Wait until config file serviceinfo_api_server.yml exists, to
avoid file not available to use flaky issue
2023-06-30 09:07:39 +08:00
Sanne Raymaekers
ebe43bd680 test/cases/api: use the request_count metric
In future it will be possible to drop the total_compose_requests metric
in favour of the request_count metric.
2023-06-28 15:08:37 +02:00
Xiaofeng Wang
bec17b6d47 test: Remove rebase test shell script
BIOS rebase test and UEFI rebase test have been moved to
raw image and simplified installer test script by PR#3512 already
2023-06-28 13:20:26 +02:00