Commit graph

1300 commits

Author SHA1 Message Date
yih
98c50e3f6e fix ostree vmdk test timeout 2023-10-08 00:08:08 +08:00
Xiaofeng Wang
7f2414caf4 test: remove fdo package workaround from PR#3690 2023-10-03 15:53:40 -07:00
Alexander Todorov
164df6ffcb Revert "Add softlockup_all_cpu_backtrace=1 boot argument"
This reverts commit 8aca402dff.
2023-10-02 16:50:32 +02:00
Tomáš Hozza
f6e0e99391 Worker/koji-finalize: include osbuild version in image metadata
Include the osbuild version used to build the image, in the image extra
metadata attached to the Koji build and image output.

Extend `koji.sh` to verify that the version is set and of the expected
value.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-09-27 12:39:28 +02:00
Tomáš Hozza
2b6570c36c test/koji.sh: test manifest extra metadata in outputs and build
Test the content of manifest outputs extra metadata and that they are
the same as the metadata attached to the build extra metadata.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-09-27 12:39:28 +02:00
Tomáš Hozza
e63472ef44 Koji: expose osbuild artifact information in image metadata
Expose the osbuild information used to produce the image, in the image
extra metadata under the `osbuild_artifact` property.

This information will get included in the image / build extra metadata
and make it explicit how to reproduce the image build using osbuild and
the attached manifest.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-09-27 12:39:28 +02:00
Tomáš Hozza
4f51d44762 Worker/koji-finalize: add cloud target results to image/build metadata
Add any non-Koji upload target results attached to an OSBuild result, to
the image extra metadata. This will make it easy to locate any image
from Koji uploaded to cloud, in the target cloud environment.

The rationale behind including only non-Koji target results is that one
can find it only in Koji, so there is no added value in including the
Koji target results at all.

Extend the `koji.sh` to check the target results in image metadata when
testing Koji scenario with cloud upload.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-09-27 12:39:28 +02:00
Tomáš Hozza
e0ec3a2a1c Worker/koji-finalize: import osbuild manifest and log to Koji build
Import osbuild manifest and build log to the Koji build as outputs. Also
note the respective filenames in the image output extra metadata.

Note that the osbuild manifest is imported as a log file for now. Koji
has very limited set of output types defined and I still need to
determine the best way to use a custom output type in Koji instances (as
other content generators do).

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-09-27 12:39:28 +02:00
Tomáš Hozza
a610bc3843 test/koji.sh: refactor and extend testing of build metadata
Refactor koji.sh:
- Store Koji hub URL in a variable and use it instead of a literal.
- Do not inspect builinfo output and don't parse it using grep and sed,
  but instead directly call Koji XMLRPC functions (using `koji call`)
  with JSON output.

In addition, test that the image archive extra metadata are the same as
those stored in the build extra metadata, stored under the image
filename.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-09-27 12:39:28 +02:00
yih
2c65ee228b add test case for iot-qcow2-image 2023-09-20 13:43:24 +08:00
Sanne Raymaekers
1e7e1308ab test/cases/api: don't print command traces
Causes some secrets to be dumped into the logs.
2023-09-19 22:57:06 +02:00
Sanne Raymaekers
522a54188a test/api: add oci test 2023-09-19 22:57:06 +02:00
Xiaofeng Wang
7259deea3a test: add workaround for bug https://issues.redhat.com/browse/RHEL-4992 2023-09-19 11:34:48 +02:00
Xiaofeng Wang
44e6278c9d test: remove workaround for bug BZ#2234390 2023-09-18 18:14:58 -07:00
Gianluca Zuccarelli
0311ef449d test/cases: OpenSCAP cloudapi tests
Run a basic check to see that the tailoring file has been created when
adding tailoring rules to the OpenSCAP config. Since the OpenSCAP scan
requires more memory and breaks some of the API tests, a full scan is
not run in the cloudapi tests.
2023-09-18 20:46:49 +02:00
Gianluca Zuccarelli
9af8579eb5 test/cases: add tailoring to oscap test
Add relevant checks to test for OpenSCAP tailoring features. The test
removes (unselects) a single rule.
2023-09-18 20:46:49 +02:00
Sanne Raymaekers
360df12548 test/cases/ubi-wsl: set --os-type when creating vm
Solves `invalid usage for storage profile: attach existing managed OS disk`.
2023-09-15 15:03:48 +02:00
Sanne Raymaekers
e698e104d9 test/cases/ubi-wsl: fix waiting for a valid ipv4
The counter never made it past 10.
2023-09-01 14:04:37 +02:00
Alexander Todorov
f2f1c8d0f0 Remove deprecated --os-type cli argument
test logs print:

[2023-08-22T10:18:14-04:00] 💿 Install image via installer(ISO) on VM
WARNING  --os-type is deprecated and does nothing. Please stop using it.
2023-09-01 13:22:30 +02:00
Xiaofeng Wang
f0c1fe2d98 test: fix "Waiter SnapshotImported failed: Max attempts exceeded" 2023-08-31 11:54:18 +02:00
Xiaofeng Wang
f0eb8e9738 test: add workaround for bug BZ#2234390 2023-08-30 09:29:50 +02:00
Sanne Raymaekers
b26458f1f1 oci/upload: create image capability schema
After creating the custom image, make sure the capabilities default to
paravirtualized.
2023-08-28 10:29:14 +02:00
Sanne Raymaekers
adf2d5b22a test/cases/oci: add oci integration test 2023-08-28 10:29:14 +02:00
Sanne Raymaekers
93fc55f98a test/cases/ubi-wsl: public ip fixes
Use the "Standard" public ip sku, as "Basic" produces warnings.

Spin until the vm gets assigned a valid ipv4 address.
2023-08-28 08:44:12 +02:00
Alexander Todorov
8aca402dff Add softlockup_all_cpu_backtrace=1 boot argument
should trigger a kernel trace instead of only warnings
2023-08-28 08:36:07 +03:00
Sanne Raymaekers
e92ead5449 test/cases/koji: build nightlies 2023-08-17 15:07:20 +02:00
Sanne Raymaekers
a82e3c38c8 diff-manifests: CRB is enabled in the prepareScript 2023-08-17 15:07:20 +02:00
Sanne Raymaekers
757ca2f51a test/data/repositories: use the cdn for rhel-88 and rhel92 2023-08-17 15:07:20 +02:00
Sanne Raymaekers
e7e6a9095a test/cases/ubi-wsl: double ssh timeout
This times out on occasion, give azure and windows a bit more time.
2023-08-17 15:44:07 +03:00
Xiaofeng Wang
dc5583b382 test: add aws ec2 wait commands for instance terminate, image
register, and instance running
2023-08-14 18:30:06 +02:00
Xiaofeng Wang
84728ea85d test: re-format some long shell commands shorter 2023-08-14 18:30:06 +02:00
Xiaofeng Wang
37faf0d929 test: run greenboot rollback test on ostree.sh, ami and vsphere
Do not need to run greenboot rollback test on all tests to save
some time
2023-08-14 11:12:14 +02:00
Xiaofeng Wang
16e27dad1b test: update edge-ami test to support aarch64 2023-08-11 22:52:14 +02:00
Xiaofeng Wang
8678125f89 test: add workaround for bug 2230537 and 2229722 2023-08-11 20:55:35 +08:00
Xiaofeng Wang
336842d7bb test: update ostree.sh to test ostree commit as value of --parent 2023-08-10 12:49:44 +02:00
Tomáš Hozza
4ac6a7a11d Koji: expose boot mode in image extra metadata
Also extend the Koji test case to verify that the boot mode information
is in the build extra metadata and that it contains valid value.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-08-08 15:53:07 +02:00
Tomáš Hozza
af1c373407 Koji: expose image output metadata in build extra metadata
Expose the extra metadata information for each image output stored in
`ImageExtraInfo` also in the build extra metadata. The extra metadata
for each image is nested under key corresponding to the image filename.

Extend the Koji test case to check information in the buildinfo output
and specifically check for all expected metadata in the build Extra
metadata field.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-08-08 15:53:07 +02:00
Sanne Raymaekers
1b04a78120 test/cases/api: add check for subscription-manager facts 2023-08-07 20:47:20 +02:00
Achilleas Koutsou
6a3b0af934 test: update repositories for building Fedora images
Update the rpmrepo snapshots used in tests for building Fedora images.
2023-08-03 10:35:21 +02:00
Achilleas Koutsou
d3ef361dd5 test: update repos and manifests
Summary of changes:
- ova image type uses ustar format
    - https://github.com/osbuild/images/pull/16
- New image type "minimal-raw"
    - https://github.com/osbuild/images/pull/29
- Fedora repositories and test manifests updated
    - https://github.com/osbuild/images/pull/57
- Distro aliases for major version without minor updated
    - https://github.com/osbuild/images/pull/59
2023-08-03 10:35:21 +02:00
Brian C. Lane
4c7b3dd25a test: Make log errors easier to find
We were using greenprint for failures, which makes it hard to quickly
find where the tests failed. This switches errors to use redprint, and
adds it to places that were simply using echo before doing an exit 1.
2023-08-02 14:46:35 +02:00
yih
f889be9e05 test edge-vsphere image 2023-08-01 14:18:17 +08:00
Xiaofeng Wang
967570a2a6 test: Add workaround for BZ#2213660 and #2225667 2023-07-26 22:23:41 +08:00
Brian C. Lane
2e7afcffe1 test: Fix Fedora 39 snapshot urls in test repo 2023-07-26 12:16:24 +02:00
Sanne Raymaekers
b2451c6247 test: add ubi-wsl test 2023-07-25 10:53:21 +02:00
Alexander Todorov
38ed9a39be Start collecting logs from virt-install 2023-07-21 12:11:02 +02:00
Achilleas Koutsou
ee0c7b53dc test/README: update test manifest generation instructions 2023-07-21 12:05:50 +02:00
Achilleas Koutsou
52234c5fd1 test/README: describe vendoring of modified images repo
Add instructions for how to test an updated osbuild/images repo against
osbuild-composer.
2023-07-21 12:05:50 +02:00
Xiaofeng Wang
8ba6487b82 test: update for minimal raw new xz format 2023-07-21 12:05:00 +02:00
Achilleas Koutsou
3bbcc8a7cc Remove test that depends on removed code from images
Manifest tests can no longer run and also aren't needed.
All image type manifests are generated and built in the obsuild/images
CI tests and the test function in images
(distro_test_common.TestDistro_Manifest()) has been removed.
2023-07-21 12:05:00 +02:00