Commit graph

595 commits

Author SHA1 Message Date
Achilleas Koutsou
5ba4d3cf9e tools: remove image-info
The image-info tool now lives in osbuild/osbuild.
2025-01-31 08:22:29 +01:00
Tom Koscielniak
1193187e0a tools/tests: Update rhel10 compose url
Update a rhel 10 compose url to point to nightly instead of public beta.
Fix for a failing rhel 10 nightly pipeline.
2024-12-06 12:06:40 +01:00
Tom Koscielniak
d8295ea2ea Test with rhel-9.6 nightly 2024-11-21 08:14:22 +01:00
Florian Schüller
f291f41dbc tools/dbtest-*: fix shellcheck complaints 2024-11-06 15:16:42 +01:00
Florian Schüller
00d3f07d08 Makefile: implement make db-tests
enables the option to run the DB tests locally
that are executed in the github actions
2024-11-06 15:16:42 +01:00
Achilleas Koutsou
c9e412f320 test: enable ignore_missing_repos in service configs 2024-11-05 08:21:42 +01:00
Tomáš Hozza
3607783339 provision.sh: ensure no repositories in the Service scenario
In the Service scenario, we should be testing that osbuild-composer
works fine, without any repository configurations being present on the
filesystem.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-09-23 18:51:39 +02:00
Sanne Raymaekers
0273908fc7 tools/build-rpms: fix ec2 client initialisation
Fixes:
```
Error: Create EC2 instances  failed: 'ec2.ServiceResource' object has no attribute 'describe_images'
Traceback (most recent call last):
  File "/osbuild-composer/tools/build-rpms.py", line 218, in <module>
    stage_generate_rpms(cleanup_actions, args)
  File "/osbuild-composer/tools/build-rpms.py", line 175, in stage_generate_rpms
    create_ec2_instances, cleanup_actions, args, keyname)
  File "/osbuild-composer/tools/build-rpms.py", line 66, in stage
    ret = fun(*args)
  File "/osbuild-composer/tools/build-rpms.py", line 109, in create_ec2_instances
    img = ec2.describe_images(ImageIds=[arch_info[a]["ImageId"]])
AttributeError: 'ec2.ServiceResource' object has no attribute 'describe_images'
```
2024-09-11 17:31:13 +02:00
Sanne Raymaekers
72ed7db62d tools/build-rpms: increase rpm builder instance disk size
The instance created for rpm builds is running out of space on the
default 10G disk, let's double it.
2024-09-11 15:51:04 +02:00
Jakub Rusz
15c8e83b94 test/cases: adapt upgrade to support rhel9to10 2024-09-06 14:38:57 +02:00
Sanne Raymaekers
6563e98c94 tools/appsre-ansible/rpmbuild: enable cdn repositories
Subscription manager should be configured to manage repositories, and by
disabling rhui-client-config-server-9 rhui repositories don't get
(re-)enabled after updates.
2024-09-03 15:33:48 +02:00
Sanne Raymaekers
8e1d053797 tools/build-rpms: use rhel 9.4 instances as a baseline 2024-09-03 15:33:48 +02:00
Sanne Raymaekers
30ea05dd43 tools/build-rpms: increase size of instances
Mockbuilds are currently timing out after #4287, maybe due to memory
constraints.
2024-08-30 10:49:56 +02:00
Sanne Raymaekers
574c9d7d95 tools/appsre-ansible: fix unregister
The community redhat_subscription module calls `subscription-manager
unsusbscribe`, which doesn't exist. Use shell for now.
2024-08-26 14:24:48 +02:00
Sanne Raymaekers
9fcbcdb5dc tools/appsre-ansible: retry subscribing rpmbuild machines
Also unsubscribe after the build is done.
2024-08-21 13:42:11 +02:00
Jakub Rusz
3de5aa02f3 test/manifests: Add rhel-10.0 repos and generate manifests 2024-08-16 15:15:38 +02:00
Brian C. Lane
8cfba81b2c prepare-source: Move go fmt to last step
When rebasing, the generated code ends up with conflict markers in it
and go fmt quits with an error. This change regenerates the code first
so that fmt is happy with it.
2024-08-12 02:43:38 -07:00
Jakub Rusz
1af3bd6e34 tests/libvirt: disable secure boot for el-10
Related bug: CNV-41858
2024-08-12 08:39:05 +03:00
Jakub Rusz
27a8145d66 tests/libvirt: define el-10 variants 2024-08-12 08:39:05 +03:00
Tomáš Hozza
02c35060b9 define-compose-url.sh: support RHEL-10 composes
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-07-23 12:14:13 +02:00
Tomáš Hozza
58e2303143 define-compose-url.sh: use download.devel.redhat.com
Use mirror-agnostic URL for composes.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-07-23 12:14:13 +02:00
Tomáš Hozza
d0006b0134 define-compose-url.sh: drop RHEL-8 support
There are no more RHEL-8 nightly composes, thus we don't need the code
that defines the repo url for them.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-07-23 12:14:13 +02:00
Tomáš Hozza
3e8dc4ca8c define-compose-url.sh: drop condition for RHEL-9.1
We are long time past RHEL-9.1 development and this is therefore not
needed any more.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-07-23 12:14:13 +02:00
Achilleas Koutsou
1cc90c6a0b go.mod: update to go v1.21
Go 1.21 is included in all currently supported distro versions.
It is required by new updates to some of our dependencies, including
osbuild/images.
2024-07-04 19:01:07 +02:00
Florian Schüller
c36367d4cc makefile: implement make lint 2024-07-04 17:52:44 +02:00
Sanne Raymaekers
5347c82dc9 tools/koji-compose: deal with rhsm repositories 2024-07-03 16:52:02 +02:00
Sanne Raymaekers
b8cebc17ae tools/image-info: fix _read_inifile_to_dict
`RawConfigParser.readfp` was deprecated in favour of `.read_file`.
2024-07-01 14:09:08 +02:00
Sanne Raymaekers
a83c794a95 tools/test-case-generators: update rhel8.10 repos
Only the newer snapshots have `rhui-azure-rhel8-base-sap-ha`.
2024-06-28 12:02:24 +02:00
Sanne Raymaekers
ae5f82dc33 tools/test-case-generators: use newer google repo snapshots 2024-06-28 12:02:24 +02:00
Tomáš Hozza
8c54226793 Test manifests: update RH release key and regenerate manifests
Regenerate all manifests.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-06-12 11:29:56 +02:00
Tomáš Hozza
ab4dd4995c Remove F37 and F38 test manifest, because they are EOL
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-06-12 11:29:56 +02:00
Tomáš Hozza
ff433563c0 Remove c8s test manifest, because it is EOL
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-06-12 11:29:56 +02:00
Alexander Todorov
537fe1a033 Define 9.5 repositories for gen-manifests 2024-06-07 10:31:54 +02:00
Tomáš Hozza
f3e83a3838 Tools/provision.sh: adjust conditional EPEL installation for el10
EPEL-10 can't be installed on any of c10s and el10. Previously, the
script would try to install EPEL repositories package on el10 and fail.

In addition, use our "workaround" repository with c10s builds of some
packages (such as koji) also on el10.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-06-04 17:17:19 +02:00
Tomáš Hozza
f9079ae39c Tools/provision.sh: add workarounds for c10s
There is no EPEL for RHEL-10 at this moment. Use our own COPR repository
with c10s builds of some packages required by our tests.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-06-04 13:03:37 +02:00
Sanne Raymaekers
4629a31f22 templates/packer: use python3.10 on fedora
Ansible on fedora 40 seems broken, the default python 3.12 interpreter
doesn't work, 3.10 works but then the dnf module breaks.

Use 3.10 and stop using the dnf module.
2024-05-31 13:55:58 +02:00
Tomáš Hozza
71b9c0ad65 Fix pylint issues
Add timeout to `requests.post()` and `requests.get()` calls to make
pylint happy.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-05-30 19:58:34 +02:00
Sanne Raymaekers
a96f1b6d31 templates/packer: switch to fedora-40
Fedora 38 is EOL, and packit no longer builds rpms for it.

The current python3.12 + ansible 2.12 combination which is the default
on fedora 40 doesn't work, so switch to python3.9.
2024-05-29 19:36:31 +02:00
Achilleas Koutsou
4241f5bb39 tools/gen-ssh: upgrade openssh before generating key
openssl gets installed as a dependency of the osbuild-composer-tests but
it might not update openssh at the same time, which can cause a version
mismatch when running ssh-keygen:

  OpenSSL version mismatch. Built against 30000000, you have 30200010

This is currently happening in CentOS Stream 9 so let's make sure
openssh is up to date before running ssh-keygen.
2024-05-29 00:27:31 +02:00
Sanne Raymaekers
13aae7d532 templates/packer: invert tag logic
With the rpmcopy or rpmrepo_osbuild tags, the `Install worker rpm` stage
got skipped on RHEL and CI. Invert the tag logic and use `--tags`
instead of `--skip-tags`.
2024-05-21 09:40:11 +02:00
Sanne Raymaekers
9c047cd8e0 tools/fedora-worker-packer: don't trace statements
It makes the logs extremely verbose, and requests/responses are already
printed when relevant.
2024-05-07 18:38:13 +02:00
Sanne Raymaekers
aadf5dfc9a tools/fedora-worker-packer: increase timeouts further
The first timeout increase didn't take effect. And once the suite is
present the rpm builds can stay pending for a very long time.
2024-05-07 18:38:13 +02:00
Sanne Raymaekers
c9ce5af655 tools/fedora-worker-packer: set the commit sha
Currently the COMMIT_SHA variable is empty.
2024-05-07 14:47:59 +02:00
Sanne Raymaekers
28e4b0aa07 tools/fedora-worker-packer: increase timeout waiting for packit 2024-05-07 14:47:59 +02:00
Sanne Raymaekers
a1476bdfb1 tools/appsre-build-worker-packer: stop writing bogus files 2024-05-07 13:57:48 +02:00
Sanne Raymaekers
61848cb88d tools/appsre-build-fedora-worker-packer: wait for packit
Wait for packit to complete it's runs, after which the rpms should be
available from the @osbuild/osbuild-composer copr repo.
2024-05-07 13:57:48 +02:00
Sanne Raymaekers
616db61105 tools/build-worker-packer: skip rpmcopr for RHEL and on CI
Also skip both rpmrepo tasks on RHEL.
2024-05-07 13:57:48 +02:00
Achilleas Koutsou
f98169c29a go.mod: update to go v1.20
Go 1.20 is included in all currently supported distro versions.

Signed-off-by: Achilleas Koutsou <achilleas@koutsou.net>
2024-04-11 16:39:21 +02:00
Alexander Todorov
4db594dac7 Skip image_installer tests b/c already tested in installers.sh 2024-03-06 09:09:39 +01:00
Alexander Todorov
d7388fdc66 Remove already tested manifests from test-case-generators
and remove redundant skips from image_tests.sh
2024-03-06 09:09:39 +01:00