Commit graph

97 commits

Author SHA1 Message Date
Achilleas Koutsou
4bc6e226ea rpmbuild: add fedora-37 2022-09-01 11:31:58 +02:00
Thomas Lavocat
f38ddb5f20 test: manifests testing on each PR
On each PR test that osbuild don't break the image generation by testing
against the manifest-db that the produced image-infos are still the same
as the one stored.
2022-08-30 14:42:13 +02:00
Alexander Todorov
4911ca5b65 tests: Update OSBUILD_COMPOSER_COMMIT for testing on Fedora 36 2022-07-25 15:58:43 +02:00
Jakub Rusz
7cd4b4ea66 tests: run tests on RHEL-9.1 and 8.7 nightly 2022-07-16 18:59:06 +02:00
Jakub Rusz
527be5081c rpmbuild: add fedora-36 2022-06-23 10:41:16 +02:00
Jakub Rusz
bd7d2a5628 rpmbuild: add RHEL 8.7 and 9.1 nightly 2022-06-16 14:24:02 +02:00
Jakub Rusz
1e7ba87eb7 mockbuild: update mockbuild script after RHEL-9 GA
Removing rhel-9 templates as they are shipped upstream already and
making necessary modifications to mockbuild.sh
2022-06-16 14:24:02 +02:00
Alexander Todorov
8884b4cac8 COMPOSER-1576: Start building RPMs on 8.6 & 9.0 GA 2022-06-08 14:18:42 +02:00
Jakub Rusz
008d013e1c ci: run ci-details.sh
This script collects useful information about CI runners.
2022-04-13 14:57:27 +02:00
Jakub Rusz
62f2bf608c tools: add set-env-variables.sh
Very simple script to set env variables.
2022-04-13 14:57:27 +02:00
Jakub Rusz
a5b42a84f2 mockbuild: use rpmrepo in mock templates
We're using rpmrepo snapshots as system repositories on the runners, so
let's use them also for mockbuild.
2022-04-13 14:57:27 +02:00
Jakub Rusz
8f430733c1 ci/deploy: use public EPEL-9 2022-03-02 16:59:11 +01:00
Jakub Rusz
89666714f4 rpmbuild: run on centos-9
Also update terraform SHA and EPEL installation for mockbuild.
2022-02-22 18:05:51 +00:00
Jakub Rusz
d878824696 ci: remove fedora-33 and add fedora-35 2022-02-09 10:52:21 +01:00
Jakub Rusz
df189a7301 ci: update to 8.5 ga runners 2022-02-09 10:52:21 +01:00
Jakub Rusz
860a9bb49f tests/ci: fix sonarqube analysis for main branch
Only use the branch options if it's actually running in a branch and
analyse main without them, sonarqube otherwise doesn't recognize the
main branch.
2022-02-04 12:57:36 +02:00
Jakub Rusz
b38524b7ee test/ci: fix sonarqube run on main
Minor oversight from previous commit. Specify clone depth in
.gitlab-ci.yml file instead.
2022-01-26 13:51:18 +02:00
Jakub Rusz
8bc4bff80c tests/ci: add sonarqube scan
Adding sonarqube scan to the pipeline.
2022-01-25 13:23:36 +02:00
Ondřej Budai
dccbfb5916 schutzbot: remove ssh keys of team member that left us
bye 😢

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2022-01-06 09:18:17 +01:00
Christian Kellner
0aea72e44e ci: run ostree image tests via Schutbot
OSTree tests, especially the fedora-ostree-image one, will soon
need the tight integration with the host for LVM2/LUKS support.
This we cannot run them in github action containers. Move them
to Schutzbot.
Explicitly install the new sub-package until composer gains the
needed requirement.
2021-12-09 00:44:21 +00:00
Ondřej Budai
22d1d46ec1 schutzbot: drop send_webhook.py script
It was used to trigger Jenkins but nowadays, it's useless.
2021-12-02 12:03:51 +00:00
Jakub Rusz
8d67396ff3 tests: enable testing on aarch64 RHEL
Also update osbuild-composer version.

debug: skip openstack boot on aarch64
2021-11-29 14:46:09 +01:00
Jakub Rusz
180e853c23 mockbuild: remove beta from rhel-9 template
Beta is out already, switch template to RHEL-9.
2021-11-24 13:26:54 +01:00
Jakub Rusz
de94251a32 ci: switch to rhel-9 runners
RHEL-9-Beta is no longer being developed. Switching to RHEL-9 instead.
Currently testing is not run there because of issues linked in the
comment.
2021-11-24 13:26:54 +01:00
Ondřej Budai
8cd9fd79c6 mockbuild: reuse mock repos from the system ones
There's no need to define the repositories twice, let's just reuse the system
repository.

This change was already successfully applied in composer.
2021-10-21 17:48:08 +02:00
Ondřej Budai
b02dc8a7ab mockbuild: rotate a variable name
The previous one is no longer defined.
2021-10-21 17:48:08 +02:00
Ondřej Budai
74d1806ab0 gitlab: don't save journal 2021-10-21 17:48:08 +02:00
Ondřej Budai
f01d522dbf deploy: update to the latest composer commit
We rotated some variable names in composer, thus we need to adjust..
2021-10-21 17:48:08 +02:00
Ondřej Budai
3e402f126c ci: don't register the runners
They all subscribed before deploy.sh is even run.
2021-10-21 17:48:08 +02:00
Jakub Rusz
221381b2de tests/ci: Switch to testing on 8.4 GA
Updating terraform sha and switching to 8.4 GA runners.
Also updating DISTRO_CODE for each runner.
2021-10-12 13:29:37 +02:00
Jakub Rusz
b065a456d6 tests: enable testing on RHEl-8.5 and RHEL-9.0
Also update osbuild-composer commit to use newer manifests.
2021-10-12 13:29:37 +02:00
Achilleas Koutsou
3de57ae9a7 mockbuild: add RHEL 8.6
- CI runners
- Subscription override for mock templates
- Terraform SHA for 8.6 runners

Signed-off-by: Achilleas Koutsou <achilleas@koutsou.net>
2021-10-05 15:57:45 +02:00
Sanne Raymaekers
36a7475e26 schutzbot: Update terraform sha
Unbreaks fedora-33 updates-modular dnf error when installing the
gitlab-runner.
2021-09-21 16:00:08 +02:00
Ondřej Budai
b24f9858c3 schutzbot: update images for RHEL 9
Previously:
We used images built from pre-mass-rebuild composes but installed packages
from post-mass-rebuild composes. This caused weird stuff like sshd crashing
when installing non-related packages via dnf.

Now:
Both the image and repositories are post-mass-rebuild ones. This should solve
these weird issues.
2021-08-19 01:42:40 +02:00
Ondřej Budai
124cda90e2 mockbuild: add rhel 9 2021-07-22 17:58:41 +02:00
Ondřej Budai
ea7eee8db6 ci: update composer to make tests more robust
f8fd3d04 switched F33 image tests to use rpmrepo rather than kernel mirrors
that are sometimes desynced. This should make the testsuite more stable.
2021-07-14 23:51:05 +02:00
Ondřej Budai
8396e73372 ci: upload rpms built in RHEL 8 CDN buildroot into rhel-8-cdn directory
Let's explain how RPMs for RHEL are built:

We use a subscribed RHEL 8.x machine and mock build these on it. Mock
initializes its own buildroot based on the latest RHEL 8 CDN content, see[1].
This means that the minor version of the buildroot is independent of the minor
version of the host.

However, we currently upload RPMs to a directory whose name consists also of
the minor version of the host. Our hosts are currently running RHEL 8.3 so
the RPMs are uploaded into rhel-8.3 directory despite them being built in the
RHEL 8.4 buildroot (RHEL 8 CDN buildroot specifically). This means that
we cannot guarantee that they are installable on RHEL 8.3 which is weird.

This commit adds a special case for hosts that run on subscribed RHEL and
thus build RPMs in a buildroot constructed from RHEL CDN. These RPMs are
now uploaded into rhel-8-cdn directory. This change more accurately reflects
the way we build our RPMs and removes some confusion.

[1]: https://github.com/rpm-software-management/mock/blob/main/mock-core-configs/etc/mock/templates/rhel-8.tpl#L37
2021-07-12 19:02:21 +02:00
Ondřej Budai
41e01326f0 mockbuild: register the host as soon as possible
So we can check if we are subscribed in the variable definitions.

I believe that registering the instance will go away soon nevertheless.
2021-07-12 19:02:21 +02:00
Ondřej Budai
54f233ac96 mockbuild: use REPO_BUCKET when defining the repo's base URL
Just deduplication of code.
2021-07-12 19:02:21 +02:00
Jakub Rusz
e5d599d8ee ci: add Gitlab CI
This is an inital commit that enables the use of Gitlab CI.
2021-06-30 19:54:37 +02:00
Jakub Rusz
803c698f9a ci: Remove Jenkins in favor of Gitlab CI
Jenkinsfile and the trigger are no longer neccessary since
we're moving all testing to Gitlab CI.
2021-06-30 19:54:37 +02:00
Ondřej Budai
7765c53ecc mockbuild: use s3cmd put instead of sync to speed up the RPM upload
s3cmd sync actually downloads metadata for all objects in a s3 bucket.
We have built a lot of RPMs, thus this takes 5 minutes on AWS and 25 minutes
on my laptop (!!!).

Let's use recursive put instead. This doesn't delete any files on the remote
side. As we upload RPMs only once, this also shouldn't fail on "the
object already exists". Using this method, we should be able to upload the
RPMs in seconds.

The same patch was applied in osbuild-composer cf73edd2
2021-06-10 09:35:04 +01:00
Ondřej Budai
b5e324c874 ci: remove Fedora 32 tests
It's EOL.
2021-06-04 15:08:38 +02:00
Ondřej Budai
ef0939db9b ci: remove RHEL 8.4 tests
RHEL 8.4 is now GA, so we don't need any extra tests for it. This should also
make the CI more reliable because having two distros with the same DISTRO_CODE
caused some tests to fail randomly (they used the same intermediate
artifacts).
2021-06-04 15:08:38 +02:00
Achilleas Koutsou
1476b88dcf schutzbot: add RHEL 8.5 2021-04-19 09:12:21 +02:00
Alexander Todorov
6c68e45dbe ci: Start running image tests against 8.4
Refs https://github.com/osbuild/osbuild-composer/issues/962
2021-03-30 11:38:47 +03:00
Aleksandar Todorov
33db6cbd2f ci: Excute image_tests directly from osbuild-composer-tests
instead of duplicating the same script here!

Specifies needed cloud credentials.

NOTE: don't start osbuild-composer in deploy.sh because this is
now done by /usr/libexec/osbuild-composer-test/provision.sh. Otherwise
leads to errors because the socket is already taken.
2021-03-26 19:02:57 +00:00
Aleksandar Todorov
775dceaf20 tests: Save osbuild.repo file under artifacts
makes it easier to grab if we need it for manual testing or
in case one needs to download the RPMs from Schutzbot
2021-03-10 12:00:49 +02:00
Ondřej Budai
555b5d0f2b schutzbot/deploy: remove the RHEL 8.3 Beta workaround
These days are long gone, we no longer test osbuild against development RHEL
versions. This is covered by osbuild-composer's test suite.
2021-03-07 12:50:06 +00:00
Ondřej Budai
3028402e71 schutzbot/deploy: bump to osbuild-composer 29
It was set to osbuild-composer 24, so old.
2021-03-07 12:50:06 +00:00