Commit graph

147 commits

Author SHA1 Message Date
Achilleas Koutsou
ef16cbf04f CI: update terraform hash
Updated Fedora 41 runners
2024-08-20 17:34:18 +02:00
Achilleas Koutsou
d882956508 schutzbot: add Achilleas' SSH keys 2024-08-20 10:14:03 +02:00
Brian C. Lane
0bbdabfcca tests: Add f41 and update terraform hash 2024-08-01 08:57:30 +02:00
Tomáš Hozza
df83c62920 Mockbuild: workaround a SELinux policy issue on c10s.
SELinux policy forbids systemd-machined from creating a varlink socket,
which it does since v256. This makes it fail to start. Subsequently,
mock fails to build the RPM, because it uses systemd-nspawn as an
isolation and it fails to register the machine with systemd-machined.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-07-19 09:27:30 +02:00
Tomáš Hozza
dcc08d8bd4 CI: build RPMs for RHEL-10.0-nightly
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-07-19 09:27:30 +02:00
Tomáš Hozza
3959de8a19 mockbuild.sh: temporarily base missing el10 mock template on el9
There is no RHEL-10 mock template yet. Let's base it on RHEL-9 template
with a few tweaks.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-07-19 09:27:30 +02:00
Alexander Todorov
207648549c There is no EPEL for EL10 yet so use a custom repository 2024-07-16 11:30:13 +02:00
Alexander Todorov
60d4f56b54 Use CentOS-Stream-10-20240703.2 runner images 2024-07-16 11:30:13 +02:00
Tomáš Hozza
143677f5d9 Tests: force checkout manifest-db
Manifest tests on Fedora 39 sometimes fail, because checking out the
specific manifest-db commit fails with:

"error: The following untracked working tree files would be
overwritten by checkout"

Use --force when checking out the ref, which will hopefully solve any
error like this.

[1] https://gitlab.com/redhat/services/products/image-builder/ci/osbuild/-/jobs/7317097983

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-07-15 11:06:10 +02:00
Tomáš Hozza
8db6b8985a schutzbot/mockbuild.sh: let mock bootstrap chroot
Don't instruct mock to not bootstrap the chroot. This is making builds
to fail on F40 due to DNF5. The error message suggests to bootstrap
chroot.

Example:
https://gitlab.com/redhat/services/products/image-builder/ci/osbuild/-/jobs/7239614060#L1363

Note that e.g. osbuild-composer does not specify the
--no-bootstrap-chroot option either.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-07-02 09:46:45 +02:00
Tomáš Hozza
ae33fe4e65 Schutzbot: update terraform ref
Update to the latest 'main' HEAD, so that all the latest RHEL GA runners
are available.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-07-02 09:46:45 +02:00
Alexander Todorov
4b66874824 Start building RPMs on 9.5 nightly
Related: COMPOSER-2227
2024-05-03 11:09:38 +02:00
Tom Koscielniak
3b7a8aa728 Migrate manifest tests to new RHEL GA version 2024-03-21 15:46:48 +01:00
Achilleas Koutsou
b0abe9725d schutzbot/update_github_status.sh: new verb: fail
New script subcommand that explicitly reports a failure.
2024-03-05 16:04:20 +01:00
Jakub Rusz
95c1b90d33 Schutzbot: Remove RH-IT-Root-CA 2024-03-04 23:53:36 +01:00
Simon Steinbeiss
3de3bddc10 actions/sonarqube: Drop SonarQube in favor of Snyk 2024-03-04 14:14:03 +01:00
Jakub Rusz
5d0c69fe00 CI: update terraform SHA
We had to switch fedora-38-aarch64 image to an older one because the
current one was broken in AWS.
2024-01-31 12:34:57 +01:00
Tom Koscielniak
4977501cc6 Switch rpmbuild to RHEL 8.9/9.3 GA 2024-01-18 19:19:23 +01:00
Dusty Mabe
94b10403a0 schutzbot: add dustymabe SSH key to team_ssh_keys
This will allow me to access a CI runner for debugging a CI failure.
2024-01-17 19:54:19 +01:00
Simon de Vlieger
e73f4e57dd ci: update terraform hash
Some AMI went AWOL.
2023-12-08 14:29:52 +01:00
Jakub Rusz
36883654ce rpmbuild: add fedora-40 2023-12-06 10:11:32 +01:00
Sanne Raymaekers
60c96febfa schutzbot/terraform: aws instance types rework 2023-11-17 17:27:57 +01:00
Jakub Rusz
fd29a31832 rpmbuild: build on RHEL-9.4 and RHEL-8.10 2023-10-31 12:50:03 +01:00
Achilleas Koutsou
7b359e3ecd Update Fedora 39 x86_64 runner 2023-09-28 09:15:53 -07:00
Sanne Raymaekers
6c4e5c5378 .gitlab-ci: update RHEL ga runners 2023-08-28 12:16:24 +02:00
Sanne Raymaekers
433515cff8 schutzbot: unregister test hosts 2023-08-21 18:46:55 +02:00
Jakub Rusz
4ddfe5ed0f Add jrusz ssh key to list of team keys 2023-08-14 17:39:27 +02:00
Jakub Rusz
9017408366 Update fedora-39 runners and repositories 2023-08-14 17:39:27 +02:00
Brian C. Lane
a4ee2f47b7 terraform: Use new rawhide and new RHEL 9.3 images
This uses Fedora's 20230809.n.2 cloud image with dnf5 5.1.1-1,
and new RHEL 9.3 Image Builder.
2023-08-10 13:04:14 +02:00
Brian C. Lane
43d776e55e terraform: Add f39 runners 2023-07-17 12:18:10 +02:00
Alexander Todorov
8c29e8144d CI variable name has changed,
see
25d1a458a0
2023-06-26 19:51:42 +02:00
Tomáš Hozza
9a47a56639 mockbuild.sh: retry dnf install up to 5 times
We have been observing a race condition in our CI when installing
packages at the beginning of the SUT setup. This happens only on RHEL
and it is caused by the `rhc` tool, which executes some Ansible
playbooks on system startup, which install packages using dnf. This
interferes with dnf commands ran by the `mockbuild.sh` script, which
results in a job failure.

Since there seems to be no way to determine if `rhc` finished "its
thing", let's retry dnf install of packages up to 5 times with
exponential backoff in between retries.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-05-29 15:53:24 +02:00
Thomas Lavocat
8669d0ad4c ci/parallelization: manifest tests run in parallel
To avoid hitting the 4h timeout.
2023-05-23 11:52:11 +02:00
Alexander Todorov
04eab998b7 Start building osbuild on RHEL 8.9 and 9.3 nightly 2023-05-04 13:34:35 +03:00
Jakub Rusz
f2163dd950 Update terraform SHA
Centos-stream-9 images are gone for some reason, let's use new ones.
2023-05-03 16:47:47 +03:00
Tomáš Hozza
feb216c07b mockbuild.sh: use dnf to install local package, not rpm
DNF has more elaborate locking system and can wait for other instances of
itself when installing packages. Using rpm directly to install local
package is causing failures in CI due to it not being able to acquire
lock on `/var/lib/rpm/.rpm.lock`.

Using DNF should improve the situation, although there is no good
documentation to link and support this claim for sure.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-04-24 21:04:45 +02:00
Tomáš Hozza
bb406d11fe CI: set up team SSH keys in before_script, not deploy.sh
This is how it is done also in osbuild-composer. The downside of doing
this in `deploy.sh` is that team SSH keys are not set as authorized for
mock-build jobs, which make it impossible to log into the machine and
debug anything.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-04-24 21:04:45 +02:00
Tomáš Hozza
2d3ceab935 Good bye Lars and David 😢
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-04-21 16:30:56 +02:00
Jakub Rusz
cfed69adca CI: update fedora-38 images 2023-03-28 10:02:53 +02:00
Jakub Rusz
4d5715faf1 rpmbuild: build on fedora-38 2023-03-27 14:31:52 +03:00
Thomas Lavocat
996c1ca889 ci: update terraform reference
To stop leaking CI resources, we need to be above commit sha 89fb25d15.
Update to latest reference
2023-02-23 12:48:45 +01:00
Tomáš Hozza
58579b62e9 schutzbot: add thozza's ssh key
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-01-19 10:05:19 +01:00
Tomáš Hozza
89660b0c7c schutzbot: remove Christian's ssh key
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-01-19 10:05:19 +01:00
Tomáš Hozza
282d725f6d schutzbot/deploy.sh: don't install osbuild-composer-tests
osbuild CI tests, specifically image tests are not executing the test
script from osbuild-composer any more, but it uses manifest-db.

Therefore it is not needed to set up repository for osbuild-composer nor
install it.

Delete all unneeded lines from the script and replace them by installing
all osbuild packages needed to build images from `manifest-db`.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-01-19 10:05:19 +01:00
Christian Kellner
919e03ed20 schutzbot: set the cache size for the correct store
The default cache location for `osbuild-image-test` is actually
`/var/lib/osbuild/store`. Pass that to `osbuild` when setting
the `maximum cache size to set the size for the correct location.
2022-12-09 16:44:58 +01:00
Christian Kellner
ae0680da11 osbuid: integrate FsCache into ObjectStore
Integrate the recently added file system cache `FsCache` into our
object store `ObjectStore`. NB: This changes the semantics of it:
previously a call to `ObjectStore.commit` resulted in the object
being in the cache (i/o errors aside). But `FsCache.store`, which
is now the backing store for objects, will only commit objects if
there is enough space left. Thus we cannot rely that objects are
present for reading after a call to `FsCache.store`. To cope with
this we now always copy the object into the cache, even for cases
where we previously moved it: for the case where commit is called
with `object_id` matching `Object.id`, which is the case for when
`commit` is called for last stage in the pipeline. We could keep
this optimization but then we would have to special case it and
not call `commit` for these cases but only after we exported all
objects; or in other words, after we are sure we will never read
from any committed object again. The extra complexity seems not
worth it for the little gain of the optimization.
Convert all the tests for the new semantic and also remove a lot
of them that make no sense under this new paradigm.

Add a new command line option `--cache-max-size` which will set
the maximum size of the cache, if specified.
2022-12-09 12:03:40 +01:00
Thomas Lavocat
0a5e558604 ci: use the latest terraform to fix missing images
From OSBuild-composer:

cloud-cleaner deleted all our nightly and CS9 testing images, let's replace them.
2022-11-29 11:49:51 +01:00
Thomas Lavocat
9d1eb6cecc ci: add tags to AWS instances
The new terraform runners support an extended lists of tags to get a
greater precision on the stats we can extract from AWS cost center.
2022-11-10 20:09:26 +01:00
Sanne Raymaekers
fb3ac490d5 schutzbot/mockbuild: stop running mock as root
Running mock as root is broken, this commit can be reverted once
rhbz#2135203 is fixed.
2022-10-17 18:36:02 +02:00
Jakub Rusz
c638cbcb83 rpmbuild: build rpms on RHEL 8.8 and 9.2 nightly 2022-10-14 10:24:33 +02:00