Commit graph

361 commits

Author SHA1 Message Date
Jakub Rusz
004c4e8acc Gitlab CI: Run libvirt.sh tests on GCP
We can now use GCP runners in our CI. Let's test them out by running all
of libvirt tests for starters.
2023-02-20 14:24:09 +01:00
Juan Abia
5a62453190 Remove cloud cleaner
cloud cleaner is now being executed in it's own repo.
2023-02-15 17:23:35 +01:00
Tomáš Hozza
7a5c2641ac schutzbot: delete ckellner's SSH key
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-01-18 12:53:30 +01:00
Ondřej Budai
d12d9674d6 terraform: update to the latest definitions
Currently, we still have the issue with rogue instances. The latest commit in
the gitlab-ci-terraform repository prevents that by limiting the validity
of the spot fleet request to 4 hours which matches our maximum job duration
set in GitLab.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-01-10 14:26:18 +01:00
Alexander Todorov
d3c6eba7bf Switch 8.6 and 9.0 GA to 8.7 and 9.1 GA 2023-01-10 00:28:23 +01:00
Alexander Todorov
28a6346d87 ci: Use sudo before localectl
should help resolve:

+ localectl set-locale LANG=en_US.UTF-8
Failed to issue method call: Interactive authentication required.
2023-01-10 00:28:23 +01:00
Ondřej Budai
97c8622a0c ci: update Fedora 37 runners to GA
We used pre-GA repositories previously. Since GA is now out, let's switch to
it. We need to do two changes:

- use the latest terraform definitions that use the GA images
- update Schutzfile to use GA repositories (and updates)

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2022-11-28 16:56:44 +01:00
Ondřej Budai
ccb3a67d94 ci: use the latest terraform config to fix missing images
cloud-cleaner deleted all our nightly and CS9 testing images, let's replace
them.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2022-11-24 09:02:29 +01:00
Thomas Lavocat
4e7b021514 ci: add tags to AWS instances
The new terraform runners support an extended lists of tags to get a
greater precision on the stats we can extract from AWS cost center.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2022-11-10 20:56:21 +01:00
Simon de Vlieger
1612d9cb80 ci: add my SSH keys to the CI ssh keys 2022-11-09 11:31:57 +01:00
Jakub Rusz
fe1bf7a7bf Update terraform SHA
Fedora-37 was using "ci-ssd" instance in RHOS-01 which does not support
nested KVM. This SHA switches them to use "ci" instances which do
support nested kvm.
2022-11-07 16:10:41 +01:00
Jakub Rusz
f2671e0074 Update terraform SHA
This update removes all repos on the f-37 runner during provisioning
which should resolve issues with "updates-testing" repo being enabled
and not overwritten.
2022-10-27 12:47:45 +02:00
Sanne Raymaekers
423b4b77d7 schutzbot/update_github_status: fix release fast-forwarding
The checkout in the working directory is a shallow clone with gitlab as
a remote. As a result fast-forwarding failed due to not recognizing the
remote release branch as an ancestor of $CI_COMMIT_SHA.

This clones (with `--bare`) the github remote in a separate
directory. It should not be necessary to remove the release-ff-clone
directory each time, simply fetch if it already exists.
2022-10-21 10:54:30 +02:00
Sanne Raymaekers
545ce3412e schutzbot/mockbuild: stop running mock as root
Running mock as root is broken, this commit can be reverted once this is
fixed.

rhbz#2135203
2022-10-17 18:08:31 +02:00
Jakub Rusz
a23b1c4b3e rpmbuild: build rpms on RHEL 8.8 and 9.2 2022-10-14 12:25:36 +02:00
Achilleas Koutsou
d7d098a857 CI: update terraform SHA for Fedora 37 runners 2022-09-13 16:06:19 +01:00
Sanne Raymaekers
6a2e719c76 schutzbot: Fast-forward release branch after green main run
The release branch can be tracked by stage deployments to make sure CI
is green before deploying to stage.
2022-09-02 11:05:28 +02:00
Jakub Rusz
de6b8e8f5b Update terraform SHA with more aarch64 runner options
This commit adds the option to also provision c6g.large machines in
addition to c7g.large machines in AWS.
2022-08-23 15:31:47 +03:00
Alexander Todorov
f451e0291a Modify repositories/rhel-xy.json file before testing nightly compose
Fixes #1318

- uses a wildcard match for sed in order to replace only lines which
  match and keep the rest intact
2022-08-18 14:00:16 +03:00
Alexander Todorov
860b122f2c tests: Remove useless JSON file overrides
See comment
https://github.com/osbuild/osbuild-composer/pull/2881/files#r940065803

for explanation why
2022-08-10 16:33:34 +03:00
Tomas Hozza
444f85ac5c schutzbot: add thozza's SSH public key 2022-08-04 11:55:43 +02:00
Jakub Rusz
cf562dbb57 CI: drop /tmp/artifacts upload to Gitlab
Contents of this folder are uploaded to S3 with shutzbot/upload_artifacts.sh
Also fixing epel installation in the mentioned script.
2022-07-26 17:08:32 +02:00
Jakub Rusz
f93b38c1a8 CI: fix ci_details artifact placement
The output of the ci_details.sh needs to be placed in the /tmp/artifacts
in order to be uploaded with the rest of the artifacts.
2022-07-21 13:17:45 +02:00
Jakub Rusz
efbd5ebd7b ci/tests: Change the way artifacts are collected
We want to be able to safely gather any artifacts without worrying about
any possible secrets leaking. Every artifacts that we want to upload
will now have to be placed in /tmp/artifacts which will then be uploaded
to S3 by the executor and link to the artifacts will be provided in the
logs. Only people with access to our AWS account can see them.
2022-07-18 11:33:57 +03:00
Jakub Rusz
b297ee8d40 CI: temporarily siwtch RHOS-01 to non-ssd instances
There appears to be a problem with nested virtualization on newly added
hypervisors with ssd. I believe the issue is not preset on regular
instances, so switching to those until the issues can be resolved.
2022-07-14 12:00:50 +03:00
Ygal Blum
534625fa38 Fedora - Use vendor instead of rpm dependencies
RPM Spec
--------
Remove all Go dependecies
Add Start and End marker comments for bundling information
Add '-k' to goprep to preserve the vendor directory

tools
-----
Add script to update the RPM spec file to generate the indication lines
based on vendor/modules.txt

Packit
------
Run the new script as a post-upstream-clone hook

Makefile
--------
Run the new script on the generated spec file before generating the RPM

mockbuild.sh
------------
Run the new script before creating the RPM
2022-06-23 18:02:09 +02:00
Jakub Rusz
8fef39c4cf rpmbuild: add fedora-36 2022-06-23 12:30:20 +02:00
Jakub Rusz
1829ff24ea Update terraform SHA 2022-06-21 10:40:58 +02:00
Jakub Rusz
d87c60857c mockbuild: update mockbuild script after RHEL-9 GA
Removing rhel-9 templates as they are shipped upstream already and
making necessary modifications to mockbuild.sh
2022-06-21 10:40:58 +02:00
Alexander Todorov
8c03162867 COMPOSER-1576: Switch to latest RHEL versions for testing 2022-06-21 10:40:58 +02:00
Juan Abia
135d28bc9f remove cloud-cleaner in favour of scheduled cloud cleaner
from now on, we will run schedules cloud cleaner every ~1h, so there's
no need to run cloud cleaner.
2022-06-14 10:41:18 +02:00
Juan Abia
bdd7122f10 separate scheduled cloud cleaner to a separate repo
checkout this repo on our CI so changes can be made easier.
2022-06-14 10:41:18 +02:00
Alexander Todorov
ee044a50bb COMPOSER-1576: Start building RPMs on 8.6 and 9.0 GA before we can test 2022-06-06 12:53:43 +02:00
Ondřej Budai
ea36377925 terraform: bump to a version that does spot fleets
This should help with errors that we are seeing recently about not enough
capacity.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2022-05-25 11:59:32 +02:00
Sanne Raymaekers
5658cadcae shutzbot: Add sanne@redhat.com ssh key to CI's authorized_keys
[skip ci]
2022-05-18 13:28:11 +02:00
Juan Abia
031b67566b scheduled-cloud-cleaner: remove storage account skip
scheduled cloud cleaner is skipping the default storage account for a
resource group, as this images should get removed. There can be a
situation where this images are not removed and forgotten here. Remove
this skip condition so scc checks also in this storage account.
2022-05-17 16:37:18 +02:00
Jakub Rusz
ef87c917d5 Nightly testing: remove edge testing from nightly pipelines
All of the edge tests are being ran on every nightly compose inside
virt-qe Jenkins so no need to run all of them here as well. Keep just
ostree-raw-image.sh to cover edge testing for sign-off.
2022-05-10 14:13:24 +02:00
Xiaofeng Wang
0af53e4cad test: Add fedora-iot-container and fedora-iot-installer tests 2022-05-09 12:25:21 +02:00
Jakub Rusz
0aad2fa43f mockbuild: use rpmrepo in mock templates
We're using rpmrepo snapshots as system repositories on the runners, so
let's use them also for mockbuild.
2022-04-12 13:13:50 +02:00
Jakub Rusz
9c3e9ff616 ci: add team ssh keys in before_script
Add the keys in before_script to make also rpbuild runners accessible as
the deploy.sh script is not being ran there.
2022-04-12 13:13:50 +02:00
Ondřej Budai
fd49ed9a07 repositories: update key for RHEL 9.0
RHEL 9.0 will ship a brand new auxiliary key. Let's use it everywhere in our
RHEL 9 stuff. Taken from current RHEL 9.0's redhat-release package.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2022-04-01 19:22:23 +02:00
Alexander Todorov
7ea3920cdf Add Xiaofeng to notifications for nightly pipeline 2022-03-28 11:30:44 +02:00
Jakub Rusz
8390709614 ci/details: list system repositories and run in after_script too
It is good to know what system repositories are used exactly on the
runner. Also running the ci_details.sh in after_script can help during
any debugging as packages that got updated or installed during the run
can be easily identified.
2022-03-25 16:00:39 +01:00
Ondřej Budai
99aad294dd deploy: work around a podman bug in CS8
See the comment.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2022-03-21 16:45:49 +01:00
Jakub Rusz
67c5f91ea4 mockbuild: use public EPEL-9 2022-03-09 22:03:39 +01:00
Jakub Rusz
ec93130a30 schutzbot/prepare-rhel-internal: update repository gpgkey
SHA-1 key is no longer supported, update it with a new one from
redhat-release. Related rhbz#2058497
2022-03-08 09:23:05 +01:00
Jakub Rusz
5f28e0b7f6 schutzbot: update terraform SHA
CentOS-stream-9 image update in AWS. Resolves current koji.sh failures.
2022-03-04 09:34:46 +01:00
Jakub Rusz
a351a17f5e schutzbot: fix jrusz ssh key 2022-03-03 15:02:13 +01:00
Jakub Rusz
71f9355c87 schutzbot: add jrusz ssh-key 2022-03-03 13:29:55 +01:00
Achilleas Koutsou
e869c6ab84 schutzbot: keep runners alive when users are logged on
For troubleshooting in CI, if a user is logged on to a runner, keep it
alive until they are logged off.
2022-02-27 12:52:43 +01:00