Commit graph

351 commits

Author SHA1 Message Date
Jakub Rusz
fe1bf7a7bf Update terraform SHA
Fedora-37 was using "ci-ssd" instance in RHOS-01 which does not support
nested KVM. This SHA switches them to use "ci" instances which do
support nested kvm.
2022-11-07 16:10:41 +01:00
Jakub Rusz
f2671e0074 Update terraform SHA
This update removes all repos on the f-37 runner during provisioning
which should resolve issues with "updates-testing" repo being enabled
and not overwritten.
2022-10-27 12:47:45 +02:00
Sanne Raymaekers
423b4b77d7 schutzbot/update_github_status: fix release fast-forwarding
The checkout in the working directory is a shallow clone with gitlab as
a remote. As a result fast-forwarding failed due to not recognizing the
remote release branch as an ancestor of $CI_COMMIT_SHA.

This clones (with `--bare`) the github remote in a separate
directory. It should not be necessary to remove the release-ff-clone
directory each time, simply fetch if it already exists.
2022-10-21 10:54:30 +02:00
Sanne Raymaekers
545ce3412e schutzbot/mockbuild: stop running mock as root
Running mock as root is broken, this commit can be reverted once this is
fixed.

rhbz#2135203
2022-10-17 18:08:31 +02:00
Jakub Rusz
a23b1c4b3e rpmbuild: build rpms on RHEL 8.8 and 9.2 2022-10-14 12:25:36 +02:00
Achilleas Koutsou
d7d098a857 CI: update terraform SHA for Fedora 37 runners 2022-09-13 16:06:19 +01:00
Sanne Raymaekers
6a2e719c76 schutzbot: Fast-forward release branch after green main run
The release branch can be tracked by stage deployments to make sure CI
is green before deploying to stage.
2022-09-02 11:05:28 +02:00
Jakub Rusz
de6b8e8f5b Update terraform SHA with more aarch64 runner options
This commit adds the option to also provision c6g.large machines in
addition to c7g.large machines in AWS.
2022-08-23 15:31:47 +03:00
Alexander Todorov
f451e0291a Modify repositories/rhel-xy.json file before testing nightly compose
Fixes #1318

- uses a wildcard match for sed in order to replace only lines which
  match and keep the rest intact
2022-08-18 14:00:16 +03:00
Alexander Todorov
860b122f2c tests: Remove useless JSON file overrides
See comment
https://github.com/osbuild/osbuild-composer/pull/2881/files#r940065803

for explanation why
2022-08-10 16:33:34 +03:00
Tomas Hozza
444f85ac5c schutzbot: add thozza's SSH public key 2022-08-04 11:55:43 +02:00
Jakub Rusz
cf562dbb57 CI: drop /tmp/artifacts upload to Gitlab
Contents of this folder are uploaded to S3 with shutzbot/upload_artifacts.sh
Also fixing epel installation in the mentioned script.
2022-07-26 17:08:32 +02:00
Jakub Rusz
f93b38c1a8 CI: fix ci_details artifact placement
The output of the ci_details.sh needs to be placed in the /tmp/artifacts
in order to be uploaded with the rest of the artifacts.
2022-07-21 13:17:45 +02:00
Jakub Rusz
efbd5ebd7b ci/tests: Change the way artifacts are collected
We want to be able to safely gather any artifacts without worrying about
any possible secrets leaking. Every artifacts that we want to upload
will now have to be placed in /tmp/artifacts which will then be uploaded
to S3 by the executor and link to the artifacts will be provided in the
logs. Only people with access to our AWS account can see them.
2022-07-18 11:33:57 +03:00
Jakub Rusz
b297ee8d40 CI: temporarily siwtch RHOS-01 to non-ssd instances
There appears to be a problem with nested virtualization on newly added
hypervisors with ssd. I believe the issue is not preset on regular
instances, so switching to those until the issues can be resolved.
2022-07-14 12:00:50 +03:00
Ygal Blum
534625fa38 Fedora - Use vendor instead of rpm dependencies
RPM Spec
--------
Remove all Go dependecies
Add Start and End marker comments for bundling information
Add '-k' to goprep to preserve the vendor directory

tools
-----
Add script to update the RPM spec file to generate the indication lines
based on vendor/modules.txt

Packit
------
Run the new script as a post-upstream-clone hook

Makefile
--------
Run the new script on the generated spec file before generating the RPM

mockbuild.sh
------------
Run the new script before creating the RPM
2022-06-23 18:02:09 +02:00
Jakub Rusz
8fef39c4cf rpmbuild: add fedora-36 2022-06-23 12:30:20 +02:00
Jakub Rusz
1829ff24ea Update terraform SHA 2022-06-21 10:40:58 +02:00
Jakub Rusz
d87c60857c mockbuild: update mockbuild script after RHEL-9 GA
Removing rhel-9 templates as they are shipped upstream already and
making necessary modifications to mockbuild.sh
2022-06-21 10:40:58 +02:00
Alexander Todorov
8c03162867 COMPOSER-1576: Switch to latest RHEL versions for testing 2022-06-21 10:40:58 +02:00
Juan Abia
135d28bc9f remove cloud-cleaner in favour of scheduled cloud cleaner
from now on, we will run schedules cloud cleaner every ~1h, so there's
no need to run cloud cleaner.
2022-06-14 10:41:18 +02:00
Juan Abia
bdd7122f10 separate scheduled cloud cleaner to a separate repo
checkout this repo on our CI so changes can be made easier.
2022-06-14 10:41:18 +02:00
Alexander Todorov
ee044a50bb COMPOSER-1576: Start building RPMs on 8.6 and 9.0 GA before we can test 2022-06-06 12:53:43 +02:00
Ondřej Budai
ea36377925 terraform: bump to a version that does spot fleets
This should help with errors that we are seeing recently about not enough
capacity.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2022-05-25 11:59:32 +02:00
Sanne Raymaekers
5658cadcae shutzbot: Add sanne@redhat.com ssh key to CI's authorized_keys
[skip ci]
2022-05-18 13:28:11 +02:00
Juan Abia
031b67566b scheduled-cloud-cleaner: remove storage account skip
scheduled cloud cleaner is skipping the default storage account for a
resource group, as this images should get removed. There can be a
situation where this images are not removed and forgotten here. Remove
this skip condition so scc checks also in this storage account.
2022-05-17 16:37:18 +02:00
Jakub Rusz
ef87c917d5 Nightly testing: remove edge testing from nightly pipelines
All of the edge tests are being ran on every nightly compose inside
virt-qe Jenkins so no need to run all of them here as well. Keep just
ostree-raw-image.sh to cover edge testing for sign-off.
2022-05-10 14:13:24 +02:00
Xiaofeng Wang
0af53e4cad test: Add fedora-iot-container and fedora-iot-installer tests 2022-05-09 12:25:21 +02:00
Jakub Rusz
0aad2fa43f mockbuild: use rpmrepo in mock templates
We're using rpmrepo snapshots as system repositories on the runners, so
let's use them also for mockbuild.
2022-04-12 13:13:50 +02:00
Jakub Rusz
9c3e9ff616 ci: add team ssh keys in before_script
Add the keys in before_script to make also rpbuild runners accessible as
the deploy.sh script is not being ran there.
2022-04-12 13:13:50 +02:00
Ondřej Budai
fd49ed9a07 repositories: update key for RHEL 9.0
RHEL 9.0 will ship a brand new auxiliary key. Let's use it everywhere in our
RHEL 9 stuff. Taken from current RHEL 9.0's redhat-release package.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2022-04-01 19:22:23 +02:00
Alexander Todorov
7ea3920cdf Add Xiaofeng to notifications for nightly pipeline 2022-03-28 11:30:44 +02:00
Jakub Rusz
8390709614 ci/details: list system repositories and run in after_script too
It is good to know what system repositories are used exactly on the
runner. Also running the ci_details.sh in after_script can help during
any debugging as packages that got updated or installed during the run
can be easily identified.
2022-03-25 16:00:39 +01:00
Ondřej Budai
99aad294dd deploy: work around a podman bug in CS8
See the comment.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2022-03-21 16:45:49 +01:00
Jakub Rusz
67c5f91ea4 mockbuild: use public EPEL-9 2022-03-09 22:03:39 +01:00
Jakub Rusz
ec93130a30 schutzbot/prepare-rhel-internal: update repository gpgkey
SHA-1 key is no longer supported, update it with a new one from
redhat-release. Related rhbz#2058497
2022-03-08 09:23:05 +01:00
Jakub Rusz
5f28e0b7f6 schutzbot: update terraform SHA
CentOS-stream-9 image update in AWS. Resolves current koji.sh failures.
2022-03-04 09:34:46 +01:00
Jakub Rusz
a351a17f5e schutzbot: fix jrusz ssh key 2022-03-03 15:02:13 +01:00
Jakub Rusz
71f9355c87 schutzbot: add jrusz ssh-key 2022-03-03 13:29:55 +01:00
Achilleas Koutsou
e869c6ab84 schutzbot: keep runners alive when users are logged on
For troubleshooting in CI, if a user is logged on to a runner, keep it
alive until they are logged off.
2022-02-27 12:52:43 +01:00
He Yi
f24e3d93e3 Update team_ssh_keys.txt 2022-02-22 21:55:56 +01:00
He Yi
866d2aabe7 Update team_ssh_keys.txt 2022-02-22 21:55:56 +01:00
Ondřej Budai
0fa7c96549 Revert "mockbuild: temporarily pin RHEL 9 compose to an older one"
This reverts commit 10c0891fe0.
2022-02-22 19:26:42 +00:00
Jakub Rusz
f0f80bd930 ci: update terraform SHA
This brings AWS internal subnet balancing which allows to double our CI
runners in AWS.
2022-02-21 12:21:13 +01:00
Ondřej Budai
10c0891fe0 mockbuild: temporarily pin RHEL 9 compose to an older one
A quick and dirty solution just to see the CI green before the release.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2022-02-18 16:03:20 +01:00
Ondřej Budai
16f6864d58 mockbuild: fix CS9 mockbuild
- name mangling from centos to centos-stream was enabled also for
  centos 9
- CS9 mock configs from mock-core-configs-36.3-1.fc35.noarch were added

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2022-02-18 10:39:08 +00:00
Jakub Rusz
8331af3ffd ci/nightly: report composer NVR in slack
Storing composer NVR in a file after it's installed and reporting on
Slack. Also reducing duplications of artifacts in .gitlab-ci.yml
2022-02-17 11:14:31 +01:00
Jakub Rusz
a4c19eee85 Schutzfile: add RPMREPO to repo titles
This will make it easier to distinguish nightly rpmrepo snapshots from
actual nightly repositories in the test logs.
2022-02-08 14:28:06 +02:00
Jakub Rusz
29a8810d6e tests/ci: fix sonarqube analysis for main branch
Only use the branch options if it's actually running in a branch and
analyse main without them, sonarqube otherwise doesn't recognize the
main branch.
2022-02-08 14:28:06 +02:00
Alexander Todorov
b31f61649a ci: Overwrite REPO_PATH based on the value of $NIGHTLY
Override only for osbuild-composer, not other projects

will produce different repositories/rpms for the same commit when
executed from a PR and from the scheduled pipelines. We need the
distinction b/c osbuild-composer-tests RPMs end up slightly different in
these two cases. For more info see:
https://github.com/osbuild/osbuild-composer/pull/2093#pullrequestreview-854328838
https://github.com/osbuild/osbuild-composer/pull/2093#issuecomment-1014469915
2022-02-04 23:43:43 +01:00