Commit graph

311 commits

Author SHA1 Message Date
He Yi
f24e3d93e3 Update team_ssh_keys.txt 2022-02-22 21:55:56 +01:00
He Yi
866d2aabe7 Update team_ssh_keys.txt 2022-02-22 21:55:56 +01:00
Ondřej Budai
0fa7c96549 Revert "mockbuild: temporarily pin RHEL 9 compose to an older one"
This reverts commit 10c0891fe0.
2022-02-22 19:26:42 +00:00
Jakub Rusz
f0f80bd930 ci: update terraform SHA
This brings AWS internal subnet balancing which allows to double our CI
runners in AWS.
2022-02-21 12:21:13 +01:00
Ondřej Budai
10c0891fe0 mockbuild: temporarily pin RHEL 9 compose to an older one
A quick and dirty solution just to see the CI green before the release.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2022-02-18 16:03:20 +01:00
Ondřej Budai
16f6864d58 mockbuild: fix CS9 mockbuild
- name mangling from centos to centos-stream was enabled also for
  centos 9
- CS9 mock configs from mock-core-configs-36.3-1.fc35.noarch were added

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2022-02-18 10:39:08 +00:00
Jakub Rusz
8331af3ffd ci/nightly: report composer NVR in slack
Storing composer NVR in a file after it's installed and reporting on
Slack. Also reducing duplications of artifacts in .gitlab-ci.yml
2022-02-17 11:14:31 +01:00
Jakub Rusz
a4c19eee85 Schutzfile: add RPMREPO to repo titles
This will make it easier to distinguish nightly rpmrepo snapshots from
actual nightly repositories in the test logs.
2022-02-08 14:28:06 +02:00
Jakub Rusz
29a8810d6e tests/ci: fix sonarqube analysis for main branch
Only use the branch options if it's actually running in a branch and
analyse main without them, sonarqube otherwise doesn't recognize the
main branch.
2022-02-08 14:28:06 +02:00
Alexander Todorov
b31f61649a ci: Overwrite REPO_PATH based on the value of $NIGHTLY
Override only for osbuild-composer, not other projects

will produce different repositories/rpms for the same commit when
executed from a PR and from the scheduled pipelines. We need the
distinction b/c osbuild-composer-tests RPMs end up slightly different in
these two cases. For more info see:
https://github.com/osbuild/osbuild-composer/pull/2093#pullrequestreview-854328838
https://github.com/osbuild/osbuild-composer/pull/2093#issuecomment-1014469915
2022-02-04 23:43:43 +01:00
Alexander Todorov
8a46796cf7 ci: Don't account for SCHUTZ_OSBUILD variable
if you want to use a custom osbuild.rpm you can supply that in REPO_URL,
no?

Note: this removal of .repo files breaks building the -tests RPM from
source in downstream branches/nightlies b/c the repo is defined in
osbuild-composer.repo
2022-02-04 23:43:43 +01:00
Alexander Todorov
e07bd4bebf Don't override osbuild-composer-tests-multi-arch repo if not needed
drop the discovery mechanism from Brew b/c we're building the tests RPM
from main but overwrite the repository if REPO_URL is configured in ENV.
2022-02-04 23:43:43 +01:00
Alexander Todorov
63bca237cf ci: Check that installed osbuild-composer RPM matches SUT 2022-02-04 23:43:43 +01:00
Alexander Todorov
570e5f595f Relax the requirements between osbuild-composer-tests and osbuild-composer
this is only useful for our RHEL nightly pipeline testing b/c we intend
to be building the -tests RPM from the main branch.
2022-02-04 23:43:43 +01:00
Sanne Raymaekers
b53ee4135c schutzbot/terraform: New 86 runners 2022-02-03 00:24:59 +01:00
Jakub Rusz
c173d88061 test/ci: add sonarqube scan
Adding sonarqube scan to the pipeline.
2022-02-01 16:38:43 +02:00
Juan Abia
17e8a570a3 scheduled-cloud-cleaner: clean vmware resources
remove every object that has the tag "gitlab-ci-test" and it's old
enough
2022-01-31 09:26:51 +01:00
Jakub Rusz
1b951c5377 ci: update terraform SHA 2022-01-19 09:59:09 +01:00
Achilleas Koutsou
785b11b008 schutzbot: add new key and remove old for Achilleas
Signed-off-by: Achilleas Koutsou <achilleas@koutsou.net>
2022-01-06 23:51:00 +00:00
Ondřej Budai
4637e36ddf schutzbot: remove ssh keys of team member that left us
bye 😢

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2022-01-06 09:18:01 +01:00
sanne
71da979c81 tools: AppSRE packer build 2022-01-05 22:13:55 +01:00
Jakub Rusz
d543e39fc9 Update terraform SHA
Update of Openstack 8.6 runners was needed.
2022-01-03 12:12:26 +01:00
Thomas Lavocat
d26a93319c Tracing: measure IO during each job
Using iostat from package sysstat
2021-12-16 10:32:37 +01:00
Juan Abia
4875998cbe schutzbot: remove tagged gcp resources
extend scheduled cloud cleaner functionality to clean old enough and
tagged gcp resources
2021-12-14 12:20:31 +01:00
Thomas Lavocat
4da7ec68a0 openstack: use rhos-01 2021-12-13 19:11:13 +00:00
Alexander Todorov
af18116574 ci: CC QE in notification message 2021-12-13 12:12:41 +01:00
sanne
704c5daf71 8.5
openstack probably won't work
2021-12-02 10:41:04 +01:00
Ondřej Budai
05c22554d8 schutzbot: introduce packer builds
Every schutzbot run will now build an AMI image that contains the worker.
The composer RPM is taken from the mockbuild phase. The osbuild version
is taken from Schutzfile for RHEL 8 GA.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2021-12-01 16:08:11 +00:00
Jakub Rusz
dbd9285275 schutzbot/prepare-rhel-internal: add trailing slash to repo url
Regression tests were failing without this trailing slash at the end.
2021-11-26 12:20:54 +01:00
Juan Abia
ca36cf155e schutzbot: remove aws s3 resources
remove old enough and tagged s3 objects
2021-11-26 10:00:42 +01:00
Ondřej Budai
dc7968d5c7 terraform: update to use the new instance type
The latest commit switched all our AWS x86_64 workloads to the newly announced
c6i.large instance type. I did some measurements and the test suite runs about
10% faster. Nice!

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2021-11-24 17:13:41 +01:00
Jakub Rusz
14b7e92eaa tests/ci: split nightly testing based on RHEL major version
Using just the major version from the $VERSION_ID and defining new CI
variable $RHEL_MAJOR.
2021-11-16 10:46:50 +01:00
Juan Abia
0bc6ea1172 schuzbot: clean aws unused resources
list all unused resources on ec2 and remove them.

each resource originated by test scripts should be tagged with
"gitlab-ci-test"
2021-11-11 15:42:32 +01:00
Achilleas Koutsou
0b41cd8003 mockbuild: change RHEL 9 template to use latest non-beta repos 2021-11-10 14:54:31 +01:00
Achilleas Koutsou
ad896fb69e schutzbot: update terraform sha 2021-11-10 14:54:31 +01:00
Thomas Lavocat
82ee9661a9 CI: Journal-log is accessible and encrypted 2021-11-10 10:31:33 +01:00
Martin Sehnoutka
01acebda64 schutzbot: double quote jq argument to prevent shellcheck failures
The argument contains a variable $i. Shellcheck complains that it must
be quoted.
2021-11-09 15:32:29 +01:00
Jakub Rusz
2d13fa3a87 prepare_rhel_internal: configure s3cmd explicitly
A similar change was added in 65e429fc4a
so adding it here as well.
2021-11-02 08:43:40 +01:00
Achilleas Koutsou
aea77ed3de test: timestamp messages in test scripts
The commonly used 'greenprint' function now adds a date + timestamp to
each message for debugging and tracking the duration of segments of each
scripts.
2021-10-24 16:13:53 +01:00
Ondřej Budai
361ff64bfc ci: pin a specific RHEL 9.0b compose
Otherwise, we get RPM failures. We also have to use a newer terraform
commit. :/

See RHELCMP-7135

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2021-10-21 07:28:46 +02:00
Ondřej Budai
58423c262b ci: rotate secret names
Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2021-10-21 07:28:46 +02:00
Ondřej Budai
65e429fc4a mockbuild: explicitly configure s3cmd
We are no longer using the variable names that s3cmd uses by default
so we need to configure it explicitly.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2021-10-21 07:28:46 +02:00
Ondřej Budai
99a8d67812 mockbuild: remove subscriptions
Everything is pre-subscribed.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2021-10-21 07:28:46 +02:00
Achilleas Koutsou
ed9e57dc98 schutzbot: update terraform sha
Signed-off-by: Achilleas Koutsou <achilleas@koutsou.net>
2021-10-11 09:49:15 +02:00
sanne
149d53c1e4 schutzbot: Clean up non-default storage accounts 2021-10-04 14:30:04 +02:00
Ondřej Budai
af784a11b1 mockbuild: use download.devel of download.eng.bos
download.eng.bos.redhat.com is down, use the mirroring service instead.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2021-10-01 15:23:53 +02:00
sanne
042eb75de6 schutzbot: Also build container on branch pushes
The regression test failed to find the container when not running from a
PR.
2021-09-29 15:07:35 +02:00
sanne
2f328b0e97 workers: Backwards compatible api.openshift.com spec compliance
The main changes are:
- Kind, Href, Id fields for every object returned
- Attach operationIds to each request, return it for errors
- Errors are predefined and queryable
2021-09-27 13:10:05 +01:00
Ondřej Budai
3991827f68 ci: add workaround for missing redhat.repo in EC2
Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2021-09-24 17:03:53 +02:00
Ondřej Budai
fbb091c8c8 mockbuild: use REPO_BUCKET when defining the base URL
Just deduplication of code.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2021-09-24 17:03:53 +02:00