Commit graph

5853 commits

Author SHA1 Message Date
Ondřej Budai
cac9327b44 update to go 1.19
UBI and the oldest support Fedora (37) now all have go 1.19, so we are
cleared to switch.

gofmt now reformats comments in certain cases, so that explains the formatting
changes in this commit.
See https://go.dev/doc/go1.19#go-doc

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-07-21 19:18:00 +02:00
Simon de Vlieger
89274e538d spec: require osbuild >= 89
The recently merged `live-installer` image type depends on osbuild >=
89, see the following commit in osbuild:

c90b587dcc
2023-07-21 14:20:37 +02:00
Diaa Sami
b6d6ecf874 cloudapi: add validation where missing 2023-07-21 12:52:32 +02:00
Diaa Sami
2bdfa045c1 cloudapi: fix typo in property name 2023-07-21 12:52:32 +02:00
Ondřej Budai
ba417dbf3d packer: use gp3 volumes
GP3 is cheaper than GP2, let's switch to it for storing our images:
https://fedoraproject.org/wiki/Changes/CloudEC2gp3

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-07-21 12:20:47 +02:00
Ondřej Budai
b461e403ef packer: move Fedora to 38
Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-07-21 12:20:47 +02:00
Ondřej Budai
3acc0d1d2e ci: fix the gitlab trigger
There were two issues:

- ${{ }} converts the expression to a string and strings are apparently always truthy
  https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#jobsjob_idif
- There was a typo in pr_data

Therefore, the check didn't work properly.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-07-21 12:12:44 +02:00
Alexander Todorov
38ed9a39be Start collecting logs from virt-install 2023-07-21 12:11:02 +02:00
Achilleas Koutsou
ee0c7b53dc test/README: update test manifest generation instructions 2023-07-21 12:05:50 +02:00
Achilleas Koutsou
52234c5fd1 test/README: describe vendoring of modified images repo
Add instructions for how to test an updated osbuild/images repo against
osbuild-composer.
2023-07-21 12:05:50 +02:00
Xiaofeng Wang
8ba6487b82 test: update for minimal raw new xz format 2023-07-21 12:05:00 +02:00
Achilleas Koutsou
3bbcc8a7cc Remove test that depends on removed code from images
Manifest tests can no longer run and also aren't needed.
All image type manifests are generated and built in the obsuild/images
CI tests and the test function in images
(distro_test_common.TestDistro_Manifest()) has been removed.
2023-07-21 12:05:00 +02:00
Achilleas Koutsou
5c292c61c6 deps: update osbuild/images to 246b718310ea
Current main.
246b718310
2023-07-21 12:05:00 +02:00
Simon de Vlieger
326f0cfa2f cloudapi: add live-installer
This was missing to enable `live-installer` in the CloudAPI.
2023-07-20 18:53:28 +02:00
Brian C. Lane
d0a5da6866 lint: Enable check for replace in go.mod 2023-07-20 15:07:20 +02:00
Mario Cattamo
5b42eeb8b3 Include test for edge-ami image type 2023-07-20 17:18:35 +08:00
Diaa Sami
cb0734145d remove old prometheus listener 2023-07-19 10:56:36 +02:00
Brian C. Lane
3cfde5860d tools: Make pylint happier 2023-07-18 23:20:19 +02:00
Brian C. Lane
08e5c53d31 tools: Add support for local go package replacement
Local packages do not have a version number. Fake it with 'HEAD' to
indicate it's using whatever the working directory is pointing at.

The Provides line will then look like:

Provides: bundled(golang(../osbuild-images)) = HEAD

which rpmbuild is happy to process into an rpm.

This is ONLY for test builds on local systems and should never be seen
in the wild.
2023-07-18 23:20:19 +02:00
Brian C. Lane
f7dcc79bd8 tools: Set a+x on rpm_spec_vendor2provides 2023-07-18 23:20:19 +02:00
Achilleas Koutsou
f478323e3a tools: replace spec Provides generator
Replace the generator for the spec file "Provides:" list with the one
from the current go-rpm-macros [1].  The new generator can handle
'replace' commands in vendor/modules.txt, which makes it possible to
build RPMs with temporarily modified dependencies.  This enables making
scratch builds against forks or branches of the new osbuild/images
repository for development and testing.

In the future, we can use the packaged version of the script, but this
isn't yet available in all supported distros (EL8).

Made some minor modifications to the original script to prepend each
dependency with "Provides:" and read input files as arguments instead of
lines from stdin.

https://pagure.io/go-rpm-macros/blob/c32fbbd25bbcedee8c0b898d3653255b18a0d30e/f/rpm/go_mod_vendor.prov
2023-07-18 18:08:49 +02:00
schutzbot
1c148c162f Post release version bump
[skip ci]
2023-07-12 08:19:40 +00:00
Sanne Raymaekers
4bbfdb624c cloudapi/v2: cleanup rebase leftovers
This is a review oversight from osbuild/osbuild-composer#3551, just
remove it.
2023-07-10 23:51:08 +02:00
Achilleas Koutsou
0e4a9e586f split: replace internal packages with images library
Remove all the internal package that are now in the
github.com/osbuild/images package and vendor it.

A new function in internal/blueprint/ converts from an osbuild-composer
blueprint to an images blueprint.  This is necessary for keeping the
blueprint implementation in both packages.  In the future, the images
package will change the blueprint (and most likely rename it) and it
will only be part of the osbuild-composer internals and interface.  The
Convert() function will be responsible for converting the blueprint into
the new configuration object.
2023-07-10 21:11:19 +02:00
Alexander Todorov
d59199670f Remove Juan from the list of QE associates 2023-07-10 17:33:31 +02:00
Alexander Todorov
b8eea609f9 Fix typo in reference to another CI step 2023-07-10 15:27:24 +02:00
Alexander Todorov
9593eec847 Fix for possibly undefined variable in CI script 2023-07-10 15:27:24 +02:00
Alexander Todorov
7fa81a514f Schedule a nightly CI pipeline against each PR
- don't report to Slack if SLACK_WEBHOOK_URL is not defined
- report GitHub statuses separately for regular pipeline & nightly
  pipeline
2023-07-10 13:11:43 +02:00
schutzbot
d7ed3cae6e schutzfile: Update snapshots to 20230701 2023-07-03 17:18:34 +02:00
Simon de Vlieger
e7557f6086 live-installer: enable aarch64 for fedora 2023-06-30 16:42:56 +02:00
Tomáš Hozza
fce19f9676
Update create-tag.yml
Enable scheduled releases again.
2023-06-30 16:39:25 +02:00
Sanne Raymaekers
a2c07ea83a templates/dashboards: rework composer dashboard
splits the board into 3 sections:
- SLO
- API throughput
- API latency

It's also possible to filter by tenant. And some colours were adjusted
to improve readability.
2023-06-30 11:06:51 +02:00
Tomáš Hozza
6db01ab6de test/repos: use EUS CDN repos for RHEL 8.4 / 8.6 / 9.0
Use EUS repositories for these RHEL versions, since the content of
non-EUS repos is too old for CIV to pass on images built using them.
This is caused by some bugs which are tested by CIV being fixed only in
EUS.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-06-30 09:01:14 +02:00
Xiaofeng Wang
2baaa20859 test: Four fixes for RHEL for Edge tests
1. Remove ansible-blocking-io.py workaround. It's not required.
2. Variable should be PROD_REPO_URL, not STAGE_REPO_URL in
ostree-raw-image.sh
3. Use --reboot in rpm-ostree install to reboot VM instead of
a reboot ansible task
4. Wait until config file serviceinfo_api_server.yml exists, to
avoid file not available to use flaky issue
2023-06-30 09:07:39 +08:00
Sanne Raymaekers
6040c10e10 worker/v1: rearrange middlewares
The duration middleware should come after the tenant channel middleware,
otherwise the tenant in the context will be empty. The status middleware
can come beforehand because it queries the request context right before
sending a response.
2023-06-29 16:41:36 +02:00
Sanne Raymaekers
f303e7c233 cloudapi/v2: rearrange middlewares
The duration middleware should come after the tenant channel middleware,
otherwise the tenant in the context will be empty. The status middleware
can come beforehand because it queries the request context right before
sending a response.
2023-06-29 16:41:36 +02:00
Gianluca Zuccarelli
fa6f3ba197 cloudapi: openscap integration
Enable the openscap customizations in the cloudapi.
2023-06-29 13:42:49 +01:00
Gianluca Zuccarelli
12e7b806b6 internal/distro: default oscap datastreams
Set fallback datastreams for openscap if no datastream is provided by
the user. This will also simplify the cloudapi experience by not
exposing the `datastream`
2023-06-29 13:42:49 +01:00
Gianluca Zuccarelli
c32fac7169 distro/rhel8: enable oscap for centos8
Remediations for centos 8 images were not previously enabled.
This commit enables running oscap remediations for centos 8.
2023-06-29 13:42:49 +01:00
Diaa Sami
962ad9e582 containers/osbuild-composer: add prometheus port parameter 2023-06-29 14:34:15 +02:00
Sanne Raymaekers
170feba87b templates/packer: use RH SSO for the default token endpoint
MAS SSO (identity.api.openshift.com) was deprecated, RH SSO should be
the default.
2023-06-29 11:32:44 +02:00
Sanne Raymaekers
38093100e3 templates/composer: No longer accept MAS SSO 2023-06-29 11:32:44 +02:00
Sanne Raymaekers
ebe43bd680 test/cases/api: use the request_count metric
In future it will be possible to drop the total_compose_requests metric
in favour of the request_count metric.
2023-06-28 15:08:37 +02:00
Sanne Raymaekers
2837b2a3ad prometheus: split off request timing information into separate mw
Tracks the worker api in addition to the composer api.
2023-06-28 15:08:37 +02:00
Sanne Raymaekers
9594156baf internal/worker: use TenantChannelMiddleware 2023-06-28 15:08:37 +02:00
Sanne Raymaekers
06038b2af6 internal/prometheus: add tenant to http and status metrics 2023-06-28 15:08:37 +02:00
Sanne Raymaekers
0f946e1c9e internal/auth: add TenantChannelMiddleware
Extracts the tenant from the JWT and sets it in the request context.
2023-06-28 15:08:37 +02:00
Xiaofeng Wang
bec17b6d47 test: Remove rebase test shell script
BIOS rebase test and UEFI rebase test have been moved to
raw image and simplified installer test script by PR#3512 already
2023-06-28 13:20:26 +02:00
Tomáš Hozza
815f6c4f16
Pause scheduled releases
We need to hold-off the next release until https://github.com/osbuild/osbuild-composer/pull/3524 is merged
2023-06-28 09:43:56 +02:00
schutzbot
36158ab843 schutzfile: Update snapshots to 20230627 2023-06-27 16:17:46 +02:00