Commit graph

5842 commits

Author SHA1 Message Date
Achilleas Koutsou
3bbcc8a7cc Remove test that depends on removed code from images
Manifest tests can no longer run and also aren't needed.
All image type manifests are generated and built in the obsuild/images
CI tests and the test function in images
(distro_test_common.TestDistro_Manifest()) has been removed.
2023-07-21 12:05:00 +02:00
Achilleas Koutsou
5c292c61c6 deps: update osbuild/images to 246b718310ea
Current main.
246b718310
2023-07-21 12:05:00 +02:00
Simon de Vlieger
326f0cfa2f cloudapi: add live-installer
This was missing to enable `live-installer` in the CloudAPI.
2023-07-20 18:53:28 +02:00
Brian C. Lane
d0a5da6866 lint: Enable check for replace in go.mod 2023-07-20 15:07:20 +02:00
Mario Cattamo
5b42eeb8b3 Include test for edge-ami image type 2023-07-20 17:18:35 +08:00
Diaa Sami
cb0734145d remove old prometheus listener 2023-07-19 10:56:36 +02:00
Brian C. Lane
3cfde5860d tools: Make pylint happier 2023-07-18 23:20:19 +02:00
Brian C. Lane
08e5c53d31 tools: Add support for local go package replacement
Local packages do not have a version number. Fake it with 'HEAD' to
indicate it's using whatever the working directory is pointing at.

The Provides line will then look like:

Provides: bundled(golang(../osbuild-images)) = HEAD

which rpmbuild is happy to process into an rpm.

This is ONLY for test builds on local systems and should never be seen
in the wild.
2023-07-18 23:20:19 +02:00
Brian C. Lane
f7dcc79bd8 tools: Set a+x on rpm_spec_vendor2provides 2023-07-18 23:20:19 +02:00
Achilleas Koutsou
f478323e3a tools: replace spec Provides generator
Replace the generator for the spec file "Provides:" list with the one
from the current go-rpm-macros [1].  The new generator can handle
'replace' commands in vendor/modules.txt, which makes it possible to
build RPMs with temporarily modified dependencies.  This enables making
scratch builds against forks or branches of the new osbuild/images
repository for development and testing.

In the future, we can use the packaged version of the script, but this
isn't yet available in all supported distros (EL8).

Made some minor modifications to the original script to prepend each
dependency with "Provides:" and read input files as arguments instead of
lines from stdin.

https://pagure.io/go-rpm-macros/blob/c32fbbd25bbcedee8c0b898d3653255b18a0d30e/f/rpm/go_mod_vendor.prov
2023-07-18 18:08:49 +02:00
schutzbot
1c148c162f Post release version bump
[skip ci]
2023-07-12 08:19:40 +00:00
Sanne Raymaekers
4bbfdb624c cloudapi/v2: cleanup rebase leftovers
This is a review oversight from osbuild/osbuild-composer#3551, just
remove it.
2023-07-10 23:51:08 +02:00
Achilleas Koutsou
0e4a9e586f split: replace internal packages with images library
Remove all the internal package that are now in the
github.com/osbuild/images package and vendor it.

A new function in internal/blueprint/ converts from an osbuild-composer
blueprint to an images blueprint.  This is necessary for keeping the
blueprint implementation in both packages.  In the future, the images
package will change the blueprint (and most likely rename it) and it
will only be part of the osbuild-composer internals and interface.  The
Convert() function will be responsible for converting the blueprint into
the new configuration object.
2023-07-10 21:11:19 +02:00
Alexander Todorov
d59199670f Remove Juan from the list of QE associates 2023-07-10 17:33:31 +02:00
Alexander Todorov
b8eea609f9 Fix typo in reference to another CI step 2023-07-10 15:27:24 +02:00
Alexander Todorov
9593eec847 Fix for possibly undefined variable in CI script 2023-07-10 15:27:24 +02:00
Alexander Todorov
7fa81a514f Schedule a nightly CI pipeline against each PR
- don't report to Slack if SLACK_WEBHOOK_URL is not defined
- report GitHub statuses separately for regular pipeline & nightly
  pipeline
2023-07-10 13:11:43 +02:00
schutzbot
d7ed3cae6e schutzfile: Update snapshots to 20230701 2023-07-03 17:18:34 +02:00
Simon de Vlieger
e7557f6086 live-installer: enable aarch64 for fedora 2023-06-30 16:42:56 +02:00
Tomáš Hozza
fce19f9676
Update create-tag.yml
Enable scheduled releases again.
2023-06-30 16:39:25 +02:00
Sanne Raymaekers
a2c07ea83a templates/dashboards: rework composer dashboard
splits the board into 3 sections:
- SLO
- API throughput
- API latency

It's also possible to filter by tenant. And some colours were adjusted
to improve readability.
2023-06-30 11:06:51 +02:00
Tomáš Hozza
6db01ab6de test/repos: use EUS CDN repos for RHEL 8.4 / 8.6 / 9.0
Use EUS repositories for these RHEL versions, since the content of
non-EUS repos is too old for CIV to pass on images built using them.
This is caused by some bugs which are tested by CIV being fixed only in
EUS.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2023-06-30 09:01:14 +02:00
Xiaofeng Wang
2baaa20859 test: Four fixes for RHEL for Edge tests
1. Remove ansible-blocking-io.py workaround. It's not required.
2. Variable should be PROD_REPO_URL, not STAGE_REPO_URL in
ostree-raw-image.sh
3. Use --reboot in rpm-ostree install to reboot VM instead of
a reboot ansible task
4. Wait until config file serviceinfo_api_server.yml exists, to
avoid file not available to use flaky issue
2023-06-30 09:07:39 +08:00
Sanne Raymaekers
6040c10e10 worker/v1: rearrange middlewares
The duration middleware should come after the tenant channel middleware,
otherwise the tenant in the context will be empty. The status middleware
can come beforehand because it queries the request context right before
sending a response.
2023-06-29 16:41:36 +02:00
Sanne Raymaekers
f303e7c233 cloudapi/v2: rearrange middlewares
The duration middleware should come after the tenant channel middleware,
otherwise the tenant in the context will be empty. The status middleware
can come beforehand because it queries the request context right before
sending a response.
2023-06-29 16:41:36 +02:00
Gianluca Zuccarelli
fa6f3ba197 cloudapi: openscap integration
Enable the openscap customizations in the cloudapi.
2023-06-29 13:42:49 +01:00
Gianluca Zuccarelli
12e7b806b6 internal/distro: default oscap datastreams
Set fallback datastreams for openscap if no datastream is provided by
the user. This will also simplify the cloudapi experience by not
exposing the `datastream`
2023-06-29 13:42:49 +01:00
Gianluca Zuccarelli
c32fac7169 distro/rhel8: enable oscap for centos8
Remediations for centos 8 images were not previously enabled.
This commit enables running oscap remediations for centos 8.
2023-06-29 13:42:49 +01:00
Diaa Sami
962ad9e582 containers/osbuild-composer: add prometheus port parameter 2023-06-29 14:34:15 +02:00
Sanne Raymaekers
170feba87b templates/packer: use RH SSO for the default token endpoint
MAS SSO (identity.api.openshift.com) was deprecated, RH SSO should be
the default.
2023-06-29 11:32:44 +02:00
Sanne Raymaekers
38093100e3 templates/composer: No longer accept MAS SSO 2023-06-29 11:32:44 +02:00
Sanne Raymaekers
ebe43bd680 test/cases/api: use the request_count metric
In future it will be possible to drop the total_compose_requests metric
in favour of the request_count metric.
2023-06-28 15:08:37 +02:00
Sanne Raymaekers
2837b2a3ad prometheus: split off request timing information into separate mw
Tracks the worker api in addition to the composer api.
2023-06-28 15:08:37 +02:00
Sanne Raymaekers
9594156baf internal/worker: use TenantChannelMiddleware 2023-06-28 15:08:37 +02:00
Sanne Raymaekers
06038b2af6 internal/prometheus: add tenant to http and status metrics 2023-06-28 15:08:37 +02:00
Sanne Raymaekers
0f946e1c9e internal/auth: add TenantChannelMiddleware
Extracts the tenant from the JWT and sets it in the request context.
2023-06-28 15:08:37 +02:00
Xiaofeng Wang
bec17b6d47 test: Remove rebase test shell script
BIOS rebase test and UEFI rebase test have been moved to
raw image and simplified installer test script by PR#3512 already
2023-06-28 13:20:26 +02:00
Tomáš Hozza
815f6c4f16
Pause scheduled releases
We need to hold-off the next release until https://github.com/osbuild/osbuild-composer/pull/3524 is merged
2023-06-28 09:43:56 +02:00
schutzbot
36158ab843 schutzfile: Update snapshots to 20230627 2023-06-27 16:17:46 +02:00
Ondřej Budai
7dd018a482 test: regen manifests
The two last commits touched the image definitions, so this has to be done.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-06-27 16:13:25 +02:00
Ondřej Budai
b5c9feeff9 distro/fedora: remove obsolete conditions for package set
osbuild-composer no longer supports Fedora 36, so we are safe to drop these
now.

iotCommitPackageSet would really benefit from sorting, but that would
create hard to handle conflicts with other PRs upstream, so I decided
not to do it in this commit.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-06-27 16:13:25 +02:00
Achilleas Koutsou
78931c0f05 test: update fedora repos
Update Fedora 37, 38, and 39 repositories for the test case generator.
Changes are only package versions and dependencies.

For Fedora 39, a package (lklug-fonts) had to be removed from the
Anaconda package set since it is no longer available.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-06-27 16:13:25 +02:00
Alexander Todorov
1757e5473d Sanity check if cloud-cleaner workflow is enabled
GitHub will automatically disable scheduled actions defined on
repositories which don't receive much activity. In particular such
scheduled jobs will be disabled after 60 days of repo inactivity.

This CI job sanity checks the current status and reports back to
every PR so we can manually re-enable cloud-cleaner if necessary.
2023-06-27 15:08:42 +03:00
Ondřej Budai
d108849a59 packit: remove epel builds
osbuild-composer doesn't need the epel buildroot, it should be totally
buildable in just a plain RHEL buildroot. Remove the EPEL targets to save
the copr team some resources.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-06-27 15:07:04 +03:00
Ondřej Budai
1d9ba597d9 packit: add aarch64 builds to RHEL 8
This makes our matrix for RHEL 8 and EPEL 8 the same.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-06-27 15:07:04 +03:00
Ondřej Budai
90e6596172 packit: sort copr build targets alphabetically
Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-06-27 15:07:04 +03:00
Ondřej Budai
6dafd59eaa packit: use yaml anchors to dedup the copr build targets
Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-06-27 15:07:04 +03:00
Simon de Vlieger
46f93614f2 fedora: live-installer image type
This image type produces the same artifact as the current workstation
installer live media.

During the implementation of this new installer some names have been
changed to make a bit more sense in the source tree. Installer images
now always mention which installer they are (anaconda, etc).
2023-06-27 13:18:56 +02:00
dependabot[bot]
32c3865507 build(deps): bump github.com/vmware/govmomi from 0.29.0 to 0.30.5
Bumps [github.com/vmware/govmomi](https://github.com/vmware/govmomi) from 0.29.0 to 0.30.5.
- [Release notes](https://github.com/vmware/govmomi/releases)
- [Changelog](https://github.com/vmware/govmomi/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vmware/govmomi/compare/v0.29.0...v0.30.5)

---
updated-dependencies:
- dependency-name: github.com/vmware/govmomi
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-06-27 09:41:01 +02:00
Achilleas Koutsou
4f91e956aa osbuild: validate checksums for algo prefix
Make sure checksums used in the file input helper functions contain only
1 colon delimiter and it is not at the start of the string.

Adjusted tests to work with new restriction.
2023-06-27 08:57:06 +02:00