Commit graph

5181 commits

Author SHA1 Message Date
Gianluca Zuccarelli
25faf5ab60 internal/prometheus: remove compose fail metrics
We have switched how 5xx errors are being recorded
internally and we are now recording all failures
for all endpoints. As a result, a dedicated metric
only for compose failures is no longer required.
2023-01-12 12:55:01 +01:00
schutzbot
382db4245a Post release version bump
[skip ci]
2023-01-11 08:23:59 +00:00
Ondřej Budai
d12d9674d6 terraform: update to the latest definitions
Currently, we still have the issue with rogue instances. The latest commit in
the gitlab-ci-terraform repository prevents that by limiting the validity
of the spot fleet request to 4 hours which matches our maximum job duration
set in GitLab.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-01-10 14:26:18 +01:00
Gianluca Zuccarelli
08aa1e99a1 worker/server: log unresponsive job removal
Re-add the logging for when unresponsive heartbeats
are being removed so we can verify that they
are correctly being logged as 5xx errors.
2023-01-10 09:29:33 +01:00
Jakub Rusz
fe554ad184 tests/ostree: use local install and lower memory
Download the boot.iso to the hypervisor to use local install instead of
networked which allows to use lower RAM.
2023-01-10 00:28:23 +01:00
Alexander Todorov
e18cda1fa2 Remove OSTree raw image test from nightly pipelines
leave this entirely to Virt-QE
2023-01-10 00:28:23 +01:00
Jakub Rusz
340f79c537 tests/ostree: use local install
Download the boot.iso to the hypervisor to use local install instead of
networked which allows to use lower RAM.
2023-01-10 00:28:23 +01:00
Alexander Todorov
6d0c8ced8d Update more test conditions based on code review 2023-01-10 00:28:23 +01:00
Alexander Todorov
ccd54a2c99 Build latest 8.8 and 9.2 development versions in Koji
see
eb78fcd85e
aff680542d
2023-01-10 00:28:23 +01:00
Alexander Todorov
155f8aac76 Update osbuild commit reference for 8.8 and 9.2
https://coreos.slack.com/archives/C0235DZB0DT/p1670837975974169
2023-01-10 00:28:23 +01:00
Alexander Todorov
cbc46ed75a Use 9.2 URLs in upgrade test 2023-01-10 00:28:23 +01:00
Alexander Todorov
57cb9c0803 Remove repo overrides for 8.7 and 9.1 GA 2023-01-10 00:28:23 +01:00
Alexander Todorov
ed02075387 Fix typo in composer-cli command used in test 2023-01-10 00:28:23 +01:00
Alexander Todorov
7756a801f5 Update 8.7 & 9.1 GA urls in .json files 2023-01-10 00:28:23 +01:00
Alexander Todorov
d3c6eba7bf Switch 8.6 and 9.0 GA to 8.7 and 9.1 GA 2023-01-10 00:28:23 +01:00
Alexander Todorov
00dd497173 libvirt.sh: Adjust virt-install parameters for 9.2 2023-01-10 00:28:23 +01:00
Alexander Todorov
28a6346d87 ci: Use sudo before localectl
should help resolve:

+ localectl set-locale LANG=en_US.UTF-8
Failed to issue method call: Interactive authentication required.
2023-01-10 00:28:23 +01:00
Alexander Todorov
3b75d032d0 tests: Specify commit for newer osbuild 2023-01-10 00:28:23 +01:00
Alexander Todorov
a8df4879ac Adjust tests for 8.8 and 9.2 2023-01-10 00:28:23 +01:00
Alexander Todorov
29fd2873a1 Enable rhel-8.8 & rhel-9.2 CI runners 2023-01-10 00:28:23 +01:00
Alexander Todorov
b41353f01c Revert "test: Update nightly compose URL to updates URL"
This reverts commit 422e70c8ce because it
breaks nightly CI testing with 8.8 and 9.2.
2023-01-10 00:28:23 +01:00
Gianluca Zuccarelli
5aae10c951 templates/dashboards: update worker queries
The workers now use a new metric to record all
http requests. This commit updates the worker dashboard
to use the new `image_builder_worker_request_count`
query.
2023-01-09 16:52:16 +01:00
Gianluca Zuccarelli
50237e3797 templates/dashboards: update composer queries
osbuild-composer now uses a new metric to record all
http requests. This commit updates the composer dashboard
to use the new `image_builder_composer_request_count`
query.
2023-01-09 16:52:16 +01:00
dependabot[bot]
967b68745d build(deps): bump github.com/theupdateframework/go-tuf
Bumps [github.com/theupdateframework/go-tuf](https://github.com/theupdateframework/go-tuf) from 0.3.1 to 0.3.2.
- [Release notes](https://github.com/theupdateframework/go-tuf/releases)
- [Commits](https://github.com/theupdateframework/go-tuf/compare/v0.3.1...v0.3.2)

---
updated-dependencies:
- dependency-name: github.com/theupdateframework/go-tuf
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-01-09 14:46:28 +01:00
Ondřej Budai
b997142db0 common: merge all *ToPtr methods to one generic ToPtr
After introducing Go 1.18 to a project, it's required by law to convert at
least one method to a generic one.

Everyone hates IntToPtr, StringToPtr, BoolToPtr and Uint64ToPtr, so let's
convert them to the ultimate generic ToPtr one.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-01-09 14:03:18 +01:00
Ondřej Budai
0359647a82 go.mod: update to Go 1.18
Fedora 35 support was dropped, so we can update to a newer Go.

Stable RHEL 8 and 9 and Fedora 36 ships Go 1.18, so let's switch to it.

"//go:build" directives are now apparently enforced by go fmt, so that's why
there were added.

Also, all the github actions were adjusted to use Go 1.18.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-01-09 14:03:18 +01:00
Sanne Raymaekers
6ca12a493d osbuild-worker: add dnf-json error reason to depsolve job error 2023-01-06 13:55:04 +01:00
Ondřej Budai
4bafe1ead9 remove Fedora 35 support
Fedora 35 is going EOL on Tue 2022-12-13. At the time of writing this commit
message, that's the next day. As we do releases on Wednesdays, the next
release will never find its way to F35 and thus, there's no point in keeping
support for it.

Let's delete everything that relates to Fedora 35. If there's something that
cannot be deleted (e.g. CI containers based on F35), let's upgrade it to F37.

TestCrossArchDepsolve now uses CentOS Stream 8 because RHEL 8.4 cannot read
F37 repository metadata. This is a similar issue to
https://bugzilla.redhat.com/show_bug.cgi?id=2004853 . Basically, newer
repositories can be only read by libmodulemd >= 2.11.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-01-06 11:34:50 +01:00
Ondřej Budai
8c4689f082 workflows: mark the working directory safe for git
Github actions have a peculiar behaviour: The "job root" directory is owned
by user with ID 1001 whereas many containers (like the Fedora one) run as root
by default. This causes git to freak out because repositories owned by
different users aren't considered safe anymore and must be explicitly allow-
listed.

This becomes a problem when we switch to Go 1.18 because it stamps build with
Git information which fails because the repository technically isn't safe.

Let's fix this by marking the repository as a safe one.

Note that the actions/checkout action has a set-safe-directory feature, but
this one is not permanent. After the action is done, the setting is removed.
See https://github.com/actions/checkout/pull/762

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-01-06 11:34:50 +01:00
Ondřej Budai
1f782900f0 tools/koji-composer: add encoding to open()
Newer versions of pylint complain about a missing encoding in the open()
function.

Signed-off-by: Ondřej Budai <ondrej@budai.cz>
2023-01-06 11:34:50 +01:00
Achilleas Koutsou
d968765c64 Schutzfile: update osbuild version to latest build (v75) 2023-01-05 19:32:25 +01:00
Miroslav Suchý
1dd513c44a Migrate to SPDX license
See https://fedoraproject.org/wiki/Changes/SPDX_Licenses_Phase_1
2023-01-05 11:34:47 +01:00
schutzbot
20143b66c7 Post release version bump
[skip ci]
2022-12-28 08:21:37 +00:00
Lukáš Zapletal
13fdf04839 Update building instructions
Looks like `build/` is not even in `.gitignore`. What happened there? :-)
2022-12-19 10:49:37 +01:00
Tomáš Hozza
5e0c66e008 RHEL-9: add missing Azure aarch64 image manifests
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2022-12-16 15:40:09 +01:00
Achilleas Koutsou
e217c6069e distro/rhel9: update image type lists in tests 2022-12-16 15:40:09 +01:00
Achilleas Koutsou
a5c1f8e98c test: generate new manifests: Azure aarch64
Co-Authored-By: Christian Kellner <christian@kellner.me>
2022-12-16 15:40:09 +01:00
Achilleas Koutsou
a9842d5e9c test-case-generators: enable azure aarch64 manifest generation
Add the rhui-azure rpmrepo snapshots to aarch64 repositories.
The repos are labelled as x86_64 but they're actually 'noarch' and we
name them x86_64 when creating the snapshots.

Co-Authored-By: Christian Kellner <christian@kellner.me>
2022-12-16 15:40:09 +01:00
Achilleas Koutsou
d3b0b2218b distro/rhel9: add Azure aarch64 platform and include image types
Co-Authored-By: Christian Kellner <christian@kellner.me>
2022-12-16 15:40:09 +01:00
Achilleas Koutsou
2a0e935fc3 distro/rhel9: add partition table for aarch64 azure-rhui
Copy of the x86_64 partition table with BIOS partition removed.

Co-Authored-By: Christian Kellner <christian@kellner.me>
2022-12-16 15:40:09 +01:00
Achilleas Koutsou
617ec35c57 distro/rhel9: clarify partition table error message
The previous error didn't make it clear where the issue was coming from.
Now it explains that the problem is that a partition table for a given
architecture isn't specified on the image type.

Co-Authored-By: Christian Kellner <christian@kellner.me>
2022-12-16 15:40:09 +01:00
Achilleas Koutsou
ee7429880f distro/rhel9: remove arch-dependent packages from Azure common
These are already added by the platform.

Co-Authored-By: Christian Kellner <christian@kellner.me>
2022-12-16 15:40:09 +01:00
Irene Diez
f711219f0a tests: update si tests with ignition blueprint
Signed-off-by: Irene Diez <idiez@redhat.com>
2022-12-15 11:34:17 +00:00
Irene Diez
76728818c9 internal/distro/rhel9: handle ignition.embedded for edge
Signed-off-by: Irene Diez <idiez@redhat.com>
2022-12-15 11:34:17 +00:00
Irene Diez
428dd169e4 internal/distro/rhel9: handle ignition.firstboot for edge
Signed-off-by: Irene Diez <idiez@redhat.com>
2022-12-15 11:34:17 +00:00
Irene Diez
2f2ef709cd internal/blueprint: add ignition customizations
This allows a user to configure the system via `edge-simplified-installer`
using an ignition configuration specified in the blueprint.

This ignition config can be embedded in the ISO as a Base64
encoded file (ignition.embedded.data) or as a file
containing the URL where the ignition config file is served
(ignition.embedded.url).

The user can also instead specify an URL serving an ignition
config file that will passed as a karg and be fetched at first
boot (ignition.firstboot.url).

Signed-off-by: Irene Diez <idiez@redhat.com>
2022-12-15 11:34:17 +00:00
Sanne Raymaekers
81a5ff1bf6 templates/packer: triple aws polling attempts
AMIs can take a long time to get ready.
2022-12-14 17:10:13 +01:00
schutzbot
99a202fa99 Post release version bump
[skip ci]
2022-12-14 08:26:06 +00:00
Achilleas Koutsou
cc4744b306 test: regenerate manifests - RHEL 9.x and CS9 edge installers
The edge installer manifests for RHEL 9.x and CS9 no longer enable the
Users module in Anaconda.
Note that the 'edge_installer_with_users' manifests are unaffected.  The
module is enabled in these manifests so that the user specified in the
build request can be created during installation.
2022-12-13 20:33:27 +00:00
Achilleas Koutsou
83cb043daa distro/rhel9: conditionally enable users module for edge installer
In RHEL 9, for the edge installer, only enable the users module when it
is required for creating a user specified in the blueprint or request.
2022-12-13 20:33:27 +00:00