Sanne Raymaekers
13aae7d532
templates/packer: invert tag logic
...
With the rpmcopy or rpmrepo_osbuild tags, the `Install worker rpm` stage
got skipped on RHEL and CI. Invert the tag logic and use `--tags`
instead of `--skip-tags`.
2024-05-21 09:40:11 +02:00
schutzbot
773bfe6c49
Post release version bump
...
[skip ci]
2024-05-15 08:13:55 +00:00
Mario Cattamo
9164c9a8dd
test: update osname for edge deployments
2024-05-14 21:12:36 +02:00
Brian C. Lane
66c5c5ecf9
cloudapi: Add UploadTypesLocal for local_save status reports
...
This allows the compose status to reflect that it was saved locally, not
uploaded to a remote service. Without this it returns an error of
'Compose has unknown upload target'
2024-05-13 13:27:12 -07:00
Alexander Todorov
8dece19342
Submit data to CodeCov only if actor has access to token secrets
2024-05-10 22:08:27 +03:00
Alexander Todorov
75a80c9625
Tell CodeCov to add comments to PRs
2024-05-10 22:08:27 +03:00
Alexander Todorov
966685607b
Re-enable codecov but use a GHA to submit the results
...
because the bash upload has been deprecated
2024-05-10 22:08:27 +03:00
Sanne Raymaekers
c886d6c1f5
templates/dashboards: fix community-stage tenant variable
...
A space is necessary before and after the colon separating the key and
the value.
[skip ci]
2024-05-08 12:59:34 +02:00
Sanne Raymaekers
9c047cd8e0
tools/fedora-worker-packer: don't trace statements
...
It makes the logs extremely verbose, and requests/responses are already
printed when relevant.
2024-05-07 18:38:13 +02:00
Sanne Raymaekers
aadf5dfc9a
tools/fedora-worker-packer: increase timeouts further
...
The first timeout increase didn't take effect. And once the suite is
present the rpm builds can stay pending for a very long time.
2024-05-07 18:38:13 +02:00
Sanne Raymaekers
c9ce5af655
tools/fedora-worker-packer: set the commit sha
...
Currently the COMMIT_SHA variable is empty.
2024-05-07 14:47:59 +02:00
Sanne Raymaekers
28e4b0aa07
tools/fedora-worker-packer: increase timeout waiting for packit
2024-05-07 14:47:59 +02:00
Sanne Raymaekers
a1476bdfb1
tools/appsre-build-worker-packer: stop writing bogus files
2024-05-07 13:57:48 +02:00
Sanne Raymaekers
61848cb88d
tools/appsre-build-fedora-worker-packer: wait for packit
...
Wait for packit to complete it's runs, after which the rpms should be
available from the @osbuild/osbuild-composer copr repo.
2024-05-07 13:57:48 +02:00
Sanne Raymaekers
616db61105
tools/build-worker-packer: skip rpmcopr for RHEL and on CI
...
Also skip both rpmrepo tasks on RHEL.
2024-05-07 13:57:48 +02:00
Sanne Raymaekers
592308f7af
templates/packer/ansible: add task to install rpms from copr
...
Split the rpmrepo tasks in osbuild and composer. With copr we'll use
osbuild from rpmrepo, because the osbuild copr rpms disappear too
quickly.
2024-05-07 13:57:48 +02:00
Achilleas Koutsou
cf75093163
Update osbuild/images v0.59.0
...
Pulling in:
- https://github.com/osbuild/images/pull/650
- https://github.com/osbuild/images/pull/651
2024-05-03 20:32:45 +02:00
dependabot[bot]
57f701587d
build(deps): bump github.com/go-jose/go-jose/v3 from 3.0.1 to 3.0.3
...
Bumps [github.com/go-jose/go-jose/v3](https://github.com/go-jose/go-jose ) from 3.0.1 to 3.0.3.
- [Release notes](https://github.com/go-jose/go-jose/releases )
- [Changelog](https://github.com/go-jose/go-jose/blob/v3.0.3/CHANGELOG.md )
- [Commits](https://github.com/go-jose/go-jose/compare/v3.0.1...v3.0.3 )
---
updated-dependencies:
- dependency-name: github.com/go-jose/go-jose/v3
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-05-03 15:59:30 +02:00
dependabot[bot]
88cbad85f2
build(deps): bump gopkg.in/go-jose/go-jose.v2 from 2.6.1 to 2.6.3
...
Bumps gopkg.in/go-jose/go-jose.v2 from 2.6.1 to 2.6.3.
---
updated-dependencies:
- dependency-name: gopkg.in/go-jose/go-jose.v2
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-05-03 10:34:32 +02:00
dependabot[bot]
9f26ef71b7
build(deps): bump github.com/docker/docker
...
Bumps [github.com/docker/docker](https://github.com/docker/docker ) from 25.0.3+incompatible to 25.0.5+incompatible.
- [Release notes](https://github.com/docker/docker/releases )
- [Commits](https://github.com/docker/docker/compare/v25.0.3...v25.0.5 )
---
updated-dependencies:
- dependency-name: github.com/docker/docker
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-05-02 16:32:35 +02:00
Tomáš Hozza
37995a7c65
Schutzfile: bump pinned osbuild version to v117
...
This is needed to get the support for "After" key in the
`org.osbuild.systemd.unit.create` stage, which is used by the new
version of `osbuild/images`.
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-05-02 13:48:55 +02:00
dependabot[bot]
9193f3eebc
build(deps): bump the go-deps group across 1 directory with 14 updates
...
Bumps the go-deps group with 11 updates in the / directory:
| Package | From | To |
| --- | --- | --- |
| [cloud.google.com/go/compute](https://github.com/googleapis/google-cloud-go ) | `1.25.1` | `1.26.0` |
| [github.com/Azure/azure-sdk-for-go/sdk/azidentity](https://github.com/Azure/azure-sdk-for-go ) | `1.5.1` | `1.5.2` |
| [github.com/Azure/azure-sdk-for-go/sdk/resourcemanager/compute/armcompute/v5](https://github.com/Azure/azure-sdk-for-go ) | `5.5.0` | `5.7.0` |
| [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go ) | `1.51.25` | `1.52.0` |
| [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go ) | `0.26.0` | `0.27.0` |
| [github.com/gophercloud/gophercloud](https://github.com/gophercloud/gophercloud ) | `1.10.0` | `1.11.0` |
| [github.com/jackc/pgtype](https://github.com/jackc/pgtype ) | `1.14.1` | `1.14.3` |
| [github.com/labstack/echo/v4](https://github.com/labstack/echo ) | `4.11.4` | `4.12.0` |
| [github.com/openshift-online/ocm-sdk-go](https://github.com/openshift-online/ocm-sdk-go ) | `0.1.398` | `0.1.418` |
| [github.com/osbuild/images](https://github.com/osbuild/images ) | `0.56.0` | `0.58.0` |
| [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang ) | `1.18.0` | `1.19.0` |
Updates `cloud.google.com/go/compute` from 1.25.1 to 1.26.0
- [Release notes](https://github.com/googleapis/google-cloud-go/releases )
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/documentai/CHANGES.md )
- [Commits](https://github.com/googleapis/google-cloud-go/compare/pubsub/v1.25.1...pubsub/v1.26.0 )
Updates `github.com/Azure/azure-sdk-for-go/sdk/azidentity` from 1.5.1 to 1.5.2
- [Release notes](https://github.com/Azure/azure-sdk-for-go/releases )
- [Changelog](https://github.com/Azure/azure-sdk-for-go/blob/main/documentation/release.md )
- [Commits](https://github.com/Azure/azure-sdk-for-go/compare/sdk/internal/v1.5.1...sdk/internal/v1.5.2 )
Updates `github.com/Azure/azure-sdk-for-go/sdk/resourcemanager/compute/armcompute/v5` from 5.5.0 to 5.7.0
- [Release notes](https://github.com/Azure/azure-sdk-for-go/releases )
- [Changelog](https://github.com/Azure/azure-sdk-for-go/blob/main/documentation/release.md )
- [Commits](https://github.com/Azure/azure-sdk-for-go/compare/sdk/resourcemanager/compute/armcompute/v5.5.0...sdk/resourcemanager/compute/armcompute/v5.7.0 )
Updates `github.com/aws/aws-sdk-go` from 1.51.25 to 1.52.0
- [Release notes](https://github.com/aws/aws-sdk-go/releases )
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.51.25...v1.52.0 )
Updates `github.com/getsentry/sentry-go` from 0.26.0 to 0.27.0
- [Release notes](https://github.com/getsentry/sentry-go/releases )
- [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md )
- [Commits](https://github.com/getsentry/sentry-go/compare/v0.26.0...v0.27.0 )
Updates `github.com/gophercloud/gophercloud` from 1.10.0 to 1.11.0
- [Release notes](https://github.com/gophercloud/gophercloud/releases )
- [Changelog](https://github.com/gophercloud/gophercloud/blob/v1.11.0/CHANGELOG.md )
- [Commits](https://github.com/gophercloud/gophercloud/compare/v1.10.0...v1.11.0 )
Updates `github.com/jackc/pgtype` from 1.14.1 to 1.14.3
- [Changelog](https://github.com/jackc/pgtype/blob/master/CHANGELOG.md )
- [Commits](https://github.com/jackc/pgtype/compare/v1.14.1...v1.14.3 )
Updates `github.com/jackc/pgx/v4` from 4.18.1 to 4.18.2
- [Changelog](https://github.com/jackc/pgx/blob/v4.18.2/CHANGELOG.md )
- [Commits](https://github.com/jackc/pgx/compare/v4.18.1...v4.18.2 )
Updates `github.com/labstack/echo/v4` from 4.11.4 to 4.12.0
- [Release notes](https://github.com/labstack/echo/releases )
- [Changelog](https://github.com/labstack/echo/blob/master/CHANGELOG.md )
- [Commits](https://github.com/labstack/echo/compare/v4.11.4...v4.12.0 )
Updates `github.com/openshift-online/ocm-sdk-go` from 0.1.398 to 0.1.418
- [Release notes](https://github.com/openshift-online/ocm-sdk-go/releases )
- [Changelog](https://github.com/openshift-online/ocm-sdk-go/blob/main/CHANGES.md )
- [Commits](https://github.com/openshift-online/ocm-sdk-go/compare/v0.1.398...v0.1.418 )
Updates `github.com/osbuild/images` from 0.56.0 to 0.58.0
- [Release notes](https://github.com/osbuild/images/releases )
- [Commits](https://github.com/osbuild/images/compare/v0.56.0...v0.58.0 )
Updates `github.com/prometheus/client_golang` from 1.18.0 to 1.19.0
- [Release notes](https://github.com/prometheus/client_golang/releases )
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md )
- [Commits](https://github.com/prometheus/client_golang/compare/v1.18.0...v1.19.0 )
Updates `golang.org/x/sync` from 0.6.0 to 0.7.0
- [Commits](https://github.com/golang/sync/compare/v0.6.0...v0.7.0 )
Updates `google.golang.org/api` from 0.175.0 to 0.177.0
- [Release notes](https://github.com/googleapis/google-api-go-client/releases )
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.175.0...v0.177.0 )
---
updated-dependencies:
- dependency-name: cloud.google.com/go/compute
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: go-deps
- dependency-name: github.com/Azure/azure-sdk-for-go/sdk/azidentity
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: go-deps
- dependency-name: github.com/Azure/azure-sdk-for-go/sdk/resourcemanager/compute/armcompute/v5
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: go-deps
- dependency-name: github.com/aws/aws-sdk-go
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: go-deps
- dependency-name: github.com/getsentry/sentry-go
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: go-deps
- dependency-name: github.com/gophercloud/gophercloud
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: go-deps
- dependency-name: github.com/jackc/pgtype
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: go-deps
- dependency-name: github.com/jackc/pgx/v4
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: go-deps
- dependency-name: github.com/labstack/echo/v4
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: go-deps
- dependency-name: github.com/openshift-online/ocm-sdk-go
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: go-deps
- dependency-name: github.com/osbuild/images
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: go-deps
- dependency-name: github.com/prometheus/client_golang
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: go-deps
- dependency-name: golang.org/x/sync
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: go-deps
- dependency-name: google.golang.org/api
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: go-deps
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-05-02 13:48:55 +02:00
Sanne Raymaekers
49566b7ce4
templates/packer: add failure script
...
In case the service failed, set the instance to unhealthy.
2024-05-02 13:34:47 +02:00
dependabot[bot]
90dd99471c
build(deps): bump golangci/golangci-lint-action from 4 to 5
...
Bumps [golangci/golangci-lint-action](https://github.com/golangci/golangci-lint-action ) from 4 to 5.
- [Release notes](https://github.com/golangci/golangci-lint-action/releases )
- [Commits](https://github.com/golangci/golangci-lint-action/compare/v4...v5 )
---
updated-dependencies:
- dependency-name: golangci/golangci-lint-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-05-02 08:46:48 +02:00
schutzbot
be17c23959
Post release version bump
...
[skip ci]
2024-05-01 08:14:53 +00:00
Sanne Raymaekers
a8148f9b34
templates/openshift/maintenance: fix service account
2024-04-30 16:58:00 +02:00
Sanne Raymaekers
7901889d87
templates/openshift/maintenance: PGSSLMODE is a parameter
...
Parameters need to be declared.
2024-04-30 16:58:00 +02:00
Sanne Raymaekers
37233b7b62
.github/workflows/tests: disable codecov until further notice
...
The script hangs while pinging codecov for a url to upload the results
to.
2024-04-30 12:59:58 +02:00
Sanne Raymaekers
a87e3069a1
templates/openshift: make the maintenance template generic
...
We could deploy this job for both composer and each tenant's workers
that's present in app-intf. Then we can remove the maintenance bits from
the composer template.
2024-04-29 15:04:52 +02:00
Sanne Raymaekers
5a776c5b79
templates/openshift: split worker from composer maintenance
2024-04-25 17:32:21 +02:00
Sanne Raymaekers
3827f710de
templates/openshift: move openshift templates to separate folder
...
Keep a symlink to the old composer template so the current deployment
doesn't break.
2024-04-25 17:32:21 +02:00
Sanne Raymaekers
007a10fd64
test/old-worker-new-composer: reset osbuild repo for image-info
...
Image-info is installed via the latest test rpms, which need a newer
osbuild version.
2024-04-25 13:17:02 +02:00
schutzbot
465b400c1e
Post release version bump
...
[skip ci]
2024-04-24 14:05:58 +00:00
Tomáš Hozza
5028a8c99d
Update osbuild/images to v0.56.0
...
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-04-24 15:04:54 +02:00
Sanne Raymaekers
3df0c3a631
templates/packer: fix proxy config in ldap service account init
...
The proxy is set to "null" currently.
2024-04-23 22:13:17 +02:00
Sanne Raymaekers
e607f3b629
dashboards/worker-general: bump version
2024-04-22 13:05:39 +02:00
Sanne Raymaekers
f6acb31dd8
dashboards/worker-general: add community-stage tenant
2024-04-22 13:05:39 +02:00
Sanne Raymaekers
2eea99d008
dashboards/worker-general: min intervals and multi tooltip mode
2024-04-22 13:05:39 +02:00
Sanne Raymaekers
10d2e272a4
dashboards/worker-general: add active worker count
2024-04-22 13:05:39 +02:00
Sanne Raymaekers
95ae8ed917
dashboards/worker-general: fix tenant query
2024-04-22 13:05:39 +02:00
Sanne Raymaekers
ac9f4a2c81
dashboards/worker-general: update schema
2024-04-22 13:05:39 +02:00
Sanne Raymaekers
b8d97b7b68
templates/composer: worker heartbeat timeout of 5m
...
The default timeout of 1 hour is fine for on-prem, but in the service it
makes workers seemingly stick around for way too long.
2024-04-19 19:56:25 +02:00
Sanne Raymaekers
0b277937dd
worker/server: make worker timeout configurable
2024-04-19 19:56:25 +02:00
Jakub Rusz
161a15196f
tests: Fix leapp repo url
...
They changed the group and branch.
2024-04-19 16:01:46 +03:00
Sanne Raymaekers
68bc8e0c88
prometheus: active worker gauge
2024-04-19 14:32:07 +02:00
Sanne Raymaekers
1b4935c325
jobqueue: add channel to workers
...
Stores the channel alongside the worker.
2024-04-19 14:32:07 +02:00
Alexander Todorov
ede798ae6c
Merge clean_up() into cleanup_on_exit() for filesystem.sh
2024-04-19 13:16:11 +03:00
Alexander Todorov
2a8bd4ce9b
Define cleanup() function in outer scope and execute on EXIT
...
for these 2 scripts we make cleanup() defined in the outer scope and
make sure that it executes on EXIT rather than RETURN which makes it
possible to stick the journalctl killing functionality inside of the
same function.
2024-04-19 13:16:11 +03:00
Alexander Todorov
85ce42570d
Refactor how the 'trap' command is used to avoid double calls
...
in many files there was a secondary call to `trap` for the sole purpose
of killing jornalctl (watching worker logs) so that GitLab CI doesn't
hang.
The issue with this is that sometimes the cleared the trap which invokes
the cleanup() function without reinstating it again (not everywhere).
Instead of doing this back-and-forth just make sure we don't leave any
journalctl processes dangling in the background!
NOTES:
- for some scripts, mainly ostree- ones there was no cleanup trap
present, but instead `trap` was configured inside the build_image() function.
The trouble is that this function is executed multiple times and
$WORKER_JOURNAL_PID changes value between these multiple executions.
That's why these scripts introduce the cleanup_on_exit() function where
we make sure to kill any possible dangling journalctl processes.
- The name `cleanup_on_exit()` is chosed because these same scripts
often have a helper function named clean_up() which is sometimes used to remove
virtual machines and other artifacts between calls of build_image().
2024-04-19 13:16:11 +03:00
Alexander Todorov
c534689d57
Add CI step to detect possible problematic usage of trap
...
see for example this change:
https://github.com/osbuild/osbuild-composer/pull/3681/commits/13a3ca24ceef05164a77db1c71b929e262098f41
2024-04-19 13:16:11 +03:00