particle-os/debian-forge-composer
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
6439 commits 1 branch 0 tags 688 MiB
Commit graph

6439 commits

This branch
This branch
All branches
Author SHA1 Message Date
Alexander Todorov
966685607b Re-enable codecov but use a GHA to submit the results 
because the bash upload has been deprecated
 2024-05-10 22:08:27 +03:00
Sanne Raymaekers
c886d6c1f5 templates/dashboards: fix community-stage tenant variable 
A space is necessary before and after the colon separating the key and
the value.

[skip ci]
 2024-05-08 12:59:34 +02:00
Sanne Raymaekers
9c047cd8e0 tools/fedora-worker-packer: don't trace statements 
It makes the logs extremely verbose, and requests/responses are already
printed when relevant.
 2024-05-07 18:38:13 +02:00
Sanne Raymaekers
aadf5dfc9a tools/fedora-worker-packer: increase timeouts further 
The first timeout increase didn't take effect. And once the suite is
present the rpm builds can stay pending for a very long time.
 2024-05-07 18:38:13 +02:00
Sanne Raymaekers
c9ce5af655 tools/fedora-worker-packer: set the commit sha 
Currently the COMMIT_SHA variable is empty.
 2024-05-07 14:47:59 +02:00
Sanne Raymaekers
28e4b0aa07 tools/fedora-worker-packer: increase timeout waiting for packit 2024-05-07 14:47:59 +02:00
Sanne Raymaekers
a1476bdfb1 tools/appsre-build-worker-packer: stop writing bogus files 2024-05-07 13:57:48 +02:00
Sanne Raymaekers
61848cb88d tools/appsre-build-fedora-worker-packer: wait for packit 
Wait for packit to complete it's runs, after which the rpms should be
available from the @osbuild/osbuild-composer copr repo.
 2024-05-07 13:57:48 +02:00
Sanne Raymaekers
616db61105 tools/build-worker-packer: skip rpmcopr for RHEL and on CI 
Also skip both rpmrepo tasks on RHEL.
 2024-05-07 13:57:48 +02:00
Sanne Raymaekers
592308f7af templates/packer/ansible: add task to install rpms from copr 
Split the rpmrepo tasks in osbuild and composer. With copr we'll use
osbuild from rpmrepo, because the osbuild copr rpms disappear too
quickly.
 2024-05-07 13:57:48 +02:00
Achilleas Koutsou
cf75093163 Update osbuild/images v0.59.0 
Pulling in:
- https://github.com/osbuild/images/pull/650
- https://github.com/osbuild/images/pull/651
 2024-05-03 20:32:45 +02:00
dependabot[bot]
57f701587d build(deps): bump github.com/go-jose/go-jose/v3 from 3.0.1 to 3.0.3 
Bumps [github.com/go-jose/go-jose/v3](https://github.com/go-jose/go-jose) from 3.0.1 to 3.0.3.
- [Release notes](https://github.com/go-jose/go-jose/releases)
- [Changelog](https://github.com/go-jose/go-jose/blob/v3.0.3/CHANGELOG.md)
- [Commits](https://github.com/go-jose/go-jose/compare/v3.0.1...v3.0.3)

---
updated-dependencies:
- dependency-name: github.com/go-jose/go-jose/v3
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-05-03 15:59:30 +02:00
dependabot[bot]
88cbad85f2 build(deps): bump gopkg.in/go-jose/go-jose.v2 from 2.6.1 to 2.6.3 
Bumps gopkg.in/go-jose/go-jose.v2 from 2.6.1 to 2.6.3.

---
updated-dependencies:
- dependency-name: gopkg.in/go-jose/go-jose.v2
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-05-03 10:34:32 +02:00
dependabot[bot]
9f26ef71b7 build(deps): bump github.com/docker/docker 
Bumps [github.com/docker/docker](https://github.com/docker/docker) from 25.0.3+incompatible to 25.0.5+incompatible.
- [Release notes](https://github.com/docker/docker/releases)
- [Commits](https://github.com/docker/docker/compare/v25.0.3...v25.0.5)

---
updated-dependencies:
- dependency-name: github.com/docker/docker
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-05-02 16:32:35 +02:00
Tomáš Hozza
37995a7c65 Schutzfile: bump pinned osbuild version to v117 
This is needed to get the support for "After" key in the
`org.osbuild.systemd.unit.create` stage, which is used by the new
version of `osbuild/images`.

Signed-off-by: Tomáš Hozza <thozza@redhat.com>
 2024-05-02 13:48:55 +02:00
dependabot[bot]
9193f3eebc build(deps): bump the go-deps group across 1 directory with 14 updates 
Bumps the go-deps group with 11 updates in the / directory:

| Package | From | To |
| --- | --- | --- |
| [cloud.google.com/go/compute](https://github.com/googleapis/google-cloud-go) | `1.25.1` | `1.26.0` |
| [github.com/Azure/azure-sdk-for-go/sdk/azidentity](https://github.com/Azure/azure-sdk-for-go) | `1.5.1` | `1.5.2` |
| [github.com/Azure/azure-sdk-for-go/sdk/resourcemanager/compute/armcompute/v5](https://github.com/Azure/azure-sdk-for-go) | `5.5.0` | `5.7.0` |
| [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) | `1.51.25` | `1.52.0` |
| [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go) | `0.26.0` | `0.27.0` |
| [github.com/gophercloud/gophercloud](https://github.com/gophercloud/gophercloud) | `1.10.0` | `1.11.0` |
| [github.com/jackc/pgtype](https://github.com/jackc/pgtype) | `1.14.1` | `1.14.3` |
| [github.com/labstack/echo/v4](https://github.com/labstack/echo) | `4.11.4` | `4.12.0` |
| [github.com/openshift-online/ocm-sdk-go](https://github.com/openshift-online/ocm-sdk-go) | `0.1.398` | `0.1.418` |
| [github.com/osbuild/images](https://github.com/osbuild/images) | `0.56.0` | `0.58.0` |
| [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang) | `1.18.0` | `1.19.0` |



Updates `cloud.google.com/go/compute` from 1.25.1 to 1.26.0
- [Release notes](https://github.com/googleapis/google-cloud-go/releases)
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/documentai/CHANGES.md)
- [Commits](https://github.com/googleapis/google-cloud-go/compare/pubsub/v1.25.1...pubsub/v1.26.0)

Updates `github.com/Azure/azure-sdk-for-go/sdk/azidentity` from 1.5.1 to 1.5.2
- [Release notes](https://github.com/Azure/azure-sdk-for-go/releases)
- [Changelog](https://github.com/Azure/azure-sdk-for-go/blob/main/documentation/release.md)
- [Commits](https://github.com/Azure/azure-sdk-for-go/compare/sdk/internal/v1.5.1...sdk/internal/v1.5.2)

Updates `github.com/Azure/azure-sdk-for-go/sdk/resourcemanager/compute/armcompute/v5` from 5.5.0 to 5.7.0
- [Release notes](https://github.com/Azure/azure-sdk-for-go/releases)
- [Changelog](https://github.com/Azure/azure-sdk-for-go/blob/main/documentation/release.md)
- [Commits](https://github.com/Azure/azure-sdk-for-go/compare/sdk/resourcemanager/compute/armcompute/v5.5.0...sdk/resourcemanager/compute/armcompute/v5.7.0)

Updates `github.com/aws/aws-sdk-go` from 1.51.25 to 1.52.0
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.51.25...v1.52.0)

Updates `github.com/getsentry/sentry-go` from 0.26.0 to 0.27.0
- [Release notes](https://github.com/getsentry/sentry-go/releases)
- [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-go/compare/v0.26.0...v0.27.0)

Updates `github.com/gophercloud/gophercloud` from 1.10.0 to 1.11.0
- [Release notes](https://github.com/gophercloud/gophercloud/releases)
- [Changelog](https://github.com/gophercloud/gophercloud/blob/v1.11.0/CHANGELOG.md)
- [Commits](https://github.com/gophercloud/gophercloud/compare/v1.10.0...v1.11.0)

Updates `github.com/jackc/pgtype` from 1.14.1 to 1.14.3
- [Changelog](https://github.com/jackc/pgtype/blob/master/CHANGELOG.md)
- [Commits](https://github.com/jackc/pgtype/compare/v1.14.1...v1.14.3)

Updates `github.com/jackc/pgx/v4` from 4.18.1 to 4.18.2
- [Changelog](https://github.com/jackc/pgx/blob/v4.18.2/CHANGELOG.md)
- [Commits](https://github.com/jackc/pgx/compare/v4.18.1...v4.18.2)

Updates `github.com/labstack/echo/v4` from 4.11.4 to 4.12.0
- [Release notes](https://github.com/labstack/echo/releases)
- [Changelog](https://github.com/labstack/echo/blob/master/CHANGELOG.md)
- [Commits](https://github.com/labstack/echo/compare/v4.11.4...v4.12.0)

Updates `github.com/openshift-online/ocm-sdk-go` from 0.1.398 to 0.1.418
- [Release notes](https://github.com/openshift-online/ocm-sdk-go/releases)
- [Changelog](https://github.com/openshift-online/ocm-sdk-go/blob/main/CHANGES.md)
- [Commits](https://github.com/openshift-online/ocm-sdk-go/compare/v0.1.398...v0.1.418)

Updates `github.com/osbuild/images` from 0.56.0 to 0.58.0
- [Release notes](https://github.com/osbuild/images/releases)
- [Commits](https://github.com/osbuild/images/compare/v0.56.0...v0.58.0)

Updates `github.com/prometheus/client_golang` from 1.18.0 to 1.19.0
- [Release notes](https://github.com/prometheus/client_golang/releases)
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md)
- [Commits](https://github.com/prometheus/client_golang/compare/v1.18.0...v1.19.0)

Updates `golang.org/x/sync` from 0.6.0 to 0.7.0
- [Commits](https://github.com/golang/sync/compare/v0.6.0...v0.7.0)

Updates `google.golang.org/api` from 0.175.0 to 0.177.0
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.175.0...v0.177.0)

---
updated-dependencies:
- dependency-name: cloud.google.com/go/compute
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: go-deps
- dependency-name: github.com/Azure/azure-sdk-for-go/sdk/azidentity
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: go-deps
- dependency-name: github.com/Azure/azure-sdk-for-go/sdk/resourcemanager/compute/armcompute/v5
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: go-deps
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: go-deps
- dependency-name: github.com/getsentry/sentry-go
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: go-deps
- dependency-name: github.com/gophercloud/gophercloud
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: go-deps
- dependency-name: github.com/jackc/pgtype
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: go-deps
- dependency-name: github.com/jackc/pgx/v4
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: go-deps
- dependency-name: github.com/labstack/echo/v4
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: go-deps
- dependency-name: github.com/openshift-online/ocm-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: go-deps
- dependency-name: github.com/osbuild/images
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: go-deps
- dependency-name: github.com/prometheus/client_golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: go-deps
- dependency-name: golang.org/x/sync
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: go-deps
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: go-deps
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-05-02 13:48:55 +02:00
Sanne Raymaekers
49566b7ce4 templates/packer: add failure script 
In case the service failed, set the instance to unhealthy.
 2024-05-02 13:34:47 +02:00
dependabot[bot]
90dd99471c build(deps): bump golangci/golangci-lint-action from 4 to 5 
Bumps [golangci/golangci-lint-action](https://github.com/golangci/golangci-lint-action) from 4 to 5.
- [Release notes](https://github.com/golangci/golangci-lint-action/releases)
- [Commits](https://github.com/golangci/golangci-lint-action/compare/v4...v5)

---
updated-dependencies:
- dependency-name: golangci/golangci-lint-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-05-02 08:46:48 +02:00
schutzbot
be17c23959 Post release version bump 
[skip ci]
 2024-05-01 08:14:53 +00:00
Sanne Raymaekers
a8148f9b34 templates/openshift/maintenance: fix service account 2024-04-30 16:58:00 +02:00
Sanne Raymaekers
7901889d87 templates/openshift/maintenance: PGSSLMODE is a parameter 
Parameters need to be declared.
 2024-04-30 16:58:00 +02:00
Sanne Raymaekers
37233b7b62 .github/workflows/tests: disable codecov until further notice 
The script hangs while pinging codecov for a url to upload the results
to.
 2024-04-30 12:59:58 +02:00
Sanne Raymaekers
a87e3069a1 templates/openshift: make the maintenance template generic 
We could deploy this job for both composer and each tenant's workers
that's present in app-intf. Then we can remove the maintenance bits from
the composer template.
 2024-04-29 15:04:52 +02:00
Sanne Raymaekers
5a776c5b79 templates/openshift: split worker from composer maintenance 2024-04-25 17:32:21 +02:00
Sanne Raymaekers
3827f710de templates/openshift: move openshift templates to separate folder 
Keep a symlink to the old composer template so the current deployment
doesn't break.
 2024-04-25 17:32:21 +02:00
Sanne Raymaekers
007a10fd64 test/old-worker-new-composer: reset osbuild repo for image-info 
Image-info is installed via the latest test rpms, which need a newer
osbuild version.
 2024-04-25 13:17:02 +02:00
schutzbot
465b400c1e Post release version bump 
[skip ci]
 2024-04-24 14:05:58 +00:00
Tomáš Hozza
5028a8c99d Update osbuild/images to v0.56.0 
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
 2024-04-24 15:04:54 +02:00
Sanne Raymaekers
3df0c3a631 templates/packer: fix proxy config in ldap service account init 
The proxy is set to "null" currently.
 2024-04-23 22:13:17 +02:00
Sanne Raymaekers
e607f3b629 dashboards/worker-general: bump version 2024-04-22 13:05:39 +02:00
Sanne Raymaekers
f6acb31dd8 dashboards/worker-general: add community-stage tenant 2024-04-22 13:05:39 +02:00
Sanne Raymaekers
2eea99d008 dashboards/worker-general: min intervals and multi tooltip mode 2024-04-22 13:05:39 +02:00
Sanne Raymaekers
10d2e272a4 dashboards/worker-general: add active worker count 2024-04-22 13:05:39 +02:00
Sanne Raymaekers
95ae8ed917 dashboards/worker-general: fix tenant query 2024-04-22 13:05:39 +02:00
Sanne Raymaekers
ac9f4a2c81 dashboards/worker-general: update schema 2024-04-22 13:05:39 +02:00
Sanne Raymaekers
b8d97b7b68 templates/composer: worker heartbeat timeout of 5m 
The default timeout of 1 hour is fine for on-prem, but in the service it
makes workers seemingly stick around for way too long.
 2024-04-19 19:56:25 +02:00
Sanne Raymaekers
0b277937dd worker/server: make worker timeout configurable 2024-04-19 19:56:25 +02:00
Jakub Rusz
161a15196f tests: Fix leapp repo url 
They changed the group and branch.
 2024-04-19 16:01:46 +03:00
Sanne Raymaekers
68bc8e0c88 prometheus: active worker gauge 2024-04-19 14:32:07 +02:00
Sanne Raymaekers
1b4935c325 jobqueue: add channel to workers 
Stores the channel alongside the worker.
 2024-04-19 14:32:07 +02:00
Alexander Todorov
ede798ae6c Merge clean_up() into cleanup_on_exit() for filesystem.sh 2024-04-19 13:16:11 +03:00
Alexander Todorov
2a8bd4ce9b Define cleanup() function in outer scope and execute on EXIT 
for these 2 scripts we make cleanup() defined in the outer scope and
make sure that it executes on EXIT rather than RETURN which makes it
possible to stick the journalctl killing functionality inside of the
same function.
 2024-04-19 13:16:11 +03:00
Alexander Todorov
85ce42570d Refactor how the 'trap' command is used to avoid double calls 
in many files there was a secondary call to `trap` for the sole purpose
of killing jornalctl (watching worker logs) so that GitLab CI doesn't
hang.

The issue with this is that sometimes the cleared the trap which invokes
the cleanup() function without reinstating it again (not everywhere).

Instead of doing this back-and-forth just make sure we don't leave any
journalctl processes dangling in the background!

NOTES:

- for some scripts, mainly ostree- ones there was no cleanup trap
  present, but instead `trap` was configured inside the build_image() function.
  The trouble is that this function is executed multiple times and
  $WORKER_JOURNAL_PID changes value between these multiple executions.
  That's why these scripts introduce the cleanup_on_exit() function where
  we make sure to kill any possible dangling journalctl processes.
- The name `cleanup_on_exit()` is chosed because these same scripts
  often have a helper function named clean_up() which is sometimes used to remove
  virtual machines and other artifacts between calls of build_image().
 2024-04-19 13:16:11 +03:00
Alexander Todorov
c534689d57 Add CI step to detect possible problematic usage of trap 
see for example this change:
https://github.com/osbuild/osbuild-composer/pull/3681/commits/13a3ca24ceef05164a77db1c71b929e262098f41
 2024-04-19 13:16:11 +03:00
Achilleas Koutsou
1fa98e4253 Makefile: remove installation of dnf-json 2024-04-18 12:49:01 +02:00
Sanne Raymaekers
c9eb60d674 osbuild-worker: fix nil pointer in depsolve job 2024-04-18 12:21:07 +02:00
Alexander Todorov
6fdbde4857 Skip aws.sh test on 8.4-ga-x86_64 
because it times out waiting for ssh nomatter what

Docs on do-not-match regex syntax:
https://docs.gitlab.com/ee/ci/jobs/job_control.html#compare-a-variable-to-a-regex-pattern
 2024-04-18 10:52:24 +02:00
Alexander Todorov
3732028d59 Update Arm64 EC2 instance to a newer one 
This one is 1 vCPU + 4GiB RAM, the older one is 2 vCPU, same RAM
 2024-04-18 10:52:24 +02:00
Sanne Raymaekers
7d24ac5567 osbuildexecutor/ec2: pass extraEnv only to sources invocation 
The extra env only contains paths to secrets which are needed to pull
sources. Since the sources don't get pulled on the executor, don't pass
the env along to the executor.
 2024-04-17 23:01:57 +02:00
Sanne Raymaekers
7684dbeedd osbuild-worker: fix mtls credentials injection in depsolve job 2024-04-17 20:27:06 +02:00