Commit graph

6415 commits

Author SHA1 Message Date
Sanne Raymaekers
3827f710de templates/openshift: move openshift templates to separate folder
Keep a symlink to the old composer template so the current deployment
doesn't break.
2024-04-25 17:32:21 +02:00
Sanne Raymaekers
007a10fd64 test/old-worker-new-composer: reset osbuild repo for image-info
Image-info is installed via the latest test rpms, which need a newer
osbuild version.
2024-04-25 13:17:02 +02:00
schutzbot
465b400c1e Post release version bump
[skip ci]
2024-04-24 14:05:58 +00:00
Tomáš Hozza
5028a8c99d Update osbuild/images to v0.56.0
Signed-off-by: Tomáš Hozza <thozza@redhat.com>
2024-04-24 15:04:54 +02:00
Sanne Raymaekers
3df0c3a631 templates/packer: fix proxy config in ldap service account init
The proxy is set to "null" currently.
2024-04-23 22:13:17 +02:00
Sanne Raymaekers
e607f3b629 dashboards/worker-general: bump version 2024-04-22 13:05:39 +02:00
Sanne Raymaekers
f6acb31dd8 dashboards/worker-general: add community-stage tenant 2024-04-22 13:05:39 +02:00
Sanne Raymaekers
2eea99d008 dashboards/worker-general: min intervals and multi tooltip mode 2024-04-22 13:05:39 +02:00
Sanne Raymaekers
10d2e272a4 dashboards/worker-general: add active worker count 2024-04-22 13:05:39 +02:00
Sanne Raymaekers
95ae8ed917 dashboards/worker-general: fix tenant query 2024-04-22 13:05:39 +02:00
Sanne Raymaekers
ac9f4a2c81 dashboards/worker-general: update schema 2024-04-22 13:05:39 +02:00
Sanne Raymaekers
b8d97b7b68 templates/composer: worker heartbeat timeout of 5m
The default timeout of 1 hour is fine for on-prem, but in the service it
makes workers seemingly stick around for way too long.
2024-04-19 19:56:25 +02:00
Sanne Raymaekers
0b277937dd worker/server: make worker timeout configurable 2024-04-19 19:56:25 +02:00
Jakub Rusz
161a15196f tests: Fix leapp repo url
They changed the group and branch.
2024-04-19 16:01:46 +03:00
Sanne Raymaekers
68bc8e0c88 prometheus: active worker gauge 2024-04-19 14:32:07 +02:00
Sanne Raymaekers
1b4935c325 jobqueue: add channel to workers
Stores the channel alongside the worker.
2024-04-19 14:32:07 +02:00
Alexander Todorov
ede798ae6c Merge clean_up() into cleanup_on_exit() for filesystem.sh 2024-04-19 13:16:11 +03:00
Alexander Todorov
2a8bd4ce9b Define cleanup() function in outer scope and execute on EXIT
for these 2 scripts we make cleanup() defined in the outer scope and
make sure that it executes on EXIT rather than RETURN which makes it
possible to stick the journalctl killing functionality inside of the
same function.
2024-04-19 13:16:11 +03:00
Alexander Todorov
85ce42570d Refactor how the 'trap' command is used to avoid double calls
in many files there was a secondary call to `trap` for the sole purpose
of killing jornalctl (watching worker logs) so that GitLab CI doesn't
hang.

The issue with this is that sometimes the cleared the trap which invokes
the cleanup() function without reinstating it again (not everywhere).

Instead of doing this back-and-forth just make sure we don't leave any
journalctl processes dangling in the background!

NOTES:

- for some scripts, mainly ostree- ones there was no cleanup trap
  present, but instead `trap` was configured inside the build_image() function.
  The trouble is that this function is executed multiple times and
  $WORKER_JOURNAL_PID changes value between these multiple executions.
  That's why these scripts introduce the cleanup_on_exit() function where
  we make sure to kill any possible dangling journalctl processes.
- The name `cleanup_on_exit()` is chosed because these same scripts
  often have a helper function named clean_up() which is sometimes used to remove
  virtual machines and other artifacts between calls of build_image().
2024-04-19 13:16:11 +03:00
Alexander Todorov
c534689d57 Add CI step to detect possible problematic usage of trap
see for example this change:
https://github.com/osbuild/osbuild-composer/pull/3681/commits/13a3ca24ceef05164a77db1c71b929e262098f41
2024-04-19 13:16:11 +03:00
Achilleas Koutsou
1fa98e4253 Makefile: remove installation of dnf-json 2024-04-18 12:49:01 +02:00
Sanne Raymaekers
c9eb60d674 osbuild-worker: fix nil pointer in depsolve job 2024-04-18 12:21:07 +02:00
Alexander Todorov
6fdbde4857 Skip aws.sh test on 8.4-ga-x86_64
because it times out waiting for ssh nomatter what

Docs on do-not-match regex syntax:
https://docs.gitlab.com/ee/ci/jobs/job_control.html#compare-a-variable-to-a-regex-pattern
2024-04-18 10:52:24 +02:00
Alexander Todorov
3732028d59 Update Arm64 EC2 instance to a newer one
This one is 1 vCPU + 4GiB RAM, the older one is 2 vCPU, same RAM
2024-04-18 10:52:24 +02:00
Sanne Raymaekers
7d24ac5567 osbuildexecutor/ec2: pass extraEnv only to sources invocation
The extra env only contains paths to secrets which are needed to pull
sources. Since the sources don't get pulled on the executor, don't pass
the env along to the executor.
2024-04-17 23:01:57 +02:00
Sanne Raymaekers
7684dbeedd osbuild-worker: fix mtls credentials injection in depsolve job 2024-04-17 20:27:06 +02:00
Sanne Raymaekers
05a1e8f054 worker: support a proxy for repository mtls configuration
Allows setting a proxy for the mtls settings for a specific
repository. This is useful when consuming content from the content
service in consoledot.
2024-04-17 16:17:57 +02:00
Sanne Raymaekers
677e30cc68 templates/packer: add proxy 2024-04-17 16:17:57 +02:00
Sanne Raymaekers
18db445745 Revert "templates/packer: set http(s)_proxy environment variabl…"
This reverts commit 484c82ce55.

The AWS sdk fails to get the instance identity document when the proxy
is configured. The proxy will need to be configured explicitly for the
depsolve job and osbuild (sources) job.
2024-04-17 16:17:57 +02:00
Sanne Raymaekers
bde74c218b test/regression-old-worker: pick correct osbuild commit
The osbuild version should correspond to the version in the Schutzfile
for the old worker.

Furthermore the commits should be pulled from the rhel-9-cdn
repositories.
2024-04-17 10:27:08 +02:00
schutzbot
6f69cacdc5 schutzfile: Update snapshots to 20240415 2024-04-17 10:27:08 +02:00
Sanne Raymaekers
1805282e27 bump osbuild to 116 2024-04-17 10:27:08 +02:00
Sanne Raymaekers
d0a6828bd7 osbuild/images update: ignore repoconfigs where appropriate 2024-04-17 10:27:08 +02:00
Sanne Raymaekers
d6cfd04704 cmd/osbuild-dnf-json-tests: check repo configs 2024-04-17 10:27:08 +02:00
Sanne Raymaekers
ebea7ce2df mocks/dnfjson: support new depsolve result
The new depsolve result includes repo configurations.
2024-04-17 10:27:08 +02:00
Sanne Raymaekers
98e3892e23 cmd/osbuild-store-dump: pass repoconfigs when serializing manifests 2024-04-17 10:27:08 +02:00
Sanne Raymaekers
3094eb474d cmd/gen-manifests: pass repoconfigs when serializing manifests 2024-04-17 10:27:08 +02:00
Sanne Raymaekers
173f37feb8 weldr: pass repoconfigs when serializing manifests 2024-04-17 10:27:08 +02:00
Sanne Raymaekers
dc7bc4763c cloudapi/v2: pass repoconfigs when serializing manifests 2024-04-17 10:27:08 +02:00
Sanne Raymaekers
e0759e01af worker: save repoconfigs in depsolve result 2024-04-17 10:27:08 +02:00
Sanne Raymaekers
22140aa7c9 go.mod: bump osbuild/images to 0.55 2024-04-17 10:27:08 +02:00
schutzbot
eab44ca8a8 Post release version bump
[skip ci]
2024-04-17 08:12:38 +00:00
Achilleas Koutsou
809f2544ad deps: update images to v0.54.0
Update images dependency and adjust import paths for distro package
changes.

Signed-off-by: Achilleas Koutsou <achilleas@koutsou.net>
2024-04-11 16:43:40 +02:00
Achilleas Koutsou
356a222b83 weldr: replace use of deprecated rand.Seed with New(NewSource(seed))
"rand.Seed has been deprecated since Go 1.20 and an alternative has been
available since Go 1.0: As of Go 1.20 there is no reason to call Seed
with a random value. Programs that call Seed with a known value to get a
specific sequence of results should use New(NewSource(seed)) to obtain a
local random generator."
2024-04-11 16:39:21 +02:00
Achilleas Koutsou
f98169c29a go.mod: update to go v1.20
Go 1.20 is included in all currently supported distro versions.

Signed-off-by: Achilleas Koutsou <achilleas@koutsou.net>
2024-04-11 16:39:21 +02:00
Achilleas Koutsou
de54fc541e github: remove linting of dnf-json
Signed-off-by: Achilleas Koutsou <achilleas@koutsou.net>
2024-04-11 16:31:50 +02:00
Achilleas Koutsou
eccebeff0a rm dnf-json
The depsolver is now in osbuild and packaged as osbuild-depsolve-dnf.
Let's remove the old copy from here to avoid confusion and potential
divergence (which we already had happen before).

Signed-off-by: Achilleas Koutsou <achilleas@koutsou.net>
2024-04-11 16:31:50 +02:00
Simon Steinbeiss
41a532291c README: Update Matrix link 2024-04-10 11:55:09 +02:00
Simon Steinbeiss
006c7a6742 README: Add osbuild-composer's principles 2024-04-10 11:55:09 +02:00
Sanne Raymaekers
484c82ce55 templates/packer: set http(s)_proxy environment variable in unit 2024-04-10 10:03:43 +02:00