No description
Find a file
Tomas Hozza 27c5aafeca GCP: Specify and randomize GCE region used for image import
The GCP image import method currently use the Cloud Build API with
Google's Daisy workflow. This workflow creates multiple GCE resources
during its execution. Although the desired Region for the imported image
is specified as a workflow argument, this has no effect on the GCE
Zone used by the workflow for created resources. By default it seems
to default to "us-central1-a" Zone. As a result, there are common cases
of resources being exhausted in the default zone.

Add a method, which translates provided Google Storage Region to a GCE
Region, which is needed mainly for multi and dual Storage Regions.

Add a method, which returns a list of available GCE Zones for a given
GCE Region.

Modify the ComputeImageImport() method to translate the provided Google
Storage Region to list of corresponding GCE Regions. If the provided
Storage Region is not multi or dual Region, then the list contains only
a single item, the provided Region. Then pick a random Region from the
list. Subsequently get available GCE Zones within the Region and pick a
random one for use by the workflow. Specify the GCE Zone to use as a
build step argument.

This change should be completely transparent to the API user.

Signed-off-by: Tomas Hozza <thozza@redhat.com>
2021-04-29 09:53:29 +02:00
.github ci: add GitLab CI 2021-04-14 09:18:06 +02:00
cmd Rename all occurrences of "Compute Node" to "Compute Engine" 2021-04-01 20:12:39 +02:00
containers/osbuild-composer containers: Specify port for the composer-api as argument 2020-12-23 17:31:29 +01:00
distribution distribution: Add OCP template for clouddot 2021-04-28 14:07:23 +02:00
docs distro/rhel84: build qcow2 images with compat=0.10 2021-04-10 19:18:13 +01:00
image-types image-types: Update RHEL8 Amazon EC2 image information 2021-01-15 17:48:19 +01:00
internal GCP: Specify and randomize GCE region used for image import 2021-04-29 09:53:29 +02:00
repositories repositories: use snapshots for rhel90 repos 2021-03-26 14:05:20 +00:00
schutzbot mockbuild: use s3cmd put instead of sync to speed up the RPM upload 2021-04-15 14:39:09 +02:00
test test: Add installer test on BIOS VM 2021-04-27 22:31:19 +08:00
tools tests: Revert a lorax patch 2021-04-22 15:03:42 +03:00
vendor worker: add azure image upload target 2021-03-06 15:40:48 +00:00
.gitignore gitignore: add config and OSX metadata 2021-02-20 14:53:49 +01:00
.gitlab-ci.yml ci: add GitLab CI 2021-04-14 09:18:06 +02:00
.golangci.yml ci/lint: add integration tag 2020-03-17 20:36:58 +01:00
codecov.yml codevoc: fix threshold 2020-05-17 10:12:06 +02:00
CONTRIBUTING.md rcm: drop sub-package 2020-07-17 19:13:15 +01:00
DEPLOYING.md Add DEPLOYING.md 2020-10-20 15:43:30 +02:00
dnf-json dnf-json: don't initialize dnf plugins 2020-08-23 16:08:25 +02:00
go.mod worker: add azure image upload target 2021-03-06 15:40:48 +00:00
go.sum internal/upload: Add support for upload to GCP and CLI tool using it 2021-02-25 18:44:21 +00:00
HACKING.md HACKING: Typo fixes 2021-02-11 09:37:36 +01:00
krb5.conf upload/koji: add support for GSSAPI/Kerberos auth 2020-08-27 17:29:57 +01:00
LICENSE Revert "Fill in the license template" 2019-11-15 15:26:51 +01:00
Makefile Makefile: build osbuild-upload-gcp as part of build target 2021-03-12 12:17:02 +01:00
NEWS.md 29 2021-03-05 15:01:38 +01:00
osbuild-composer.spec distro/rhel84: build qcow2 images with compat=0.10 2021-04-10 19:18:13 +01:00
README.md spec: update osbuild dependency 2021-02-20 20:01:15 +01:00
Schutzfile distro/rhel84: build qcow2 images with compat=0.10 2021-04-10 19:18:13 +01:00

OSBuild Composer

Operating System Image Composition Services

The composer project is a set of HTTP services for composing operating system images. It builds on the pipeline execution engine of osbuild and defines its own class of images that it supports building.

Multiple APIs are available to access a composer service. This includes support for the lorax-composer API, and as such can serve as drop-in replacement for lorax-composer.

You can control a composer instance either directly via the provided APIs, or through higher-level user-interfaces from external projects. This, for instance, includes a Cockpit Module or using the composer-cli command-line tool.

Project

About

Composer is a middleman between the workhorses from osbuild and the user-interfaces like cockpit-composer, composer-cli, or others. It defines a set of high-level image compositions that it supports building. Builds of these compositions can be requested via the different APIs of Composer, which will then translate the requests into pipeline-descriptions for osbuild. The pipeline output is then either provided back to the user, or uploaded to a user specified target.

The following image visualizes the overall architecture of the OSBuild infrastructure and the place that Composer takes:

overview

Consult the osbuild-composer(7) man-page for an introduction into composer, information on running your own composer instance, as well as details on the provided infrastructure and services.

Requirements

The requirements for this project are:

  • osbuild >= 26
  • systemd >= 244

At build-time, the following software is required:

  • go >= 1.14
  • python-docutils >= 0.13

Build

The standard go package system is used. Consult upstream documentation for detailed help. In most situations the following commands are sufficient to build and install from source:

mkdir build
go build -o build ./...

The man-pages require python-docutils and can be built via:

make man

Repository:

Pull request gating

Each pull request against osbuild-composer starts a series of automated tests. Tests run via GitHub Actions and Jenkins. Each push to the pull request will launch theses tests automatically.

Jenkins only tests pull requests from members of the osbuild organization in GitHub. A member of the osbuild organization must say ok to test in a pull request comment to approve testing. Anyone can ask for testing to run by saying the bot's favorite word, schutzbot, in a pull request comment. Testing will begin shortly after the comment is posted.

Test results in Jenkins are available by clicking the Details link on the right side of the Schutzbot check in the pull request page.

License:

  • Apache-2.0
  • See LICENSE file for details.