No description
Find a file
Christian Kellner 598c2b6939 image-info: always use raw images and loop devices
Convert any image that is not a raw image, e.g. a qcow2, to a raw
image and open the partitions via loop devices. This replaces the
usage of nbd, which was racy and flaky.
Instead on relying on the kernel for the partition parsing, this
is now done manually via loop devices and start + offset taken
from sfdisk. As a result the read_partition function has been
adapted to be called at later time, after the partitions were
opened via loop devices.

Not using nbd also means that the partition table is not scanned
by the kernel anymore and udev is not triggered. As a result the
'PARTUUID' property is not present for dos/mbr partition layouts,
since it is auto-generated by udev/blkid. Relevant blkid files
and functions are:
  blkid_partition_gen_uuid(par)
    called from probe_dos_pt()
    in file libblkid/src/partitions/dos.c line 295
    defined in libblkid/src/partitions/partitions.c line 1374
    which generates the uuid via snprintf using the format:
      '"%.33s-%02x", par->tab->id, par->partno'
Based on https://github.com/karelzak/util-linux at ce8985cc7

NB: the loop device code is imported from osbuild, making this
tool depend on osbuild's private library.

NB: As of the image conversion, more disk space is required to
examine non-raw images.
2020-07-13 11:31:06 +02:00
.github Remove RPM builds in GitHub Workflows 2020-05-22 07:44:44 -05:00
cmd test: set PYTHONPATH for image-info on travis 2020-07-13 11:31:06 +02:00
distribution osbuild-worker: support canceling jobs 2020-06-12 10:00:50 +02:00
docs docs: update cockpit-composer repo url 2020-04-15 20:26:55 +02:00
image-types 📦 Use raw image format for AWS 2020-07-02 13:11:11 -05:00
internal 📦 Use raw image format for AWS 2020-07-02 13:11:11 -05:00
osbuild@c1a98af56a 🥊 Bump osbuild submodule to v18 2020-07-09 08:53:23 -05:00
repositories Use staging CDN for RHEL 8.3 beta content 2020-07-09 08:53:23 -05:00
schutzbot 🔎 Dynamically choose image test list 2020-07-09 22:27:45 +02:00
test Fix valk > talk typo 2020-07-09 08:53:23 -05:00
tools image-info: always use raw images and loop devices 2020-07-13 11:31:06 +02:00
vendor tests: upload & boot image in OpenStack. Closes #339 2020-06-23 16:17:30 +02:00
.gitignore gitignore: don't ignore files we do not generate 2020-03-21 19:50:21 +01:00
.gitmodules image-info: add test 2019-10-05 14:47:35 +02:00
.golangci.yml ci/lint: add integration tag 2020-03-17 20:36:58 +01:00
.travis.yml distro: drop fedora-30 2020-05-27 16:20:35 +02:00
codecov.yml codevoc: fix threshold 2020-05-17 10:12:06 +02:00
CONTRIBUTING.md CONTRIBUTING: Tweak documentation for new contributors 2020-05-29 22:23:10 +02:00
dnf-json dnf-json: flake8 cleanup 2020-07-10 12:20:02 -05:00
go.mod tests: upload & boot image in OpenStack. Closes #339 2020-06-23 16:17:30 +02:00
go.sum tests: upload & boot image in OpenStack. Closes #339 2020-06-23 16:17:30 +02:00
golang-github-osbuild-composer.spec 17 2020-07-08 17:35:27 +02:00
LICENSE Revert "Fill in the license template" 2019-11-15 15:26:51 +01:00
Makefile makefile: change the indentation in release target 2020-05-28 00:31:30 +02:00
NEWS.md 17 2020-07-08 17:35:27 +02:00
osbuild-composer.spec 17 2020-07-08 17:35:27 +02:00
README.md README: update cockpit-composer repo url 2020-04-15 20:26:55 +02:00

OSBuild Composer

Operating System Image Composition Services

The composer project is a set of HTTP services for composing operating system images. It builds on the pipeline execution engine of osbuild and defines its own class of images that it supports building.

Multiple APIs are available to access a composer service. This includes support for the lorax-composer API, and as such can serve as drop-in replacement for lorax-composer.

You can control a composer instance either directly via the provided APIs, or through higher-level user-interfaces from external projects. This, for instance, includes a Cockpit Module or using the composer-cli command-line tool.

Project

About

Composer is a middleman between the workhorses from osbuild and the user-interfaces like cockpit-composer, composer-cli, or others. It defines a set of high-level image compositions that it supports building. Builds of these compositions can be requested via the different APIs of Composer, which will then translate the requests into pipeline-descriptions for osbuild. The pipeline output is then either provided back to the user, or uploaded to a user specified target.

The following image visualizes the overall architecture of the OSBuild infrastructure and the place that Composer takes:

overview

Consult the osbuild-composer(7) man-page for an introduction into composer, information on running your own composer instance, as well as details on the provided infrastructure and services.

Requirements

The requirements for this project are:

  • osbuild >= 11
  • systemd >= 244

At build-time, the following software is required:

  • go >= 1.12
  • python-docutils >= 0.13

Build

The standard go package system is used. Consult upstream documentation for detailed help. In most situations the following commands are sufficient to build and install from source:

mkdir build
go build -o build ./...

The man-pages require python-docutils and can be built via:

make man

Repository:

Pull request gating

Each pull request against osbuild-composer starts a series of automated tests. Tests run via GitHub Actions, Travis CI, and Jenkins. Each push to the pull request will launch theses tests automatically.

Jenkins only tests pull requests from members of the osbuild organization in GitHub. A member of the osbuild organization must say ok to test in a pull request comment to approve testing. Anyone can ask for testing to run by saying the bot's favorite word, schutzbot, in a pull request comment. Testing will begin shortly after the comment is posted.

Test results in Jenkins are available by clicking the Details link on the right side of the Schutzbot check in the pull request page.

License:

  • Apache-2.0
  • See LICENSE file for details.