tumbi-assembler/pungi/phases
Jan Kaluza a209bda73c Create MaterializedPackageSets in threads to make pkgset faster.
When modules are used, there are lot of small package sets. These
package sets have usually less than 500 packages. The createrepo
part of `MaterializedPackageSet.create` executed for such small
set of packages takes around 1 second. Most of this time
the createrepo_c runs in single thread. It does the initialization,
it writes the XML files, ...

The parts of createrepo which can be run in parallel and therefore
would use all the CPUs are quite small for very small package sets.

This commit therefore executes multiple threads with
`MaterializedPackageSet.create` for these very small package sets.

This saves around 40 seconds from pkgset phase for RHEL compose.

Signed-off-by: Jan Kaluza <jkaluza@redhat.com>
2020-03-13 12:51:02 +01:00
..
gather Allow reusing gather phase results. 2020-03-13 10:17:59 +01:00
pkgset Create MaterializedPackageSets in threads to make pkgset faster. 2020-03-13 12:51:02 +01:00
__init__.py Format code base with black 2020-02-05 17:35:47 +08:00
base.py Format code base with black 2020-02-05 17:35:47 +08:00
buildinstall.py Move buildinstall results to final directories if using pungi-buildinstall Koji plugin. 2020-03-03 10:35:25 +01:00
createiso.py Fix flake8 complaints - E501 2020-02-07 14:36:46 +08:00
createrepo.py Add Compose.old_compose_path and use it when searching for files in old compose. 2020-03-09 12:47:23 +01:00
extra_files.py Format code base with black 2020-02-05 17:35:47 +08:00
extra_isos.py Format code base with black 2020-02-05 17:35:47 +08:00
image_build.py Fix flake8 complaints - E501 2020-02-07 14:36:46 +08:00
image_checksum.py Format code base with black 2020-02-05 17:35:47 +08:00
init.py Fix flake8 complaints - E501 2020-02-07 14:36:46 +08:00
live_images.py Fix flake8 complaints - E501 2020-02-07 14:36:46 +08:00
livemedia_phase.py Fix flake8 complaints - E501 2020-02-07 14:36:46 +08:00
osbs.py Fix formatting issues 2020-02-07 16:16:20 +08:00
ostree.py Format code base with black 2020-02-05 17:35:47 +08:00
ostree_installer.py Fix flake8 complaints - E501 2020-02-07 14:36:46 +08:00
phases_metadata.py Format code base with black 2020-02-05 17:35:47 +08:00
test.py Format code base with black 2020-02-05 17:35:47 +08:00
weaver.py Format code base with black 2020-02-05 17:35:47 +08:00