Adding multithreading support for pungi/phases/image_checksum.py

Multithreading was added to parallelize the
computation of image checksums. Resulting memory structures
are protected via synchronization primitives. Max number of
threads is uncapped- experiments were done to determine
whether a maximum number of threads would yield greater
efficiency and there were no gains from this.

Likewise, experiments were done to determine whether pools of
threads computed in separate processes could likewise decrease
compute-time. Evidence did not suggest that this was the
case. This indicate that the checksum operation is bounded
by I/O read/write times.

Merges: https://pagure.io/pungi/pull-request/1520
Jira: RHELCMP-5967
Signed-off-by: James Kunstle jkunstle@redhat.com
This commit is contained in:
JamesKunstle 2021-07-20 15:57:29 -04:00 committed by Lubomír Sedlář
parent 5a8df7b69c
commit 3349585d78
2 changed files with 49 additions and 16 deletions

1
.gitignore vendored
View file

@ -13,3 +13,4 @@ htmlcov/
.coverage
.idea/
.tox
.venv