particle-os/debian-forge
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

mockbuild: use s3cmd put instead of sync to speed up the RPM upload

Browse source 
s3cmd sync actually downloads metadata for all objects in a s3 bucket.
We have built a lot of RPMs, thus this takes 5 minutes on AWS and 25 minutes
on my laptop (!!!).

Let's use recursive put instead. This doesn't delete any files on the remote
side. As we upload RPMs only once, this also shouldn't fail on "the
object already exists". Using this method, we should be able to upload the
RPMs in seconds.

The same patch was applied in osbuild-composer cf73edd2
This commit is contained in:
Ondřej Budai 2021-06-10 08:01:16 +02:00 • committed by Tom Gundersen
parent 73420b4f27
commit 7765c53ecc
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
schutzbot/mockbuild.sh
View file

@ -100,5 +100,5 @@ createrepo_c "${REPO_DIR}"
# Upload repository to S3.
greenprint "☁ Uploading RPMs to S3"
pushd repo
s3cmd --acl-public sync . s3://${REPO_BUCKET}/
s3cmd --acl-public put --recursive . s3://${REPO_BUCKET}/
popd