debian-forge-composer/cmd/osbuild-worker
Ygal Blum feb357e538 Support Generic S3 upload in Composer API
Use case
--------
If Endpoint is not set and Region is - upload to AWS S3
If both the Endpoint and Region are set - upload the Generic S3 via Weldr API
If neither the Endpoint and Region are set - upload the Generic S3 via Composer API (use configuration)

jobimpl-osbuild
---------------
Add configuration fields for Generic S3 upload
Support S3 upload requests coming from Weldr or Composer API to either AWS or Generic S3
Weldr API for Generic S3 requires that all connection parameters but the credentials be passed in the API call
Composer API for Generic S3 requires that all conneciton parameters are taken from the configuration
Adjust to the consolidation in Target and UploadOptions

Target and UploadOptions
------------------------
Add the fields that were specific to the Generic S3 structures to the AWS S3 one
Remove the structures for Generic S3 and always use the AWS S3 ones

Worker Main
-----------
Add Endpoint, Region, Bucket, CABundle and SkipSSLVerification to the configuration structure
Pass the values to the Server

Weldr API
---------
Keep the generic.s3 provider name to maintain the API, but unmarshel into awsS3UploadSettings

tests - api.sh
--------------
Allow the caller to specifiy either AWS or Generic S3 upload targets for specific image types
Implement the pieces required for testing upload to a Generic S3 service
In some cases generalize the AWS S3 functions for reuse

GitLab CI
---------
Add test case for api.sh tests with edge-commit and generic S3
2022-06-02 16:12:53 +03:00
..
jobimpl-depsolve.go dnfjson: cache cleanup 2022-06-01 11:36:52 +01:00
jobimpl-koji-finalize.go Move OSBuildMetadataToRPMs and PackageMetadataToSignature to osbuild2 2022-02-18 09:26:35 +01:00
jobimpl-koji-init.go Relax TCP timeouts for koji connections 2022-02-10 14:58:10 +01:00
jobimpl-osbuild-koji.go worker/clienterrors: add empty manifest error 2022-04-06 10:57:37 +02:00
jobimpl-osbuild.go Support Generic S3 upload in Composer API 2022-06-02 16:12:53 +03:00
main.go Support Generic S3 upload in Composer API 2022-06-02 16:12:53 +03:00
osbuild.go worker: don't marshal manifest in byte[] from 2022-02-01 20:28:40 +00:00