debian-forge-composer/cmd
Ygal Blum feb357e538 Support Generic S3 upload in Composer API
Use case
--------
If Endpoint is not set and Region is - upload to AWS S3
If both the Endpoint and Region are set - upload the Generic S3 via Weldr API
If neither the Endpoint and Region are set - upload the Generic S3 via Composer API (use configuration)

jobimpl-osbuild
---------------
Add configuration fields for Generic S3 upload
Support S3 upload requests coming from Weldr or Composer API to either AWS or Generic S3
Weldr API for Generic S3 requires that all connection parameters but the credentials be passed in the API call
Composer API for Generic S3 requires that all conneciton parameters are taken from the configuration
Adjust to the consolidation in Target and UploadOptions

Target and UploadOptions
------------------------
Add the fields that were specific to the Generic S3 structures to the AWS S3 one
Remove the structures for Generic S3 and always use the AWS S3 ones

Worker Main
-----------
Add Endpoint, Region, Bucket, CABundle and SkipSSLVerification to the configuration structure
Pass the values to the Server

Weldr API
---------
Keep the generic.s3 provider name to maintain the API, but unmarshel into awsS3UploadSettings

tests - api.sh
--------------
Allow the caller to specifiy either AWS or Generic S3 upload targets for specific image types
Implement the pieces required for testing upload to a Generic S3 service
In some cases generalize the AWS S3 functions for reuse

GitLab CI
---------
Add test case for api.sh tests with edge-commit and generic S3
2022-06-02 16:12:53 +03:00
..
cloud-cleaner cloud-cleaner: clean up GCE instances in all regions and zones 2022-05-17 12:18:12 +02:00
gen-manifests gen-manifests: do not return workerName from makeManifestJob 2022-06-01 11:36:52 +01:00
mock-dnf-json dnfjson: use repo config hash as repo ID 2022-06-01 11:36:52 +01:00
osbuild-auth-tests osbuild-auth-tests: add a build constraint also to certificates.go 2021-12-18 11:56:17 +00:00
osbuild-composer composer+worker: make dnf-json path externally configurable 2022-06-01 11:36:52 +01:00
osbuild-composer-cli-tests gosec: G204 - Subproccess launched as function arg 2021-12-13 12:17:30 +02:00
osbuild-composer-dbjobqueue-tests jobqueue: introduce the concept of channels 2022-03-08 12:07:00 +01:00
osbuild-composer-image-definitions Tools: fetch image test case generation matrix from composer 2022-05-13 21:01:37 +03:00
osbuild-composer-manifest-tests Manifests test: ensure that every image type has test coverage 2022-05-13 21:01:37 +03:00
osbuild-dnf-json-tests dnfjson: drop repo checksums 2022-06-01 11:36:52 +01:00
osbuild-image-tests distro: housekeeping with cpu arch and arch.Name() 2022-05-10 19:53:41 +02:00
osbuild-koji koji: fix excessive logging & monitoring 2022-04-05 23:48:30 +02:00
osbuild-koji-tests gosec: G204 - Subproccess launched as function arg 2021-12-13 12:17:30 +02:00
osbuild-mock-openid-provider go.mod: Update openshift-online/ocm-sdk-go 2022-05-19 22:18:42 +02:00
osbuild-package-sets simplify package set chain handling 2022-06-01 11:36:52 +01:00
osbuild-pipeline dnfjson: cache cleanup 2022-06-01 11:36:52 +01:00
osbuild-service-maintenance osbuild-service-maintenance: Move type conversion to config 2022-05-14 16:21:21 +02:00
osbuild-store-dump dnfjson: drop repo checksums 2022-06-01 11:36:52 +01:00
osbuild-upload-aws osbuild-service-maintenance: Clean up expired images 2021-12-03 00:14:09 +00:00
osbuild-upload-azure cmd/upload-azure: set storage account 2021-03-06 15:40:48 +00:00
osbuild-upload-gcp cmd/osbuild-upload-gcp: use ComputeImageInsert() 2022-04-14 19:07:31 +01:00
osbuild-upload-generic-s3 Upload to HTTPS S3 - Support self signed certificate 2022-05-26 13:46:00 +03:00
osbuild-upload-oci Add support for OCI upload provider 2022-01-28 15:16:47 +01:00
osbuild-worker Support Generic S3 upload in Composer API 2022-06-02 16:12:53 +03:00