debian-forge-composer/internal
Ygal Blum feb357e538 Support Generic S3 upload in Composer API
Use case
--------
If Endpoint is not set and Region is - upload to AWS S3
If both the Endpoint and Region are set - upload the Generic S3 via Weldr API
If neither the Endpoint and Region are set - upload the Generic S3 via Composer API (use configuration)

jobimpl-osbuild
---------------
Add configuration fields for Generic S3 upload
Support S3 upload requests coming from Weldr or Composer API to either AWS or Generic S3
Weldr API for Generic S3 requires that all connection parameters but the credentials be passed in the API call
Composer API for Generic S3 requires that all conneciton parameters are taken from the configuration
Adjust to the consolidation in Target and UploadOptions

Target and UploadOptions
------------------------
Add the fields that were specific to the Generic S3 structures to the AWS S3 one
Remove the structures for Generic S3 and always use the AWS S3 ones

Worker Main
-----------
Add Endpoint, Region, Bucket, CABundle and SkipSSLVerification to the configuration structure
Pass the values to the Server

Weldr API
---------
Keep the generic.s3 provider name to maintain the API, but unmarshel into awsS3UploadSettings

tests - api.sh
--------------
Allow the caller to specifiy either AWS or Generic S3 upload targets for specific image types
Implement the pieces required for testing upload to a Generic S3 service
In some cases generalize the AWS S3 functions for reuse

GitLab CI
---------
Add test case for api.sh tests with edge-commit and generic S3
2022-06-02 16:12:53 +03:00
..
auth go.mod: Update openshift-online/ocm-sdk-go 2022-05-19 22:18:42 +02:00
blueprint blueprint: sanitize user home directories 2022-03-28 14:08:57 +02:00
boot distro: housekeeping with cpu arch and arch.Name() 2022-05-10 19:53:41 +02:00
client tests: use TestMain() instead of Init() to compile mock-dnf-json 2022-06-01 11:36:52 +01:00
cloud Upload to HTTPS S3 - Support self signed certificate 2022-05-26 13:46:00 +03:00
cloudapi simplify package set chain handling 2022-06-01 11:36:52 +01:00
common internal/common: introduce function to convert data sizes 2021-11-02 18:32:47 +01:00
crypt crypt: add automatic darwin support 2020-07-17 07:48:22 +02:00
disk disk: test minimum directory size calculations 2022-04-29 08:55:36 +02:00
distro distro: bring back TestImageType_PackageSetsChains() 2022-06-01 11:36:52 +01:00
distroregistry distro/fedora: refactor based on RHEL 9.0 code 2022-05-09 12:25:21 +02:00
dnfjson dnfjson: cache cleanup 2022-06-01 11:36:52 +01:00
jobqueue test: use T.TempDir to create temporary test directory 2022-04-05 09:27:43 +02:00
jsondb test: use T.TempDir to create temporary test directory 2022-04-05 09:27:43 +02:00
kojiapi dnfjson: cache cleanup 2022-06-01 11:36:52 +01:00
mocks dnfjson: drop repo checksums 2022-06-01 11:36:52 +01:00
osbuild1 osbuild1: support VMDK subformat in QEMU assembler 2022-05-04 16:22:29 +02:00
osbuild2 distro/rhel86: ignore SRIOV interface via new udev rule on azure-rhui 2022-05-16 15:46:46 +02:00
ostree ostree: rename errors and introduce ParameterComboError 2022-02-23 11:08:24 +01:00
prometheus prometheus/job: measure time spent pending rather than queued 2022-05-14 17:47:38 +01:00
reporegistry reporegistry: remove unused ReposByArch() function 2022-03-09 23:22:06 +00:00
rhsm internal/rhsm: implement fallback to the previous mechanism 2021-08-09 12:40:23 +02:00
rpmmd simplify package set chain handling 2022-06-01 11:36:52 +01:00
store distro/fedora: refactor based on RHEL 9.0 code 2022-05-09 12:25:21 +02:00
target Support Generic S3 upload in Composer API 2022-06-02 16:12:53 +03:00
test internal/test: add small library for tests 2022-03-08 12:07:00 +01:00
upload koji: fix excessive logging & monitoring 2022-04-05 23:48:30 +02:00
weldr Support Generic S3 upload in Composer API 2022-06-02 16:12:53 +03:00
worker worker: test depsolve job format compatibility 2022-06-01 11:36:52 +01:00
tools.go go: vendor the oapi-codegen cmd 2021-02-01 15:32:58 +01:00