Skip to content

Commit

Permalink
Add support for S3 as storage backend
Browse files Browse the repository at this point in the history
  • Loading branch information
Mikael Berg committed Feb 14, 2024
1 parent 86c0eda commit 3a98731
Show file tree
Hide file tree
Showing 7 changed files with 223 additions and 101 deletions.
2 changes: 2 additions & 0 deletions MODULE.bazel
Original file line number Diff line number Diff line change
Expand Up @@ -12,10 +12,12 @@ go_deps.from_file(go_mod = "//:go.mod")

use_repo(
go_deps,
"com_github_aws_aws_sdk_go_v2_config",
"com_github_olekukonko_tablewriter",
"com_github_spf13_cobra",
"com_github_stretchr_testify",
"io_beyondstorage_go_services_gcs_v3",
"io_beyondstorage_go_services_s3_v3",
"io_beyondstorage_go_v5",
"org_golang_google_genproto_googleapis_bytestream",
"org_golang_google_grpc",
Expand Down
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -118,6 +118,7 @@ If not set, the default credentials will be used and the project ID will be infe
Backend | Docs | Notes
---|---|---
Google Cloud Storage | [gcs](https://beyondstorage.io/docs/go-storage/services/gcs#storager) | `credential` and `project_id` defaults to `env`
AWS S3 | [s3](https://beyondstorage.io/docs/go-storage/services/s3) | defaults to using default config (from aws-cli)

Bazel Snapshots will create the following structure in the remote storage:

Expand Down
16 changes: 14 additions & 2 deletions go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -5,11 +5,13 @@ go 1.21.1
toolchain go1.21.6

require (
github.com/aws/aws-sdk-go-v2/config v1.9.0
github.com/bazelbuild/rules_go v0.46.0
github.com/olekukonko/tablewriter v0.0.5
github.com/spf13/cobra v1.8.0
github.com/stretchr/testify v1.8.4
go.beyondstorage.io/services/gcs/v3 v3.0.0
go.beyondstorage.io/services/s3/v3 v3.0.1
go.beyondstorage.io/v5 v5.0.0
google.golang.org/genproto/googleapis/bytestream v0.0.0-20240205150955-31a09d347014
google.golang.org/grpc v1.61.0
Expand All @@ -24,6 +26,17 @@ require (
github.com/Xuanwo/gg v0.2.0 // indirect
github.com/Xuanwo/go-bufferpool v0.2.0 // indirect
github.com/Xuanwo/templateutils v0.1.0 // indirect
github.com/aws/aws-sdk-go-v2 v1.10.0 // indirect
github.com/aws/aws-sdk-go-v2/credentials v1.5.0 // indirect
github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.7.0 // indirect
github.com/aws/aws-sdk-go-v2/internal/ini v1.2.5 // indirect
github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.4.0 // indirect
github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.4.0 // indirect
github.com/aws/aws-sdk-go-v2/service/internal/s3shared v1.8.0 // indirect
github.com/aws/aws-sdk-go-v2/service/s3 v1.17.0 // indirect
github.com/aws/aws-sdk-go-v2/service/sso v1.5.0 // indirect
github.com/aws/aws-sdk-go-v2/service/sts v1.8.0 // indirect
github.com/aws/smithy-go v1.8.1 // indirect
github.com/cpuguy83/go-md2man/v2 v2.0.3 // indirect
github.com/dave/dst v0.26.2 // indirect
github.com/davecgh/go-spew v1.1.1 // indirect
Expand All @@ -32,7 +45,6 @@ require (
github.com/go-logr/stdr v1.2.2 // indirect
github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da // indirect
github.com/golang/protobuf v1.5.3 // indirect
github.com/google/go-cmp v0.6.0 // indirect
github.com/google/s2a-go v0.1.7 // indirect
github.com/google/uuid v1.5.0 // indirect
github.com/googleapis/enterprise-certificate-proxy v0.3.2 // indirect
Expand All @@ -48,6 +60,7 @@ require (
github.com/spf13/pflag v1.0.5 // indirect
github.com/urfave/cli/v2 v2.3.0 // indirect
go.beyondstorage.io/credential v1.0.0 // indirect
go.beyondstorage.io/endpoint v1.2.0 // indirect
go.opencensus.io v0.24.0 // indirect
go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc v0.46.1 // indirect
go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp v0.46.1 // indirect
Expand All @@ -63,7 +76,6 @@ require (
golang.org/x/text v0.14.0 // indirect
golang.org/x/time v0.5.0 // indirect
golang.org/x/tools v0.15.0 // indirect
golang.org/x/xerrors v0.0.0-20220907171357-04be3eba64a2 // indirect
google.golang.org/api v0.155.0 // indirect
google.golang.org/appengine v1.6.8 // indirect
google.golang.org/genproto v0.0.0-20240125205218-1f4bbc51befe // indirect
Expand Down
Loading

0 comments on commit 3a98731

Please sign in to comment.