Tree: 54b10f3351

add-ec-vacuum

add-foundation-db

add_fasthttp_client

add_remote_storage

adding-message-queue-integration-tests

avoid_releasing_temp_file_on_write

changing-to-zap

collect-public-metrics

create-table-snapshot-api-design

data_query_pushdown

dependabot/github_actions/actions/dependency-review-action-4.8.1

dependabot/github_actions/github/codeql-action-4

dependabot/go_modules/cloud.google.com/go/kms-1.23.1

dependabot/go_modules/cloud.google.com/go/storage-1.57.0

dependabot/go_modules/github.com/Azure/azure-sdk-for-go/sdk/azidentity-1.13.0

dependabot/go_modules/github.com/go-redsync/redsync/v4-4.14.0

dependabot/go_modules/github.com/seaweedfs/raft-1.1.5

dependabot/maven/other/java/client/com.google.protobuf-protobuf-java-3.25.5

dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-3.4.0

detect-and-plan-ec-tasks

do-not-retry-if-error-is-NotFound

fasthttp

filer1_maintenance_branch

fix-GetObjectLockConfigurationHandler

fix-race-condition

fix-versioning-listing-only

ftp

gh-pages

improve-fuse-mount

improve-fuse-mount2

logrus

master

message_send

mount2

mq-subscribe

mq2

original_weed_mount

random_access_file

refactor-needle-read-operations

refactor-volume-write

remote_overlay

revert-5134-patch-1

revert-5819-patch-1

revert-6434-bugfix-missing-s3-audit

s3-select

sub

tcp_read

test-reverting-lock-table

test_udp

testing

testing-sdx-generation

tikv

track-mount-e2e

volume_buffered_writes

worker-execute-ec-tasks

0.72

0.72.release

0.73

0.74

0.75

0.76

0.77

0.90

0.91

0.92

0.93

0.94

0.95

0.96

0.97

0.98

0.99

1.00

1.01

1.02

1.03

1.04

1.05

1.06

1.07

1.08

1.09

1.10

1.11

1.12

1.14

1.15

1.16

1.17

1.18

1.19

1.20

1.21

1.22

1.23

1.24

1.25

1.26

1.27

1.28

1.29

1.30

1.31

1.32

1.33

1.34

1.35

1.36

1.37

1.38

1.40

1.41

1.42

1.43

1.44

1.45

1.46

1.47

1.48

1.49

1.50

1.51

1.52

1.53

1.54

1.55

1.56

1.57

1.58

1.59

1.60

1.61

1.61RC

1.62

1.63

1.64

1.65

1.66

1.67

1.68

1.69

1.70

1.71

1.72

1.73

1.74

1.75

1.76

1.77

1.78

1.79

1.80

1.81

1.82

1.83

1.84

1.85

1.86

1.87

1.88

1.90

1.91

1.92

1.93

1.94

1.95

1.96

1.97

1.98

1.99

1;70

2.00

2.01

2.02

2.03

2.04

2.05

2.06

2.07

2.08

2.09

2.10

2.11

2.12

2.13

2.14

2.15

2.16

2.17

2.18

2.19

2.20

2.21

2.22

2.23

2.24

2.25

2.26

2.27

2.28

2.29

2.30

2.31

2.32

2.33

2.34

2.35

2.36

2.37

2.38

2.39

2.40

2.41

2.42

2.43

2.47

2.48

2.49

2.50

2.51

2.52

2.53

2.54

2.55

2.56

2.57

2.58

2.59

2.60

2.61

2.62

2.63

2.64

2.65

2.66

2.67

2.68

2.69

2.70

2.71

2.72

2.73

2.74

2.75

2.76

2.77

2.78

2.79

2.80

2.81

2.82

2.83

2.84

2.85

2.86

2.87

2.88

2.89

2.90

2.91

2.92

2.93

2.94

2.95

2.96

2.97

2.98

2.99

3.00

3.01

3.02

3.03

3.04

3.05

3.06

3.07

3.08

3.09

3.10

3.11

3.12

3.13

3.14

3.15

3.16

3.18

3.19

3.20

3.21

3.22

3.23

3.24

3.25

3.26

3.27

3.28

3.29

3.30

3.31

3.32

3.33

3.34

3.35

3.36

3.37

3.38

3.39

3.40

3.41

3.42

3.43

3.44

3.45

3.46

3.47

3.48

3.50

3.51

3.52

3.53

3.54

3.55

3.56

3.57

3.58

3.59

3.60

3.61

3.62

3.63

3.64

3.65

3.66

3.67

3.68

3.69

3.71

3.72

3.73

3.74

3.75

3.76

3.77

3.78

3.79

3.80

3.81

3.82

3.83

3.84

3.85

3.86

3.87

3.88

3.89

3.90

3.91

3.92

3.93

3.94

3.95

3.96

3.97

dev

helm-3.65.1

v0.69

v0.70beta

v3.33

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from '54b10f3351'

${ noResults }

Commit Graph

77 Commits (54b10f335193563c023fcc68dff3794fbffb606c)

Author	SHA1	Message	Date
Chris Lu	54b10f3351	Address Gemini Code Assist review comments Fixed three issues identified by Gemini Code Assist: 1. HIGH: ReadFile now uses blob.CountToEnd when size is 0 - Old SDK: size=0 meant "read to end" - New SDK: size=0 means "read 0 bytes" - Fix: Use blob.CountToEnd (-1) to read entire blob from offset 2. MEDIUM: Use to.Ptr() instead of slice trick for DeleteSnapshots - Replaced &[]Type{value}[0] with to.Ptr(value) - Cleaner, more idiomatic Azure SDK pattern - Applied to both azure_storage_client.go and azure_sink.go 3. Added missing imports: - github.com/Azure/azure-sdk-for-go/sdk/azcore/to These changes improve code clarity and correctness while following Azure SDK best practices.	1 week ago
Chris Lu	ff271aba16	Migrate from deprecated azure-storage-blob-go to modern Azure SDK Migrates Azure Blob Storage integration from the deprecated github.com/Azure/azure-storage-blob-go to the modern github.com/Azure/azure-sdk-for-go/sdk/storage/azblob SDK. ## Changes ### Removed Files - weed/remote_storage/azure/azure_highlevel.go - Custom upload helper no longer needed with new SDK ### Updated Files - weed/remote_storage/azure/azure_storage_client.go - Migrated from ServiceURL/ContainerURL/BlobURL to Client-based API - Updated client creation using NewClientWithSharedKeyCredential - Replaced ListBlobsFlatSegment with NewListBlobsFlatPager - Updated Download to DownloadStream with proper HTTPRange - Replaced custom uploadReaderAtToBlockBlob with UploadStream - Updated GetProperties, SetMetadata, Delete to use new client methods - Fixed metadata conversion to return map[string]*string - weed/replication/sink/azuresink/azure_sink.go - Migrated from ContainerURL to Client-based API - Updated client initialization - Replaced AppendBlobURL with AppendBlobClient - Updated error handling to use azcore.ResponseError - Added streaming.NopCloser for AppendBlock ### New Test Files - weed/remote_storage/azure/azure_storage_client_test.go - Comprehensive unit tests for all client operations - Tests for Traverse, ReadFile, WriteFile, UpdateMetadata, Delete - Tests for metadata conversion function - Benchmark tests - Integration tests (skippable without credentials) - weed/replication/sink/azuresink/azure_sink_test.go - Unit tests for Azure sink operations - Tests for CreateEntry, UpdateEntry, DeleteEntry - Tests for cleanKey function - Tests for configuration-based initialization - Integration tests (skippable without credentials) - Benchmark tests ### Dependency Updates - go.mod: Removed github.com/Azure/azure-storage-blob-go v0.15.0 - go.mod: Made github.com/Azure/azure-sdk-for-go/sdk/storage/azblob v1.6.2 direct dependency - All deprecated dependencies automatically cleaned up ## API Migration Summary Old SDK → New SDK mappings: - ServiceURL → Client (service-level operations) - ContainerURL → ContainerClient - BlobURL → BlobClient - BlockBlobURL → BlockBlobClient - AppendBlobURL → AppendBlobClient - ListBlobsFlatSegment() → NewListBlobsFlatPager() - Download() → DownloadStream() - Upload() → UploadStream() - Marker-based pagination → Pager-based pagination - azblob.ResponseError → azcore.ResponseError ## Testing All tests pass: - ✅ Unit tests for metadata conversion - ✅ Unit tests for helper functions (cleanKey) - ✅ Interface implementation tests - ✅ Build successful - ✅ No compilation errors - ✅ Integration tests available (require Azure credentials) ## Benefits - ✅ Uses actively maintained SDK - ✅ Better performance with modern API design - ✅ Improved error handling - ✅ Removes ~200 lines of custom upload code - ✅ Reduces dependency count - ✅ Better async/streaming support - ✅ Future-proof against SDK deprecation ## Backward Compatibility The changes are transparent to users: - Same configuration parameters (account name, account key) - Same functionality and behavior - No changes to SeaweedFS API or user-facing features - Existing Azure storage configurations continue to work ## Breaking Changes None - this is an internal implementation change only.	1 week ago
chrislu	dd4880d55a	fix for baidu cloud storage	2 months ago
Chris Lu	69553e5ba6	convert error fromating to %w everywhere (#6995)	3 months ago
chrislu	bd4891a117	change version directory	4 months ago
chrislu	00f87e5bb5	remove unused	1 year ago
mervynzhang	df400e6c71	Concurrency works better (#4663) Co-authored-by: mervyn.zhang <mervyn.zhang@sap.com>	2 years ago
mervynzhang	1ebb549f77	support swift (#4480)	2 years ago
Muhammad Hallaj bin Subery	9bd422d2c9	adding support for B2 region (#4177) Co-authored-by: Muhammad Hallaj bin Subery <hallaj@tuta.io>	3 years ago
chrislu	81fdf3651b	grpc connection to filer add sw-client-id header	3 years ago
aronneagu	180853a2c9	Replace dashes with underscores in x-amz-meta headers (#3965)	3 years ago
Konstantin Lebedev	5431c445cd	fix filer.remote.sync to azure with ContentType (#3949) * fix filer.remote.sync to azure with ContentType * fix pass X-Amz-Meta to X-Ms-Meta	3 years ago
chrislu	4193dafce1	azure metadata: skip metadata prefixed with "X-" fix https://github.com/seaweedfs/seaweedfs/issues/3875	3 years ago
chrislu	9920d65bc0	gateway to remote object store: adjust upload concurrency	3 years ago
chrislu	eaeb141b09	move proto package	3 years ago
chrislu	26dbc6c905	move to https://github.com/seaweedfs/seaweedfs	3 years ago
chrislu	1d0c53ea56	remote storage: stop supporting hdfs as a remote storage	3 years ago
chrislu	61b8c9c361	remote object store gateway: disable tagging for backblaze	3 years ago
chrislu	bff1ccc1de	fix compilation	3 years ago
chrislu	ad01c63b84	conditionally skip hdfs related code	4 years ago
justin	d02f13c2d1	remove Redundant type conversion and use strings.TrimSuffix to enhance readability	4 years ago
chrislu	a0bad1c997	remove any go mod changes This reverts commit 6c7f7d6887.	4 years ago
chrislu	6c7f7d6887	Revert "Merge pull request #2782 from SadmiB/upstream" This reverts commit a644b7236a, reversing changes made to 349257f822.	4 years ago
SadmiB	d12540c9f2	Add contabo api client	4 years ago
chrislu	9f9ef1340c	use streaming mode for long poll grpc calls streaming mode would create separate grpc connections for each call. this is to ensure the long poll connections are properly closed.	4 years ago
Chris Lu	04663c3611	remote.mount: print out metadata sync errors	4 years ago
Eng Zer Jun	a23bcbb7ec	refactor: move from io/ioutil to io and os package The io/ioutil package has been deprecated as of Go 1.16, see https://golang.org/doc/go1.16#ioutil. This commit replaces the existing io/ioutil functions with their new definitions in io and os packages. Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>	4 years ago
Chris Lu	2789d10342	go fmt	4 years ago
Chris Lu	e5fc35ed0c	change server address from string to a type	4 years ago
Chris Lu	53b9b521c9	adjust error message	4 years ago
Chris Lu	da49d25950	auto list of storage types	4 years ago
Chris Lu	bbc77f7af4	fix compilation	4 years ago
Chris Lu	0652805236	cloud drive: add createBucket() deleteBucket()	4 years ago
Chris Lu	83cd0fc739	cloud drive: add list buckets	4 years ago
Chris Lu	fbfc90fd1e	adjust formatting remote location	4 years ago
Chris Lu	bca4a9de78	simplify	4 years ago
Chris Lu	958125bd02	conforming to http user agent common practice	4 years ago
Chris Lu	7ce97b59d8	go fmt	4 years ago
Chris Lu	3bd48c4f29	filer.remote.sync: exit when directory is unmounted this will not propagate the deletions back to the cloud	4 years ago
Chris Lu	3faaa6e360	ensure cached client with updated storage conf	4 years ago
Chris Lu	1dfcdc53b7	cloud drive: add storj, filebase	4 years ago
Chris Lu	701cc133f3	cloud drive: s3 add option for v4 signature	4 years ago
Chris Lu	eacaa44dc2	refactor	4 years ago
Chris Lu	a31f2907f0	cloud drive: filer.remote.sync supports remove folder	4 years ago
Chris Lu	001a472057	cloud mount: remote storage support hdfs	4 years ago
Chris Lu	05a648bb96	refactor: separating out remote.proto	4 years ago
Chris Lu	c08ac536ed	cloud drive: add support for Wasabi * disable md5, sha256 checking to avoid reading one chunk twice * single threaded upload to avoid chunk swapping (to be enhanced later)	4 years ago
Chris Lu	a7a914f120	cloud drive: add support for Baidu BOS	4 years ago
Chris Lu	c6c97bd83d	add default env variables	4 years ago
Chris Lu	a19c728034	cloud drive: add support for Tencent COS	4 years ago