chrislu
dd1571b95b
add some delay when starting filers, to simulate real production
8 months ago
Konstantin Lebedev
f9ec92dd83
[tests] add action s3 tests ( #5427 )
9 months ago
Nikita Borzykh
1f3742850d
Add TLS support, initial etcd connection check, fix key_prefix handling for etcd backend meta storage ( #5403 )
9 months ago
chrislu
aba934f0b5
adjust log level
9 months ago
Konstantin Lebedev
170b63d6f8
[filer.backup] add param uploader_part_size for S3sink ( #5352 )
* fix: install cronie
* chore: refactor configure S3Sink
* chore: refactor cinfig
* add filer-backup compose file
* fix: X-Amz-Meta-Mtime and resolve with comments
* fix: attr mtime
* fix: MaxUploadPartst is reduced to the maximum allowable
* fix: env and force set max MaxUploadParts
* fix: env WEED_SINK_S3_UPLOADER_PART_SIZE_MB
10 months ago
chrislu
0aed16a9c4
add make brokers
11 months ago
Konstantin Lebedev
1169f94310
Fix filer sync set offset ( #5197 )
* fix: compose 2mount with sync
* fix: DATA RACE
https://github.com/seaweedfs/seaweedfs/issues/5194
https://github.com/seaweedfs/seaweedfs/issues/5195
12 months ago
Chris Lu
580940bf82
Merge accumulated changes related to message queue ( #5098 )
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* tracking topic=>broker
* merge
* comment
1 year ago
Konstantin Lebedev
f8b94cac0e
[s3acl] Step1: move s3account.AccountManager into to iam.S3ApiConfiguration ( #4859 )
* move s3account.AccountManager into to iam.S3ApiConfiguration and switch to Interface
https://github.com/seaweedfs/seaweedfs/issues/4519
* fix: test bucket acl default and
adjust the variable names
* fix: s3 api config test
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
1 year ago
Konstantin Lebedev
a40888d343
fix: make dev_tls with volume https ( #4866 )
1 year ago
Konstantin Lebedev
a46f873edd
[s3acl] Step 0: Put bucket ACL only responds success if the ACL is private. ( #4856 )
* Passing test:
test_bucket_acl_default
test_bucket_acl_canned_private_to_private
https://github.com/seaweedfs/seaweedfs/issues/4519
* Update weed/s3api/s3api_bucket_handlers.go
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
1 year ago
Ryan Russell
949607fe90
refactor(compose)!: upgrade to v2 closes #3699 ( #3705 )
* docs(compose): Update readme for compose v2 upgrade
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(compose): Upgrade `Makefile` for compose v2
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(compose): Upgrade yml from version 2 -> 3.9
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
Konstantin Lebedev
b9933d5589
master server graceful stop ( #3797 )
2 years ago
Ryan Russell
b51880ed3b
docs(docker): readability fixes ( #3684 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
Patrick Schmidt
a73e177ecf
Add an End-to-End workflow for FUSE mount ( #3562 )
* Add an e2e workflow to test FUSE mount
* Fix deadlocks during concurrent r/w
2 years ago
Konstantin Lebedev
bcbdc4cb37
use const multipart uploads folder
avoid error bucket NotEmpty if multipart uploads folder exist
3 years ago
Konstantin Lebedev
5b388ed6c1
initial advancedtls
3 years ago
Konstantin Lebedev
a9f6c4b43d
fix ip.bind cmd for docker compose
3 years ago
Konstantin Lebedev
b86628f85d
fix show empty dir
https://github.com/chrislusf/seaweedfs/issues/3086
3 years ago
Konstantin Lebedev
a14728d508
docker compose nextcloud rm mysql
3 years ago
Konstantin Lebedev
a34438384e
docker compose file for nextcloud testing
https://github.com/chrislusf/seaweedfs/issues/3086
3 years ago
Konstantin Lebedev
d12a423aa0
refactor
add some tests
https://github.com/chrislusf/seaweedfs/pull/2996
3 years ago
chrislu
22fbce8fd5
add docker compose file to sync 2 mounts
3 years ago
chrislu
362dec87a3
add tests
3 years ago
Konstantin Lebedev
8342f651f3
fix scanNamed
3 years ago
Konstantin Lebedev
319d300d48
fix createDB
3 years ago
Konstantin Lebedev
275c3bb19c
ydb initial
https://github.com/chrislusf/seaweedfs/issues/2942
3 years ago
chrislu
192983b464
s3 backend support customizing storage class
3 years ago
Konstantin Lebedev
357aa818fe
add raft shell cmds
3 years ago
Konstantin Lebedev
b7cdde14ae
auto bootstraping and update peers
3 years ago
Konstantin Lebedev
1a1e5778c3
fix cluster status
3 years ago
Konstantin Lebedev
14dd971890
hashicorp raft with state machine
3 years ago
Konstantin Lebedev
c514710b7b
initial add hashicorp raft
3 years ago
Konstantin Lebedev
b6a2b43efe
allowDeleteBucketNotEmpty
3 years ago
Konstantin Lebedev
5b90a39954
fix s3 tests:
multipart_upload_incorrect_etag
multipart_resend_first_finishes_last
3 years ago
chrislu
24541fc7ec
minor
3 years ago
kmlebedev
4f98553ba9
audit log SignatureVersion
3 years ago
Konstantin Lebedev
10678cde81
audit log config
3 years ago
Konstantin Lebedev
9d6ffa0ea1
GetBucketLifecycleConfigurationHandler
3 years ago
Konstantin Lebedev
be4b3ed509
AclHandlers
3 years ago
Konstantin Lebedev
302738ee74
s3 test bucket delete nonempty
4 years ago
Konstantin Lebedev
b612d5aebd
s3 test get w/ If-Match: bogus ETag
4 years ago
Konstantin Lebedev
69c768870b
- object write cache control
- object write expires
4 years ago
Chris Lu
e3f47ddb76
debug
4 years ago
Chris Lu
f51bf61a16
remove wrong parameter
4 years ago
Konstantin Lebedev
995ae91007
add DeleteUserPolicy
4 years ago
Konstantin Lebedev
6b3cc94ac4
minio gateway s3 docker compose file
4 years ago
Chris Lu
b1a86cf808
s3: copy object to itself
fix https://github.com/chrislusf/seaweedfs/issues/1922
4 years ago
Chris Lu
2d567e00aa
add mount memory profiling
4 years ago
Konstantin Lebedev
d66645ecda
add 12 tests
https://github.com/chrislusf/seaweedfs/issues/1810
4 years ago