Konstantin Lebedev
c8b0a04409
golang up version to 1.24 ( #6724 )
6 days ago
MaratKarimov
ba3afd1803
Tarantool filer store ( #6669 )
Co-authored-by: Marat Karimov <m.karimov@digitalms.ru>
1 month ago
Tom Crasset
be2b389b81
add more logging for s3 signature ( #6652 )
1 month ago
SmoothDenis
e60aa71890
fix: restore deletion audit of individual objects ( #6644 )
1 month ago
Chris Lu
02773a6107
Accumulated changes for message queue ( #6600 )
* rename
* set agent address
* refactor
* add agent sub
* pub messages
* grpc new client
* can publish records via agent
* send init message with session id
* fmt
* check cancelled request while waiting
* use sessionId
* handle possible nil stream
* subscriber process messages
* separate debug port
* use atomic int64
* less logs
* minor
* skip io.EOF
* rename
* remove unused
* use saved offsets
* do not reuse session, since always session id is new after restart
remove last active ts from SessionEntry
* simplify printing
* purge unused
* just proxy the subscription, skipping the session step
* adjust offset types
* subscribe offset type and possible value
* start after the known tsns
* avoid wrongly set startPosition
* move
* remove
* refactor
* typo
* fix
* fix changed path
2 months ago
chrislu
ddd67dd191
upgade rocksdb to 9.10.0
2 months ago
chrislu
5e46960651
use golang:1.23 image
3 months ago
Tom Crasset
c5f21b2b01
fix S3 per-user-directory Policy ( #6443 )
* fix S3 per-user-directory Policy
* Delete docker/config.json
* add tests
* remove logs
* undo modifications of weed/shell/command_volume_balance.go
* remove modifications of docker-compose
* fix failing test
---------
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
3 months ago
chrislu
8211b29689
fix s3tests.conf file name
10 months ago
chrislu
dd1571b95b
add some delay when starting filers, to simulate real production
12 months ago
chrislu
30f8600a24
working
1 year ago
Konstantin Lebedev
f9ec92dd83
[tests] add action s3 tests ( #5427 )
1 year ago
Nikita Borzykh
1f3742850d
Add TLS support, initial etcd connection check, fix key_prefix handling for etcd backend meta storage ( #5403 )
1 year ago
chrislu
aba934f0b5
adjust log level
1 year ago
Konstantin Lebedev
170b63d6f8
[filer.backup] add param uploader_part_size for S3sink ( #5352 )
* fix: install cronie
* chore: refactor configure S3Sink
* chore: refactor cinfig
* add filer-backup compose file
* fix: X-Amz-Meta-Mtime and resolve with comments
* fix: attr mtime
* fix: MaxUploadPartst is reduced to the maximum allowable
* fix: env and force set max MaxUploadParts
* fix: env WEED_SINK_S3_UPLOADER_PART_SIZE_MB
1 year ago
Chris Lu
2ad363d984
upgrade go, rocksdb
1 year ago
Chris Lu
c471265837
build with pub sub clients for testing
1 year ago
chrislu
0aed16a9c4
add make brokers
1 year ago
Konstantin Lebedev
1169f94310
Fix filer sync set offset ( #5197 )
* fix: compose 2mount with sync
* fix: DATA RACE
https://github.com/seaweedfs/seaweedfs/issues/5194
https://github.com/seaweedfs/seaweedfs/issues/5195
1 year ago
chrislu
53188a1191
fix rocksdb build
1 year ago
chrislu
88d3f51648
fix rocksdb build
1 year ago
Chris Lu
580940bf82
Merge accumulated changes related to message queue ( #5098 )
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* tracking topic=>broker
* merge
* comment
1 year ago
chrislu
556a242acf
remove unused file
1 year ago
Konstantin Lebedev
ce9b822a8e
golang up version to 1.21.3 ( #4911 )
2 years ago
Konstantin Lebedev
f8b94cac0e
[s3acl] Step1: move s3account.AccountManager into to iam.S3ApiConfiguration ( #4859 )
* move s3account.AccountManager into to iam.S3ApiConfiguration and switch to Interface
https://github.com/seaweedfs/seaweedfs/issues/4519
* fix: test bucket acl default and
adjust the variable names
* fix: s3 api config test
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2 years ago
Konstantin Lebedev
a40888d343
fix: make dev_tls with volume https ( #4866 )
2 years ago
chrislu
1494221b08
reduce binary size
2 years ago
Konstantin Lebedev
a46f873edd
[s3acl] Step 0: Put bucket ACL only responds success if the ACL is private. ( #4856 )
* Passing test:
test_bucket_acl_default
test_bucket_acl_canned_private_to_private
https://github.com/seaweedfs/seaweedfs/issues/4519
* Update weed/s3api/s3api_bucket_handlers.go
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2 years ago
chrislu
b0da8788a1
upgrade rocksdb versions
2 years ago
chrislu
1f7934a89c
enable gocdk in the generated local image
fix https://github.com/seaweedfs/seaweedfs/issues/4256
2 years ago
Chris Lu
bac45912e3
go 1.20 ( #4192 )
2 years ago
CommanderRoot
c7c9d22f37
filer.store.mysql: Use utf8mb4 instead of 3 byte UTF8 ( #4094 )
2 years ago
Ryan Russell
949607fe90
refactor(compose)!: upgrade to v2 closes #3699 ( #3705 )
* docs(compose): Update readme for compose v2 upgrade
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(compose): Upgrade `Makefile` for compose v2
Signed-off-by: Ryan Russell <git@ryanrussell.org>
* refactor(compose): Upgrade yml from version 2 -> 3.9
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
3 years ago
Konstantin Lebedev
b9933d5589
master server graceful stop ( #3797 )
3 years ago
Ryan Russell
b51880ed3b
docs(docker): readability fixes ( #3684 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
3 years ago
chrislu
5afc20dbd3
add tmux for dev
3 years ago
chrislu
04300dc2ac
build local rocksdb
3 years ago
chrislu
466bbe4cdd
dockerfile fix directory
3 years ago
chrislu
9c76896e2d
fix building rocksdb image
3 years ago
Patrick Schmidt
a73e177ecf
Add an End-to-End workflow for FUSE mount ( #3562 )
* Add an e2e workflow to test FUSE mount
* Fix deadlocks during concurrent r/w
3 years ago
Konstantin Lebedev
913a5d0dd4
add target dev_race to MakeFile ( #3522 )
3 years ago
Konstantin Lebedev
d8c54b527e
avoid Dockerfile Entrypoint: "file not found" ( #3430 )
https://www.koskila.net/how-to-fix-exec-user-process-caused-no-such-file-or-directory-in-docker-on-windows/
3 years ago
chrislu
8a61c124c7
go 1.19
3 years ago
chrislu
5fbe437ee9
update rocksdb version to 7.4.4
3 years ago
chrislu
1d05e7fcbd
site move
3 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
3 years ago
Konstantin Lebedev
bcbdc4cb37
use const multipart uploads folder
avoid error bucket NotEmpty if multipart uploads folder exist
3 years ago
Konstantin Lebedev
5b388ed6c1
initial advancedtls
3 years ago
Konstantin Lebedev
a9f6c4b43d
fix ip.bind cmd for docker compose
3 years ago
Konstantin Lebedev
fb57aa431c
stats master_replica_placement_mismatch
3 years ago