chrislu
6c7824c813
consistent sorted tags elastic,gocdk,rclone,sqlite,tikv,ydb
12 months ago
chrislu
0df4a4298b
adjust comment
12 months ago
Guang Jiong Lou
54b91ba2b2
fix permission check in put request ( #6142 )
12 months ago
dsd
1e13b6879c
fix(volume): to avoid duplicate write a same needle ( #6138 )
fix WriteNeedleBlob to avoid duplicate write a same needle
Co-authored-by: 邓书东 <shudong_deng@hhnb2024010108.intsig.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
12 months ago
chrislu
f11567816e
Revert "fix: volume data integrity check ( #6118 )"
This reverts commit e12b9ab746
.
12 months ago
wusong
e12b9ab746
fix: volume data integrity check ( #6118 )
Co-authored-by: wang wusong <wangwusong@virtaitech.com>
12 months ago
steve.wei
cfbe45c765
feat: add in-flight metric for s3/file/volume-server ( #6120 )
12 months ago
chrislu
804e765397
remove unused
12 months ago
chrislu
6845e25318
set proxied request content length
12 months ago
chrislu
35fd1e1c9a
optimize memory usage for large number of volumes
1. unwrap the map to avoid extra map object creation
2. fix ec shard counting in UpdateEcShards
12 months ago
chrislu
b28b1a3402
3.77
1 year ago
chrislu
07df5c53de
avoid nil
I1010 03:10:25.220345 mount_std.go:281 This is SeaweedFS version 30GB 3.76 82ed61c655
linux amd64
^[OR^[OR2024/10/10 03:12:56 Unimplemented opcode POLL
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x28 pc=0x3983b41]
goroutine 112 [running]:
github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents.func2.mergeProceesors.1(0xc000513540)
/github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:30 +0x41
github.com/seaweedfs/seaweedfs/weed/pb.WithFilerClientFollowMetadata.makeSubscribeMetadataFunc.func1({0x514a560, 0xc0009b06d0})
/github/workspace/weed/pb/filer_pb_tail.go:87 +0x293
github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).WithFilerClient.func1.1(0xc000d9e008)
/github/workspace/weed/mount/wfs_filer_client.go:27 +0x68
github.com/seaweedfs/seaweedfs/weed/pb.WithGrpcClient(0xa9?, 0x9d1f90fb?, 0xc00098fbe0, {0xc000e1c078, 0x15}, 0x0?, {0xc000a76bd0?, 0x1?, 0x1?
})
/github/workspace/weed/pb/grpc_client_server.go:155 +0x33a
github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).WithFilerClient.func1()
/github/workspace/weed/mount/wfs_filer_client.go:25 +0x14c
github.com/seaweedfs/seaweedfs/weed/util.Retry({0x489a10c, 0xa}, 0xc00098fcf8)
/github/workspace/weed/util/retry.go:16 +0xa7
github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).WithFilerClient(0x0?, 0x30?, 0xc00056a568?)
/github/workspace/weed/mount/wfs_filer_client.go:18 +0x65
github.com/seaweedfs/seaweedfs/weed/pb.WithFilerClientFollowMetadata({0x50f5898, 0xc000e2c180}, 0xc00101e000, 0xc000d22030)
/github/workspace/weed/pb/filer_pb_tail.go:51 +0x87
github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents.func2()
/github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:115 +0xcb
github.com/seaweedfs/seaweedfs/weed/util.RetryUntil({0x48b8b35, 0x11}, 0xc00098fef0, 0x4af0048)
/github/workspace/weed/util/retry.go:64 +0x4e
github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents(0xc000d1d980, 0x9d1f90fb, {0x50f5898, 0xc000e2c180}, {0x7ffdf6f98dca,
0x4}, 0x17fcf8b7c7ecf8cf, {0xc0000ac208, 0x1, 0x1})
/github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:113 +0x39b
created by github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).StartBackgroundTasks in goroutine 1
/github/workspace/weed/mount/weedfs.go:150 +0x146
1 year ago
chrislu
82ed61c655
3.76
1 year ago
chrislu
c0e36231ad
use only one metadata follow process
1 year ago
Konstantin Lebedev
44b275879b
[s3] add {Get,Put,Delete}BucketTagging and PublicAccessBlock Handlers ( #6088 )
* add {Get,Put,Delete}BucketTagging Handlers
* s3 add skip bucket PublicAccessBlock handlers
---------
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
1 year ago
chrislu
a3a8f6217e
fix
1 year ago
chrislu
117c3aebda
3.75
1 year ago
Konstantin Lebedev
a3556acd98
[s3] add skip bucket encryption handlers ( #6091 )
s3 add skip bucket encryption handlers
1 year ago
Er2
5644bc8f01
s3api: Fix signature v4 with reverse proxy at sub-path ( #6092 )
1 year ago
chrislu
ff47956530
add helper functions
1 year ago
chrislu
11e53dd8ef
skip error if conf file is not created
1 year ago
chrislu
f747767aa1
support load balancer in front of s3
1 year ago
chrislu
7dd480acad
handle missing leading zero padding in replica
1 year ago
chrislu
e3fa87bcc1
3.74
1 year ago
chrislu
cdd7fa81ab
fix help message
1 year ago
chrislu
20929f2a57
adjust resource heavy for volume.fix.replication
1 year ago
chrislu
6564ceda91
skip resource heavy commands from running on master nodes
1 year ago
chrislu
ec30a504ba
refactor
1 year ago
chrislu
9cd263b2ce
refactor
1 year ago
chrislu
701abbb9df
add IsResourceHeavy() to command interface
1 year ago
coffeecloudgit
dad3a26fb6
Update volume_grpc_erasure_coding.go , fix no space left bug ( #6077 )
1 year ago
Konstantin Lebedev
bae93e611d
[filer] avoid 500 if table doesn't exist ( #6075 )
1 year ago
coffeecloudgit
6cbce110d5
Update volume_grpc_erasure_coding.go ( #6073 )
1 year ago
Neo
aa61824442
master:fix empty target in Build() ( #6069 )
1 year ago
Max Denushev
f1e700ce2f
Fix/copy before delete replication ( #6064 )
* fix(shell): volume.fix.replication misplaced volumes unsatisfying replication factor
* fix(shell): simplify replication check
* fix(shell): add test for satisfyReplicaCurrentLocation
1 year ago
steve.wei
ae8c6d95a6
fix: Prevent potential metadata change events from being lost. ( #6066 )
1 year ago
LHHDZ
4dc33cc143
fix unclaimed spaces calculation when volumePreallocate is enabled ( #6063 )
the calculation of `unclaimedSpaces` only needs to subtract `unusedSpace` when `preallocate` is not enabled.
Signed-off-by: LHHDZ <shichanglin5@qq.com>
1 year ago
Max Denushev
d056c0ddf2
fix(volume): don't persist RO state in specific cases ( #6058 )
* fix(volume): don't persist RO state in specific cases
* fix(volume): writable always persist
1 year ago
zemul
028ebb1d0d
Feat:merge small chunk ( #6049 )
* fix:mount deadlock
* feat: merge small chunk
* adjust MergeChunkMinCount
* fix
---------
Co-authored-by: zemul <zhouzemiao@ihuman.com>
1 year ago
chrislu
4ec6eab004
fix max volume count auto setting
related to https://github.com/seaweedfs/seaweedfs/issues/6041#issuecomment-2360448182
1 year ago
dsd
a3572999bb
Vol check disk bug ( #6044 )
* fix volume.check.disk
* ensure multiple replica sync
* add comment
---------
Co-authored-by: 邓书东 <shudong_deng@hhnb2024010108.intsig.com>
1 year ago
Konstantin Lebedev
6d4f5c94ac
[volume] remove truncate idx file if size not healthy ( #6043 )
1 year ago
chrislu
50e22864cf
refactor
1 year ago
chrislu
99ae99e3b9
fix nil filer conf
fix https://github.com/seaweedfs/seaweedfs/issues/6034
1 year ago
Konstantin Lebedev
2b13d2c083
[filer] fix return 204 for DELETE on entry not found ( #6023 )
fix return 204 for DELETE on entry not found
1 year ago
Guang Jiong Lou
6c986e9d70
improve worm support ( #5983 )
* improve worm support
Signed-off-by: lou <alex1988@outlook.com>
* worm mode in filer
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* move to fs configure
Signed-off-by: lou <alex1988@outlook.com>
* remove flag
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* support worm hardlink
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* typo
Signed-off-by: lou <alex1988@outlook.com>
* sync filer conf
Signed-off-by: lou <alex1988@outlook.com>
---------
Signed-off-by: lou <alex1988@outlook.com>
1 year ago
Guang Jiong Lou
367e7638d7
fix invalid file read ( #6024 )
1 year ago
Eugeniy E. Mikhailov
0da9e40abb
Feature: compress before encryption ( #6013 )
1 year ago
Bruce
5428229347
fix file read crash ( #6021 )
1 year ago
zouyixiong
881c9a009e
[master] master missing start LoopPushingMetric routine fixed. ( #6018 )
1 year ago