Guang Jiong Lou
54b91ba2b2
fix permission check in put request ( #6142 )
2 months ago
dsd
1e13b6879c
fix(volume): to avoid duplicate write a same needle ( #6138 )
fix WriteNeedleBlob to avoid duplicate write a same needle
Co-authored-by: 邓书东 <shudong_deng@hhnb2024010108.intsig.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2 months ago
chrislu
f11567816e
Revert "fix: volume data integrity check ( #6118 )"
This reverts commit e12b9ab746
.
2 months ago
wusong
e12b9ab746
fix: volume data integrity check ( #6118 )
Co-authored-by: wang wusong <wangwusong@virtaitech.com>
2 months ago
steve.wei
cfbe45c765
feat: add in-flight metric for s3/file/volume-server ( #6120 )
2 months ago
chrislu
804e765397
remove unused
2 months ago
chrislu
6845e25318
set proxied request content length
2 months ago
chrislu
35fd1e1c9a
optimize memory usage for large number of volumes
1. unwrap the map to avoid extra map object creation
2. fix ec shard counting in UpdateEcShards
2 months ago
chrislu
b28b1a3402
3.77
2 months ago
chrislu
07df5c53de
avoid nil
I1010 03:10:25.220345 mount_std.go:281 This is SeaweedFS version 30GB 3.76 82ed61c655
linux amd64
^[OR^[OR2024/10/10 03:12:56 Unimplemented opcode POLL
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x28 pc=0x3983b41]
goroutine 112 [running]:
github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents.func2.mergeProceesors.1(0xc000513540)
/github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:30 +0x41
github.com/seaweedfs/seaweedfs/weed/pb.WithFilerClientFollowMetadata.makeSubscribeMetadataFunc.func1({0x514a560, 0xc0009b06d0})
/github/workspace/weed/pb/filer_pb_tail.go:87 +0x293
github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).WithFilerClient.func1.1(0xc000d9e008)
/github/workspace/weed/mount/wfs_filer_client.go:27 +0x68
github.com/seaweedfs/seaweedfs/weed/pb.WithGrpcClient(0xa9?, 0x9d1f90fb?, 0xc00098fbe0, {0xc000e1c078, 0x15}, 0x0?, {0xc000a76bd0?, 0x1?, 0x1?
})
/github/workspace/weed/pb/grpc_client_server.go:155 +0x33a
github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).WithFilerClient.func1()
/github/workspace/weed/mount/wfs_filer_client.go:25 +0x14c
github.com/seaweedfs/seaweedfs/weed/util.Retry({0x489a10c, 0xa}, 0xc00098fcf8)
/github/workspace/weed/util/retry.go:16 +0xa7
github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).WithFilerClient(0x0?, 0x30?, 0xc00056a568?)
/github/workspace/weed/mount/wfs_filer_client.go:18 +0x65
github.com/seaweedfs/seaweedfs/weed/pb.WithFilerClientFollowMetadata({0x50f5898, 0xc000e2c180}, 0xc00101e000, 0xc000d22030)
/github/workspace/weed/pb/filer_pb_tail.go:51 +0x87
github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents.func2()
/github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:115 +0xcb
github.com/seaweedfs/seaweedfs/weed/util.RetryUntil({0x48b8b35, 0x11}, 0xc00098fef0, 0x4af0048)
/github/workspace/weed/util/retry.go:64 +0x4e
github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents(0xc000d1d980, 0x9d1f90fb, {0x50f5898, 0xc000e2c180}, {0x7ffdf6f98dca,
0x4}, 0x17fcf8b7c7ecf8cf, {0xc0000ac208, 0x1, 0x1})
/github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:113 +0x39b
created by github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).StartBackgroundTasks in goroutine 1
/github/workspace/weed/mount/weedfs.go:150 +0x146
2 months ago
chrislu
82ed61c655
3.76
3 months ago
chrislu
c0e36231ad
use only one metadata follow process
3 months ago
Konstantin Lebedev
44b275879b
[s3] add {Get,Put,Delete}BucketTagging and PublicAccessBlock Handlers ( #6088 )
* add {Get,Put,Delete}BucketTagging Handlers
* s3 add skip bucket PublicAccessBlock handlers
---------
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
3 months ago
chrislu
a3a8f6217e
fix
3 months ago
chrislu
117c3aebda
3.75
3 months ago
Konstantin Lebedev
a3556acd98
[s3] add skip bucket encryption handlers ( #6091 )
s3 add skip bucket encryption handlers
3 months ago
Er2
5644bc8f01
s3api: Fix signature v4 with reverse proxy at sub-path ( #6092 )
3 months ago
chrislu
ff47956530
add helper functions
3 months ago
chrislu
11e53dd8ef
skip error if conf file is not created
3 months ago
chrislu
f747767aa1
support load balancer in front of s3
3 months ago
chrislu
7dd480acad
handle missing leading zero padding in replica
3 months ago
chrislu
e3fa87bcc1
3.74
3 months ago
chrislu
cdd7fa81ab
fix help message
3 months ago
chrislu
20929f2a57
adjust resource heavy for volume.fix.replication
3 months ago
chrislu
6564ceda91
skip resource heavy commands from running on master nodes
3 months ago
chrislu
ec30a504ba
refactor
3 months ago
chrislu
9cd263b2ce
refactor
3 months ago
chrislu
701abbb9df
add IsResourceHeavy() to command interface
3 months ago
coffeecloudgit
dad3a26fb6
Update volume_grpc_erasure_coding.go , fix no space left bug ( #6077 )
3 months ago
Konstantin Lebedev
bae93e611d
[filer] avoid 500 if table doesn't exist ( #6075 )
3 months ago
coffeecloudgit
6cbce110d5
Update volume_grpc_erasure_coding.go ( #6073 )
3 months ago
Neo
aa61824442
master:fix empty target in Build() ( #6069 )
3 months ago
Max Denushev
f1e700ce2f
Fix/copy before delete replication ( #6064 )
* fix(shell): volume.fix.replication misplaced volumes unsatisfying replication factor
* fix(shell): simplify replication check
* fix(shell): add test for satisfyReplicaCurrentLocation
3 months ago
steve.wei
ae8c6d95a6
fix: Prevent potential metadata change events from being lost. ( #6066 )
3 months ago
LHHDZ
4dc33cc143
fix unclaimed spaces calculation when volumePreallocate is enabled ( #6063 )
the calculation of `unclaimedSpaces` only needs to subtract `unusedSpace` when `preallocate` is not enabled.
Signed-off-by: LHHDZ <shichanglin5@qq.com>
3 months ago
Max Denushev
d056c0ddf2
fix(volume): don't persist RO state in specific cases ( #6058 )
* fix(volume): don't persist RO state in specific cases
* fix(volume): writable always persist
3 months ago
zemul
028ebb1d0d
Feat:merge small chunk ( #6049 )
* fix:mount deadlock
* feat: merge small chunk
* adjust MergeChunkMinCount
* fix
---------
Co-authored-by: zemul <zhouzemiao@ihuman.com>
3 months ago
chrislu
4ec6eab004
fix max volume count auto setting
related to https://github.com/seaweedfs/seaweedfs/issues/6041#issuecomment-2360448182
3 months ago
dsd
a3572999bb
Vol check disk bug ( #6044 )
* fix volume.check.disk
* ensure multiple replica sync
* add comment
---------
Co-authored-by: 邓书东 <shudong_deng@hhnb2024010108.intsig.com>
3 months ago
Konstantin Lebedev
6d4f5c94ac
[volume] remove truncate idx file if size not healthy ( #6043 )
3 months ago
chrislu
50e22864cf
refactor
3 months ago
chrislu
99ae99e3b9
fix nil filer conf
fix https://github.com/seaweedfs/seaweedfs/issues/6034
3 months ago
Konstantin Lebedev
2b13d2c083
[filer] fix return 204 for DELETE on entry not found ( #6023 )
fix return 204 for DELETE on entry not found
3 months ago
Guang Jiong Lou
6c986e9d70
improve worm support ( #5983 )
* improve worm support
Signed-off-by: lou <alex1988@outlook.com>
* worm mode in filer
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* move to fs configure
Signed-off-by: lou <alex1988@outlook.com>
* remove flag
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* support worm hardlink
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* typo
Signed-off-by: lou <alex1988@outlook.com>
* sync filer conf
Signed-off-by: lou <alex1988@outlook.com>
---------
Signed-off-by: lou <alex1988@outlook.com>
3 months ago
Guang Jiong Lou
367e7638d7
fix invalid file read ( #6024 )
3 months ago
Eugeniy E. Mikhailov
0da9e40abb
Feature: compress before encryption ( #6013 )
3 months ago
Bruce
5428229347
fix file read crash ( #6021 )
3 months ago
zouyixiong
881c9a009e
[master] master missing start LoopPushingMetric routine fixed. ( #6018 )
3 months ago
Aleksey Kosov
7340c62c47
changing FindEntry error handling in cassandra store ( #6015 )
3 months ago
chrislu
a9c9e1bcb3
refactor
3 months ago