seaweedfs

Commit Graph

Author	SHA1	Message	Date
wusong	e12b9ab746	fix: volume data integrity check (#6118 ) Co-authored-by: wang wusong <wangwusong@virtaitech.com>	2 months ago
steve.wei	cfbe45c765	feat: add in-flight metric for s3/file/volume-server (#6120 )	2 months ago
chrislu	804e765397	remove unused	2 months ago
chrislu	6845e25318	set proxied request content length	2 months ago
chrislu	35fd1e1c9a	optimize memory usage for large number of volumes 1. unwrap the map to avoid extra map object creation 2. fix ec shard counting in UpdateEcShards	2 months ago
chrislu	b28b1a3402	3.77	2 months ago
chrislu	07df5c53de	avoid nil I1010 03:10:25.220345 mount_std.go:281 This is SeaweedFS version 30GB 3.76 `82ed61c655` linux amd64 ^[OR^[OR2024/10/10 03:12:56 Unimplemented opcode POLL panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x1 addr=0x28 pc=0x3983b41] goroutine 112 [running]: github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents.func2.mergeProceesors.1(0xc000513540) /github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:30 +0x41 github.com/seaweedfs/seaweedfs/weed/pb.WithFilerClientFollowMetadata.makeSubscribeMetadataFunc.func1({0x514a560, 0xc0009b06d0}) /github/workspace/weed/pb/filer_pb_tail.go:87 +0x293 github.com/seaweedfs/seaweedfs/weed/mount.(WFS).WithFilerClient.func1.1(0xc000d9e008) /github/workspace/weed/mount/wfs_filer_client.go:27 +0x68 github.com/seaweedfs/seaweedfs/weed/pb.WithGrpcClient(0xa9?, 0x9d1f90fb?, 0xc00098fbe0, {0xc000e1c078, 0x15}, 0x0?, {0xc000a76bd0?, 0x1?, 0x1? }) /github/workspace/weed/pb/grpc_client_server.go:155 +0x33a github.com/seaweedfs/seaweedfs/weed/mount.(WFS).WithFilerClient.func1() /github/workspace/weed/mount/wfs_filer_client.go:25 +0x14c github.com/seaweedfs/seaweedfs/weed/util.Retry({0x489a10c, 0xa}, 0xc00098fcf8) /github/workspace/weed/util/retry.go:16 +0xa7 github.com/seaweedfs/seaweedfs/weed/mount.(WFS).WithFilerClient(0x0?, 0x30?, 0xc00056a568?) /github/workspace/weed/mount/wfs_filer_client.go:18 +0x65 github.com/seaweedfs/seaweedfs/weed/pb.WithFilerClientFollowMetadata({0x50f5898, 0xc000e2c180}, 0xc00101e000, 0xc000d22030) /github/workspace/weed/pb/filer_pb_tail.go:51 +0x87 github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents.func2() /github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:115 +0xcb github.com/seaweedfs/seaweedfs/weed/util.RetryUntil({0x48b8b35, 0x11}, 0xc00098fef0, 0x4af0048) /github/workspace/weed/util/retry.go:64 +0x4e github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents(0xc000d1d980, 0x9d1f90fb, {0x50f5898, 0xc000e2c180}, {0x7ffdf6f98dca, 0x4}, 0x17fcf8b7c7ecf8cf, {0xc0000ac208, 0x1, 0x1}) /github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:113 +0x39b created by github.com/seaweedfs/seaweedfs/weed/mount.(WFS).StartBackgroundTasks in goroutine 1 /github/workspace/weed/mount/weedfs.go:150 +0x146	2 months ago
chrislu	82ed61c655	3.76	3 months ago
chrislu	c0e36231ad	use only one metadata follow process	3 months ago
Konstantin Lebedev	44b275879b	[s3] add {Get,Put,Delete}BucketTagging and PublicAccessBlock Handlers (#6088 ) * add {Get,Put,Delete}BucketTagging Handlers * s3 add skip bucket PublicAccessBlock handlers --------- Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>	3 months ago
chrislu	a3a8f6217e	fix	3 months ago
chrislu	117c3aebda	3.75	3 months ago
Konstantin Lebedev	a3556acd98	[s3] add skip bucket encryption handlers (#6091 ) s3 add skip bucket encryption handlers	3 months ago
Er2	5644bc8f01	s3api: Fix signature v4 with reverse proxy at sub-path (#6092 )	3 months ago
chrislu	ff47956530	add helper functions	3 months ago
chrislu	11e53dd8ef	skip error if conf file is not created	3 months ago
chrislu	f747767aa1	support load balancer in front of s3	3 months ago
chrislu	7dd480acad	handle missing leading zero padding in replica	3 months ago
chrislu	e3fa87bcc1	3.74	3 months ago
chrislu	cdd7fa81ab	fix help message	3 months ago
chrislu	20929f2a57	adjust resource heavy for volume.fix.replication	3 months ago
chrislu	6564ceda91	skip resource heavy commands from running on master nodes	3 months ago
chrislu	ec30a504ba	refactor	3 months ago
chrislu	9cd263b2ce	refactor	3 months ago
chrislu	701abbb9df	add IsResourceHeavy() to command interface	3 months ago
coffeecloudgit	dad3a26fb6	Update volume_grpc_erasure_coding.go , fix no space left bug (#6077 )	3 months ago
Konstantin Lebedev	bae93e611d	[filer] avoid 500 if table doesn't exist (#6075 )	3 months ago
coffeecloudgit	6cbce110d5	Update volume_grpc_erasure_coding.go (#6073 )	3 months ago
Neo	aa61824442	master:fix empty target in Build() (#6069 )	3 months ago
Max Denushev	f1e700ce2f	Fix/copy before delete replication (#6064 ) * fix(shell): volume.fix.replication misplaced volumes unsatisfying replication factor * fix(shell): simplify replication check * fix(shell): add test for satisfyReplicaCurrentLocation	3 months ago
steve.wei	ae8c6d95a6	fix: Prevent potential metadata change events from being lost. (#6066 )	3 months ago
LHHDZ	4dc33cc143	fix unclaimed spaces calculation when volumePreallocate is enabled (#6063 ) the calculation of `unclaimedSpaces` only needs to subtract `unusedSpace` when `preallocate` is not enabled. Signed-off-by: LHHDZ <shichanglin5@qq.com>	3 months ago
Max Denushev	d056c0ddf2	fix(volume): don't persist RO state in specific cases (#6058 ) * fix(volume): don't persist RO state in specific cases * fix(volume): writable always persist	3 months ago
zemul	028ebb1d0d	Feat:merge small chunk (#6049 ) * fix:mount deadlock * feat: merge small chunk * adjust MergeChunkMinCount * fix --------- Co-authored-by: zemul <zhouzemiao@ihuman.com>	3 months ago
chrislu	4ec6eab004	fix max volume count auto setting related to https://github.com/seaweedfs/seaweedfs/issues/6041#issuecomment-2360448182	3 months ago
dsd	a3572999bb	Vol check disk bug (#6044 ) * fix volume.check.disk * ensure multiple replica sync * add comment --------- Co-authored-by: 邓书东 <shudong_deng@hhnb2024010108.intsig.com>	3 months ago
Konstantin Lebedev	6d4f5c94ac	[volume] remove truncate idx file if size not healthy (#6043 )	3 months ago
chrislu	50e22864cf	refactor	3 months ago
chrislu	99ae99e3b9	fix nil filer conf fix https://github.com/seaweedfs/seaweedfs/issues/6034	3 months ago
Konstantin Lebedev	2b13d2c083	[filer] fix return 204 for DELETE on entry not found (#6023 ) fix return 204 for DELETE on entry not found	3 months ago
Guang Jiong Lou	6c986e9d70	improve worm support (#5983 ) * improve worm support Signed-off-by: lou <alex1988@outlook.com> * worm mode in filer Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * move to fs configure Signed-off-by: lou <alex1988@outlook.com> * remove flag Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * support worm hardlink Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * typo Signed-off-by: lou <alex1988@outlook.com> * sync filer conf Signed-off-by: lou <alex1988@outlook.com> --------- Signed-off-by: lou <alex1988@outlook.com>	3 months ago
Guang Jiong Lou	367e7638d7	fix invalid file read (#6024 )	3 months ago
Eugeniy E. Mikhailov	0da9e40abb	Feature: compress before encryption (#6013 )	3 months ago
Bruce	5428229347	fix file read crash (#6021 )	3 months ago
zouyixiong	881c9a009e	[master] master missing start LoopPushingMetric routine fixed. (#6018 )	3 months ago
Aleksey Kosov	7340c62c47	changing FindEntry error handling in cassandra store (#6015 )	3 months ago
chrislu	a9c9e1bcb3	refactor	3 months ago
chrislu	6063a889ed	3.73	3 months ago
Eugeniy E. Mikhailov	dab0bb8097	Feature limit caching to prescribed number of bytes per file (#6009 ) * feature: we can check if a fileId is already in the cache We using this to protect cache from adding the same needle to the cache over and over. * fuse mount: Do not start dowloader if needle is already in the cache * added maxFilePartSizeInCache property to ChunkCache If file very large only first maxFilePartSizeInCache bytes are going to be put to the cache (subject to the needle size constrains). * feature: for large files put in cache no more than prescribed number of bytes Before this patch only the first needle of a large file was intended for caching. This patch uses maximum prescribed amount of bytes to be put in cache. This allows to bypass default 2MB maximum for a file part stored in the cache. * added dummy mock methods to satisfy interfaces of ChunkCache	3 months ago
dsd	151f2ff7a9	prevent dead loop for followers of master node (#6007 ) * prevent dead loop for followers of master node * fix comments --------- Co-authored-by: levi <344887649@foxmail.com>	3 months ago

1 2 3 4 5 ...

7125 Commits (7bd638de4706c0ebbe0391232b38c04d17756d81)