seaweedfs

Commit Graph

Author	SHA1	Message	Date
chrislu	6845e25318	set proxied request content length	2 months ago
chrislu	35fd1e1c9a	optimize memory usage for large number of volumes 1. unwrap the map to avoid extra map object creation 2. fix ec shard counting in UpdateEcShards	2 months ago
chrislu	b28b1a3402	3.77	2 months ago
chrislu	07df5c53de	avoid nil I1010 03:10:25.220345 mount_std.go:281 This is SeaweedFS version 30GB 3.76 `82ed61c655` linux amd64 ^[OR^[OR2024/10/10 03:12:56 Unimplemented opcode POLL panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x1 addr=0x28 pc=0x3983b41] goroutine 112 [running]: github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents.func2.mergeProceesors.1(0xc000513540) /github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:30 +0x41 github.com/seaweedfs/seaweedfs/weed/pb.WithFilerClientFollowMetadata.makeSubscribeMetadataFunc.func1({0x514a560, 0xc0009b06d0}) /github/workspace/weed/pb/filer_pb_tail.go:87 +0x293 github.com/seaweedfs/seaweedfs/weed/mount.(WFS).WithFilerClient.func1.1(0xc000d9e008) /github/workspace/weed/mount/wfs_filer_client.go:27 +0x68 github.com/seaweedfs/seaweedfs/weed/pb.WithGrpcClient(0xa9?, 0x9d1f90fb?, 0xc00098fbe0, {0xc000e1c078, 0x15}, 0x0?, {0xc000a76bd0?, 0x1?, 0x1? }) /github/workspace/weed/pb/grpc_client_server.go:155 +0x33a github.com/seaweedfs/seaweedfs/weed/mount.(WFS).WithFilerClient.func1() /github/workspace/weed/mount/wfs_filer_client.go:25 +0x14c github.com/seaweedfs/seaweedfs/weed/util.Retry({0x489a10c, 0xa}, 0xc00098fcf8) /github/workspace/weed/util/retry.go:16 +0xa7 github.com/seaweedfs/seaweedfs/weed/mount.(WFS).WithFilerClient(0x0?, 0x30?, 0xc00056a568?) /github/workspace/weed/mount/wfs_filer_client.go:18 +0x65 github.com/seaweedfs/seaweedfs/weed/pb.WithFilerClientFollowMetadata({0x50f5898, 0xc000e2c180}, 0xc00101e000, 0xc000d22030) /github/workspace/weed/pb/filer_pb_tail.go:51 +0x87 github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents.func2() /github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:115 +0xcb github.com/seaweedfs/seaweedfs/weed/util.RetryUntil({0x48b8b35, 0x11}, 0xc00098fef0, 0x4af0048) /github/workspace/weed/util/retry.go:64 +0x4e github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents(0xc000d1d980, 0x9d1f90fb, {0x50f5898, 0xc000e2c180}, {0x7ffdf6f98dca, 0x4}, 0x17fcf8b7c7ecf8cf, {0xc0000ac208, 0x1, 0x1}) /github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:113 +0x39b created by github.com/seaweedfs/seaweedfs/weed/mount.(WFS).StartBackgroundTasks in goroutine 1 /github/workspace/weed/mount/weedfs.go:150 +0x146	2 months ago
chrislu	82ed61c655	3.76	3 months ago
chrislu	c0e36231ad	use only one metadata follow process	3 months ago
Konstantin Lebedev	44b275879b	[s3] add {Get,Put,Delete}BucketTagging and PublicAccessBlock Handlers (#6088 ) * add {Get,Put,Delete}BucketTagging Handlers * s3 add skip bucket PublicAccessBlock handlers --------- Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>	3 months ago
chrislu	a3a8f6217e	fix	3 months ago
chrislu	117c3aebda	3.75	3 months ago
Konstantin Lebedev	a3556acd98	[s3] add skip bucket encryption handlers (#6091 ) s3 add skip bucket encryption handlers	3 months ago
Er2	5644bc8f01	s3api: Fix signature v4 with reverse proxy at sub-path (#6092 )	3 months ago
chrislu	ff47956530	add helper functions	3 months ago
chrislu	11e53dd8ef	skip error if conf file is not created	3 months ago
chrislu	f747767aa1	support load balancer in front of s3	3 months ago
chrislu	7dd480acad	handle missing leading zero padding in replica	3 months ago
chrislu	e3fa87bcc1	3.74	3 months ago
chrislu	cdd7fa81ab	fix help message	3 months ago
chrislu	20929f2a57	adjust resource heavy for volume.fix.replication	3 months ago
chrislu	6564ceda91	skip resource heavy commands from running on master nodes	3 months ago
chrislu	ec30a504ba	refactor	3 months ago
chrislu	9cd263b2ce	refactor	3 months ago
chrislu	701abbb9df	add IsResourceHeavy() to command interface	3 months ago
coffeecloudgit	dad3a26fb6	Update volume_grpc_erasure_coding.go , fix no space left bug (#6077 )	3 months ago
Konstantin Lebedev	bae93e611d	[filer] avoid 500 if table doesn't exist (#6075 )	3 months ago
coffeecloudgit	6cbce110d5	Update volume_grpc_erasure_coding.go (#6073 )	3 months ago
Neo	aa61824442	master:fix empty target in Build() (#6069 )	3 months ago
Max Denushev	f1e700ce2f	Fix/copy before delete replication (#6064 ) * fix(shell): volume.fix.replication misplaced volumes unsatisfying replication factor * fix(shell): simplify replication check * fix(shell): add test for satisfyReplicaCurrentLocation	3 months ago
steve.wei	ae8c6d95a6	fix: Prevent potential metadata change events from being lost. (#6066 )	3 months ago
LHHDZ	4dc33cc143	fix unclaimed spaces calculation when volumePreallocate is enabled (#6063 ) the calculation of `unclaimedSpaces` only needs to subtract `unusedSpace` when `preallocate` is not enabled. Signed-off-by: LHHDZ <shichanglin5@qq.com>	3 months ago
Max Denushev	d056c0ddf2	fix(volume): don't persist RO state in specific cases (#6058 ) * fix(volume): don't persist RO state in specific cases * fix(volume): writable always persist	3 months ago
zemul	028ebb1d0d	Feat:merge small chunk (#6049 ) * fix:mount deadlock * feat: merge small chunk * adjust MergeChunkMinCount * fix --------- Co-authored-by: zemul <zhouzemiao@ihuman.com>	3 months ago
chrislu	4ec6eab004	fix max volume count auto setting related to https://github.com/seaweedfs/seaweedfs/issues/6041#issuecomment-2360448182	3 months ago
dsd	a3572999bb	Vol check disk bug (#6044 ) * fix volume.check.disk * ensure multiple replica sync * add comment --------- Co-authored-by: 邓书东 <shudong_deng@hhnb2024010108.intsig.com>	3 months ago
Konstantin Lebedev	6d4f5c94ac	[volume] remove truncate idx file if size not healthy (#6043 )	3 months ago
chrislu	50e22864cf	refactor	3 months ago
chrislu	99ae99e3b9	fix nil filer conf fix https://github.com/seaweedfs/seaweedfs/issues/6034	3 months ago
Konstantin Lebedev	2b13d2c083	[filer] fix return 204 for DELETE on entry not found (#6023 ) fix return 204 for DELETE on entry not found	3 months ago
Guang Jiong Lou	6c986e9d70	improve worm support (#5983 ) * improve worm support Signed-off-by: lou <alex1988@outlook.com> * worm mode in filer Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * move to fs configure Signed-off-by: lou <alex1988@outlook.com> * remove flag Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * support worm hardlink Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * typo Signed-off-by: lou <alex1988@outlook.com> * sync filer conf Signed-off-by: lou <alex1988@outlook.com> --------- Signed-off-by: lou <alex1988@outlook.com>	3 months ago
Guang Jiong Lou	367e7638d7	fix invalid file read (#6024 )	3 months ago
Eugeniy E. Mikhailov	0da9e40abb	Feature: compress before encryption (#6013 )	3 months ago
Bruce	5428229347	fix file read crash (#6021 )	3 months ago
zouyixiong	881c9a009e	[master] master missing start LoopPushingMetric routine fixed. (#6018 )	3 months ago
Aleksey Kosov	7340c62c47	changing FindEntry error handling in cassandra store (#6015 )	3 months ago
chrislu	a9c9e1bcb3	refactor	3 months ago
chrislu	6063a889ed	3.73	3 months ago
Eugeniy E. Mikhailov	dab0bb8097	Feature limit caching to prescribed number of bytes per file (#6009 ) * feature: we can check if a fileId is already in the cache We using this to protect cache from adding the same needle to the cache over and over. * fuse mount: Do not start dowloader if needle is already in the cache * added maxFilePartSizeInCache property to ChunkCache If file very large only first maxFilePartSizeInCache bytes are going to be put to the cache (subject to the needle size constrains). * feature: for large files put in cache no more than prescribed number of bytes Before this patch only the first needle of a large file was intended for caching. This patch uses maximum prescribed amount of bytes to be put in cache. This allows to bypass default 2MB maximum for a file part stored in the cache. * added dummy mock methods to satisfy interfaces of ChunkCache	3 months ago
dsd	151f2ff7a9	prevent dead loop for followers of master node (#6007 ) * prevent dead loop for followers of master node * fix comments --------- Co-authored-by: levi <344887649@foxmail.com>	3 months ago
dsd	3b840c20e3	change math/rand => math/rand/v2 in volume_layout.go where is a perfo… (#6006 )	3 months ago
Eugeniy E. Mikhailov	c04edeed68	bug fix in the data received from cache processing (#6002 ) The patch addresses #3745. The cache should return the exact amount of data requested by the buffer. By construction of the cache it is always all requested data range or we have error happening. The old use of minsize miscalculate the requested data size, if non zero offset is requested.	3 months ago
chrislu	d660d5c7d4	increasing default cache size	3 months ago

1 2 3 4 5 ...

7222 Commits (7a92b2cbb91a2786c2c6e4efc878862a8c3a29d8)