seaweedfs

Commit Graph

Author	SHA1	Message	Date
qinguoyi	b74b506e52	add command backup destory volume error log (#5846 )	5 months ago
chrislu	8378a5b70b	rename	5 months ago
chrislu	d49ecde535	rename functions	5 months ago
zuzuviewer	5ee50d26d8	fix CVE-2016-2183 (#5844 ) * fix CVE-2016-2183 * allow tls.min_version and tls.max_version not set	5 months ago
chrislu	4fee496b49	conditional delete	5 months ago
wyang	31b89c1062	fsck: only check the appendNs of deleted needle (#5841 ) increase fsck speed Co-authored-by: Yang Wang <yangwang@weride.ai>	5 months ago
Konstantin Lebedev	b2ffcdaab2	[master] do sync grow request only if absolutely necessary (#5821 ) * do sync grow request only if absolutely necessary https://github.com/seaweedfs/seaweedfs/pull/5819 * remove check VolumeGrowStrategy Threshold on PickForWrite * fix fmt.Errorf	5 months ago
Jiffs Maverick	c8506609d8	[filer] Added a version to the title of Filer UI (#5836 ) Added a version to the title of Filer UI	5 months ago
Konstantin Lebedev	e1f9336688	[filer] fix panic filer on webdav.maxMB (#5822 ) fix panic filer on webdav.maxMB	5 months ago
wyang	4b1f539ab8	fix allocate reduplicated volumeId to different volume (#5811 ) * fix allocate reduplicated volumeId to different volume * only check barrier when read --------- Co-authored-by: Yang Wang <yangwang@weride.ai>	5 months ago
wyang	c1bffca246	fix evacuate volume to different disk types (#5530 ) Co-authored-by: wyang <wyang@wyangs-Air.lan>	5 months ago
chrislu	e2a07d11d5	Revert "Check `ShouldGrowVolumes` before returning error in assign. (#5819 )" This reverts commit `98d66338d0`.	5 months ago
wyang	0581ce6096	fix delete chunk failed if volumeSever specified grpc.port (#5820 ) Co-authored-by: Yang Wang <yangwang@weride.ai>	5 months ago
chrislu	ec9455dab7	same change as #5819 follow up with https://github.com/seaweedfs/seaweedfs/pull/5819	5 months ago
Ruoxi	d15966ae8e	Check `ShouldGrowVolumes` before returning error in assign. (#5819 )	5 months ago
Chris Lu	952afd810c	Fix dead lock (#5815 ) * reduce locks to avoid dead lock Flush->FlushData->uplloadPipeline.FluahAll uploaderCount>0 goroutine 1 [sync.Cond.Wait, 71 minutes]: sync.runtime_notifyListWait(0xc0007ae4d0, 0x0) /usr/local/go/src/runtime/sema.go:569 +0x159 sync.(Cond).Wait(0xc001a59290?) /usr/local/go/src/sync/cond.go:70 +0x85 github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(UploadPipeline).waitForCurrentWritersToComplete(0xc0002ee4d0) /github/workspace/weed/mount/page_writer/upload_pipeline_lock.go:58 +0x32 github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(UploadPipeline).FlushAll(0xc0002ee4d0) /github/workspace/weed/mount/page_writer/upload_pipeline.go:151 +0x25 github.com/seaweedfs/seaweedfs/weed/mount.(ChunkedDirtyPages).FlushData(0xc00087e840) /github/workspace/weed/mount/dirty_pages_chunked.go:54 +0x29 github.com/seaweedfs/seaweedfs/weed/mount.(PageWriter).FlushData(...) /github/workspace/weed/mount/page_writer.go:50 github.com/seaweedfs/seaweedfs/weed/mount.(WFS).doFlush(0xc0006ad600, 0xc00030d380, 0x0, 0x0) /github/workspace/weed/mount/weedfs_file_sync.go:101 +0x169 github.com/seaweedfs/seaweedfs/weed/mount.(WFS).Flush(0xc0006ad600, 0xc001a594a8?, 0xc0004c1ca0) /github/workspace/weed/mount/weedfs_file_sync.go:59 +0x48 github.com/hanwen/go-fuse/v2/fuse.doFlush(0xc0000da870?, 0xc0004c1b08) SaveContent -> MemChunk.RLock -> ChunkedDirtyPages.saveChunkedFileIntervalToStorage pages.fh.AddChunks([]filer_pb.FileChunk{chunk}) fh.entryLock.Lock() sync.(RWMutex).Lock(0x0?) /usr/local/go/src/sync/rwmutex.go:146 +0x31 github.com/seaweedfs/seaweedfs/weed/mount.(FileHandle).AddChunks(0xc00030d380, {0xc00028bdc8, 0x1, 0x1}) /github/workspace/weed/mount/filehandle.go:93 +0x45 github.com/seaweedfs/seaweedfs/weed/mount.(ChunkedDirtyPages).saveChunkedFileIntervalToStorage(0xc00087e840, {0x2be7ac0, 0xc00018d9e0}, 0x0, 0x121, 0x17e3c624565ace45, 0x1?) /github/workspace/weed/mount/dirty_pages_chunked.go:80 +0x2d4 github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(MemChunk).SaveContent(0xc0008d9130, 0xc0008093e0) /github/workspace/weed/mount/page_writer/page_chunk_mem.go:115 +0x112 github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(UploadPipeline).moveToSealed.func1() /github/workspace/weed/mount/page_writer/upload_pipeline.go:187 +0x55 github.com/seaweedfs/seaweedfs/weed/util.(LimitedConcurrentExecutor).Execute.func1() /github/workspace/weed/util/limited_executor.go:38 +0x62 created by github.com/seaweedfs/seaweedfs/weed/util.(LimitedConcurrentExecutor).Execute in goroutine 1 /github/workspace/weed/util/limited_executor.go:33 +0x97 On metadata update fh.entryLock.Lock() fh.dirtyPages.Destroy() up.chunksLock.Lock => each sealed chunk.FreeReference => MemChunk.Lock goroutine 134 [sync.RWMutex.Lock, 71 minutes]: sync.runtime_SemacquireRWMutex(0xc0007c3558?, 0xea?, 0x3fb0800?) /usr/local/go/src/runtime/sema.go:87 +0x25 sync.(RWMutex).Lock(0xc0007c35a8?) /usr/local/go/src/sync/rwmutex.go:151 +0x6a github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(MemChunk).FreeResource(0xc0008d9130) /github/workspace/weed/mount/page_writer/page_chunk_mem.go:38 +0x2a github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(SealedChunk).FreeReference(0xc00071cdb0, {0xc0006ba1a0, 0x20}) /github/workspace/weed/mount/page_writer/upload_pipeline.go:38 +0xb7 github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(UploadPipeline).Shutdown(0xc0002ee4d0) /github/workspace/weed/mount/page_writer/upload_pipeline.go:220 +0x185 github.com/seaweedfs/seaweedfs/weed/mount.(ChunkedDirtyPages).Destroy(0xc0008cea40?) /github/workspace/weed/mount/dirty_pages_chunked.go:87 +0x17 github.com/seaweedfs/seaweedfs/weed/mount.(PageWriter).Destroy(...) /github/workspace/weed/mount/page_writer.go:78 github.com/seaweedfs/seaweedfs/weed/mount.NewSeaweedFileSystem.func3({0xc00069a6c0, 0x30}, 0x6?) /github/workspace/weed/mount/weedfs.go:119 +0x17a github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.NewMetaCache.func1({0xc00069a6c0?, 0xc00069a480?}, 0x4015b40?) /github/workspace/weed/mount/meta_cache/meta_cache.go:37 +0x1c github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents.func1(0xc000661810) /github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:43 +0x570 use locked entry everywhere * modifiable remote entry * skip locking after getting lock from fhLockTable	5 months ago
chrislu	ed7e721efe	3.71	5 months ago
chrislu	9265be43c0	avoid nil	5 months ago
chrislu	4020149690	3.70	5 months ago
chrislu	9dd008f8f1	add version to filer	5 months ago
chrislu	9dcc576499	Revert "add collection for buckets" This reverts commit `96af571219`.	5 months ago
chrislu	aed2a18223	get, set and add path conf	5 months ago
chrislu	96af571219	add collection for buckets	5 months ago
chrislu	a8fa78b892	refactoring	5 months ago
chrislu	7a75928e7d	Azure sink: avoid overwriting existing files	5 months ago
vadimartynov	86d92a42b4	Added tls for http clients (#5766 ) * Added global http client * Added Do func for global http client * Changed the code to use the global http client * Fix http client in volume uploader * Fixed pkg name * Fixed http util funcs * Fixed http client for bench_filer_upload * Fixed http client for stress_filer_upload * Fixed http client for filer_server_handlers_proxy * Fixed http client for command_fs_merge_volumes * Fixed http client for command_fs_merge_volumes and command_volume_fsck * Fixed http client for s3api_server * Added init global client for main funcs * Rename global_client to client * Changed: - fixed NewHttpClient; - added CheckIsHttpsClientEnabled func - updated security.toml in scaffold * Reduce the visibility of some functions in the util/http/client pkg * Added the loadSecurityConfig function * Use util.LoadSecurityConfiguration() in NewHttpClient func	5 months ago
chrislu	c6dec11ea5	[filer.sync] skip overwriting existing fresh entry	5 months ago
chrislu	19d14b4c71	minor	5 months ago
vadimartynov	b796c21fa9	Added loadSecurityConfigOnce (#5792 )	5 months ago
Konstantin Lebedev	67edf1d014	[master] Do Automatic Volume Grow in background (#5781 ) * Do Automatic Volume Grow in backgound * pass lastGrowCount to master * fix build * fix count to uint64	5 months ago
wusong	ce61a66b65	Fix mmap write fail (#5791 ) * [mount] fix GetAttr blocks count Signed-off-by: wang wusong <wangwusong@virtaitech.com> * [mount] fix mmap read Signed-off-by: wang wusong <wangwusong@virtaitech.com> --------- Signed-off-by: wang wusong <wangwusong@virtaitech.com> Co-authored-by: wang wusong <wangwusong@virtaitech.com>	5 months ago
Dan	794a5aa67d	Add warning with hints to why a EC shard cant be moved (#5790 )	5 months ago
Konstantin Lebedev	a53e406c99	[master] refactor HasGrowRequest to atomic bool (#5782 ) refactor HasGrowRequest to atomit bool	5 months ago
Konstantin Lebedev	33964fa292	metrics stats of volume layout depends on the data center (#5775 ) stats volume layout depends on the data center	5 months ago
Konstantin Lebedev	04f4b10884	fix: avoid timeout if datacenter does not exist in topology (#5772 ) * fix: avoid timeout if datacenter does not exist in topology * fix: error msg * fix: rm dublicate check * fix: compare * revert minor change	5 months ago
chrislu	3a82f5ffad	ensure metadata follow a specific folder fix https://github.com/seaweedfs/seaweedfs/issues/5774	5 months ago
vadimartynov	ec9e7493b3	-metricsIp cmd flag (#5773 ) * Added/Updated: - Added metrics ip options for all servers; - Fixed a bug with the selection of the binIp or ip parameter for the metrics handler; * Fixed cmd flags	5 months ago
小羽	cb5dae0c9c	Fix "no more writable volumes" error when volume grows and master leader changed at the same time (#5771 )	5 months ago
小羽	e8537d7172	Different disk labels should not use the same DiskUsages instance while master received volume heatbeat (#5770 )	5 months ago
chrislu	4e7d8eb3f1	small refactoring	5 months ago
vadimartynov	de60f383de	Added tls for http handlers (#5764 ) * Added https handler for filer * Added example for security.toml	5 months ago
chrislu	2addcd1623	fix test	5 months ago
chrislu	590397229e	fix heap init	6 months ago
chrislu	06e3dd306f	clean up	6 months ago
chrislu	c59517e284	upgrade to github.com/redis/go-redis/v9 fix https://github.com/seaweedfs/seaweedfs/issues/4532	6 months ago
chrislu	33b11f92bc	Squashed commit of the following: commit `465b47b8f7` Merge: f39272b54 9c440d472 Author: chrislu <chris.lu@gmail.com> Date: Wed Jul 10 23:56:51 2024 -0700 Merge branch 'master' into merged-persisted-logs commit f39272b5416bdd4d1714ce3e99aded0fe62e7d89 Author: chrislu <chris.lu@gmail.com> Date: Wed Jul 10 23:49:26 2024 -0700 merge meta logs from multiple files	6 months ago
Konstantin Lebedev	9c440d472c	[s3] revert skip deletion error, since the error file was not found is already skipped on the side of the grpc function (#5760 ) * revert skip deletion error, since the error file was not found is already skipped on the side of the grpc function * fix response error * fix test_lifecycle_get * Revert "fix test_lifecycle_get" This reverts commit `8f991bdcf9`.	6 months ago
chrislu	182f6d00a9	always copy ecj files	6 months ago
Dan	bd54669d58	Detect underflow when calculating unused space (#5758 ) * Detect underflow when calculating unused space * Detect underflow when calculating unused space	6 months ago
chrislu	b8121e4b24	simplify	6 months ago

... 2 3 4 5 6 ...

7154 Commits (98b519b113955d1f9f26739707ba6d5ec83352cc)