270e91b0be
adds locking
9 months ago
b6fd1ff4ce
refactor
9 months ago
63c707f9c1
added access-control-expose-headers to put request ( #5876 )
9 months ago
e825dd7496
fix opposite logic
fix https://github.com/seaweedfs/seaweedfs/issues/5871
9 months ago
e069009f09
[remote.cache, remote.uncache] fix min/max age
fix https://github.com/seaweedfs/seaweedfs/issues/5871
9 months ago
9ca30e52d5
fuse mount handles ttl entries
fix https://github.com/seaweedfs/seaweedfs/issues/5527
9 months ago
2074e7db67
fix invalid toml
9 months ago
e86b0bcaaa
simplify
9 months ago
57dc39c451
randomizing next file handle id
9 months ago
3e6ca6e706
[webdav] status code 500 if internal error from filer ( #5865 )
9 months ago
ef4c555e90
[shell] volume.grow ( #5855 )
9 months ago
bf2366ba3a
Fix KeyMaterial nil bug ( #5849 )
9 months ago
e88da0be1b
Fix KeyMaterial nil bug ( #5848 )
9 months ago
606d0cba64
Fix extractToFile gz file nil bug ( #5847 )
9 months ago
b74b506e52
add command backup destory volume error log ( #5846 )
9 months ago
8378a5b70b
rename
9 months ago
d49ecde535
rename functions
9 months ago
5ee50d26d8
fix CVE-2016-2183 ( #5844 )
* fix CVE-2016-2183
* allow tls.min_version and tls.max_version not set
9 months ago
4fee496b49
conditional delete
9 months ago
31b89c1062
fsck: only check the appendNs of deleted needle ( #5841 )
increase fsck speed
Co-authored-by: Yang Wang <yangwang@weride.ai>
9 months ago
b2ffcdaab2
[master] do sync grow request only if absolutely necessary ( #5821 )
* do sync grow request only if absolutely necessary
https://github.com/seaweedfs/seaweedfs/pull/5819
* remove check VolumeGrowStrategy Threshold on PickForWrite
* fix fmt.Errorf
9 months ago
c8506609d8
[filer] Added a version to the title of Filer UI ( #5836 )
Added a version to the title of Filer UI
9 months ago
e1f9336688
[filer] fix panic filer on webdav.maxMB ( #5822 )
fix panic filer on webdav.maxMB
9 months ago
4b1f539ab8
fix allocate reduplicated volumeId to different volume ( #5811 )
* fix allocate reduplicated volumeId to different volume
* only check barrier when read
---------
Co-authored-by: Yang Wang <yangwang@weride.ai>
9 months ago
c1bffca246
fix evacuate volume to different disk types ( #5530 )
Co-authored-by: wyang <wyang@wyangs-Air.lan>
9 months ago
e2a07d11d5
Revert "Check `ShouldGrowVolumes` before returning error in assign. ( #5819 )"
This reverts commit 98d66338d0
9 months ago
0581ce6096
fix delete chunk failed if volumeSever specified grpc.port ( #5820 )
Co-authored-by: Yang Wang <yangwang@weride.ai>
9 months ago
ec9455dab7
same change as #5819
follow up with https://github.com/seaweedfs/seaweedfs/pull/5819
9 months ago
d15966ae8e
Check `ShouldGrowVolumes` before returning error in assign. ( #5819 )
9 months ago
952afd810c
Fix dead lock ( #5815 )
* reduce locks to avoid dead lock
Flush->FlushData->uplloadPipeline.FluahAll
uploaderCount>0
goroutine 1 [sync.Cond.Wait, 71 minutes]:
sync.runtime_notifyListWait(0xc0007ae4d0, 0x0)
/usr/local/go/src/runtime/sema.go:569 +0x159
sync.(*Cond).Wait(0xc001a59290?)
/usr/local/go/src/sync/cond.go:70 +0x85
github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(*UploadPipeline).waitForCurrentWritersToComplete(0xc0002ee4d0)
/github/workspace/weed/mount/page_writer/upload_pipeline_lock.go:58 +0x32
github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(*UploadPipeline).FlushAll(0xc0002ee4d0)
/github/workspace/weed/mount/page_writer/upload_pipeline.go:151 +0x25
github.com/seaweedfs/seaweedfs/weed/mount.(*ChunkedDirtyPages).FlushData(0xc00087e840)
/github/workspace/weed/mount/dirty_pages_chunked.go:54 +0x29
github.com/seaweedfs/seaweedfs/weed/mount.(*PageWriter).FlushData(...)
/github/workspace/weed/mount/page_writer.go:50
github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).doFlush(0xc0006ad600, 0xc00030d380, 0x0, 0x0)
/github/workspace/weed/mount/weedfs_file_sync.go:101 +0x169
github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).Flush(0xc0006ad600, 0xc001a594a8?, 0xc0004c1ca0)
/github/workspace/weed/mount/weedfs_file_sync.go:59 +0x48
github.com/hanwen/go-fuse/v2/fuse.doFlush(0xc0000da870?, 0xc0004c1b08)
SaveContent -> MemChunk.RLock ->
ChunkedDirtyPages.saveChunkedFileIntervalToStorage
pages.fh.AddChunks([]*filer_pb.FileChunk{chunk})
fh.entryLock.Lock()
sync.(*RWMutex).Lock(0x0?)
/usr/local/go/src/sync/rwmutex.go:146 +0x31
github.com/seaweedfs/seaweedfs/weed/mount.(*FileHandle).AddChunks(0xc00030d380, {0xc00028bdc8, 0x1, 0x1})
/github/workspace/weed/mount/filehandle.go:93 +0x45
github.com/seaweedfs/seaweedfs/weed/mount.(*ChunkedDirtyPages).saveChunkedFileIntervalToStorage(0xc00087e840, {0x2be7ac0, 0xc00018d9e0}, 0x0, 0x121, 0x17e3c624565ace45, 0x1?)
/github/workspace/weed/mount/dirty_pages_chunked.go:80 +0x2d4
github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(*MemChunk).SaveContent(0xc0008d9130, 0xc0008093e0)
/github/workspace/weed/mount/page_writer/page_chunk_mem.go:115 +0x112
github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(*UploadPipeline).moveToSealed.func1()
/github/workspace/weed/mount/page_writer/upload_pipeline.go:187 +0x55
github.com/seaweedfs/seaweedfs/weed/util.(*LimitedConcurrentExecutor).Execute.func1()
/github/workspace/weed/util/limited_executor.go:38 +0x62
created by github.com/seaweedfs/seaweedfs/weed/util.(*LimitedConcurrentExecutor).Execute in goroutine 1
/github/workspace/weed/util/limited_executor.go:33 +0x97
On metadata update
fh.entryLock.Lock()
fh.dirtyPages.Destroy()
up.chunksLock.Lock => each sealed chunk.FreeReference => MemChunk.Lock
goroutine 134 [sync.RWMutex.Lock, 71 minutes]:
sync.runtime_SemacquireRWMutex(0xc0007c3558?, 0xea?, 0x3fb0800?)
/usr/local/go/src/runtime/sema.go:87 +0x25
sync.(*RWMutex).Lock(0xc0007c35a8?)
/usr/local/go/src/sync/rwmutex.go:151 +0x6a
github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(*MemChunk).FreeResource(0xc0008d9130)
/github/workspace/weed/mount/page_writer/page_chunk_mem.go:38 +0x2a
github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(*SealedChunk).FreeReference(0xc00071cdb0, {0xc0006ba1a0, 0x20})
/github/workspace/weed/mount/page_writer/upload_pipeline.go:38 +0xb7
github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(*UploadPipeline).Shutdown(0xc0002ee4d0)
/github/workspace/weed/mount/page_writer/upload_pipeline.go:220 +0x185
github.com/seaweedfs/seaweedfs/weed/mount.(*ChunkedDirtyPages).Destroy(0xc0008cea40?)
/github/workspace/weed/mount/dirty_pages_chunked.go:87 +0x17
github.com/seaweedfs/seaweedfs/weed/mount.(*PageWriter).Destroy(...)
/github/workspace/weed/mount/page_writer.go:78
github.com/seaweedfs/seaweedfs/weed/mount.NewSeaweedFileSystem.func3({0xc00069a6c0, 0x30}, 0x6?)
/github/workspace/weed/mount/weedfs.go:119 +0x17a
github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.NewMetaCache.func1({0xc00069a6c0?, 0xc00069a480?}, 0x4015b40?)
/github/workspace/weed/mount/meta_cache/meta_cache.go:37 +0x1c
github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents.func1(0xc000661810)
/github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:43 +0x570
* use locked entry everywhere
* modifiable remote entry
* skip locking after getting lock from fhLockTable
9 months ago
ed7e721efe
3.71
9 months ago
9265be43c0
avoid nil
9 months ago
4020149690
3.70
9 months ago
9dd008f8f1
add version to filer
9 months ago
9dcc576499
Revert "add collection for buckets"
This reverts commit 96af571219
10 months ago
aed2a18223
get, set and add path conf
10 months ago
96af571219
add collection for buckets
10 months ago
a8fa78b892
refactoring
10 months ago
7a75928e7d
Azure sink: avoid overwriting existing files
10 months ago
86d92a42b4
Added tls for http clients ( #5766 )
* Added global http client
* Added Do func for global http client
* Changed the code to use the global http client
* Fix http client in volume uploader
* Fixed pkg name
* Fixed http util funcs
* Fixed http client for bench_filer_upload
* Fixed http client for stress_filer_upload
* Fixed http client for filer_server_handlers_proxy
* Fixed http client for command_fs_merge_volumes
* Fixed http client for command_fs_merge_volumes and command_volume_fsck
* Fixed http client for s3api_server
* Added init global client for main funcs
* Rename global_client to client
* Changed:
- fixed NewHttpClient;
- added CheckIsHttpsClientEnabled func
- updated security.toml in scaffold
* Reduce the visibility of some functions in the util/http/client pkg
* Added the loadSecurityConfig function
* Use util.LoadSecurityConfiguration() in NewHttpClient func
10 months ago
c6dec11ea5
[filer.sync] skip overwriting existing fresh entry
10 months ago
19d14b4c71
minor
10 months ago
b796c21fa9
Added loadSecurityConfigOnce ( #5792 )
10 months ago
67edf1d014
[master] Do Automatic Volume Grow in background ( #5781 )
* Do Automatic Volume Grow in backgound
* pass lastGrowCount to master
* fix build
* fix count to uint64
10 months ago
ce61a66b65
Fix mmap write fail ( #5791 )
* [mount] fix GetAttr blocks count
Signed-off-by: wang wusong <wangwusong@virtaitech.com>
* [mount] fix mmap read
Signed-off-by: wang wusong <wangwusong@virtaitech.com>
---------
Signed-off-by: wang wusong <wangwusong@virtaitech.com>
Co-authored-by: wang wusong <wangwusong@virtaitech.com>
10 months ago
794a5aa67d
Add warning with hints to why a EC shard cant be moved ( #5790 )
10 months ago
a53e406c99
[master] refactor HasGrowRequest to atomic bool ( #5782 )
refactor HasGrowRequest to atomit bool
10 months ago
33964fa292
metrics stats of volume layout depends on the data center ( #5775 )
stats volume layout depends on the data center
10 months ago
04f4b10884
fix: avoid timeout if datacenter does not exist in topology ( #5772 )
* fix: avoid timeout if datacenter does not exist in topology
* fix: error msg
* fix: rm dublicate check
* fix: compare
* revert minor change
10 months ago
3a82f5ffad
ensure metadata follow a specific folder
fix https://github.com/seaweedfs/seaweedfs/issues/5774
10 months ago
chrislu
Kamran Sarwar
Konstantin Lebedev
qinguoyi
zuzuviewer
wyang
Jiffs Maverick
Ruoxi
Chris Lu
vadimartynov
wusong
Dan