Guo Lei
5b905fb2b7
Lazy loading ( #3958 )
* types packages is imported more than onece
* lazy-loading
* fix bugs
* fix bugs
* fix unit tests
* fix test error
* rename function
* unload ldb after initial startup
* Don't load ldb when starting volume server if ldbtimeout is set.
* remove uncessary unloadldb
* Update weed/command/server.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
* Update weed/command/volume.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: guol-fnst <goul-fnst@fujitsu.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2 years ago
chrislu
aae82dca6f
file name escape uri
fix https://github.com/seaweedfs/seaweedfs/issues/3969
2 years ago
chrislu
ea2637734a
refactor filer proto chunk variable from mtime to modified_ts_ns
2 years ago
Eric Yang
51d462f204
ADHOC: volume fsck using append at ns ( #3906 )
* ADHOC: volume fsck using append at ns
* nit
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2 years ago
liubaojiang
25471d579a
add md5 header when UploadData to replication in ReplicatedWrite ( #3881 )
2 years ago
chrislu
de286fe662
shell: volume.move handles volume moved to cloud tier
fix https://github.com/seaweedfs/seaweedfs/issues/3803
2 years ago
Konstantin Lebedev
2f72103c83
avoid load volume file with BytesOffset mismatch ( #3841 )
* avoid load volume file with BytesOffset mismatch
https://github.com/seaweedfs/seaweedfs/issues/2966
* set BytesOffset if has not VolumeInfoFile
* typos fail => failed
* exit if bytesOffset mismatch
2 years ago
Konstantin Lebedev
1f7e52c63e
vacuum metrics and force sync dst files ( #3832 )
2 years ago
zemul
a05725aea6
filer: get directory metadata ( #3833 )
2 years ago
LHHDZ
d21e2f523d
split `ExtAcpKey` to `ExtAmzOwnerKey` and `ExtAmzAclKey` to avoid unn… ( #3824 )
split `ExtAcpKey` to `ExtAmzOwnerKey` and `ExtAmzAclKey` to avoid unnecessary `json.Unmarshal()` call
Signed-off-by: changlin.shi <changlin.shi@ly.com>
Signed-off-by: changlin.shi <changlin.shi@ly.com>
2 years ago
Konstantin Lebedev
5db25a8f2a
metric shows who is currently blocking the cluster or not ( #3799 )
* master_admin_lock Shows whether cluster is locked now or not
https://github.com/seaweedfs/seaweedfs/issues/3452
* fix metric MasterAdminLock
2 years ago
Konstantin Lebedev
a522507f95
configure raft metrics ( #3798 )
2 years ago
Konstantin Lebedev
b9933d5589
master server graceful stop ( #3797 )
2 years ago
Konstantin Lebedev
36daa7709d
show raft leader via shell ( #3796 )
2 years ago
LHHDZ
3de1e19780
s3: sync bucket info from filer ( #3759 )
2 years ago
Konstantin Lebedev
301b678147
[volume] Add new volumes to HUP(reload) signal ( #3755 )
Add new volumes to HUP(reload) signal
2 years ago
jerebear12
190afcc3fd
Allow CORS on Filer ( #3750 )
Adjusted filer response headers
2 years ago
chrislu
b90d92fca9
grpc: watch metadata changes by directory
2 years ago
chrislu
23f3aea4cf
adjust logs
2 years ago
chrislu
10d5b4b32b
volume server: rename readBufferSize to readBufferSizeMB
2 years ago
Konstantin Lebedev
5d87ad72d8
mute log filer: no entry is found in filer store ( #3707 )
2 years ago
famosss
d949a238b8
volume: add "readBufSize" option to customize read optimization ( #3702 )
* simplify a bit
* feat: volume: add "readBufSize" option to customize read optimization
* refactor : redbufSIze -> readBufferSize
* simplify a bit
* simplify a bit
2 years ago
Ryan Russell
c4fc007630
refactor(raft_hashicorp): `timeSpeep` -> `timeSleep` ( #3694 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
Ryan Russell
c202d4c1b0
refactor(master_grpc_server_cluster): `seletedSet` -> `selectedSet` ( #3693 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
chrislu
896a85d6e4
volume: add "hasSlowRead" option to customize read optimization
2 years ago
Ryan Russell
92658b05a8
refactor(volume_grpc_client_to_master): `grpcConection` -> `grpcConne… ( #3690 )
refactor(volume_grpc_client_to_master): `grpcConection` -> `grpcConnection`
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
chrislu
21c0587900
go fmt
2 years ago
chrislu
c8645fd232
master: implement grpc VolumeMarkWritable
fix https://github.com/seaweedfs/seaweedfs/issues/3657
2 years ago
Ryan Russell
3429cbe3fc
refactor(webdav_server): `modifiledTime` -> `modifiedTime` ( #3676 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
Ryan Russell
d5239ab983
refactor(server): `suppported` -> `supported` ( #3677 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2 years ago
chrislu
58d18b68d8
rename variable
2 years ago
Konstantin Lebedev
f8ef25099c
Removing chunks on failed to write to replicas ( #3591 )
* Removing chunks on failed to write to replicas
https://github.com/seaweedfs/seaweedfs/issues/3578
* put with in the util.Retry
* just purge on any errors
2 years ago
chrislu
ce55922884
fixing
2 years ago
Konstantin Lebedev
721c6197f9
skip deltaBeat if dn is zero ( #3630 )
* skip deltaBeat
https://github.com/seaweedfs/seaweedfs/issues/3629
* fix GrpcPort
* skip url :0
* skip empty DataCenter or Rack
* skip empty heartbeat Ip
* dell msg add DataCenter
* comment todo
* fix
2 years ago
chrislu
b9112747b5
volume server: synchronously report volume readonly status to master
fix https://github.com/seaweedfs/seaweedfs/issues/3628
2 years ago
chrislu
9b084d4c88
purge tcp implementation
2 years ago
Konstantin Lebedev
31d2f77ceb
refactor https://github.com/seaweedfs/seaweedfs/pull/3616 ( #3625 )
2 years ago
chrislu
7e52b1e195
return err for processRangeRequest()
2 years ago
famosss
449582343f
fix:Sometimes a nil pointer exception is thrown ( #3618 )
2 years ago
famosss
9678fc2106
fix: volume heartbeat processing error ( #3616 )
2 years ago
famosss
5ff33eb558
fix: volume Deadlock when exception is thrown ( #3613 )
* fix: volume Deadlock when exception is thrown
* adjust log level
2 years ago
Eric Yang
b324a6536c
ADHOC: add read needle meta grpc ( #3581 )
* ADHOC: add read needle meta grpc
* add test
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2 years ago
Konstantin Lebedev
3c3682fcce
more log detail for upload err and deleting ( #3577 )
2 years ago
Konstantin Lebedev
5307cadb32
[s3] Replace code 500 to 499 for upload with ErrUnexpectedEOF ( #3597 )
2 years ago
famosss
7f56a40553
Turn down the 404 log level ( #3585 )
2 years ago
Konstantin Lebedev
90d55cd179
avoid data race read fileChunksSize ( #3570 )
https://github.com/seaweedfs/seaweedfs/issues/3557
2 years ago
Konstantin Lebedev
82c2ce74db
more error details in the log ( #3568 )
* more error details in the log
https://github.com/seaweedfs/seaweedfs/issues/3567
* format message
2 years ago
Konstantin Lebedev
77098de69a
migrate from boltdb to bbolt ( #3554 )
2 years ago
Konstantin Lebedev
105702ebe0
avoid data race access to uploadReaderToChunks.uploadErr ( #3550 )
avoid data race access to uploadErr
https://github.com/seaweedfs/seaweedfs/issues/3549
2 years ago
Rain Li
089446f5b1
Fix reload page before all file uploaded bug ( #3534 )
2 years ago