chrislu
81fdf3651b
grpc connection to filer add sw-client-id header
2 years ago
chrislu
6ede19e825
add a simple file replication progress bar
2 years ago
chrislu
6c7fe40305
filer sink retries reading file chunks, skipping missing chunks
if the file chunk is not available during replication time, the file is skipped
2 years ago
chrislu
ea2637734a
refactor filer proto chunk variable from mtime to modified_ts_ns
2 years ago
chrislu
ea271600ec
fix parameters
2 years ago
chrislu
0452ae6a6c
filer.sync: limit concurrency when fetching file chunks
fix https://github.com/seaweedfs/seaweedfs/issues/3787
2 years ago
askeipx
2e78a522ab
remove old raft servers if they don't answer to pings for too long ( #3398 )
* remove old raft servers if they don't answer to pings for too long
add ping durations as options
rename ping fields
fix some todos
get masters through masterclient
raft remove server from leader
use raft servers to ping them
CheckMastersAlive for hashicorp raft only
* prepare blocking ping
* pass waitForReady as param
* pass waitForReady through all functions
* waitForReady works
* refactor
* remove unneeded params
* rollback unneeded changes
* fix
2 years ago
chrislu
4081d50607
filer sink: retryable data chunk uploading
2 years ago
Konstantin Lebedev
4d08393b7c
filer prefer volume server in same data center ( #3405 )
* initial prefer same data center
https://github.com/seaweedfs/seaweedfs/issues/3404
* GetDataCenter
* prefer same data center for ReplicationSource
* GetDataCenterId
* remove glog
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
chrislu
9f9ef1340c
use streaming mode for long poll grpc calls
streaming mode would create separate grpc connections for each call.
this is to ensure the long poll connections are properly closed.
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
3 years ago
Chris Lu
6923af7280
refactoring
3 years ago
Chris Lu
8f8738867f
add retry to assign volume
fix https://github.com/chrislusf/seaweedfs/issues/2056
4 years ago
Chris Lu
990fa69bfe
add back AdjustedUrl() related code
4 years ago
Chris Lu
00707ec00f
mount: outsideContainerClusterMode proxy through filer
Running mount outside of the cluster would not need to expose all the volume servers to outside of the cluster. The chunk read and write will go through the filer.
4 years ago
Chris Lu
6ca10725b8
Revert "mount: when outside cluster network, use filer as proxy to access volume servers"
This reverts commit 096e088d7b
.
4 years ago
Chris Lu
096e088d7b
mount: when outside cluster network, use filer as proxy to access volume servers
4 years ago
Chris Lu
80b8692688
filer.sync: replicate outside of either cluster, only need to see filers
4 years ago
Chris Lu
1bf22c0b5b
go fmt
4 years ago
Chris Lu
0d2ec832e2
rename from volumeType to diskType
4 years ago
Chris Lu
e9cd798bd3
adding volume type
4 years ago
Chris Lu
e219c57849
passing full path when assign volume locations
4 years ago
Chris Lu
f375b93aef
renaming
4 years ago
Chris Lu
723ae11db4
refactoring in order to adjust volume server url later
4 years ago
Chris Lu
4fc0bd1a81
return http response directly
4 years ago
Chris Lu
97239ce6f1
rename filechunk is_gzipped to is_compressed
5 years ago
Chris Lu
ed3cf811f5
refactoring
5 years ago
Chris Lu
eedd33dda3
refactoring
5 years ago
Chris Lu
b97768c51c
refactoring
5 years ago
Chris Lu
bec6ec7db6
go fmt
5 years ago
HongyanShen
81610ed006
fix : #1226
5 years ago
Chris Lu
2e3f6ad3a9
filer: remember content is gzipped or not
5 years ago
Chris Lu
13e215ee5c
filer: option to encrypt data on volume server
5 years ago
Chris Lu
f90c43635d
refactoring
5 years ago
Chris Lu
892e726eb9
avoid reusing context object
fix https://github.com/chrislusf/seaweedfs/issues/1182
5 years ago
Chris Lu
0841bedb15
move filer assign volume grpc errror to response
5 years ago
Chris Lu
6ab7368ef2
filer: dynamically create bucket under /buckets folder
5 years ago
Chris Lu
72a64a5cf8
use the same context object in order to retry
5 years ago
j.laycock
6fc6322c90
Change joeslay paths to chrislusf paths
5 years ago
j.laycock
595a1beff0
Swap imports to use joeslay
5 years ago
Chris Lu
3fa1f150d9
refactoring
6 years ago
Chris Lu
c789b496d8
use cached grpc client
6 years ago
Chris Lu
55bab1b456
add context.Context
6 years ago
Chris Lu
77b9af531d
adding grpc mutual tls
6 years ago
Chris Lu
157c0f7c01
add jwt for writes
6 years ago
Chris Lu
9fe24991d5
refactoring
6 years ago
Chris Lu
d3e1f20dcc
adjust log level
6 years ago
Chris Lu
db69ce89f0
go fmt
6 years ago
Chris Lu
a6cfaba018
able to sync the changes
6 years ago