Chris Lu
ac875976c0
filer, volume: add concurrent upload size limit to avoid OOM
add some back pressure when writes are slow
4 years ago
李海
06be5dc6c3
log snowflake sequencer nodeid's hex when start, it'll be in part of new assigned fid
4 years ago
李海
69b2dab9c6
add a snowflake sequencer as more robust fid generator, but less compressable than small auto-inc id
4 years ago
Chris Lu
a801332b0d
filer: return 409 if file conflicts with a directory
fix https://github.com/chrislusf/seaweedfs/issues/1938
4 years ago
Chris Lu
5d931eff27
avoid possible nil
fix https://github.com/chrislusf/seaweedfs/issues/1928
The nil was because of `dn.Parent().UnlinkChildNode(dn.Id())` in topo.UnRegisterDataNode() function, when the dn leaves the cluster.
4 years ago
Chris Lu
f315eb2bb8
fix build error
4 years ago
Chris Lu
b465095db1
shell: add volume.check.disk to fix inconsistency for replicated volumes
fix https://github.com/chrislusf/seaweedfs/issues/1923
4 years ago
Chris Lu
b1a86cf808
s3: copy object to itself
fix https://github.com/chrislusf/seaweedfs/issues/1922
4 years ago
Konstantin Lebedev
06da02739d
CheckAllChunkViews() for HEAD requests only
4 years ago
Konstantin Lebedev
90510e3137
If WriteHeader is not called explicitly, the first call to Write
will trigger an implicit WriteHeader(http.StatusOK).
WriteHeader: Only one header may be written. Go does not currently!
4 years ago
Konstantin Lebedev
46b9f5cff4
add debug logging
4 years ago
Chris Lu
5d446673a6
fix error printing
4 years ago
Chris Lu
df72dc206d
stats collect chunk upload retry count
4 years ago
Chris Lu
8363be8548
trim out trailing return character
4 years ago
Chris Lu
400de380f4
volume server: support tcp direct put/get/delete
4 years ago
Chris Lu
e982b06bcd
support IPv6
4 years ago
Patrick Schmidt
5f7b024891
Show the real disk usage in stats calls
Currently the file size of only one volume location is taken into
account in the stats. This commit multiplies the disk usages by the
amount of nodes holding a replica of the volume.
This will yield the expected amount of disk usage and matches the
total size calculations from before.
4 years ago
Konstantin Lebedev
ee21c0042e
log error write entry
4 years ago
Chris Lu
7ba75e3d5a
filer: do not return no content for empty files
fix https://github.com/chrislusf/seaweedfs/issues/1831
fix https://github.com/chrislusf/seaweedfs/issues/1830
4 years ago
Chris Lu
30b30b8fe0
volume.tier.move: passing non-empty disk type
4 years ago
bingoohuang
ee7cdf3668
revert ErrXyz to ErrorXyz temporarily.
4 years ago
bingoohuang
a6d421508a
revert ErrXyz to ErrorXyz temporarily.
4 years ago
bingoohuang
7ffe736d20
renaming to ErrXyz
4 years ago
Chris Lu
73958e357d
add descriptive error if no free volumes
4 years ago
Chris Lu
c2ad6f1047
webdav add replication setting
fix https://github.com/chrislusf/seaweedfs/issues/1817
4 years ago
bingoohuang
eab6e31d34
use backticks instead of double quotes to avoid escaped additionally in regex
4 years ago
Chris Lu
3575d41009
go fmt
4 years ago
Chris Lu
6daa932f5c
refactoring to get master function, instead of passing master values directly
this will enable retrying later
4 years ago
Chris Lu
aa17311063
s3: set filename when uploading file chunks
4 years ago
Chris Lu
cd866664a8
skip JWT if fileId is empty
related to https://github.com/chrislusf/seaweedfs/issues/1808
4 years ago
Chris Lu
3fe628f04e
use hdd instead of empty string
4 years ago
Chris Lu
f8446b42ab
this can compile now!!!
4 years ago
Chris Lu
7ce647f27e
support customizable disk type
4 years ago
Chris Lu
4bd8a692d8
disk type can be generic tags
4 years ago
Chris Lu
487e435679
adjust http max idle connections per host
related to https://github.com/chrislusf/seaweedfs/issues/1802
4 years ago
Chris Lu
770393a48c
volume: add capability to change disk type when moving a volume
4 years ago
bingoohuang
7256902fb0
fix typo offset.ToAcutalOffset to offset.ToActualOffset
4 years ago
bingoohuang
94ea3bd3a5
renaming NeedleMapType to NeedleMapKind
4 years ago
Chris Lu
a331bbb3ae
filer: should return 204 on DELETE to nonexistent file
related to
https://github.com/chrislusf/seaweedfs/issues/1776
https://github.com/chrislusf/seaweedfs/issues/1160
4 years ago
Chris Lu
d67ccb66c0
webdav: can start together with "weed server" or "weed filer"
4 years ago
Chris Lu
76430790b9
webdav: cache to version specific folder
4 years ago
Chris Lu
d475c89fcc
go fmt
4 years ago
Chris Lu
990fa69bfe
add back AdjustedUrl() related code
4 years ago
Chris Lu
00707ec00f
mount: outsideContainerClusterMode proxy through filer
Running mount outside of the cluster would not need to expose all the volume servers to outside of the cluster. The chunk read and write will go through the filer.
4 years ago
Chris Lu
6ca10725b8
Revert "mount: when outside cluster network, use filer as proxy to access volume servers"
This reverts commit 096e088d7b
.
4 years ago
Chris Lu
096e088d7b
mount: when outside cluster network, use filer as proxy to access volume servers
4 years ago
Chris Lu
80b8692688
filer.sync: replicate outside of either cluster, only need to see filers
4 years ago
Chris Lu
f8dbb03bdd
filer: append operation returns final file size
4 years ago
Chris Lu
759482e2ac
filer: proxy all http methods to volume servers
4 years ago
Chris Lu
937cfacc01
filer: add "proxyToFileId" to reverse proxy to a volume server
4 years ago