Konstantin Lebedev
c2269123d3
fix aws style Etag for chunks
4 years ago
Chris Lu
69694a17be
reverting 7d57664c2d
4 years ago
Chris Lu
7d57664c2d
mount: internals switch to filer.Entry instead of protobuf
4 years ago
Chris Lu
2b76854641
add "weed filer.cat" to read files directly from volume servers
4 years ago
Konstantin Lebedev
e4f2d9eb4a
We return etag using the same algorithm as aws s3
https://teppen.io/2018/06/23/aws_s3_etags/
4 years ago
Chris Lu
387ab6796f
filer: cross cluster synchronization
4 years ago
Chris Lu
eb7929a971
rename filer2 to filer
4 years ago
Chris Lu
99ecf63276
go fmt
4 years ago
Chris Lu
aee27ccbe1
multiple fixes
* adjust isOpen count
* move ContinuousDirtyPages lock to filehandle
* fix problem with MergeIntoVisibles, avoid reusing slices
* let filer delete the garbage
4 years ago
Chris Lu
d60bcbf08a
sorting chunks
4 years ago
Chris Lu
e72953dff7
logs
4 years ago
Chris Lu
2ba817afac
read randomly written data
4 years ago
Chris Lu
6111b265e7
fix compilation
4 years ago
Chris Lu
4a77f0820a
clean up logs
4 years ago
Chris Lu
8c9e6eaacd
fix tests
4 years ago
Chris Lu
1d9ea30b72
fix ViewFromVisibleIntervals
4 years ago
Chris Lu
c647deace1
file size support set file length
use Attr.FileSize and TotalChunkSize to determine file size
4 years ago
Chris Lu
97d97f3528
go code can read and write chunk manifest
4 years ago
Chris Lu
97239ce6f1
rename filechunk is_gzipped to is_compressed
5 years ago
Chris Lu
f282ed444b
refactoring
5 years ago
Chris Lu
dc08e4098f
add etag only for PUT or large chunked uploads
5 years ago
Chris Lu
ec2eb8bc48
add If-None-Match and If-Modified-Since
fix https://github.com/chrislusf/seaweedfs/issues/1269
5 years ago
Chris Lu
4aa82c95e6
refactor
5 years ago
Chris Lu
f06ca04451
avoid overflow
5 years ago
Chris Lu
ae2ee379c0
consistent 64bit size
5 years ago
Chris Lu
2e3f6ad3a9
filer: remember content is gzipped or not
5 years ago
Chris Lu
13e215ee5c
filer: option to encrypt data on volume server
5 years ago
j.laycock
6fc6322c90
Change joeslay paths to chrislusf paths
5 years ago
j.laycock
595a1beff0
Swap imports to use joeslay
5 years ago
Chris Lu
3fa1f150d9
refactoring
6 years ago
Chris Lu
be9a7592a1
incrementally calculate visible intervals
6 years ago
Chris Lu
832ac8129a
reduce pointer usage
6 years ago
Chris Lu
0388d421d2
caching visible intervals for read
speeds up 4x in single thread mode
speeds up 30% in 32 threads mode
6 years ago
Chris Lu
1bfb96f34d
optimization for reading whole chunk with gzip encoding
6 years ago
Chris Lu
86dd933596
go fmt
6 years ago
Chris Lu
e5ad2223a1
add missing intervals
fix https://github.com/chrislusf/seaweedfs/issues/774
6 years ago
Chris Lu
ee3fe07acf
fix sort bug
6 years ago
Chris Lu
469863f7f0
merge interval now is quite faster with reusing slices
6 years ago
Chris Lu
d2924c7748
merge intervals is a bit faster
6 years ago
Chris Lu
4fcfc9410f
cleanup
6 years ago
Chris Lu
9655dc9ca9
simpler logic
6 years ago
Chris Lu
296acc4a0a
go fmt
6 years ago
Chris Lu
164091c269
add s3 multipart upload
6 years ago
Chris Lu
07e0d13d2d
filer support reading multiple chunks, with range support
7 years ago
Chris Lu
8db9319a06
refactoring: go fmt, reorg
7 years ago
Chris Lu
8b0718ac92
go vet
7 years ago
Chris Lu
458ada173e
go fmt
7 years ago
Chris Lu
e18c7e160c
avoid empty chunk view
7 years ago
Chris Lu
d773e11c7a
file handler directly read from volume servers
this mostly works fine now!
next: need to cache files to local disk
7 years ago
Chris Lu
00d0274fd7
prepare to read from multiple file chunks
7 years ago