Chris Lu
28ac536280
fix: normalize Windows backslash paths in weed admin file uploads ( #7636 )
fix: normalize Windows backslash paths in file uploads
When uploading files from a Windows client to a Linux server,
file paths containing backslashes were not being properly interpreted as
directory separators. This caused files intended for subdirectories to be
created in the root directory with backslashes in their filenames.
Changes:
- Add util.CleanWindowsPath and util.CleanWindowsPathBase helper functions
in weed/util/fullpath.go for reusable path normalization
- Use path.Join/path.Clean/path.Base instead of filepath equivalents
for URL path semantics (filepath is OS-specific)
- Apply normalization in weed admin handlers and filer upload parsing
Fixes #7628
3 weeks ago
Chris Lu
69553e5ba6
convert error fromating to %w everywhere ( #6995 )
6 months ago
chrislu
d2be5822a1
refactoring
7 months ago
chrislu
e71d681fee
refactor
7 months ago
chrislu
7c4d98446b
refactor
7 months ago
chrislu
f27e195354
refactoring
7 months ago
chrislu
33ecc8442e
refactor
7 months ago
chrislu
60f11f6510
add a readme file for volume needle data layout
7 months ago
chrislu
61c4f01e05
refactor
7 months ago
chrislu
a489d99333
fix tests
7 months ago
chrislu
7439af0eca
refactoring
7 months ago
chrislu
cc135c63f7
a bit refactoring
7 months ago
chrislu
c4695fc3b3
refactor needle write for different versions
7 months ago
dongxufeng
ff878a542d
correctly report volume with input/output error to master ( #6790 )
* correctly capture io error and report to master
* code fix
* check io error by error.Is
---------
Co-authored-by: dongxu_feng <dongxu_feng@intsig.net>
8 months ago
bwlfhu
0e08b83521
Fix volume ttl ( #6683 )
9 months ago
chrislu
c9f3448692
ReadAt may return io.EOF t end of file
related to https://github.com/seaweedfs/seaweedfs/issues/6219
1 year ago
chrislu
be09d08eb6
adjust error message
1 year ago
Kevin Bulteel
4a0dc883cf
Fix/parse upload filename ( #6241 )
* fix: parse filename in PUT + refactor
* fix: master iu public url with http
* fix: better parsing and handle disposition header
* fix: take mime type from file extension if not set
1 year ago
Eugeniy E. Mikhailov
3003c9e17e
added backward compatible CRC check and extra explanatory comments ( #6233 )
1 year ago
augustazz
0b00706454
EC volume supports expiration and displays expiration message when executing volume.list ( #5895 )
* ec volume expire
* volume.list show DestroyTime
* comments
* code optimization
---------
Co-authored-by: xuwenfeng <xuwenfeng1@zto.com>
1 year ago
Konstantin Lebedev
5ffacbb6ea
refactor all methods strings to const ( #5726 )
2 years ago
Kevin Bulteel
a3dab1fcd0
feat: upload files directly without multipart/form-data ( #5539 )
2 years ago
Konstantin Lebedev
5189a09de0
[volume] Reduce the number of buffers for uploading one chunk ( #5458 )
2 years ago
skycope
316ae45795
can vacuum volume when size mismatch ( #5200 )
Co-authored-by: Yang Wang <yangwang@weride.ai>
2 years ago
skycope
0e8a54f6f6
fix write volume over size MaxPossibleVolumeSize ( #5190 )
Co-authored-by: Yang Wang <yangwang@weride.ai>
2 years ago
Konstantin Lebedev
a7fc723ae0
chore: add status code for request_total metrics ( #5188 )
2 years ago
zemul
bd6f2716d3
fix_read_tomb_needle_meta ( #4263 )
Co-authored-by: zemul <zhouzemiao@ihuman.com>
3 years ago
Eric Yang
51d462f204
ADHOC: volume fsck using append at ns ( #3906 )
* ADHOC: volume fsck using append at ns
* nit
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
3 years ago
Konstantin Lebedev
6253058d9d
ensure monotonic n.AppendAtNs in each place ( #3880 )
https://github.com/seaweedfs/seaweedfs/issues/3852
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
3 years ago
Konstantin Lebedev
452202f35b
ReadNeedleMeta recovery panic occurred ( #3883 )
ReadNeedleMeta panic occurred
https://github.com/seaweedfs/seaweedfs/issues/3882
3 years ago
chrislu
e3ea544d40
skip reading needle if size is invalid
related to https://github.com/seaweedfs/seaweedfs/issues/3882
3 years ago
Ryan Russell
277976bd76
refactor(storage): readability improvements ( #3703 )
Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org>
3 years ago
chrislu
2bfc8970d2
refactor: move ReadNeedleDataInto into volume_read.go
3 years ago
Eric Yang
b324a6536c
ADHOC: add read needle meta grpc ( #3581 )
* ADHOC: add read needle meta grpc
* add test
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
3 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
3 years ago
chrislu
36d2756978
volume: avoid writing too much data for range requests in large files
related to https://github.com/chrislusf/seaweedfs/issues/3178
4 years ago
chrislu
11f1e7996b
fix test
4 years ago
chrislu
056c480eb0
volume: checksum remove the hashing step in Value()
4 years ago
chrislu
ecef844dfc
stream read large files
4 years ago
chrislu
685643d506
needle read into a writer
4 years ago
chrislu
663bc5dc23
add needle reading in chunks
4 years ago
chrislu
18b29f709c
refactoring, split file
4 years ago
chrislu
433fde4b18
move error to a separate file
This file contains metric names for all errors
The naming convention is ErrorSomeThing = "error.some.thing"
4 years ago
Konstantin Lebedev
3f4e17aa24
error metrics for filer and store
4 years ago
Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
4 years ago
Chris Lu
d688e10ed1
do not try to compress if not sure about the file content
4 years ago
Chris Lu
332f5ad3a8
revert temporary changes that disabled compression
fix https://github.com/chrislusf/seaweedfs/issues/2362
4 years ago
Chris Lu
5956a8b05a
adjust comment
4 years ago
Chris Lu
1b942dfa3c
add error message
4 years ago
Konstantin Lebedev
865b06b7fe
The IEEE assembler optimizations has been submitted and will be part of the Go 1.6 standard library.
https://github.com/klauspost/crc32
4 years ago