Chris Lu
90802cb201
revert part of d8c574a5ef
( #6829 )
2 months ago
FQHSLycopene
ee0c14673d
Fix TTL Behavior for Directories in Path-Specific Configuration ( #6827 )
2 months ago
Lisandro Pin
9ffc8bcb54
Further improve memory usage of `needle_map.CompactMap()`. ( #6825 )
2 months ago
Aleksey Kosov
283d9e0079
Add context with request ( #6824 )
2 months ago
Bruce Zou
62aaaa18f3
unlimit the list entries in completeMultipartUpload ( #6822 )
2 months ago
royatwp
2786bea839
Unable to upload empty files to seaweed via. multipart when length is unknown ( #6729 )
2 months ago
chrislu
6677f1f563
3.88
2 months ago
Mohamed Sekour
27a392f706
Fix sftp performances and add seaweedfs all-in-one deployment ( #6792 )
* improve perfs & fix rclone & refactoring
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
* improve perfs on download + add seaweedfs all-in-one deployment
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
* use helper for topologySpreadConstraints and fix create home dir of sftp users
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
* fix helm lint
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
* add missing ctx param
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
---------
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
2 months ago
Weihao Jiang
ea70d17c5f
Make fuse command linux/MacOS only ( #6811 )
2 months ago
Lisandro Pin
2e1506c31e
Rewrite `needle_map.CompactMap()` for more efficient memory usage ( #6813 )
2 months ago
bwlfhu
f1181f1121
Fix mysql tls enable ( #6807 )
2 months ago
chrislu
f3d44b1eb6
Update fuse.go
Changed the signal from SIGUSR1 to SIGTERM. This should fix the compilation error since SIGTERM is available on all Unix-like systems including macOS. The functionality remains similar - it will still allow the master process to wait for a signal before exiting, just using a different signal type.
2 months ago
chrislu
896096c41b
fix compilation on windows
2 months ago
chrislu
25d6310307
fix error format
2 months ago
Weihao Jiang
874b4a5535
Ensure `weed fuse` master process exits after mounted ( #6809 )
* Ensure fuse master process wait for mounted
* Validate parent PID input in fuse command
2 months ago
Aleksey Kosov
165af32d6b
added context to filer_client method calls ( #6808 )
Co-authored-by: akosov <a.kosov@kryptonite.ru>
2 months ago
Aleksey Kosov
5182d46e22
Added middleware for processing request_id grpc and http requests ( #6805 )
2 months ago
dongxufeng
ff878a542d
correctly report volume with input/output error to master ( #6790 )
* correctly capture io error and report to master
* code fix
* check io error by error.Is
---------
Co-authored-by: dongxu_feng <dongxu_feng@intsig.net>
2 months ago
chrislu
d8c574a5ef
fix fsync logic
2 months ago
Lisandro Pin
0be020b0fa
Nit: unify the default `--maxParallelization` value for `weed shell` commands supporting this option ( #6788 )
2 months ago
Lisandro Pin
ba1d82db90
Move `shell.ErrorWaitGroup` into a common file, to cleanly reuse across `weed shell` commands. ( #6780 )
Move `shell.ErrorWaitGroup` into a dedicated common file, to cleanly reuse across `weed shell` commands.
3 months ago
SmoothDenis
45964c2f86
fix: ydb filer bugs ( #6778 )
* fix: ydb filer bugs
* fix(ydb): correct DeleteEntry log argument types
* fix(ydb): bucket creation & deletion logic
3 months ago
Kuzmin Anton
9c1048bacb
Add prefix listing in mongodb_store.go ( #6777 )
3 months ago
Lisandro Pin
dddb0f0ae5
Fix update of `SeaweedFS_volumeServer_volumes` gauge metrics when EC shards are unmounted ( #6776 )
3 months ago
Lisandro Pin
848d1f7c34
Improve safety for weed shell's `ec.encode`. ( #6773 )
Improve safety for weed shells `ec.encode`.
The current process for `ec.encode` is:
1. EC shards for a volume are generated and added to a single server
2. The original volume is deleted
3. EC shards get re-balanced across the entire topology
It is then possible to lose data between #2 and #3 , if the underlying volume storage/server/rack/DC
happens to fail, for whatever reason. As a fix, this MR reworks `ec.encode` so:
* Newly created EC shards are spread across all locations for the source volume.
* Source volumes are deleted only after EC shards are converted and balanced.
3 months ago
Quentin D.
2ae5b480a6
Use the correct constant when computing the offset in SearchNeedleFromSortedIndex ( #6771 )
NeedleHeaderSize happen to have the same size as NeedleMapEntrySize, except when running the 5 bytes offset variant of Seaweedfs, because it does not contain OffsetSize. This causes ECX corruption on deletes, due to the drifting offset computation (offset is always computed on a basis of 16 bytes per record instead of 17 bytes)
Signed-off-by: Quentin Devos <4972091+Okhoshi@users.noreply.github.com>
3 months ago
Lisandro Pin
97dad06ed8
Improve parallelization for `ec.encode` ( #6769 )
Improve parallelization for `ec.encode`.
Instead of processing one volume at at time, perform all EC conversion
steps (mark readonly -> generate EC shards -> delete volume -> remount) in
parallel for all of them.
This should substantially improve performance when EC encoding
entire collections.
3 months ago
Bruce Zou
582206b7d2
load configuration before get max_file_name_length ( #6766 )
3 months ago
Mohamed Sekour
93aed187e9
Add SFTP Server Support ( #6753 )
* Add SFTP Server Support
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
* fix s3 tests and helm lint
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
* increase helm chart version
* adjust version
---------
Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
3 months ago
ARibster
a2c5510ae1
Addendum to issue #6733 ( #6756 )
add s3.ip.bind command line parameter to filer
3 months ago
chrislu
e4e8505208
3.87
3 months ago
chrislu
ed15357c7a
adds tls examples
related to https://github.com/seaweedfs/seaweedfs/pull/6738
3 months ago
Jade Devin Cabatlao
21514e1fea
feat(redis): add mTLS support for Redis connection initialization ( #6738 )
* feat(redis): add mTLS support for Redis connection initialization
- Enhanced the Redis2Store initialization to support mutual TLS (mTLS) by adding configuration options for CA certificate, client certificate, and client key paths.
- Updated the Redis client setup to use TLS configuration when mTLS is enabled, ensuring secure connections to the Redis server.
* feat(redis): extend Redis3Store initialization to support mTLS
- Added configuration options for enabling mutual TLS (mTLS) in Redis3Store.
- Implemented logic to load client certificates and CA certificates for secure Redis connections.
- Updated the Redis client setup to utilize TLS configuration when mTLS is enabled.
---------
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
3 months ago
ARibster
d424cbbcd5
fix: S3 Feature: please add s3.idleTimeout command line parameter #6746 ( #6747 )
ildeTimeout command line parameter for s3
3 months ago
Taehyung Lim
0fbdedecc7
[s3] refactor duplicate put-object code paths ( #6727 )
3 months ago
ARibster
9f4be83e88
fix #6733 add s3.ip.bind command line parameter ( #6741 )
3 months ago
NyaMisty
8d0e6f1ead
fix: volume.list volume info output not in order ( #6737 )
3 months ago
Taehyung Lim
ea941462f9
[s3] use chunkedReader in PutObjectPartHandler to handle aws-chunked encoding ( #6725 )
3 months ago
Konstantin Lebedev
8c1cb203fa
[s3] fix checksum algorithm CRC64NVMe ( #6722 )
3 months ago
Lisandro Pin
cea34dc21a
Fix implementation of `master_pb.CollectionList` RPC call ( #6715 )
3 months ago
zuzuviewer
396a602f86
* Fix s3 auth failed with X-Forwarded-Host and X-Forwarded-Port ( #6698 )
4 months ago
Konstantin Lebedev
aa9121aa9d
Revert "[filer] void panic if s3opt.tlsCACertificate is nill" ( #6694 )
Revert "[filer] void panic if s3opt.tlsCACertificate is nill (#6685 )"
This reverts commit 4dca59ed27
.
4 months ago
Konstantin Lebedev
4dca59ed27
[filer] void panic if s3opt.tlsCACertificate is nill ( #6685 )
* fix issues/6684
* add s3.cacert.file option for filer
4 months ago
bwlfhu
0e08b83521
Fix volume ttl ( #6683 )
4 months ago
dependabot[bot]
216c52e377
chore(deps): bump gocloud.dev from 0.40.0 to 0.41.0 ( #6679 )
* chore(deps): bump gocloud.dev from 0.40.0 to 0.41.0
Bumps [gocloud.dev](https://github.com/google/go-cloud ) from 0.40.0 to 0.41.0.
- [Release notes](https://github.com/google/go-cloud/releases )
- [Commits](https://github.com/google/go-cloud/compare/v0.40.0...v0.41.0 )
---
updated-dependencies:
- dependency-name: gocloud.dev
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* fix error
* fix printing errors
* Update go.mod
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
4 months ago
chrislu
1af0b282db
skip logs
4 months ago
MaratKarimov
ba3afd1803
Tarantool filer store ( #6669 )
Co-authored-by: Marat Karimov <m.karimov@digitalms.ru>
4 months ago
Chris Lu
528702d30b
errors when reading uncached files from cloud drive ( #6674 )
fix https://github.com/seaweedfs/seaweedfs/issues/6672
4 months ago
alingse
46b3a71a1f
fix call writeJsonError with a nil value error after check another err ( #6673 )
the dbErr != nil and err is nil
when call writeJsonError with a nil value error, it may panic
4 months ago
Chris Lu
669a3917af
add lua redis store to ensure atomicity ( #6671 )
4 months ago