chrislu
13c0826f2f
display ec shard sizes
8 months ago
Chris Lu
69553e5ba6
convert error fromating to %w everywhere ( #6995 )
8 months ago
chalet
804979d68b
[Enhancement] support fix for remote files with command fix ( #6961 )
9 months ago
chrislu
e5adc3872a
ensure deleted entries are deleted
fix https://github.com/seaweedfs/seaweedfs/issues/6936
9 months ago
chrislu
060ee1b9d5
fix tests
9 months ago
chrislu
2d0d429d2f
fix disk space calculation
9 months ago
chalet
877b9b788a
update s3 session cache key ( #6923 )
9 months ago
chrislu
2f1b3d68d7
pass volume version when creating a volume
9 months ago
chrislu
d2be5822a1
refactoring
9 months ago
chrislu
96632a34b1
add version to volume proto
9 months ago
chrislu
e71d681fee
refactor
10 months ago
chrislu
7c4d98446b
refactor
10 months ago
chrislu
f27e195354
refactoring
10 months ago
chrislu
33ecc8442e
refactor
10 months ago
chrislu
60f11f6510
add a readme file for volume needle data layout
10 months ago
chrislu
61c4f01e05
refactor
10 months ago
chrislu
a489d99333
fix tests
10 months ago
Lisandro Pin
00c621abb8
Fix dumb typo in 08556257 ( #6844 )
10 months ago
chrislu
7439af0eca
refactoring
10 months ago
chrislu
cc135c63f7
a bit refactoring
10 months ago
chrislu
c4695fc3b3
refactor needle write for different versions
10 months ago
Lisandro Pin
bed0a64693
New `needle_map.CompactMap()` implementation for reduced memory usage ( #6842 )
* Rework `needle_map.CompactMap()` to maximize memory efficiency.
* Use a memory-efficient structure for `CompactMap` needle value entries.
This slightly complicates the code, but makes a **massive** difference
in memory efficiency - preliminary results show a ~30% reduction in
heap usage, with no measurable performance impact otherwise.
* Clean up type for `CompactMap` chunk IDs.
* Add a small comment description for `CompactMap()`.
* Add the old version of `CompactMap()` for comparison purposes.
10 months ago
chrislu
35f0daa198
the isFsync parameter is essentially IsAsyncWrite and it needs to be turned off if s.isStopping
d8c574a5ef (r159132764)
10 months ago
chrislu
bd4891a117
change version directory
10 months ago
Chris Lu
b25561d0d7
3.89
10 months ago
Chris Lu
d40746f34e
fix insert beyond look back window ( #6838 )
10 months ago
Lisandro Pin
7204731749
Minor fix for the `CompactMap()` performance test. ( #6836 )
Per-entry memory usage is based on `TotalAllocs`, which is incorrect - that
value is a cummulative of heap usage, which doesn't decrease when objects
are freeed.
`Allocs` is instead an accurate represeentation of actual memory usage
at the time metrics are reported.
10 months ago
Chris Lu
90802cb201
revert part of d8c574a5ef ( #6829 )
10 months ago
Lisandro Pin
9ffc8bcb54
Further improve memory usage of `needle_map.CompactMap()`. ( #6825 )
10 months ago
Lisandro Pin
2e1506c31e
Rewrite `needle_map.CompactMap()` for more efficient memory usage ( #6813 )
10 months ago
dongxufeng
ff878a542d
correctly report volume with input/output error to master ( #6790 )
* correctly capture io error and report to master
* code fix
* check io error by error.Is
---------
Co-authored-by: dongxu_feng <dongxu_feng@intsig.net>
10 months ago
chrislu
d8c574a5ef
fix fsync logic
10 months ago
Lisandro Pin
dddb0f0ae5
Fix update of `SeaweedFS_volumeServer_volumes` gauge metrics when EC shards are unmounted ( #6776 )
11 months ago
Quentin D.
2ae5b480a6
Use the correct constant when computing the offset in SearchNeedleFromSortedIndex ( #6771 )
NeedleHeaderSize happen to have the same size as NeedleMapEntrySize, except when running the 5 bytes offset variant of Seaweedfs, because it does not contain OffsetSize. This causes ECX corruption on deletes, due to the drifting offset computation (offset is always computed on a basis of 16 bytes per record instead of 17 bytes)
Signed-off-by: Quentin Devos <4972091+Okhoshi@users.noreply.github.com>
11 months ago
bwlfhu
0e08b83521
Fix volume ttl ( #6683 )
12 months ago
dependabot[bot]
216c52e377
chore(deps): bump gocloud.dev from 0.40.0 to 0.41.0 ( #6679 )
* chore(deps): bump gocloud.dev from 0.40.0 to 0.41.0
Bumps [gocloud.dev](https://github.com/google/go-cloud ) from 0.40.0 to 0.41.0.
- [Release notes](https://github.com/google/go-cloud/releases )
- [Commits](https://github.com/google/go-cloud/compare/v0.40.0...v0.41.0 )
---
updated-dependencies:
- dependency-name: gocloud.dev
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* fix error
* fix printing errors
* Update go.mod
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
12 months ago
NinaLua
271505717e
chore: make function comment match function name ( #6607 )
1 year ago
Aleksey Kosov
ef4eda0761
added re-generating and writing the Volume UUID if it is empty ( #6568 )
1 year ago
Lisandro Pin
7913681297
`ec.encode`: Display a warning on EC balancing if no replica placement settings are found. ( #6487 )
1 year ago
chrislu
be15fee8e7
show error if backend is mis-configured
related to https://github.com/seaweedfs/seaweedfs/discussions/6472
1 year ago
ludwigxia
5452405a81
cloud tier: support for Alibaba Cloud OSS ( #6466 )
1 year ago
chrislu
de09a82a32
go fmt
1 year ago
chrislu
bfd59dd579
adjust import
1 year ago
chrislu
ec155022e7
"golang.org/x/exp/slices" => "slices" and go fmt
1 year ago
coffeecloudgit
c531e2eb0e
Update disk_location_ec.go ( #6359 )
Add lock for l.ecVolumes
1 year ago
coffeecloudgit
7eb8257126
Update store.go ( #6358 )
Add lock for location.ecVolumes And single delete
1 year ago
Konstantin Lebedev
ff1392f7f4
[shell] use constant for hdd of type ( #6337 )
use constant for hdd of type
1 year ago
chrislu
f3dde99796
adjust error message
1 year ago
Trim21
fd6c787c02
fix EcVolumes sorting in volume UI ( #6275 )
* Update store_ec.go
* fix: EcVolume sorting not work
* use stdlib
* revert
1 year ago
chrislu
75f5afa571
fix compilation
1 year ago