Lisandro Pin
dddb0f0ae5
Fix update of `SeaweedFS_volumeServer_volumes` gauge metrics when EC shards are unmounted ( #6776 )
3 days ago
Quentin D.
2ae5b480a6
Use the correct constant when computing the offset in SearchNeedleFromSortedIndex ( #6771 )
NeedleHeaderSize happen to have the same size as NeedleMapEntrySize, except when running the 5 bytes offset variant of Seaweedfs, because it does not contain OffsetSize. This causes ECX corruption on deletes, due to the drifting offset computation (offset is always computed on a basis of 16 bytes per record instead of 17 bytes)
Signed-off-by: Quentin Devos <4972091+Okhoshi@users.noreply.github.com>
3 days ago
chrislu
ec155022e7
"golang.org/x/exp/slices" => "slices" and go fmt
5 months ago
chrislu
c9f3448692
ReadAt may return io.EOF t end of file
related to https://github.com/seaweedfs/seaweedfs/issues/6219
6 months ago
chrislu
ae5bd0667a
rename proto field from DestroyTime to expire_at_sec
For TTL volume converted into EC volume, this change may leave the volumes staying.
7 months ago
augustazz
0b00706454
EC volume supports expiration and displays expiration message when executing volume.list ( #5895 )
* ec volume expire
* volume.list show DestroyTime
* comments
* code optimization
---------
Co-authored-by: xuwenfeng <xuwenfeng1@zto.com>
9 months ago
chrislu
fdf7193ae7
rename
9 months ago
chrislu
07f4998188
add dat file size into vif for EC
9 months ago
chrislu
645ae8c57b
Revert "Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs ""
This reverts commit 8cb42c39
2 years ago
chrislu
8cb42c39ad
Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs "
This reverts commit 2e5aa06026
, reversing
changes made to 4d414f54a2
.
2 years ago
dependabot[bot]
a04bd4d26f
Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 ( #4850 )
* Bump github.com/rclone/rclone from 1.63.1 to 1.64.0
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone ) from 1.63.1 to 1.64.0.
- [Release notes](https://github.com/rclone/rclone/releases )
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md )
- [Commits](https://github.com/rclone/rclone/compare/v1.63.1...v1.64.0 )
---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* API changes
* go mod
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
2 years ago
Nikita Mochalov
e6a49dc533
Fix resource leaks ( #4737 )
* Fix division by zero
* Fix file handle leak
* Fix file handle leak
* Fix file handle leak
* Fix goroutine leak
2 years ago
Konstantin Lebedev
1f7e52c63e
vacuum metrics and force sync dst files ( #3832 )
3 years ago
Eric Yang
b324a6536c
ADHOC: add read needle meta grpc ( #3581 )
* ADHOC: add read needle meta grpc
* add test
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
3 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
3 years ago
justin
3551ca2fcf
enhancement: replace sort.Slice with slices.SortFunc to reduce reflection
3 years ago
Chris Lu
e5fc35ed0c
change server address from string to a type
4 years ago
Chris Lu
05a648bb96
refactor: separating out remote.proto
4 years ago
Chris Lu
828f6e9f4d
volume: auto add missing vif files
fix https://github.com/chrislusf/seaweedfs/issues/1878
4 years ago
Chris Lu
f8446b42ab
this can compile now!!!
4 years ago
bingoohuang
7256902fb0
fix typo offset.ToAcutalOffset to offset.ToActualOffset
4 years ago
Chris Lu
6d30b21b10
volume: add "-dir.idx" option for separate index storage
fix https://github.com/chrislusf/seaweedfs/issues/1265
5 years ago
Chris Lu
4ff2ceee33
UI fix on rendering EC volumes
addressing UI problem with https://github.com/chrislusf/seaweedfs/issues/1551
5 years ago
Chris Lu
6a92f0bc7a
refactoring to typed Size
Go is amazing with refactoring!
5 years ago
Chris Lu
3137777d83
volume: automatically detect max volume count
5 years ago
Chris Lu
40ae533fa3
shell: add volume.configure.replication to change replication for a volume
fix https://github.com/chrislusf/seaweedfs/issues/1192
5 years ago
Chris Lu
672868b460
always create .vif file
5 years ago
Chris Lu
37b64a50b4
ec: generate and copy .vif file
5 years ago
Chris Lu
c06f7eb48a
load volume info from .vif file, use superblock as a backup
5 years ago
Chris Lu
58f88e530c
volume: use sorted index map for readonly volumes
5 years ago
j.laycock
6fc6322c90
Change joeslay paths to chrislusf paths
6 years ago
j.laycock
595a1beff0
Swap imports to use joeslay
6 years ago
Chris Lu
f88a8bda7b
ec deletion works
6 years ago
Chris Lu
4cea8aefd0
add grpc VolumeEcBlobDelete
6 years ago
Chris Lu
856da7aae2
ec volume support deletes
6 years ago
Chris Lu
d344e0a035
fix ec related bugs
6 years ago
Chris Lu
2215e81be7
ui add ec shard statuses
6 years ago
Chris Lu
ba18314aab
ec shard delete also check ec volumes, in addition to volumes
6 years ago
Chris Lu
47f1901843
ask for the ec volume version
6 years ago
Chris Lu
40ca2f2903
add collection.delete
6 years ago
Chris Lu
3f9ecee40f
working with reading remote intervals
6 years ago
Chris Lu
4f76342cbc
WIP
no errors, but not returning file content
* the interval needs to use actual file zie
* need to read the actual version instead of the current version
6 years ago
Chris Lu
713596e781
caching ec shard locations
6 years ago
Chris Lu
3a8c1055a2
refactoring ecx to ecVolume
6 years ago
Chris Lu
217cde0a3b
refactoring
6 years ago
Chris Lu
b4b407e403
add grpc ec shard read
6 years ago
Chris Lu
a4f3d82c57
convert needle id to ec intervals to read from
6 years ago
Chris Lu
db94a41f9e
mount/unmount ec shards
6 years ago
Chris Lu
6f4b09b6a4
pb shard info uses ShardBits instead one message for one shard
6 years ago
Chris Lu
7180520889
ec shard info can be queried via VolumeList()
6 years ago