7a50762b9e
reduce binary size by skipping rclone
1 year ago
6c1ce18541
Fix weed fix
1 year ago
6ebe26a765
Revert "Revert "Revert "Add disk type to prometheus metrics" ( #4777 )""
This reverts commit 567d788928
1 year ago
7540d43ee9
Revert "Revert "fix compilation""
This reverts commit f9abfd0b03
1 year ago
249c0e06ef
Revert "fix compilation"
This reverts commit 451ec6504d
1 year ago
451ec6504d
fix compilation
1 year ago
f9abfd0b03
Revert "fix compilation"
This reverts commit 0483ba3889
1 year ago
0483ba3889
fix compilation
1 year ago
567d788928
Revert "Revert "Add disk type to prometheus metrics" ( #4777 )"
This reverts commit 9215ba24be
1 year ago
78dbac7702
fix(ec): volumes created by foreign collection due to bug in ec balance ( #4864 )
* fix(ec): ignore 0 byte data files
refers to parts of #4861
Signed-off-by: Tobias Gurtzick <magic@wizardtales.com>
* fix(ec): ignore volumes not from the current collection during balance
fixes #4861
Signed-off-by: Tobias Gurtzick <magic@wizardtales.com>
---------
Signed-off-by: Tobias Gurtzick <magic@wizardtales.com>
1 year ago
645ae8c57b
Revert "Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs ""
This reverts commit 8cb42c39
1 year ago
27af11f1e8
Revert "Revert "Merge branch 'master' into sub""
This reverts commit 0bb97709d4
1 year ago
0bb97709d4
Revert "Merge branch 'master' into sub"
This reverts commit 4d414f54a24827425146
1 year ago
8cb42c39ad
Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs "
This reverts commit 2e5aa060264d414f54a2
1 year ago
a04bd4d26f
Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 ( #4850 )
* Bump github.com/rclone/rclone from 1.63.1 to 1.64.0
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone ) from 1.63.1 to 1.64.0.
- [Release notes](https://github.com/rclone/rclone/releases )
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md )
- [Commits](https://github.com/rclone/rclone/compare/v1.63.1...v1.64.0 )
---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* API changes
* go mod
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
1 year ago
d83107efe5
fix: weed/storage: dropped error
1 year ago
f24c7e803f
weed/storage/erasure_coding: Close() after error handling
1 year ago
d762b12e11
weed/storage/erasure_coding: fix dropped test error
1 year ago
a879e1bbb5
weed/storage/erasure_coding: remove unused err from encodeDatFile() signature
1 year ago
9215ba24be
Revert "Add disk type to prometheus metrics" ( #4777 )
Revert "Add disk type to prometheus metrics (#4736 )"
This reverts commit 9956d93a40
1 year ago
9956d93a40
Add disk type to prometheus metrics ( #4736 )
* Add disk type to prometheus metrics
* Del metrics
* Disk type as readable string
---------
Co-authored-by: Dima Mishin <dimm@dimm.dev>
1 year ago
4b1ba7f5b2
Save disk space metrics immediately ( #4740 )
1 year ago
e6a49dc533
Fix resource leaks ( #4737 )
* Fix division by zero
* Fix file handle leak
* Fix file handle leak
* Fix file handle leak
* Fix goroutine leak
1 year ago
3730772e05
refresh max volume count after adjust ( #4662 )
Signed-off-by: changlin.shi <changlin.shi@ly.com>
1 year ago
c278bac263
avoid nil needle map
fix https://github.com/seaweedfs/seaweedfs/issues/4640
1 year ago
14546f0ad8
minor
1 year ago
61553beba2
Fix DataBackend nil pointer ( #4641 )
1 year ago
2aa59ab37c
fix copying level db files during commi
fix https://github.com/seaweedfs/seaweedfs/issues/4635
1 year ago
0d9ba8c612
Support templating name of files stored via Rclone backend ( #4606 )
2 years ago
3b88ab42aa
remove duplicate `fileCount` query ( #4588 )
2 years ago
44b9d72ef0
doIsEmpty() return error if v.DataBackend is nil ( #4587 )
2 years ago
0b0fb9b9e4
avoid data race read volume.IsEmpty ( #4574 )
* avoid data race read volume.IsEmpty
- avoid phantom read isEmpty for onlyEmpty
- use `v.DataBackend.GetStat()` in v.dataFileAccessLock scope
* add Destroy(onlyEmpty: true) test
* add Destroy(onlyEmpty: false) test
* remove unused `IsEmpty()`
* change literal `8` to `SuperBlockSize`
2 years ago
1e22d5caf2
fix get file stats for IsEmpty ( #4576 )
2 years ago
4527ead295
fix from comment delete volume is empty ( #4573 )
* fix from coments
https://github.com/seaweedfs/seaweedfs/pull/4561
* fix tests
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2 years ago
25535e9c36
Delete volume is empty ( #4561 )
* use onlyEmpty for deleteVolume
https://github.com/seaweedfs/seaweedfs/issues/4559
* fix IsEmpty
* fix test
---------
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2 years ago
26f15d0079
Fix no more writable volumes by delay judgment ( #4548 )
* fix nomore writables volumes while disk free space is sufficient by time delay
* reset
---------
Co-authored-by: wang wusong <wangwusong@virtaitech.com>
2 years ago
e23f3d6eca
set df.File to nil after it is closed
possibly fix https://github.com/seaweedfs/seaweedfs/issues/4530
2 years ago
ff7b6d779e
avoid overwriting variables
fix https://github.com/seaweedfs/seaweedfs/issues/4365
2 years ago
9f55c7c90e
Rclone storage backend ( #4402 )
* Add Rclone storage backend
* Support templating the name of files stored via Rclone
* Enable Rclone accounting
* Remove redundant type conversion
* Provide progress information for Rclone download/upload operations
* Log error when Rclone can't instantiate filesystem
* Remove filename templating functionality for Rclone storage
To (maybe) be later reintroduced as a generic functionality for all
storage backends.
* Remove S3 specific check
* Move Rclone config initialisation to init() method
2 years ago
0a22eea55d
collect ec shard from multiple locations
fix https://github.com/seaweedfs/seaweedfs/issues/4365
2 years ago
f5854d13df
fix test
2 years ago
0454bb2d88
fix test
when size is zero, the "LastModified" is not written
2 years ago
c589e9837c
fix tests
2 years ago
bd6f2716d3
fix_read_tomb_needle_meta ( #4263 )
Co-authored-by: zemul <zhouzemiao@ihuman.com>
2 years ago
81624de27b
Include name/mime in ReadAllNeedles ( #4005 )
2 years ago
4c85da7844
Include meta in ReadAllNeedles ( #3991 )
This is useful for doing backups on the data so we can accurately store the
last modified time, the compression state, and verify the crc.
Previously we were doing VolumeNeedleStatus and then an HTTP request which
needlessly read from the dat file twice.
2 years ago
5b905fb2b7
Lazy loading ( #3958 )
* types packages is imported more than onece
* lazy-loading
* fix bugs
* fix bugs
* fix unit tests
* fix test error
* rename function
* unload ldb after initial startup
* Don't load ldb when starting volume server if ldbtimeout is set.
* remove uncessary unloadldb
* Update weed/command/server.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
* Update weed/command/volume.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: guol-fnst <goul-fnst@fujitsu.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2 years ago
bf8a9d2db1
[volume.chek.disk] sync of deletions the fix ( #3923 )
* sync of deletions the fix
* avoid return if only partiallyDeletedNeedles
* refactor sync deletions
2 years ago
764d9cb105
[voluche.chek.disk] needles older than the cutoff time are not missing yet ( #3922 )
needles older than the cutoff time are not missing yet
https://github.com/seaweedfs/seaweedfs/issues/3919
2 years ago
51d462f204
ADHOC: volume fsck using append at ns ( #3906 )
* ADHOC: volume fsck using append at ns
* nit
* nit
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2 years ago
chrislu
SmsS4
Tobias Gurtzick
dependabot[bot]
Lars Lehtonen
Chris Lu
Dmitry Mishin
Nikita Mochalov
LHHDZ
wusong
Damiano Albani
Bai Jie
Konstantin Lebedev
zemul
James Hartig
Guo Lei
Eric Yang