chrislu
04b141749f
explicit generation value
4 months ago
chrislu
b616dc3d20
adjust comments
4 months ago
chrislu
117bba794c
WriteDatFileAndVacuum
4 months ago
chrislu
1f8ba5c958
task ask admin for master address
4 months ago
chrislu
c0e6d00bd3
collect ec volume total volume size
4 months ago
chrislu
1485330547
Update ec_vacuum_task.go
4 months ago
chrislu
8213a4a2b6
use the EcVacuumLogic
4 months ago
chrislu
425a54019b
adding EcVacuumLogic
4 months ago
chrislu
82907ad6ca
determineGenerations() Removed
4 months ago
chrislu
729268d065
detection with generation info
4 months ago
chrislu
8a5c4a4972
add generation to TaskSource
4 months ago
chrislu
80bfce59ad
Create NOTES.md
4 months ago
chrislu
35f3da108b
distribute index files to all volume servers that will have shards mounted, not just one
4 months ago
chrislu
c8c758e639
fix hanging task detail page
4 months ago
chrislu
56db0a081a
distribute .ecx files
4 months ago
chrislu
0d6ea416a7
fix retry link
4 months ago
chrislu
4f9f9ec971
fix routing
4 months ago
chrislu
3bbe4481f2
remove unused code
4 months ago
chrislu
cac6a51cbf
implement todos
4 months ago
chrislu
7780a7d652
ec vacuum workflow is correct now
4 months ago
chrislu
83b6a94bfe
change to correct ec vacuum workflow
4 months ago
chrislu
0f1c734626
fix mounting ec volumes
4 months ago
chrislu
2a61cda2cd
adding retry button
4 months ago
chrislu
5c93557314
detect shard sources
4 months ago
chrislu
7cf5ddf8ac
more self contained tasks
4 months ago
chrislu
7622d14580
remove unused config
4 months ago
chrislu
bddb2cd5cc
keep only ec config
4 months ago
chrislu
96a2749355
adding EcVacuumTaskConfig
4 months ago
chrislu
f9e7ca4308
Merge branch 'master' into add-ec-vacuum
4 months ago
chrislu
7889e78f4d
use one http client
4 months ago
Chris Lu
af3300e063
filer: server side copying ( #7121 )
* copy
* address comments
* remove unused functions, reuse http clients
* address hardlink, checking existing directory
* destination is directory
* check for the key's existence in the map first before accessing its members
* address comments
* deep copy remote entry
* address comments
* copying chunks in parallel
* handle manifest chunks
* address comments
* errgroup
* there could be large chunks
* address comments
* address comments
4 months ago
dependabot[bot]
7e86045e22
chore(deps): bump golang.org/x/net from 0.42.0 to 0.43.0 ( #7126 )
Bumps [golang.org/x/net](https://github.com/golang/net ) from 0.42.0 to 0.43.0.
- [Commits](https://github.com/golang/net/compare/v0.42.0...v0.43.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/net
dependency-version: 0.43.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 months ago
dependabot[bot]
529c68a798
chore(deps): bump google.golang.org/api from 0.244.0 to 0.246.0 ( #7127 )
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client ) from 0.244.0 to 0.246.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases )
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.244.0...v0.246.0 )
---
updated-dependencies:
- dependency-name: google.golang.org/api
dependency-version: 0.246.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 months ago
dependabot[bot]
e3b15073a0
chore(deps): bump actions/checkout from 4 to 5 ( #7125 )
Bumps [actions/checkout](https://github.com/actions/checkout ) from 4 to 5.
- [Release notes](https://github.com/actions/checkout/releases )
- [Commits](https://github.com/actions/checkout/compare/v4...v5 )
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-version: '5'
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 months ago
dependabot[bot]
5f62b11889
chore(deps): bump golang.org/x/sys from 0.34.0 to 0.35.0 ( #7124 )
Bumps [golang.org/x/sys](https://github.com/golang/sys ) from 0.34.0 to 0.35.0.
- [Commits](https://github.com/golang/sys/compare/v0.34.0...v0.35.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/sys
dependency-version: 0.35.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 months ago
dependabot[bot]
524c1916b6
chore(deps): bump github.com/redis/go-redis/v9 from 9.11.0 to 9.12.0 ( #7123 )
Bumps [github.com/redis/go-redis/v9](https://github.com/redis/go-redis ) from 9.11.0 to 9.12.0.
- [Release notes](https://github.com/redis/go-redis/releases )
- [Changelog](https://github.com/redis/go-redis/blob/master/RELEASE-NOTES.md )
- [Commits](https://github.com/redis/go-redis/compare/v9.11.0...v9.12.0 )
---
updated-dependencies:
- dependency-name: github.com/redis/go-redis/v9
dependency-version: 9.12.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 months ago
dependabot[bot]
412fd6ee86
chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.113.4 to 3.113.5 ( #7122 )
chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3
Bumps [github.com/ydb-platform/ydb-go-sdk/v3](https://github.com/ydb-platform/ydb-go-sdk ) from 3.113.4 to 3.113.5.
- [Release notes](https://github.com/ydb-platform/ydb-go-sdk/releases )
- [Changelog](https://github.com/ydb-platform/ydb-go-sdk/blob/master/CHANGELOG.md )
- [Commits](https://github.com/ydb-platform/ydb-go-sdk/compare/v3.113.4...v3.113.5 )
---
updated-dependencies:
- dependency-name: github.com/ydb-platform/ydb-go-sdk/v3
dependency-version: 3.113.5
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 months ago
Chris Lu
605b3333c1
fix sftp start with filer ( #7120 )
* fix sftp start with filer
* add bindIp
4 months ago
Chris Lu
9265e81fe9
S3 API: unsigned streaming (no cred) but chunks contain signatures ( #7118 )
* This handles the case where we have unsigned streaming (no cred) but chunks contain signatures
* Update chunked_reader_v4.go
* address comments
4 months ago
chrislu
a265a07922
fix ttl objects
fix https://github.com/seaweedfs/seaweedfs/discussions/7107#discussioncomment-14069018
4 months ago
chrislu
f03f4383af
fix missing grpc dial option
4 months ago
chrislu
c57ccd554a
worker_pb.TaskParams_VacuumParams
4 months ago
chrislu
9df006b49d
fix min volume age
4 months ago
chrislu
424bb7fe11
showing criteria
4 months ago
chrislu
97d58e77c6
getting ec volume deletions
4 months ago
chrislu
553a229fd3
reduce lock scope
4 months ago
chrislu
57d025910d
cancel context
4 months ago
chrislu
213dd9b470
testing
4 months ago
chrislu
a31fc1ac01
Bypass compaction revision check to handle volumes compacted after task creation
4 months ago
chrislu
91d641e685
avoid dead lock
4 months ago