7c32361a7d
Added SeaweedMQ_Architecture.png
3 years ago
141f662734
edge case checking when volume server does not have capacity to balance
fix https://github.com/chrislusf/seaweedfs/issues/3257
3 years ago
bee3a7c798
fix tests
3 years ago
ddb0f6bc74
Merge pull request #3258 from kmlebedev/issues_3255
volumeServer.evacuate fix select empty node
3 years ago
96c9d16c11
Merge pull request #3263 from kmlebedev/fix_pagination
fix pagination
3 years ago
3d5f1cbc5e
fix pagination
3 years ago
06a8b174b5
also remove Sync() for idx file
3 years ago
52580743b9
stuck with file.Sync()
starting to get weed/storage () - (master) > go test ./...
I0630 12:19:54 65819 needle_map_metric_test.go:26] FileCount expected 10000 actual 10000
I0630 12:19:54 65819 needle_map_metric_test.go:27] DeletedSize expected 1648 actual 1648
I0630 12:19:54 65819 needle_map_metric_test.go:28] ContentSize expected 10000 actual 10000
I0630 12:19:54 65819 needle_map_metric_test.go:29] DeletedCount expected 1648 actual 1959
I0630 12:19:54 65819 needle_map_metric_test.go:30] MaxFileKey expected 10000 actual 10000
I0630 12:19:54 65819 volume_loading.go:136] loading index /var/folders/jv/0rlhdck17jzgt7b3hcnq63mc0000gp/T/TestCompaction909350722/001/1.idx to memory
I0630 12:20:36 65819 volume_vacuum.go:98] Committing volume 1 vacuuming...
panic: test timed out after 10m0s
goroutine 61 [running]:
testing.(*M).startAlarm.func1()
/usr/local/go/src/testing/testing.go:2029 +0x8e
created by time.goFunc
/usr/local/go/src/time/sleep.go:176 +0x32
goroutine 1 [chan receive, 10 minutes]:
testing.(*T).Run(0xc0000cd520, {0x1c09bde?, 0x5ab798ea5c102?}, 0x1c67bd8)
/usr/local/go/src/testing/testing.go:1487 +0x37a
testing.runTests.func1(0xc0000cd520?)
/usr/local/go/src/testing/testing.go:1839 +0x6e
testing.tRunner(0xc0000cd520, 0xc00039fcd8)
/usr/local/go/src/testing/testing.go:1439 +0x102
testing.runTests(0xc0000dadc0?, {0x25b4460, 0x6, 0x6}, {0x2855108?, 0x40?, 0x25c4b80?})
/usr/local/go/src/testing/testing.go:1837 +0x457
testing.(*M).Run(0xc0000dadc0)
/usr/local/go/src/testing/testing.go:1719 +0x5d9
main.main()
_testmain.go:57 +0x1aa
goroutine 21 [chan receive]:
github.com/chrislusf/seaweedfs/weed/glog.(*loggingT).flushDaemon(0x0?)
/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/glog/glog.go:883 +0x6a
created by github.com/chrislusf/seaweedfs/weed/glog.init.0
/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/glog/glog.go:410 +0x1bf
goroutine 55 [syscall]:
syscall.syscall(0x44ac0f96?, 0xc00007ad80?, 0xc00098b480?, 0x10588df?)
/usr/local/go/src/runtime/sys_darwin.go:22 +0x4e
syscall.fcntl(0x100000001?, 0xc00098b4b0?, 0x1069a7c?)
/usr/local/go/src/syscall/zsyscall_darwin_amd64.go:319 +0x30
internal/poll.(*FD).Fsync.func1(...)
/usr/local/go/src/internal/poll/fd_fsync_darwin.go:18
internal/poll.ignoringEINTR(...)
/usr/local/go/src/internal/poll/fd_posix.go:74
internal/poll.(*FD).Fsync(0xc00038f1e0?)
/usr/local/go/src/internal/poll/fd_fsync_darwin.go:17 +0xfc
os.(*File).Sync(0xc00012a030)
/usr/local/go/src/os/file_posix.go:168 +0x4e
github.com/chrislusf/seaweedfs/weed/storage/backend.(*DiskFile).Sync(...)
/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/backend/disk_file.go:84
github.com/chrislusf/seaweedfs/weed/storage.(*Volume).makeupDiff(0xc0000bb440, {0xc000633a40, 0x52}, {0xc000633aa0, 0x52}, {0xc000633b00, 0x52}, {0xc000633b60, 0x52})
/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/volume_vacuum.go:295 +0x12fa
github.com/chrislusf/seaweedfs/weed/storage.(*Volume).CommitCompact(0xc0000bb440)
/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/volume_vacuum.go:119 +0x3e8
github.com/chrislusf/seaweedfs/weed/storage.TestCompaction(0xc00025a000)
/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/volume_vacuum_test.go:89 +0x305
testing.tRunner(0xc00025a000, 0x1c67bd8)
/usr/local/go/src/testing/testing.go:1439 +0x102
created by testing.(*T).Run
/usr/local/go/src/testing/testing.go:1486 +0x35f
goroutine 56 [chan receive, 10 minutes]:
github.com/chrislusf/seaweedfs/weed/storage.(*Volume).startWorker.func1()
/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/volume_write.go:244 +0x41a
created by github.com/chrislusf/seaweedfs/weed/storage.(*Volume).startWorker
/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/volume_write.go:234 +0x56
FAIL github.com/chrislusf/seaweedfs/weed/storage 600.194s
? github.com/chrislusf/seaweedfs/weed/storage/backend [no test files]
ok github.com/chrislusf/seaweedfs/weed/storage/backend/memory_map (cached)
? github.com/chrislusf/seaweedfs/weed/storage/backend/s3_backend [no test files]
ok github.com/chrislusf/seaweedfs/weed/storage/erasure_coding (cached)
? github.com/chrislusf/seaweedfs/weed/storage/idx [no test files]
ok github.com/chrislusf/seaweedfs/weed/storage/needle (cached)
ok github.com/chrislusf/seaweedfs/weed/storage/needle_map (cached)
ok github.com/chrislusf/seaweedfs/weed/storage/super_block (cached)
? github.com/chrislusf/seaweedfs/weed/storage/types [no test files]
? github.com/chrislusf/seaweedfs/weed/storage/volume_info [no test files]
FAIL
3 years ago
5ed8165161
fix logic
add option targetServer
https://github.com/chrislusf/seaweedfs/issues/3255
3 years ago
413cb3d389
Merge pull request #3256 from shichanglin5/fix_keep_connected
fixed `volume xx not found` caused by missing VolumeLocation events
3 years ago
200a862701
fixed `volume xx not found` caused by missing VolumeLocation events
When the requested master node is the leader, `VolumeLocation` or `ClusterNodeUpdate` may be returned here. If it is `VolumeLocation`, the update will be performed while resetting the vidMap, otherwise the event will be lost
3 years ago
ffaa2163e0
Merge branch 'master' of https://github.com/chrislusf/seaweedfs
3 years ago
f3c4b07b8a
Update backers.md
3 years ago
4ae9884a6e
Merge pull request #3254 from shichanglin5/fix_subscribe_meta
[Critical] Avoid synchronizing from scratch due to err
3 years ago
b98556cff5
Merge pull request #3253 from kmlebedev/constMultipartUploadsFolder
use const multipart uploads folder
3 years ago
2b5b37231b
Make sure that onChangeEvent is called successfully before updating lastTsNs
3 years ago
e17e6ed542
Avoid synchronizing from scratch due to err
3 years ago
bcbdc4cb37
use const multipart uploads folder
avoid error bucket NotEmpty if multipart uploads folder exist
3 years ago
a8abab2412
Merge branch 'master' of https://github.com/chrislusf/seaweedfs
3 years ago
449ecc8890
remove max connection age
related to https://github.com/chrislusf/seaweedfs/pull/3226
3 years ago
c6e6e303db
Merge pull request #3200 from lapshin-vitaly/bufix/validate-tags-on-copy
validate tags on copy object and add regex for validating tags
3 years ago
e22c2c8012
Merge pull request #3188 from kmlebedev/fix_make_dev
fix ip.bind cmd for docker compose
3 years ago
7c3d9d0535
remove println
3 years ago
61b2e3f9a2
fix return
3 years ago
606252472c
fix return
3 years ago
e969370913
fix parseTagging function and add test for validate tags
3 years ago
a79bf9d92a
Merge pull request #3252 from guol-fnst/update_tbk
remove hdfs, add tikv for full version update
3 years ago
74c9f39d48
remove hdfs, add tikv for full version update
3 years ago
8d810f8305
Merge pull request #3251 from shichanglin5/fix_concurrent_write_read
3 years ago
e1b94eb6b9
fix `error: concurrent map writes` when add or remove cluster node
3 years ago
4b1f48a399
Merge branch 'master' of https://github.com/chrislusf/seaweedfs
3 years ago
4a65159250
fix reading time
3 years ago
dc6b1a52e8
Merge pull request #3250 from xdadrm/xdadrm-patch-xweo-byte-files-from-webdav
Fixes WebDAV 0-bytes files
3 years ago
3a42269da8
Fixes WebDAV 0-bytes files
Fixes the issue where files created via WebDAV show as 0-bytes size when read via fuse.
3 years ago
4be406a095
Merge pull request #3249 from kmlebedev/issues_2589
avoid set currentMaster svc.local k8s discovery service domains
3 years ago
265b05c8fc
Merge pull request #3245 from chrislusf/dependabot/go_modules/github.com/klauspost/reedsolomon-1.10.0
Bump github.com/klauspost/reedsolomon from 1.9.16 to 1.10.0
3 years ago
f5273cdd5c
Merge pull request #3244 from chrislusf/dependabot/go_modules/github.com/go-redsync/redsync/v4-4.5.1
Bump github.com/go-redsync/redsync/v4 from 4.5.0 to 4.5.1
3 years ago
a9389377b5
Merge pull request #3247 from chrislusf/dependabot/go_modules/google.golang.org/api-0.85.0
Bump google.golang.org/api from 0.83.0 to 0.85.0
3 years ago
9bff097b01
currentMaster redirected
3 years ago
6c20a3b622
avoid set currentMaster k8s svc.local discoveruy service domains
https://github.com/chrislusf/seaweedfs/issues/2589
3 years ago
201023dd15
Merge pull request #3242 from garenchan/ck-dev1
fix 3238: handle errors for GenerateDirUuid method
3 years ago
d172d07212
Merge pull request #3246 from chrislusf/dependabot/go_modules/github.com/stretchr/testify-1.7.5
Bump github.com/stretchr/testify from 1.7.3 to 1.7.5
3 years ago
2e3d6104e4
Merge pull request #3243 from chrislusf/dependabot/go_modules/cloud.google.com/go/storage-1.23.0
Bump cloud.google.com/go/storage from 1.22.1 to 1.23.0
3 years ago
1a5981d583
fix test
3 years ago
983686bb83
Bump google.golang.org/api from 0.83.0 to 0.85.0
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client ) from 0.83.0 to 0.85.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases )
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.83.0...v0.85.0 )
---
updated-dependencies:
- dependency-name: google.golang.org/api
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
3 years ago
b5d70669ad
Bump github.com/stretchr/testify from 1.7.3 to 1.7.5
Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify ) from 1.7.3 to 1.7.5.
- [Release notes](https://github.com/stretchr/testify/releases )
- [Commits](https://github.com/stretchr/testify/compare/v1.7.3...v1.7.5 )
---
updated-dependencies:
- dependency-name: github.com/stretchr/testify
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
3 years ago
787103b032
Bump github.com/klauspost/reedsolomon from 1.9.16 to 1.10.0
Bumps [github.com/klauspost/reedsolomon](https://github.com/klauspost/reedsolomon ) from 1.9.16 to 1.10.0.
- [Release notes](https://github.com/klauspost/reedsolomon/releases )
- [Commits](https://github.com/klauspost/reedsolomon/compare/v1.9.16...v1.10.0 )
---
updated-dependencies:
- dependency-name: github.com/klauspost/reedsolomon
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
3 years ago
cfd7c0fa78
Bump github.com/go-redsync/redsync/v4 from 4.5.0 to 4.5.1
Bumps [github.com/go-redsync/redsync/v4](https://github.com/go-redsync/redsync ) from 4.5.0 to 4.5.1.
- [Release notes](https://github.com/go-redsync/redsync/releases )
- [Commits](https://github.com/go-redsync/redsync/compare/v4.5.0...v4.5.1 )
---
updated-dependencies:
- dependency-name: github.com/go-redsync/redsync/v4
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
3 years ago
e90a6af65e
Bump cloud.google.com/go/storage from 1.22.1 to 1.23.0
Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go ) from 1.22.1 to 1.23.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases )
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-cloud-go/compare/pubsub/v1.22.1...pubsub/v1.23.0 )
---
updated-dependencies:
- dependency-name: cloud.google.com/go/storage
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
3 years ago
8aa19577f4
fix 3238: handle errors for GenerateDirUuid method
3 years ago
Chris Lu
chrislu
Konstantin Lebedev
石昌林
Lapshin Vitaliy
guol-fnst
xdadrm
dependabot[bot]
garenchan