chrislu
70a4c98b00
refactor filer_pb.Entry and filer.Entry to use GetChunks()
for later locking on reading chunks
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
chrislu
fc8241fb5e
leveldb3: add instant dropping bucket
2 years ago
chrislu
94635e9b5c
filer: add filer group
3 years ago
Konstantin Lebedev
21033ff4c3
refactor use const CountEntryChunksForGzip
3 years ago
chrislu
4042fdf3bb
rename to skipCheckParentDir
related to https://github.com/chrislusf/seaweedfs/pull/2761
It's better to default to false.
3 years ago
zzq09494
40b0033fa7
go fmt
3 years ago
zzq09494
ee5417a5b3
fix: ut test error
3 years ago
chrislu
56da3494cb
leveldb3: adjust memory allocation for each bucket
3 years ago
Eng Zer Jun
b92df1654c
test: use `T.TempDir` to create temporary test directory
The directory created by `T.TempDir` is automatically removed when the
test and all its subtests complete.
Reference: https://pkg.go.dev/testing#T.TempDir
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Eng Zer Jun
a23bcbb7ec
refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
3 years ago
Chris Lu
96514f0f00
fix tests
3 years ago
joshuafc
5654d0d60d
CompactionTableSizeMultiplier of leveldb use default value. #2325
To improve performance of leveldb find key in condition of large directory(millions of files) which use uuid as filename.
3 years ago
qieqieplus
2b46df13f8
add bloom filter for filer leveldb/rocksdb
3 years ago
Chris Lu
182288f860
filer: fix mysql, postgres batch delete error
3 years ago
Konstantin Lebedev
6aa1a56ec8
avoid crashes Galera Cluster
https://github.com/chrislusf/seaweedfs/issues/2125
4 years ago
Chris Lu
ddc8643ee0
filer: directory listing adds namePatternExclude
fix https://github.com/chrislusf/seaweedfs/issues/2023
4 years ago
Chris Lu
2d4c2db81d
filer: leveldb, rocksdb auto create store directory
fix https://github.com/chrislusf/seaweedfs/issues/1901
4 years ago
Chris Lu
4be51c0701
filer: leveldb and hbase may miss files when listing large directories more than 1024
fix https://github.com/chrislusf/seaweedfs/issues/1768
4 years ago
Chris Lu
a4063a5437
add stream list directory entries
4 years ago
Chris Lu
f002e668de
change limit to int64 in case of overflow
4 years ago
Chris Lu
b5ceffe188
implement leveldb changes
4 years ago
Chris Lu
ca73013453
leveldb3: ensure repeatable adding removing buckets
4 years ago
Chris Lu
5cd9c9e642
remove println
4 years ago
Chris Lu
def6d8e565
fix test
4 years ago
Chris Lu
629c9962e7
filer: add leveldb3
support dedicated leveldb instance for each bucket
4 years ago