Chris Lu
13e7069eb9
keep track of total data file size
8 years ago
霍晓栋
096ffa9744
concurrent loading volume
8 years ago
Chris Lu
5ce6bbf076
directory structure change to work with glide
glide has its own requirements. My previous workaround caused me some
code checkin errors. Need to fix this.
9 years ago
chrislusf
86cd40fba8
Add "weed backup" command.
This is a pre-cursor for asynchronous replication.
10 years ago
Stuart P. Bentley
f0c2a2dcb3
Change all chrislusf/weed-fs links to point to chrislu/seaweedfs
10 years ago
chrislusf
020ba6c9a8
add leveldb support for needle map
This supposedly should reduce memory consumption. However, for tests
with millions of, this shows consuming more memories. Need to see
whether this will work out. If not, later boltdb will be tested.
10 years ago
chrislusf
9d8a6d2562
adjust log printing
10 years ago
Chris Lu
af416189f1
Cleanup error printing.
10 years ago
Brian McQueen
d56c748fa8
switch it back to chris's repo
10 years ago
Brian McQueen
c0dfdf4392
switch to my forked repo
10 years ago
Chris Lu
179d36ba0e
formatting code by: goimports -w=true .
10 years ago
wyy
4126280d55
use github.com/chrislusf instead of github.com/aszxqw
10 years ago
wyy
1cd19447e3
use github.com/aszxqw instead of code.google.com/p
10 years ago
Chris Lu
faf497feb8
Important Fix: Avoid overwriting the index file!!!
11 years ago
Chris Lu
3b5035c468
1. v0.54
2. go vet found many printing format errors
11 years ago
Chris Lu
51939efeac
1. volume server now sends master server its max file key, so that
master server does not need to store the sequence on disk any more
2. fix raft server's failure to init cluster during bootstrapping
11 years ago
Chris Lu
3dbebfd1e1
Thread-safe fixes:
1. avoid sharing []byte
2. switch to use ReadAt()
11 years ago
Chris Lu
cd10c277b2
can now delete a collection! Is this a dangerous feature? Only enabling
deleting "benchmark" collections for now.
11 years ago
Chris Lu
82b74c7940
issue 43 "go fmt" chagnes from "Ryan S. Brown" <sb@ryansb.com>
some basic changes to parse upload url
11 years ago
Chris Lu
ed154053c8
switching to temporarily use glog library
12 years ago
Chris Lu
50269b74ce
add dataCenter option when assign file keys
add dataCenter option when starting volume servers
some work related to freeze a volume. Not tested yet.
12 years ago
Chris Lu
fb635146a1
refactoring needle mapper interface to separate index file storage logic
out
12 years ago
Chris Lu
db8e27be6e
add lots of error checking by GThomas
12 years ago
Chris Lu
a4cef2fbd4
only cares about error other than EOF
12 years ago
Chris Lu
91492b4947
avoid EOF error on windows. This is a "try to load" function anyway.
12 years ago
Chris Lu
aecea22666
Issue 15: Stress test corrupts volume
12 years ago
Chris Lu
5071f528f6
testing compilation with remove package
12 years ago
Chris Lu
55f2627fcf
testing new directory structure
12 years ago
Chris Lu
ab6fb13ad7
avoid the "src" folder
12 years ago
Chris Lu
cb4e8ec16b
re-organize code directory structure
12 years ago
Chris Lu
81b9175c7a
re-factoring volume file scanning code
add export function
fix bugs on deleted byte counting
12 years ago
Chris Lu
f35b958d90
adding visit function for the NeedleMap
12 years ago
Chris Lu
bf9c4ed033
Revert "add cmd/dump - a dumper"
This reverts commit 5d2a1e8d48
.
12 years ago
Chris Lu
d1494ea786
Revert "add CdbMap"
This reverts commit bf0ccf3461
.
12 years ago
Chris Lu
5b49065a57
Revert "add Frozen attribute to VolumeInfo"
This reverts commit dd685fdd8d
.
12 years ago
Chris Lu
3b21317863
Revert "add "freeze" subcommand to volume"
This reverts commit f262fed197
.
12 years ago
Chris Lu
ee08e38126
Revert "fix errors with frozen volume loading"
This reverts commit 92ffba2ab9
.
12 years ago
Tamás Gulácsi
92ffba2ab9
fix errors with frozen volume loading
12 years ago
Tamás Gulácsi
f262fed197
add "freeze" subcommand to volume
12 years ago
Tamás Gulácsi
dd685fdd8d
add Frozen attribute to VolumeInfo
12 years ago
Tamás Gulácsi
bf0ccf3461
add CdbMap
12 years ago
Tamás Gulácsi
5d2a1e8d48
add cmd/dump - a dumper
Walk needed to be added to NeedleMap and CompactMap, to be able to add WalkKeys and WalkValues to volume. This is needed for iterating through all the stored needles in a volume - this was dump's purpose.
12 years ago
Chris Lu
6201ed537e
reporting volume size as early as possible
12 years ago
Chris Lu
94dbe60233
periodically compact volumes
12 years ago
Chris Lu
b23e51f205
remove debug message
12 years ago
Chris Lu
01f2fcf72d
remove comments
12 years ago
Chris Lu
86c8f248bd
support compacting a volume
12 years ago
Chris Lu
6b1e60582c
adding file count and deletion count
12 years ago
Chris Lu
2fe4371899
change to a more memory efficient map, implemented by several lists of
<key,offset,size>
12 years ago
Chris Lu
98022f2b3d
use NeedleValue directly instead of additional pointer, to reduce memory
usage
12 years ago