Chris Lu
51939efeac
1. volume server now sends master server its max file key, so that
master server does not need to store the sequence on disk any more
2. fix raft server's failure to init cluster during bootstrapping
11 years ago
Chris Lu
f7f582ec86
1. refactoring, merge "replication" logic into "topology" package
2. when growing volumes, additional preferred "rack" and "dataNode"
paraemters are also provided. Previously only "dataCenter" paraemter is
provided.
11 years ago
Chris Lu
008aee0dc1
Add retrying logic to wait for other peers during cluster bootstrapping.
11 years ago
Chris Lu
0563773944
switch to ReadAt() for thread-safe read
fix bugs during volume compaction
11 years ago
Chris Lu
41143b3b78
toughen weedfs clustering, adding synchronizing max volume id among
peers in order to avoid the same volume id being assigned twice
1. moving raft.Server to topology
2. adding max volume id command for raft
11 years ago
Chris Lu
cd10c277b2
can now delete a collection! Is this a dangerous feature? Only enabling
deleting "benchmark" collections for now.
11 years ago
Chris Lu
27c74a7e66
Major:
change replication_type to ReplicaPlacement, hopefully cleaner code
works for 9 possible ReplicaPlacement
xyz
x : number of copies on other data centers
y : number of copies on other racks
z : number of copies on current rack
x y z each can be 0,1,2
Minor:
weed server "-mdir" default to "-dir" if empty
11 years ago
Chris Lu
ef4c2c0d1e
cleaner cluster messages
11 years ago
Chris Lu
3b68711139
support for collections!
11 years ago
Chris Lu
1888d01fa0
adding etcd storage support for cluster meta data. Currently just
sequence. More to come...
11 years ago
Chris Lu
82b74c7940
issue 43 "go fmt" chagnes from "Ryan S. Brown" <sb@ryansb.com>
some basic changes to parse upload url
11 years ago
Chris Lu
ed154053c8
switching to temporarily use glog library
12 years ago
Chris Lu
ac15868694
clean up log fmt usage. Move to log for important data changes,
warnings.
12 years ago
Chris Lu
50269b74ce
add dataCenter option when assign file keys
add dataCenter option when starting volume servers
some work related to freeze a volume. Not tested yet.
12 years ago
Chris Lu
915b16f97a
refactoring, same logic, but the store replication logic is moved to a
stand-alone file, for later easier improvements
12 years ago
Chris Lu
9da3ea35ac
avoid empty data nodes
12 years ago
Chris Lu
a1d5a6298c
avoid missing configuration file error
12 years ago
Chris Lu
2d4a7ac9f9
avoid error when missing configuration file
12 years ago
Chris Lu
018df9ceb0
avoid file not exist error
12 years ago
Chris Lu
db8e27be6e
add lots of error checking by GThomas
12 years ago
Chris Lu
5071f528f6
testing compilation with remove package
12 years ago
Chris Lu
55f2627fcf
testing new directory structure
12 years ago
Chris Lu
ab6fb13ad7
avoid the "src" folder
12 years ago
Chris Lu
cb4e8ec16b
re-organize code directory structure
12 years ago
Chris Lu
8fb8ebdf14
master can redirect GET/DELETE/POST requests to volume servers. So
clients does not always need to remember the volume server locations.
This is good for low~medium sized web site traffic.
12 years ago
Chris Lu
018f0b73be
properly handle quick volume server restart
12 years ago
Chris Lu
e19edccf3a
ensure properly make volume unwritable. Previously passing volumeInfo
reference, causing make wrong volumes unwritable!
12 years ago
Chris Lu
86c8f248bd
support compacting a volume
12 years ago
Chris Lu
3aefea0fe2
show volume status
12 years ago
Chris Lu
e340fbee82
removing set volume location
display version number
add default replication type
12 years ago
Chris Lu
df74f538f7
adjusting http status code for creation
switch to new lookup implementation
12 years ago
Chris Lu
73dbb3aed9
load configuration file, with topology configured
12 years ago
Chris Lu
a1bc529db6
lots of fix
1. sending 404 if not found
2. handle node-up/node-down/changing-max/volume-become-full
12 years ago
Chris Lu
fc9f1da143
handle volume server up/down events
12 years ago
Chris Lu
e19fd68f18
working now to start/stop volume servers
12 years ago
Chris Lu
f3da0906ed
channel based visitor pattern
12 years ago
Chris Lu
b0e250d437
adjusting refresh topology writable volumes(not finished yet)
Need to refreshWritableVolumes for each replication type
12 years ago
Chris Lu
4846a7232e
adjusting return messages for growing volumes
12 years ago
Chris Lu
15ced2398e
adjusting maxVolumeCount if volume server changes it
12 years ago
Chris Lu
9b99240584
can auto grow 00 and 01 replication volumes
12 years ago
Chris Lu
e7c4ee1c64
register reported topology
12 years ago
Chris Lu
6daf221937
volume layout for each replication level
12 years ago
Chris Lu
9f4630736d
rename Server to DataNode
formatting
12 years ago
Chris Lu
cdd64a8099
dc and rack aware volume allocation
12 years ago
Chris Lu
b95c9860ed
interface and default implementation for node
12 years ago
Chris Lu
6a84f50d24
interface and default implementation for node
12 years ago
Chris Lu
a467d5081c
adjusted tests
12 years ago
Chris Lu
c51884ce23
remove extra code
12 years ago
Chris Lu
1760dd083d
remove reservedVolumeCount to simplify volume allocation logic
12 years ago
Chris Lu
c48bda0232
return the node during assigning free volume
12 years ago