chrislusf
1704e5f1a6
adjust debug message
10 years ago
Chris Lu
7b4a53b2c1
Add optional admin port to volume server, to seperate admin operations from normal file operations.
10 years ago
Chris Lu
af416189f1
Cleanup error printing.
10 years ago
yanyiwu
cacfc85869
add some String() to make codes easier to read and debug
10 years ago
Brian McQueen
d56c748fa8
switch it back to chris's repo
10 years ago
Brian McQueen
c0dfdf4392
switch to my forked repo
10 years ago
Chris Lu
179d36ba0e
formatting code by: goimports -w=true .
10 years ago
wyy
4126280d55
use github.com/chrislusf instead of github.com/aszxqw
10 years ago
wyy
1cd19447e3
use github.com/aszxqw instead of code.google.com/p
10 years ago
Chris Lu
b9aee2defb
add TTL support
The volume TTL and file TTL are not necessarily the same. as long as
file TTL is smaller than volume TTL, it'll be fine.
volume TTL is used when assigning file id, e.g.
http://.../dir/assign?ttl=3h
file TTL is used when uploading
10 years ago
Chris Lu
0abd809663
Correct logic to allocate volume slots
11 years ago
Chris Lu
47620bb27a
correct assign logic for rack level. Still need to fix data center
level.
11 years ago
Chris Lu
ae2ef6e41d
mostly working correctly, but may have failed volume growing attempts
when slots are tight.
11 years ago
Chris Lu
f7f582ec86
1. refactoring, merge "replication" logic into "topology" package
2. when growing volumes, additional preferred "rack" and "dataNode"
paraemters are also provided. Previously only "dataCenter" paraemter is
provided.
11 years ago
Chris Lu
0563773944
switch to ReadAt() for thread-safe read
fix bugs during volume compaction
11 years ago
Chris Lu
eec67d6008
fix bug on volume growing failure where free space equals what's
required.
more meaningful volume allocation errors
11 years ago
Chris Lu
27c74a7e66
Major:
change replication_type to ReplicaPlacement, hopefully cleaner code
works for 9 possible ReplicaPlacement
xyz
x : number of copies on other data centers
y : number of copies on other racks
z : number of copies on current rack
x y z each can be 0,1,2
Minor:
weed server "-mdir" default to "-dir" if empty
11 years ago
Chris Lu
edae676913
1. volume server auto detect clustered master nodes
2. remove operation package dependency on storage
11 years ago
Chris Lu
3b68711139
support for collections!
11 years ago
Chris Lu
82b74c7940
issue 43 "go fmt" chagnes from "Ryan S. Brown" <sb@ryansb.com>
some basic changes to parse upload url
11 years ago
Chris Lu
078118ecba
v0.40
12 years ago
Chris Lu
ed154053c8
switching to temporarily use glog library
12 years ago
Chris Lu
63ebafa113
fix when volume growth are partial successful in automatic mode
12 years ago
Chris Lu
ac15868694
clean up log fmt usage. Move to log for important data changes,
warnings.
12 years ago
Chris Lu
50269b74ce
add dataCenter option when assign file keys
add dataCenter option when starting volume servers
some work related to freeze a volume. Not tested yet.
12 years ago
Chris Lu
db8e27be6e
add lots of error checking by GThomas
12 years ago
Chris Lu
2ca983b6d8
print out error message
12 years ago
Chris Lu
5071f528f6
testing compilation with remove package
12 years ago
Chris Lu
55f2627fcf
testing new directory structure
12 years ago
Chris Lu
ab6fb13ad7
avoid the "src" folder
12 years ago
Chris Lu
cb4e8ec16b
re-organize code directory structure
12 years ago
Chris Lu
b0c7df0c3b
go fmt for all source codes
12 years ago
Chris Lu
bf9c4ed033
Revert "add cmd/dump - a dumper"
This reverts commit 5d2a1e8d48
.
12 years ago
Tamás Gulácsi
5d2a1e8d48
add cmd/dump - a dumper
Walk needed to be added to NeedleMap and CompactMap, to be able to add WalkKeys and WalkValues to volume. This is needed for iterating through all the stored needles in a volume - this was dump's purpose.
12 years ago
Chris Lu
ab5e9727a9
reading/setting/reporting correct volume version
12 years ago
Chris Lu
9782ace1bd
add locking when adjusting topology
12 years ago
Chris Lu
6ce41e30a4
change to 3-digit replication types
12 years ago
Chris Lu
08dcf2f035
refactoring allocate_volume operation
12 years ago
Chris Lu
a1bc529db6
lots of fix
1. sending 404 if not found
2. handle node-up/node-down/changing-max/volume-become-full
12 years ago
Chris Lu
e19fd68f18
working now to start/stop volume servers
12 years ago
Chris Lu
b0e250d437
adjusting refresh topology writable volumes(not finished yet)
Need to refreshWritableVolumes for each replication type
12 years ago
Chris Lu
6671f576cb
adjusting log messages
12 years ago
Chris Lu
4846a7232e
adjusting return messages for growing volumes
12 years ago
Chris Lu
15ced2398e
adjusting maxVolumeCount if volume server changes it
12 years ago
Chris Lu
9b99240584
can auto grow 00 and 01 replication volumes
12 years ago
Chris Lu
9f4630736d
rename Server to DataNode
formatting
12 years ago
Chris Lu
cdd64a8099
dc and rack aware volume allocation
12 years ago
Chris Lu
317e12644a
reserve a volume
add VolumeId.Next()
12 years ago
Chris Lu
2dceb44ae4
add more for volume placement
fix possible nil volume cases
13 years ago