Chris Lu
fa176fe80f
volume tailing chunks large files
6 years ago
Chris Lu
b09e8dbb37
add VolumeStreamFollow, but not used yet
6 years ago
Chris Lu
cea5c53bf7
fix length checking
fix https://github.com/chrislusf/seaweedfs/issues/890
6 years ago
Chris Lu
916b809c08
add error checking
6 years ago
Chris Lu
44647a46c0
needle scanner read appendAtNs
6 years ago
bingoohuang
27093bc2e5
fix needle Append return offset to avoid uint32 overflow
6 years ago
Chris Lu
1478d7ea21
reduce file seek when writing
6 years ago
Chris Lu
168f461761
fix MaxUint8
6 years ago
Chris Lu
8f78a069c6
fix possible name overflow when len(name)>255
6 years ago
Chris Lu
77fadab560
go fmt
7 years ago
Chris Lu
4f317c7e3d
working version3
7 years ago
Chris Lu
7e2031b18f
go fmt
7 years ago
Chris Lu
d4d7ced922
refactoring: add type for needle id, offset
later the type size can possibly be adjusted
7 years ago
Chris Lu
7f7e4e9885
fix error for deleted files during compaction
deletion during commit may cause trouble when make up the difference during commitCompact()
7 years ago
Chris Lu
5047bdb4a2
skip bytes cache
8 years ago
Chris Lu
ed44f12f6d
support Fallocate on linux
8 years ago
sparklxb
86a7c56275
support additional header name-value pairs
8 years ago
Chris Lu
13e7069eb9
keep track of total data file size
8 years ago
霍晓栋
78678f4bcb
deleted needle does not need checksum verification
9 years ago
霍晓栋
16f6984d02
refactor data integrity checking code v2
9 years ago
霍晓栋
dda13def2a
refactor data integrity checking code
9 years ago
霍晓栋
2e74fb60c8
add data integrity checking
9 years ago
Chris Lu
5ce6bbf076
directory structure change to work with glide
glide has its own requirements. My previous workaround caused me some
code checkin errors. Need to fix this.
9 years ago
Chris Lu
f8b03c45ef
properly release memory
fix https://github.com/chrislusf/seaweedfs/issues/301
9 years ago
chrislusf
adcfaa5735
correct cache: fix racing condition
9 years ago
chrislusf
b03e7b26b5
add []byte caching and pooling
fixes https://github.com/chrislusf/seaweedfs/issues/211
9 years ago
chrislusf
0649d778a7
pooling []byte
reduce the number of requests to make([]byte)
9 years ago
chrislusf
b39c384d6d
Revert "Merge pull request #284 from thinxer/binary"
This reverts commit 3523ad5239
, reversing
changes made to 5d100994b1
.
9 years ago
Jianfei Wang
18254d9aae
replace util/bytes.go with binary.BigEndian
9 years ago
chrislusf
5d100994b1
Revert "Merge pull request #281 from thinxer/binary"
This reverts commit a87fe8ffce
, reversing
changes made to 6876bfa685
.
9 years ago
Jianfei Wang
7bc10d46e3
replace util/bytes.go with binary.BigEndian
9 years ago
chrislusf
e921cb1a9d
format changes
9 years ago
tnextday
de5e07ce3e
rename FlagChunkedFile to FlagChunkManifest
9 years ago
tnextday
6b0894d806
update ChunkedFile to seekable reader, so we can use io.* to read data
9 years ago
tnextday
1817864a45
add chunk file helper to support large file
9 years ago
chrislusf
a4d3f2da3d
Avoid nil case when fixing data
10 years ago
chrislusf
86cd40fba8
Add "weed backup" command.
This is a pre-cursor for asynchronous replication.
10 years ago
Stuart P. Bentley
f0c2a2dcb3
Change all chrislusf/weed-fs links to point to chrislu/seaweedfs
10 years ago
chrislusf
b07d81fb08
follow golint suggestions
10 years ago
chrislusf
853701cb6b
Avoid wrong way to delete on replication failure
Avoid wrong way to delete on replication failure. This deletion has bug
to write. The better fix is not to use the deletion on failure at all.
10 years ago
Chris Lu
af416189f1
Cleanup error printing.
10 years ago
Lei Xue
029e3a3822
fix some typos
10 years ago
Brian McQueen
d56c748fa8
switch it back to chris's repo
10 years ago
Brian McQueen
c0dfdf4392
switch to my forked repo
10 years ago
Chris Lu
179d36ba0e
formatting code by: goimports -w=true .
10 years ago
wyy
4126280d55
use github.com/chrislusf instead of github.com/aszxqw
10 years ago
wyy
1cd19447e3
use github.com/aszxqw instead of code.google.com/p
10 years ago
Chris Lu
b9aee2defb
add TTL support
The volume TTL and file TTL are not necessarily the same. as long as
file TTL is smaller than volume TTL, it'll be fine.
volume TTL is used when assigning file id, e.g.
http://.../dir/assign?ttl=3h
file TTL is used when uploading
10 years ago
Chris Lu
af32b52727
1. no locks for all read operations! Switching to pread for all reads.
2. prevent heartbeat lost when vacuuming, by removing locks on Size()
function
11 years ago
Chris Lu
69ac6b6bf6
Issue 45 in weed-fs: [Compact issue] Offset overflow
New issue 45 by hieu.hcmus@gmail.com: [Compact issue] Offset overflow
http://code.google.com/p/weed-fs/issues/detail?id=45
You are using uint32(Maximum 4Gb) to store needle offset(Maximum 32Gb)
when compacting.
Currently It is ok if the volume size is < 4gb
Change variable "offset" in ScanVolumeFile function to uint64 to fix the
issue.
11 years ago