j.laycock
1f01eb78e8
Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct
5 years ago
j.laycock
1e62a2b233
Fix memory not being unmapped
5 years ago
j.laycock
840ccdc35d
Refactor to pass memory maps by reference instead of value, fix memory maps not being created properly or written to properly
5 years ago
j.laycock
dc50701e7d
Overload createFile function, expose File in memory_map struct, delete from memory_map map on delete
5 years ago
j.laycock
0e5d3b1a70
Move memory_map_windows to new folder, intercept most of the read and write calls to volume dat files
5 years ago
Chris Lu
d829df4f59
volume: protect against nil needle map
fix @mastak reported nil problem in https://github.com/chrislusf/seaweedfs/issues/1037
5 years ago
Chris Lu
e40634e6b4
volume: fail the volume deletion if compaction is in progress
fix https://github.com/chrislusf/seaweedfs/issues/1035
5 years ago
Chris Lu
33b3366043
volume: avoid compacting wait group
6 years ago
Chris Lu
5a135fef87
purge old code
6 years ago
Chris Lu
c54d9221b9
write requests also checks cookie if overwrites
protect against edge cases, avoid https://github.com/chrislusf/seaweedfs/issues/1014
6 years ago
Chris Lu
c33f423955
stop early if compaction fails
fix https://github.com/chrislusf/seaweedfs/issues/1015
6 years ago
Chris Lu
c2960c7a86
defaulting file ttl to volume ttl
fix https://github.com/chrislusf/seaweedfs/issues/992
6 years ago
Chris Lu
440111a349
volume: support http status 304 for the same file id
6 years ago
Chris Lu
0302b9496c
volume: also check cookie for possible duplicates
6 years ago
Chris Lu
ac2727853f
fix needle map entry size
6 years ago
Chris Lu
e5506152c0
refactoring
6 years ago
Chris Lu
b09e8dbb37
add VolumeStreamFollow, but not used yet
6 years ago
Chris Lu
f567777d64
volume: fix needle checking for deleted needles
6 years ago
Chris Lu
000ee725fc
refactor Offset into a struct of bytes
6 years ago
Chris Lu
df95ce0b6c
weed backup: efficient delta backup
fix https://github.com/chrislusf/seaweedfs/issues/399
6 years ago
bingoohuang
6ddfaf33cb
extract VolumeFileScanner for ScanVolumeFile
6 years ago
bingoohuang
27093bc2e5
fix needle Append return offset to avoid uint32 overflow
6 years ago
Chris Lu
badd8fdf8f
shortcut for empty file
6 years ago
Chris Lu
6b5d6bb5a6
adjust error names
6 years ago
Chris Lu
9383c91eb1
wait to read again if the volume is compacting
6 years ago
Chris Lu
1478d7ea21
reduce file seek when writing
6 years ago
Chris Lu
f64dc7465b
remove index file
fix https://github.com/chrislusf/seaweedfs/issues/793
6 years ago
Chris Lu
86dd933596
go fmt
6 years ago
Chris Lu
2697d6a4fb
fix deleting bucket
6 years ago
Chris Lu
f9dbaf6292
delete file by name instead of referencing the dataFile pointer
6 years ago
alex8224
8d3f9c0b75
fix invalid point when delete collection
6 years ago
Chris Lu
f050b22d6c
close file in ScanVolumeFile()
fix https://github.com/chrislusf/seaweedfs/issues/761
6 years ago
Chris Lu
ac793a3c5a
clean remove all left over files when deleting a collection
6 years ago
Chris Lu
ea8ecf35f4
set needle AppendAtNs value during writes
7 years ago
Chris Lu
4f317c7e3d
working version3
7 years ago
Chris Lu
3edfe1d28f
extend export command to show tombstone + change output format to CSV
merging https://github.com/chrislusf/seaweedfs/pull/610 and add "-limit" option
7 years ago
Chris Lu
d4d7ced922
refactoring: add type for needle id, offset
later the type size can possibly be adjusted
7 years ago
Chris Lu
9ba335a7c4
prepare for flexible super block
7 years ago
Chris Lu
5047bdb4a2
skip bytes cache
8 years ago
brstgt
4fb5bb09b6
Remove obsolete property Volume.dataFileSize
8 years ago
brstgt
18b3afc97a
Log volumeId if dataFileSize != actual data file size - improve log types
8 years ago
brstgt
0c898df430
Log volumeId if dataFileSize != actual data file size
8 years ago
Chris Lu
13e7069eb9
keep track of total data file size
8 years ago
Chris Lu
d981eb282f
refactor volume_read_write.go out of volume.go
9 years ago
Chris Lu
576573711a
refactoring
9 years ago
Chris Lu
3d8df0f709
refactor volume_loading.go out of volume.go
9 years ago
Chris Lu
582d5d526c
refactoring
9 years ago
Chris Lu
3713119ab9
adjust verification logic.
1. log file name for easier debugging
2. remove unused version in readIndexEntryAtOffset()
3. if indexSize==0, the dataFile usually still has a super block of
size 8. So skipping this case.
9 years ago
霍晓栋
16f6984d02
refactor data integrity checking code v2
9 years ago
霍晓栋
dda13def2a
refactor data integrity checking code
9 years ago