chrislu
33b11f92bc
Squashed commit of the following:
commit 465b47b8f7
Merge: f39272b54 9c440d472
Author: chrislu <chris.lu@gmail.com>
Date: Wed Jul 10 23:56:51 2024 -0700
Merge branch 'master' into merged-persisted-logs
commit f39272b5416bdd4d1714ce3e99aded0fe62e7d89
Author: chrislu <chris.lu@gmail.com>
Date: Wed Jul 10 23:49:26 2024 -0700
merge meta logs from multiple files
6 months ago
chrislu
ccdd9cd8de
refactor
9 months ago
chrislu
34f2b600ac
each log function adds a "done" return parameter
10 months ago
chrislu
49428a303b
add batch index for each memory buffer
12 months ago
chrislu
3fc3e7083c
metadata skip reading un-available logs
this means the volumes for metadata histories have been lost.
2 years ago
chrislu
70a4c98b00
refactor filer_pb.Entry and filer.Entry to use GetChunks()
for later locking on reading chunks
2 years ago
chrislu
eaeb141b09
move proto package
2 years ago
chrislu
26dbc6c905
move to https://github.com/seaweedfs/seaweedfs
2 years ago
chrislu
64f3d6fb6e
metadata subscription uses client epoch
2 years ago
chrislu
aece35a64f
stop when on disk log is done
3 years ago
chrislu
a2b101a737
subscribe metadata between a range
3 years ago
chrislu
76da688176
adjust log level
3 years ago
Chris Lu
2baed2e1e9
avoid possible metadata subscription data loss
Previous implementation append filer logs into one file. So one file is not always sorted, which can lead to miss reading some entries, especially when different filers have different write throughput.
3 years ago
Chris Lu
ddc8643ee0
filer: directory listing adds namePatternExclude
fix https://github.com/chrislusf/seaweedfs/issues/2023
4 years ago
Konstantin Lebedev
94eac4f00e
Do reconnect to RabbitMQ
https://github.com/google/go-cloud/issues/2958
https://github.com/chrislusf/seaweedfs/issues/1773
4 years ago
Chris Lu
f002e668de
change limit to int64 in case of overflow
4 years ago
Chris Lu
394513f598
filer: ensure seamless meta data updates
4 years ago
Chris Lu
2c3c2c27d7
separate prefix from namePattern
fix https://github.com/chrislusf/seaweedfs/issues/1722
4 years ago
Chris Lu
5179e559f7
skip empty logs
4 years ago
Chris Lu
387ab6796f
filer: cross cluster synchronization
4 years ago
Chris Lu
eb7929a971
rename filer2 to filer
4 years ago
Chris Lu
ef75ce8a34
use UTC for all time related folders
4 years ago
Chris Lu
b69cb74c03
read meta logs by timestamp
pass in event ts when moving logs
meta aggregator reads in memory logs only
4 years ago
Chris Lu
ca658a97c5
add signatures to messages to avoid double processing
4 years ago
Устюжанин Антон Александрович
dc9fc01254
test ListDirectoryPrefixedEntries
4 years ago
Chris Lu
17f2d05cde
filer: ensure logs are persisted
5 years ago
Chris Lu
49929e0869
rename
5 years ago
Chris Lu
55e40b08fc
refactoring
5 years ago
Chris Lu
37d5b3ba12
replication: pass isFromOtherCluster also to EventNotification
EventNotification is consistent with message queue and metadata logs.
5 years ago
Chris Lu
31e23e9783
filer: support active<=>active filer replication
5 years ago
Chris Lu
df75b5c98d
passing ctx for metadata logging
5 years ago
Chris Lu
f9b6178b8f
log messages
5 years ago
Chris Lu
9e72e9e4b8
able to subscribe any topic from any point of time
5 years ago
Chris Lu
f9da859720
better error message
5 years ago
Chris Lu
5c57297bd1
metadata log: read from any timestamp
5 years ago
Chris Lu
e24b25de78
async meta caching: can stream updates now
5 years ago
Chris Lu
ebfab42a50
refactoring
5 years ago
Chris Lu
2955b96ef1
refactor
5 years ago
Chris Lu
ce3cb25cfb
working for in memory single log buffer
5 years ago
Chris Lu
7764e0465c
refactoring
5 years ago
Chris Lu
d30483d642
re-enable system logs
5 years ago
Chris Lu
bcf37346ef
add timestamp inside lock
5 years ago
Chris Lu
ed98223b08
still log, but not persisting the changes
5 years ago
Chris Lu
90d576affe
disable meta data change event logging for now.
5 years ago
Chris Lu
53626734d4
iterate through the log buffer
5 years ago
Chris Lu
b10679fcf0
adjust log file names
5 years ago
Chris Lu
bf270d9e8c
filer: able to tail meta data changes
5 years ago
Chris Lu
2fc2eb74dd
refactoring
5 years ago
Chris Lu
c22094d340
adjust logging
5 years ago
Chris Lu
50a5018b7f
writing meta logs is working
5 years ago