seaweedfs

Commit Graph

Author	SHA1	Message	Date
chrislu	89a1fd1751	Squashed commit of the following: commit `4827425146` Author: chrislu <chris.lu@gmail.com> Date: Sat Sep 16 15:05:38 2023 -0700 balancer works commit `3b50139f68` Author: chrislu <chris.lu@gmail.com> Date: Fri Sep 15 22:22:32 2023 -0700 comments commit `7f685ce7ba` Author: chrislu <chris.lu@gmail.com> Date: Fri Sep 15 22:20:05 2023 -0700 adjust APIs commit `436d99443b` Author: chrislu <chris.lu@gmail.com> Date: Thu Sep 14 23:49:05 2023 -0700 receive broker stats commit `b771fefa37` Merge: `0a851ec00` `890881037` Author: chrislu <chris.lu@gmail.com> Date: Wed Sep 13 00:03:47 2023 -0700 Merge branch 'master' into sub commit `0a851ec00b` Author: chrislu <chris.lu@gmail.com> Date: Sun Sep 10 22:01:25 2023 -0700 Create balancer.go commit `39941edc0b` Author: chrislu <chris.lu@gmail.com> Date: Thu Sep 7 23:55:19 2023 -0700 add publisher shutdown commit `875f562779` Author: chrislu <chris.lu@gmail.com> Date: Wed Sep 6 23:16:41 2023 -0700 server side send response at least once per second commit `984b6c54cf` Author: chrislu <chris.lu@gmail.com> Date: Wed Sep 6 23:15:29 2023 -0700 ack interval 128 commit `2492a45499` Author: chrislu <chris.lu@gmail.com> Date: Wed Sep 6 22:39:46 2023 -0700 ack interval commit `ba67e6ca29` Author: chrislu <chris.lu@gmail.com> Date: Mon Sep 4 21:43:50 2023 -0700 api for sub commit `9e4f985698` Author: chrislu <chris.lu@gmail.com> Date: Mon Sep 4 21:43:30 2023 -0700 publish, benchmark commit `cb470d44df` Author: chrislu <chris.lu@gmail.com> Date: Fri Sep 1 00:36:51 2023 -0700 can pub and sub commit `1eb2da46d5` Author: chrislu <chris.lu@gmail.com> Date: Mon Aug 28 09:02:12 2023 -0700 connect and publish commit `504ae8383a` Author: chrislu <chris.lu@gmail.com> Date: Mon Aug 28 09:01:25 2023 -0700 protoc version commit `dbcba75271` Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 18:59:04 2023 -0700 rename to lookup commit `c9caf33119` Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 18:33:46 2023 -0700 move functions commit `4d6c18d86f` Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 17:50:59 2023 -0700 pub sub initial tests commit `4eb8e8624d` Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 13:14:39 2023 -0700 rename commit `1990456670` Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 13:13:14 2023 -0700 sub commit `905911853d` Author: chrislu <chris.lu@gmail.com> Date: Sat Aug 26 13:39:21 2023 -0700 adjust proto	1 year ago
chrislu	4827425146	balancer works	1 year ago
chrislu	436d99443b	receive broker stats	1 year ago
chrislu	2492a45499	ack interval	1 year ago
chrislu	ba67e6ca29	api for sub	1 year ago
chrislu	cb470d44df	can pub and sub	1 year ago
chrislu	504ae8383a	protoc version	1 year ago
chrislu	dbcba75271	rename to lookup	1 year ago
chrislu	4d6c18d86f	pub sub initial tests	1 year ago
chrislu	1990456670	sub	1 year ago
chrislu	905911853d	adjust proto	1 year ago
Nico D'Cotta	796b7508f3	Implement SRV lookups for filer (#4767 )	1 year ago
chrislu	010c5e91e3	add stream assign proto	1 year ago
chrislu	01d70c21f3	Squashed commit of the following: commit `32f4b1a130` Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 20 22:52:19 2023 -0700 fix compilation commit `e77ad33b7c` Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 20 22:46:44 2023 -0700 pub commit `f431f30cc7` Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 20 13:27:39 2023 -0700 fix generic type commit `4e9dcb1829` Merge: 30f942580 16e3f2d52 Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 20 12:47:14 2023 -0700 Merge branch 'master' into pubsub commit 30f942580ad1bb32ae94aade2e3a21ec3ab63e21 Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 20 11:10:58 2023 -0700 wip commit f8b00980bc2f3879bb43decffd9a08d842f196f2 Author: chrislu <chris.lu@gmail.com> Date: Tue Jul 25 09:14:35 2023 -0700 add design document commit 08d2bebe42a26ebc39f1542f54d99e73620727dd Author: chrislu <chris.lu@gmail.com> Date: Tue Jul 25 09:14:06 2023 -0700 minor commit bcfa7982b262a40fcdce6fc6613fad2ce07c13da Author: chrislu <chris.lu@gmail.com> Date: Tue Jul 25 09:13:49 2023 -0700 rename	1 year ago
chrislu	f8aa5ea844	adjust filer.proto	2 years ago
chrislu	5149b3d07b	filer can proxy to peer filer holding the lock	2 years ago
chrislu	464a71a373	add distributed lock manager	2 years ago
chrislu	3fd659df2a	add distributed lock manager	2 years ago
chrislu	8ec1bc2c99	remove unused cluster node leader	2 years ago
Konstantin Lebedev	25535e9c36	Delete volume is empty (#4561 ) * use onlyEmpty for deleteVolume https://github.com/seaweedfs/seaweedfs/issues/4559 * fix IsEmpty * fix test --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>	2 years ago
wusong	26f15d0079	Fix no more writable volumes by delay judgment (#4548 ) * fix nomore writables volumes while disk free space is sufficient by time delay * reset --------- Co-authored-by: wang wusong <wangwusong@virtaitech.com>	2 years ago
mervynzhang	1ebb549f77	support swift (#4480 )	2 years ago
Konstantin Lebedev	d75a7b7f62	allow deleting only older empty dir without recursion (#4430 )	2 years ago
chrislu	5db9fcccd4	refactoring	2 years ago
Muhammad Hallaj bin Subery	9bd422d2c9	adding support for B2 region (#4177 ) Co-authored-by: Muhammad Hallaj bin Subery <hallaj@tuta.io>	2 years ago
chrislu	81fdf3651b	grpc connection to filer add sw-client-id header	2 years ago
Guo Lei	d8cfa1552b	support enable/disable vacuum (#4087 ) * stop vacuum * suspend/resume vacuum * remove unused code * rename * rename param	2 years ago
chrislu	e1ca6308cb	add chunk etag when downloading from remote storage fix https://github.com/seaweedfs/seaweedfs/issues/3987	2 years ago
James Hartig	81624de27b	Include name/mime in ReadAllNeedles (#4005 )	2 years ago
James Hartig	4c85da7844	Include meta in ReadAllNeedles (#3991 ) This is useful for doing backups on the data so we can accurately store the last modified time, the compression state, and verify the crc. Previously we were doing VolumeNeedleStatus and then an HTTP request which needlessly read from the dat file twice.	2 years ago
chrislu	70a4c98b00	refactor filer_pb.Entry and filer.Entry to use GetChunks() for later locking on reading chunks	2 years ago
chrislu	ea2637734a	refactor filer proto chunk variable from mtime to modified_ts_ns	2 years ago
Eric Yang	51d462f204	ADHOC: volume fsck using append at ns (#3906 ) * ADHOC: volume fsck using append at ns * nit * nit Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>	2 years ago
chrislu	de286fe662	shell: volume.move handles volume moved to cloud tier fix https://github.com/seaweedfs/seaweedfs/issues/3803	2 years ago
Konstantin Lebedev	e20f0dbd2d	avoid data race of TraverseBfs (#3856 ) * avoid data race of TraverseBfs * close is enough avoid panic I1014 12:29:59.207120 volume_loading.go:131 loading sorted db /tmp/sw/test2_19.sdx error: unexpected file /tmp/sw/test2_19.idx size: 255 I1014 12:29:59.207125 volume_loading.go:119 open to write file /tmp/sw/test4_26.idx panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x5260a4c] goroutine 287 [running]: github.com/seaweedfs/seaweedfs/weed/storage.(SortedFileNeedleMap).Close(0x0) /Users/tochka/GolandProjects/seaweedfs/weed/storage/needle_map_sorted_file.go:97 +0x2c github.com/seaweedfs/seaweedfs/weed/storage.(Volume).load.func1() /Users/tochka/GolandProjects/seaweedfs/weed/storage/volume_loading.go:32 +0x8e github.com/seaweedfs/seaweedfs/weed/storage.(Volume).load(0xc001b36280, 0x1, 0x1, 0x0, 0x69228c0?) /Users/tochka/GolandProjects/seaweedfs/weed/storage/volume_loading.go:205 +0x256c github.com/seaweedfs/seaweedfs/weed/storage.NewVolume({0x7ffeefbff6e0, 0x7}, {0x7ffeefbff6e0, 0x7}, {0xc0009a9284, 0x5}, 0x13, 0x0, 0x0, 0x0, ...) /Users/tochka/GolandProjects/seaweedfs/weed/storage/volume.go:62 +0x30f github.com/seaweedfs/seaweedfs/weed/storage.(DiskLocation).loadExistingVolume(0xc0006f40c0, {0x846c8d0, 0xc0009ce600}, 0x0?, 0x1) /Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:161 +0x4da github.com/seaweedfs/seaweedfs/weed/storage.(DiskLocation).concurrentLoadingVolumes.func2() /Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:201 +0xf9 created by github.com/seaweedfs/seaweedfs/weed/storage.(DiskLocation).concurrentLoadingVolumes /Users/tochka/GolandProjects/seaweedfs/weed/storage/disk_location.go:198 +0x150	2 years ago
Konstantin Lebedev	f476cf3403	fix volume_server.proto conflict (#3858 ) fix conflict https://github.com/seaweedfs/seaweedfs/pull/3841	2 years ago
Konstantin Lebedev	2f72103c83	avoid load volume file with BytesOffset mismatch (#3841 ) * avoid load volume file with BytesOffset mismatch https://github.com/seaweedfs/seaweedfs/issues/2966 * set BytesOffset if has not VolumeInfoFile * typos fail => failed * exit if bytesOffset mismatch	2 years ago
chrislu	dcd0743a35	remove unused ReadNeedleBlobRequest.needle_id fix https://github.com/seaweedfs/seaweedfs/issues/3853	2 years ago
Konstantin Lebedev	36daa7709d	show raft leader via shell (#3796 )	2 years ago
LHHDZ	e00a12b099	associate `Account` and `Identity` by accountId (#3754 )	2 years ago
chrislu	31922b2bf2	s3 to watch specific directories	2 years ago
chrislu	b90d92fca9	grpc: watch metadata changes by directory	2 years ago
chrislu	21c0587900	go fmt	2 years ago
chrislu	c8645fd232	master: implement grpc VolumeMarkWritable fix https://github.com/seaweedfs/seaweedfs/issues/3657	2 years ago
Ryan Russell	12914af4d8	Character readability (#3678 ) * refactor(pb): `quote_charactoer` -> `quote_character` Signed-off-by: Ryan Russell <git@ryanrussell.org> * refactor(volume_server): `QuoteCharactoer` -> `QuoteCharacter` Signed-off-by: Ryan Russell <git@ryanrussell.org> * refactor(volume_server): `quoteCharactoer` -> `quoteCharacter` Signed-off-by: Ryan Russell <git@ryanrussell.org> Signed-off-by: Ryan Russell <git@ryanrussell.org>	2 years ago
Ryan Russell	a8d7615eec	refactor(filer_client): `EachEntryFunciton` -> `EachEntryFunction` (#3671 ) Signed-off-by: Ryan Russell <git@ryanrussell.org> Signed-off-by: Ryan Russell <git@ryanrussell.org>	2 years ago
Konstantin Lebedev	721c6197f9	skip deltaBeat if dn is zero (#3630 ) * skip deltaBeat https://github.com/seaweedfs/seaweedfs/issues/3629 * fix GrpcPort * skip url :0 * skip empty DataCenter or Rack * skip empty heartbeat Ip * dell msg add DataCenter * comment todo * fix	2 years ago
chrislu	b9112747b5	volume server: synchronously report volume readonly status to master fix https://github.com/seaweedfs/seaweedfs/issues/3628	2 years ago
Eric Yang	b324a6536c	ADHOC: add read needle meta grpc (#3581 ) * ADHOC: add read needle meta grpc * add test * nit Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>	2 years ago
askeipx	2e78a522ab	remove old raft servers if they don't answer to pings for too long (#3398 ) * remove old raft servers if they don't answer to pings for too long add ping durations as options rename ping fields fix some todos get masters through masterclient raft remove server from leader use raft servers to ping them CheckMastersAlive for hashicorp raft only * prepare blocking ping * pass waitForReady as param * pass waitForReady through all functions * waitForReady works * refactor * remove unneeded params * rollback unneeded changes * fix	2 years ago

1 2 3 4 5 ...

532 Commits (488a7dc4287bc2962e437d73ab258f3eabe34b64)