0be020b0fa 
								
									
								
							
								 
							
						 
						
							
							
								
								Nit: unify the default `--maxParallelization` value for `weed shell` commands supporting this option ( #6788 )  
							
							
								
 
							
							
						 
						6 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								ba0707af64 
								
									
								
							
								 
							
						 
						
							
							
								
								Allow configuring the maximum number of concurrent tasks for EC parallelization. ( #6376 )  
							
							
 
							
							
							Follow-up to b0210df0 
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								b0210df081 
								
									
								
							
								 
							
						 
						
							
							
								
								Begin implementing EC balancing parallelization support. ( #6342 )  
							
							
 
							
							
							* Begin implementing EC balancing parallelization support.
Impacts both `ec.encode` and `ec.balance`,
* Nit: improve type naming.
* Make the goroutine workgroup handler for `EcBalance()` a bit smarter/error-proof.
* Nit: unify naming for `ecBalancer` wait group methods with the rest of the module.
* Fix concurrency bug.
* Fix whitespace after Gitlab automerge.
* Delete stray TODO. 
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								8c82c037b9 
								
									
								
							
								 
							
						 
						
							
							
								
								Unify the re-balancing logic for `ec.encode` with `ec.balance`. ( #6339 )  
							
							
 
							
							
							Among others, this enables recent changes related to topology aware
re-balancing at EC encoding time. 
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								522a25790a 
								
									
								
							
								 
							
						 
						
							
							
								
								Remove average constraints when selecting nodes/racks to balance EC shards into. ( #6325 )  
							
							
								
 
							
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								edef485333 
								
									
								
							
								 
							
						 
						
							
							
								
								Account for replication placement settings when balancing EC shards within the same rack. ( #6317 )  
							
							
 
							
							
							* Account for replication placement settings when balancing EC shards within racks.
* Update help contents for `ec.balance`.
* Add a few more representative test cases for `pickEcNodeToBalanceShardsInto()`. 
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								351efa134d 
								
									
								
							
								 
							
						 
						
							
							
								
								Account for replication placement settings when balancing EC shards across racks. ( #6316 )  
							
							
								
 
							
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								b2ba7d7408 
								
									
								
							
								 
							
						 
						
							
							
								
								Resolve replica placement for EC volumes from master server defaults. ( #6303 )  
							
							
								
 
							
							
						 
						11 months ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								efdebf712e 
								
									
								
							
								 
							
						 
						
							
							
								
								Refactor `ec.balance` logic into a `weeed/shell/command_ec_common.go`… ( #6195 )  
							
							
 
							
							
							* Refactor `ec.balance` logic into a `weeed/shell/command_ec_common.go` standalone function.
This is a prerequisite to unify the balance logic for `ec.balance` and `ec.encode'.
* s/Balance()/EcBalance()/g 
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ec30a504ba 
								
							
								 
							
						 
						
							
							
								
								refactor  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								701abbb9df 
								
							
								 
							
						 
						
							
							
								
								add IsResourceHeavy() to command interface  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								794a5aa67d 
								
									
								
							
								 
							
						 
						
							
							
								
								Add warning with hints to why a EC shard cant be moved ( #5790 )  
							
							
								
 
							
							
						 
						1 year ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								78dbac7702 
								
									
								
							
								 
							
						 
						
							
							
								
								fix(ec): volumes created by foreign collection due to bug in ec balance ( #4864 )  
							
							
 
							
							
							* fix(ec): ignore 0 byte data files
refers to parts of #4861 
Signed-off-by: Tobias Gurtzick <magic@wizardtales.com>
* fix(ec): ignore volumes not from the current collection during balance
fixes  #4861 
Signed-off-by: Tobias Gurtzick <magic@wizardtales.com>
---------
Signed-off-by: Tobias Gurtzick <magic@wizardtales.com> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								645ae8c57b 
								
							
								 
							
						 
						
							
							
								
								Revert "Revert "Merge branch 'master' of  https://github.com/seaweedfs/seaweedfs ""  
							
							
 
							
							
							This reverts commit 8cb42c39 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								8cb42c39ad 
								
							
								 
							
						 
						
							
							
								
								Revert "Merge branch 'master' of  https://github.com/seaweedfs/seaweedfs "  
							
							
 
							
							
							This reverts commit 2e5aa060264d414f54a2 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								a04bd4d26f 
								
									
								
							
								 
							
						 
						
							
							
								
								Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 ( #4850 )  
							
							
 
							
							
							* Bump github.com/rclone/rclone from 1.63.1 to 1.64.0
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone ) from 1.63.1 to 1.64.0.
- [Release notes](https://github.com/rclone/rclone/releases )
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md )
- [Commits](https://github.com/rclone/rclone/compare/v1.63.1...v1.64.0 )
---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
  dependency-type: direct:production
  update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* API changes
* go mod
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com> 
							
						 
						2 years ago  
				
					
						
							
							
								 
						
							
							
								
								
							
							
								
							
								bd2dc6d641 
								
									
								
							
								 
							
						 
						
							
							
								
								refactor(shell): `Decending` -> `Descending` ( #3675 )  
							
							
 
							
							
							Signed-off-by: Ryan Russell <git@ryanrussell.org>
Signed-off-by: Ryan Russell <git@ryanrussell.org> 
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								26dbc6c905 
								
							
								 
							
						 
						
							
							
								
								move to  https://github.com/seaweedfs/seaweedfs  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								6793bc853c 
								
							
								 
							
						 
						
							
							
								
								help message when in simulation mode  
							
							
								
 
							
							
						 
						3 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								3551ca2fcf 
								
							
								 
							
						 
						
							
							
								
								enhancement: replace sort.Slice with slices.SortFunc to reduce reflection  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								a2d3f89c7b 
								
							
								 
							
						 
						
							
							
								
								add lock messages  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								119d5908dd 
								
							
								 
							
						 
						
							
							
								
								shell: do not need to lock to see volume -h  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								e5fc35ed0c 
								
							
								 
							
						 
						
							
							
								
								change server address from string to a type  
							
							
								
 
							
							
						 
						4 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ad70107eb4 
								
							
								 
							
						 
						
							
							
								
								ec balance among nodes with HDD  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								36f95e50a9 
								
							
								 
							
						 
						
							
							
								
								avoid possible nil disk info  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f8446b42ab 
								
							
								 
							
						 
						
							
							
								
								this can compile now!!!  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								2bc05cfbc8 
								
							
								 
							
						 
						
							
							
								
								fix typo  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								a595916342 
								
							
								 
							
						 
						
							
							
								
								shell: add volumeServer.evacuate command  
							
							
								
 
							
							
						 
						5 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								73564e6a01 
								
							
								 
							
						 
						
							
							
								
								master: add cluster wide lock/unlock operation in weed shell  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/1286  
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								97ab8a1976 
								
							
								 
							
						 
						
							
							
								
								remove ctx if possible  
							
							
								
 
							
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								892e726eb9 
								
							
								 
							
						 
						
							
							
								
								avoid reusing context object  
							
							
 
							
							
							fix https://github.com/chrislusf/seaweedfs/issues/1182  
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								66acc2c84f 
								
							
								 
							
						 
						
							
							
								
								passing in averageShardsPerEcNode instead of expectedTotalEcShards  
							
							
 
							
							
							addressing https://github.com/chrislusf/seaweedfs/issues/1111  
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								40514c5362 
								
							
								 
							
						 
						
							
							
								
								add sortEcNodesByFreeslotsDecending and sortEcNodesByFreeslotsAscending  
							
							
 
							
							
							addressing https://github.com/chrislusf/seaweedfs/issues/1111  
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								9c2f3b1b0f 
								
							
								 
							
						 
						
							
							
								
								fix rack_not_found case  
							
							
 
							
							
							fix rack_not_found in https://github.com/chrislusf/seaweedfs/issues/1111  
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								6fc6322c90 
								
							
								 
							
						 
						
							
							
								
								Change joeslay paths to chrislusf paths  
							
							
								
 
							
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								595a1beff0 
								
							
								 
							
						 
						
							
							
								
								Swap imports to use joeslay  
							
							
								
 
							
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								57092d69ac 
								
							
								 
							
						 
						
							
							
								
								go fmt  
							
							
								
 
							
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								f9d8bd51ad 
								
							
								 
							
						 
						
							
							
								
								ec shard balancing  
							
							
								
 
							
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								9d9162ca35 
								
							
								 
							
						 
						
							
							
								
								ec.balance: collect dc rack info  
							
							
								
 
							
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d344e0a035 
								
							
								 
							
						 
						
							
							
								
								fix ec related bugs  
							
							
								
 
							
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ede876cfdb 
								
							
								 
							
						 
						
							
							
								
								periodic scripts exeuction from leader master  
							
							
								
 
							
							
						 
						6 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								0e49add2bc 
								
							
								 
							
						 
						
							
							
								
								adjust help message  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								06133ae98f 
								
							
								 
							
						 
						
							
							
								
								correct count for free ec slots, avoid removing generated shards  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								6cea23d091 
								
							
								 
							
						 
						
							
							
								
								purge duplicated ec shards  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								b05456fe07 
								
							
								 
							
						 
						
							
							
								
								able to purge extra ec shard copies  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								7e80b2b882 
								
							
								 
							
						 
						
							
							
								
								fix multiple bugs  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								9ce6b949bf 
								
							
								 
							
						 
						
							
							
								
								adjust help message  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								d6e2c877fa 
								
							
								 
							
						 
						
							
							
								
								ec.balance: use specific collection names  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								ba18314aab 
								
							
								 
							
						 
						
							
							
								
								ec shard delete also check ec volumes, in addition to volumes  
							
							
								
 
							
							
						 
						7 years ago  
				
					
						
							
							
								 
						
							
							
							
								
							
								1d111d6ce8 
								
							
								 
							
						 
						
							
							
								
								collection list normal and ec volumes  
							
							
								
 
							
							
						 
						7 years ago