From 1affeaf25dbe156a62778a0a4fc250b62eb3c17a Mon Sep 17 00:00:00 2001 From: nodiscc Date: Wed, 14 Jun 2023 02:32:40 +0200 Subject: [PATCH 01/10] distributed fs: update URLs, use HTTPS URLs, rename Go-IPFS to Kubo --- README.md | 24 ++++++++++++------------ 1 file changed, 12 insertions(+), 12 deletions(-) diff --git a/README.md b/README.md index 1c2cc60..437162d 100644 --- a/README.md +++ b/README.md @@ -314,22 +314,22 @@ _See also: [awesome-selfhosted/Database Management](https://github.com/awesome-s *Network distributed filesystems.* -- [Ceph](http://ceph.com/) - Distributed object store and file system. -- [DRBD](http://drbd.linbit.com/) - Distributed Replicated Block Device. -- [GlusterFS](http://www.gluster.org/) - Scale-out network-attached storage file system. -- [Go IPFS](https://github.com/ipfs/go-ipfs) - Implementation of [IPFS](http://ipfs.io/), a global, versioned, peer-to-peer filesystem that seeks to connect all computing devices with the same system of files. -- [HDFS](http://hadoop.apache.org/) - Distributed, scalable, and portable file-system written in Java for the Hadoop framework. +- [Ceph](https://ceph.com/) - Distributed object store and file system. +- [DRBD](https://linbit.com/drbd/) - Distributed Replicated Block Device. +- [GlusterFS](https://www.gluster.org/) - Scale-out network-attached storage file system. +- [Kubo](https://github.com/ipfs/kubo) - Implementation of [IPFS](http://ipfs.io/), a global, versioned, peer-to-peer filesystem that seeks to connect all computing devices with the same system of files. +- [Hadoop Distributed Filesystem (HDFS)](https://hadoop.apache.org/) - Distributed, scalable, and portable file-system written in Java for the Hadoop framework. - [JuiceFS](https://juicefs.com/) - Distributed POSIX file system built on top of Redis and S3. ([Source Code](https://github.com/juicedata/juicefs)) `Apache-2.0` `Go` -- [LeoFS](http://leo-project.net) - Unstructured object/data storage and a highly available, distributed, eventually consistent storage system. -- [Lustre](http://lustre.org/) - Parallel distributed file system, generally used for large-scale cluster computing. -- [Minio](https://minio.io/) - Minio is an open source object storage server compatible with Amazon S3 APIs. ([Source Code](https://github.com/minio/minio)) `AGPL-3.0` `Go` -- [MooseFS](http://www.moosefs.org/) - Fault tolerant, network distributed file system. -- [OpenAFS](http://www.openafs.org/) - Distributed network file system with read-only replicas and multi-OS support. +- [LeoFS](https://leo-project.net) - Unstructured object/data storage and a highly available, distributed, eventually consistent storage system. +- [Lustre](https://www.lustre.org/) - Parallel distributed file system, generally used for large-scale cluster computing. +- [Minio](https://min.io/) - Minio is an open source object storage server compatible with Amazon S3 APIs. ([Source Code](https://github.com/minio/minio)) `AGPL-3.0` `Go` +- [MooseFS](https://moosefs.com/) - Fault tolerant, network distributed file system. +- [OpenAFS](https://www.openafs.org/) - Distributed network file system with read-only replicas and multi-OS support. - [Perkeep](https://perkeep.org/) (née Camlistore) - A set of open source formats, protocols, and software for modeling, storing, searching, sharing and synchronizing data. - [SheepDog](https://sheepdog.github.io/sheepdog/) - A distributed Blockdevice, Rest, QEMU and distributed Filesystem storage. -- [Swift](http://docs.openstack.org/developer/swift/) - A highly available, distributed, eventually consistent object/blob store. +- [Swift](https://docs.openstack.org/developer/swift/) - A highly available, distributed, eventually consistent object/blob store. - [TahoeLAFS](https://tahoe-lafs.org/trac/tahoe-lafs) - secure, decentralized, fault-tolerant, peer-to-peer distributed data store and distributed file system. -- [XtreemFS](http://www.xtreemfs.org/) - XtreemFS is a fault-tolerant distributed file system for all storage needs. +- [XtreemFS](https://www.xtreemfs.org/) - XtreemFS is a fault-tolerant distributed file system for all storage needs. ### DNS - Servers From ddd47eba9099086d2ee4635257a215ed279b1454 Mon Sep 17 00:00:00 2001 From: nodiscc Date: Wed, 14 Jun 2023 02:39:23 +0200 Subject: [PATCH 02/10] distributed fs: add source code links - ref. https://github.com/awesome-foss/awesome-sysadmin/issues/416 --- README.md | 26 +++++++++++++------------- 1 file changed, 13 insertions(+), 13 deletions(-) diff --git a/README.md b/README.md index 437162d..e62181f 100644 --- a/README.md +++ b/README.md @@ -314,22 +314,22 @@ _See also: [awesome-selfhosted/Database Management](https://github.com/awesome-s *Network distributed filesystems.* -- [Ceph](https://ceph.com/) - Distributed object store and file system. -- [DRBD](https://linbit.com/drbd/) - Distributed Replicated Block Device. -- [GlusterFS](https://www.gluster.org/) - Scale-out network-attached storage file system. +- [Ceph](https://ceph.com/) - Distributed object store and file system. ([Source Code](https://github.com/ceph/ceph)) +- [DRBD](https://linbit.com/drbd/) - Distributed Replicated Block Device. ([Source Code](https://github.com/LINBIT/drbd)) +- [GlusterFS](https://www.gluster.org/) - Scale-out network-attached storage file system. ([Source Code](https://github.com/gluster/glusterfs)) - [Kubo](https://github.com/ipfs/kubo) - Implementation of [IPFS](http://ipfs.io/), a global, versioned, peer-to-peer filesystem that seeks to connect all computing devices with the same system of files. -- [Hadoop Distributed Filesystem (HDFS)](https://hadoop.apache.org/) - Distributed, scalable, and portable file-system written in Java for the Hadoop framework. +- [Hadoop Distributed Filesystem (HDFS)](https://hadoop.apache.org/) - Distributed, scalable, and portable file-system written in Java for the Hadoop framework. ([Source Code](https://github.com/apache/hadoop)) - [JuiceFS](https://juicefs.com/) - Distributed POSIX file system built on top of Redis and S3. ([Source Code](https://github.com/juicedata/juicefs)) `Apache-2.0` `Go` -- [LeoFS](https://leo-project.net) - Unstructured object/data storage and a highly available, distributed, eventually consistent storage system. -- [Lustre](https://www.lustre.org/) - Parallel distributed file system, generally used for large-scale cluster computing. +- [LeoFS](https://leo-project.net) - Unstructured object/data storage and a highly available, distributed, eventually consistent storage system. ([Source Code](https://github.com/leo-project/leofs)) +- [Lustre](https://www.lustre.org/) - Parallel distributed file system, generally used for large-scale cluster computing. ([Source Code](https://git.whamcloud.com/?p=fs/lustre-release.git;a=summary)) - [Minio](https://min.io/) - Minio is an open source object storage server compatible with Amazon S3 APIs. ([Source Code](https://github.com/minio/minio)) `AGPL-3.0` `Go` -- [MooseFS](https://moosefs.com/) - Fault tolerant, network distributed file system. -- [OpenAFS](https://www.openafs.org/) - Distributed network file system with read-only replicas and multi-OS support. -- [Perkeep](https://perkeep.org/) (née Camlistore) - A set of open source formats, protocols, and software for modeling, storing, searching, sharing and synchronizing data. -- [SheepDog](https://sheepdog.github.io/sheepdog/) - A distributed Blockdevice, Rest, QEMU and distributed Filesystem storage. -- [Swift](https://docs.openstack.org/developer/swift/) - A highly available, distributed, eventually consistent object/blob store. -- [TahoeLAFS](https://tahoe-lafs.org/trac/tahoe-lafs) - secure, decentralized, fault-tolerant, peer-to-peer distributed data store and distributed file system. -- [XtreemFS](https://www.xtreemfs.org/) - XtreemFS is a fault-tolerant distributed file system for all storage needs. +- [MooseFS](https://moosefs.com/) - Fault tolerant, network distributed file system. ([Source Code](https://github.com/moosefs/moosefs)) +- [OpenAFS](https://www.openafs.org/) - Distributed network file system with read-only replicas and multi-OS support. ([Source Code](https://git.openafs.org/?p=openafs.git;a=summary)) +- [Perkeep](https://perkeep.org/) - A set of open source formats, protocols, and software for modeling, storing, searching, sharing and synchronizing data (previously Camlistore). ([Source Code](https://github.com/perkeep/perkeep)) +- [SheepDog](https://sheepdog.github.io/sheepdog/) - A distributed Blockdevice, Rest, QEMU and distributed Filesystem storage. ([Source Code](https://github.com/sheepdog/sheepdog)) +- [Openstack Swift](https://docs.openstack.org/developer/swift/) - A highly available, distributed, eventually consistent object/blob store. ([Source Code](https://opendev.org/openstack/swift)) +- [TahoeLAFS](https://tahoe-lafs.org/trac/tahoe-lafs) - secure, decentralized, fault-tolerant, peer-to-peer distributed data store and distributed file system. ([Source Code](https://github.com/tahoe-lafs/tahoe-lafs)) +- [XtreemFS](https://www.xtreemfs.org/) - XtreemFS is a fault-tolerant distributed file system for all storage needs. ([Source Code](https://github.com/xtreemfs/xtreemfs)) ### DNS - Servers From b81db289ce1f379271467e2b73d12967bdb530e8 Mon Sep 17 00:00:00 2001 From: nodiscc Date: Wed, 14 Jun 2023 02:41:23 +0200 Subject: [PATCH 03/10] distributed fs: update descriptions as per official project descriptions --- README.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/README.md b/README.md index e62181f..6d63baa 100644 --- a/README.md +++ b/README.md @@ -314,9 +314,9 @@ _See also: [awesome-selfhosted/Database Management](https://github.com/awesome-s *Network distributed filesystems.* -- [Ceph](https://ceph.com/) - Distributed object store and file system. ([Source Code](https://github.com/ceph/ceph)) -- [DRBD](https://linbit.com/drbd/) - Distributed Replicated Block Device. ([Source Code](https://github.com/LINBIT/drbd)) -- [GlusterFS](https://www.gluster.org/) - Scale-out network-attached storage file system. ([Source Code](https://github.com/gluster/glusterfs)) +- [Ceph](https://ceph.com/) - Distributed object, block, and file storage platform. ([Source Code](https://github.com/ceph/ceph)) +- [DRBD](https://linbit.com/drbd/) - Distributed replicated storage system, implemented as a Linux kernel driver. ([Source Code](https://github.com/LINBIT/drbd)) +- [GlusterFS](https://www.gluster.org/) - Software-defined distributed storage that can scale to several petabytes, with interfaces for object, block and file storage. ([Source Code](https://github.com/gluster/glusterfs)) - [Kubo](https://github.com/ipfs/kubo) - Implementation of [IPFS](http://ipfs.io/), a global, versioned, peer-to-peer filesystem that seeks to connect all computing devices with the same system of files. - [Hadoop Distributed Filesystem (HDFS)](https://hadoop.apache.org/) - Distributed, scalable, and portable file-system written in Java for the Hadoop framework. ([Source Code](https://github.com/apache/hadoop)) - [JuiceFS](https://juicefs.com/) - Distributed POSIX file system built on top of Redis and S3. ([Source Code](https://github.com/juicedata/juicefs)) `Apache-2.0` `Go` From 94783cbdbc5dd33dae73a605c5d2ff9c6b5d58fe Mon Sep 17 00:00:00 2001 From: nodiscc Date: Wed, 14 Jun 2023 02:41:50 +0200 Subject: [PATCH 04/10] distributed fs: remove inline link --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 6d63baa..fd37b9e 100644 --- a/README.md +++ b/README.md @@ -317,7 +317,7 @@ _See also: [awesome-selfhosted/Database Management](https://github.com/awesome-s - [Ceph](https://ceph.com/) - Distributed object, block, and file storage platform. ([Source Code](https://github.com/ceph/ceph)) - [DRBD](https://linbit.com/drbd/) - Distributed replicated storage system, implemented as a Linux kernel driver. ([Source Code](https://github.com/LINBIT/drbd)) - [GlusterFS](https://www.gluster.org/) - Software-defined distributed storage that can scale to several petabytes, with interfaces for object, block and file storage. ([Source Code](https://github.com/gluster/glusterfs)) -- [Kubo](https://github.com/ipfs/kubo) - Implementation of [IPFS](http://ipfs.io/), a global, versioned, peer-to-peer filesystem that seeks to connect all computing devices with the same system of files. +- [Kubo](https://github.com/ipfs/kubo) - Implementation of IPFS, a global, versioned, peer-to-peer filesystem that seeks to connect all computing devices with the same system of files. - [Hadoop Distributed Filesystem (HDFS)](https://hadoop.apache.org/) - Distributed, scalable, and portable file-system written in Java for the Hadoop framework. ([Source Code](https://github.com/apache/hadoop)) - [JuiceFS](https://juicefs.com/) - Distributed POSIX file system built on top of Redis and S3. ([Source Code](https://github.com/juicedata/juicefs)) `Apache-2.0` `Go` - [LeoFS](https://leo-project.net) - Unstructured object/data storage and a highly available, distributed, eventually consistent storage system. ([Source Code](https://github.com/leo-project/leofs)) From 59c4c8ef9ac98732043fefcc75dd2e27d2b61ae8 Mon Sep 17 00:00:00 2001 From: nodiscc Date: Wed, 14 Jun 2023 02:47:51 +0200 Subject: [PATCH 05/10] distributed fs: update descriptions as per official descriptions --- README.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/README.md b/README.md index fd37b9e..c664ade 100644 --- a/README.md +++ b/README.md @@ -318,11 +318,11 @@ _See also: [awesome-selfhosted/Database Management](https://github.com/awesome-s - [DRBD](https://linbit.com/drbd/) - Distributed replicated storage system, implemented as a Linux kernel driver. ([Source Code](https://github.com/LINBIT/drbd)) - [GlusterFS](https://www.gluster.org/) - Software-defined distributed storage that can scale to several petabytes, with interfaces for object, block and file storage. ([Source Code](https://github.com/gluster/glusterfs)) - [Kubo](https://github.com/ipfs/kubo) - Implementation of IPFS, a global, versioned, peer-to-peer filesystem that seeks to connect all computing devices with the same system of files. -- [Hadoop Distributed Filesystem (HDFS)](https://hadoop.apache.org/) - Distributed, scalable, and portable file-system written in Java for the Hadoop framework. ([Source Code](https://github.com/apache/hadoop)) +- [Hadoop Distributed Filesystem (HDFS)](https://hadoop.apache.org/) - Distributed file system that provides high-throughput access to application data. ([Source Code](https://github.com/apache/hadoop)) - [JuiceFS](https://juicefs.com/) - Distributed POSIX file system built on top of Redis and S3. ([Source Code](https://github.com/juicedata/juicefs)) `Apache-2.0` `Go` -- [LeoFS](https://leo-project.net) - Unstructured object/data storage and a highly available, distributed, eventually consistent storage system. ([Source Code](https://github.com/leo-project/leofs)) +- [LeoFS](https://leo-project.net) - Highly available, distributed, replicated eventually consistent object/blob store. ([Source Code](https://github.com/leo-project/leofs)) - [Lustre](https://www.lustre.org/) - Parallel distributed file system, generally used for large-scale cluster computing. ([Source Code](https://git.whamcloud.com/?p=fs/lustre-release.git;a=summary)) -- [Minio](https://min.io/) - Minio is an open source object storage server compatible with Amazon S3 APIs. ([Source Code](https://github.com/minio/minio)) `AGPL-3.0` `Go` +- [Minio](https://min.io/) - High-performance, S3 compatible object store built for large scale AI/ML, data lake and database workloads. ([Source Code](https://github.com/minio/minio)) `AGPL-3.0` `Go` - [MooseFS](https://moosefs.com/) - Fault tolerant, network distributed file system. ([Source Code](https://github.com/moosefs/moosefs)) - [OpenAFS](https://www.openafs.org/) - Distributed network file system with read-only replicas and multi-OS support. ([Source Code](https://git.openafs.org/?p=openafs.git;a=summary)) - [Perkeep](https://perkeep.org/) - A set of open source formats, protocols, and software for modeling, storing, searching, sharing and synchronizing data (previously Camlistore). ([Source Code](https://github.com/perkeep/perkeep)) From 111cc4765be90dc17ac9666874a05ef1c77d2b58 Mon Sep 17 00:00:00 2001 From: nodiscc Date: Wed, 14 Jun 2023 02:47:59 +0200 Subject: [PATCH 06/10] distributed fs: remove sheepdog (unmaintained since 2018) - https://github.com/sheepdog/sheepdog/commits/master - ref. https://github.com/awesome-foss/awesome-sysadmin/issues/405 --- README.md | 1 - 1 file changed, 1 deletion(-) diff --git a/README.md b/README.md index c664ade..7b5a28f 100644 --- a/README.md +++ b/README.md @@ -326,7 +326,6 @@ _See also: [awesome-selfhosted/Database Management](https://github.com/awesome-s - [MooseFS](https://moosefs.com/) - Fault tolerant, network distributed file system. ([Source Code](https://github.com/moosefs/moosefs)) - [OpenAFS](https://www.openafs.org/) - Distributed network file system with read-only replicas and multi-OS support. ([Source Code](https://git.openafs.org/?p=openafs.git;a=summary)) - [Perkeep](https://perkeep.org/) - A set of open source formats, protocols, and software for modeling, storing, searching, sharing and synchronizing data (previously Camlistore). ([Source Code](https://github.com/perkeep/perkeep)) -- [SheepDog](https://sheepdog.github.io/sheepdog/) - A distributed Blockdevice, Rest, QEMU and distributed Filesystem storage. ([Source Code](https://github.com/sheepdog/sheepdog)) - [Openstack Swift](https://docs.openstack.org/developer/swift/) - A highly available, distributed, eventually consistent object/blob store. ([Source Code](https://opendev.org/openstack/swift)) - [TahoeLAFS](https://tahoe-lafs.org/trac/tahoe-lafs) - secure, decentralized, fault-tolerant, peer-to-peer distributed data store and distributed file system. ([Source Code](https://github.com/tahoe-lafs/tahoe-lafs)) - [XtreemFS](https://www.xtreemfs.org/) - XtreemFS is a fault-tolerant distributed file system for all storage needs. ([Source Code](https://github.com/xtreemfs/xtreemfs)) From 10de50715970ceac16c8b0d8a03d6d847d318f82 Mon Sep 17 00:00:00 2001 From: nodiscc Date: Wed, 14 Jun 2023 02:50:26 +0200 Subject: [PATCH 07/10] distributed fs: update descriptions as per official project descriptions --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 7b5a28f..ada3df1 100644 --- a/README.md +++ b/README.md @@ -327,8 +327,8 @@ _See also: [awesome-selfhosted/Database Management](https://github.com/awesome-s - [OpenAFS](https://www.openafs.org/) - Distributed network file system with read-only replicas and multi-OS support. ([Source Code](https://git.openafs.org/?p=openafs.git;a=summary)) - [Perkeep](https://perkeep.org/) - A set of open source formats, protocols, and software for modeling, storing, searching, sharing and synchronizing data (previously Camlistore). ([Source Code](https://github.com/perkeep/perkeep)) - [Openstack Swift](https://docs.openstack.org/developer/swift/) - A highly available, distributed, eventually consistent object/blob store. ([Source Code](https://opendev.org/openstack/swift)) -- [TahoeLAFS](https://tahoe-lafs.org/trac/tahoe-lafs) - secure, decentralized, fault-tolerant, peer-to-peer distributed data store and distributed file system. ([Source Code](https://github.com/tahoe-lafs/tahoe-lafs)) -- [XtreemFS](https://www.xtreemfs.org/) - XtreemFS is a fault-tolerant distributed file system for all storage needs. ([Source Code](https://github.com/xtreemfs/xtreemfs)) +- [TahoeLAFS](https://tahoe-lafs.org/trac/tahoe-lafs) - Secure, decentralized, fault-tolerant, peer-to-peer distributed data store and distributed file system. ([Source Code](https://github.com/tahoe-lafs/tahoe-lafs)) +- [XtreemFS](https://www.xtreemfs.org/) - Distributed, replicated and fault-tolerant file system for federated IT infrastructures.. ([Source Code](https://github.com/xtreemfs/xtreemfs)) ### DNS - Servers From 245d36d0812917b7282c0d862bdb499ec4f966e9 Mon Sep 17 00:00:00 2001 From: nodiscc Date: Wed, 14 Jun 2023 15:04:18 +0200 Subject: [PATCH 08/10] distributed fs: add licenses/langaue/platform tags - ref. https://github.com/awesome-foss/awesome-sysadmin/issues/416 --- README.md | 26 +++++++++++++------------- 1 file changed, 13 insertions(+), 13 deletions(-) diff --git a/README.md b/README.md index ada3df1..e580bb5 100644 --- a/README.md +++ b/README.md @@ -314,21 +314,21 @@ _See also: [awesome-selfhosted/Database Management](https://github.com/awesome-s *Network distributed filesystems.* -- [Ceph](https://ceph.com/) - Distributed object, block, and file storage platform. ([Source Code](https://github.com/ceph/ceph)) -- [DRBD](https://linbit.com/drbd/) - Distributed replicated storage system, implemented as a Linux kernel driver. ([Source Code](https://github.com/LINBIT/drbd)) -- [GlusterFS](https://www.gluster.org/) - Software-defined distributed storage that can scale to several petabytes, with interfaces for object, block and file storage. ([Source Code](https://github.com/gluster/glusterfs)) -- [Kubo](https://github.com/ipfs/kubo) - Implementation of IPFS, a global, versioned, peer-to-peer filesystem that seeks to connect all computing devices with the same system of files. -- [Hadoop Distributed Filesystem (HDFS)](https://hadoop.apache.org/) - Distributed file system that provides high-throughput access to application data. ([Source Code](https://github.com/apache/hadoop)) +- [Ceph](https://ceph.com/) - Distributed object, block, and file storage platform. ([Source Code](https://github.com/ceph/ceph)) `LGPL-3.0` `C++` +- [DRBD](https://linbit.com/drbd/) - Distributed replicated storage system, implemented as a Linux kernel driver. ([Source Code](https://github.com/LINBIT/drbd)) `GPL-2.0` `C` +- [GlusterFS](https://www.gluster.org/) - Software-defined distributed storage that can scale to several petabytes, with interfaces for object, block and file storage. ([Source Code](https://github.com/gluster/glusterfs)) `GPL-2.0/LGPL-3.0` `C` +- [Kubo](https://github.com/ipfs/kubo) - Implementation of IPFS, a global, versioned, peer-to-peer filesystem that seeks to connect all computing devices with the same system of files. `Apache-2.0/MIT` `Go` +- [Hadoop Distributed Filesystem (HDFS)](https://hadoop.apache.org/) - Distributed file system that provides high-throughput access to application data. ([Source Code](https://github.com/apache/hadoop)) `Apache-2.0` `Java` - [JuiceFS](https://juicefs.com/) - Distributed POSIX file system built on top of Redis and S3. ([Source Code](https://github.com/juicedata/juicefs)) `Apache-2.0` `Go` -- [LeoFS](https://leo-project.net) - Highly available, distributed, replicated eventually consistent object/blob store. ([Source Code](https://github.com/leo-project/leofs)) -- [Lustre](https://www.lustre.org/) - Parallel distributed file system, generally used for large-scale cluster computing. ([Source Code](https://git.whamcloud.com/?p=fs/lustre-release.git;a=summary)) +- [LeoFS](https://leo-project.net) - Highly available, distributed, replicated eventually consistent object/blob store. ([Source Code](https://github.com/leo-project/leofs)) `Apache-2.0` `Erlang` +- [Lustre](https://www.lustre.org/) - Parallel distributed file system, generally used for large-scale cluster computing. ([Source Code](https://git.whamcloud.com/?p=fs/lustre-release.git;a=summary)) `GPL-2.0` `C` - [Minio](https://min.io/) - High-performance, S3 compatible object store built for large scale AI/ML, data lake and database workloads. ([Source Code](https://github.com/minio/minio)) `AGPL-3.0` `Go` -- [MooseFS](https://moosefs.com/) - Fault tolerant, network distributed file system. ([Source Code](https://github.com/moosefs/moosefs)) -- [OpenAFS](https://www.openafs.org/) - Distributed network file system with read-only replicas and multi-OS support. ([Source Code](https://git.openafs.org/?p=openafs.git;a=summary)) -- [Perkeep](https://perkeep.org/) - A set of open source formats, protocols, and software for modeling, storing, searching, sharing and synchronizing data (previously Camlistore). ([Source Code](https://github.com/perkeep/perkeep)) -- [Openstack Swift](https://docs.openstack.org/developer/swift/) - A highly available, distributed, eventually consistent object/blob store. ([Source Code](https://opendev.org/openstack/swift)) -- [TahoeLAFS](https://tahoe-lafs.org/trac/tahoe-lafs) - Secure, decentralized, fault-tolerant, peer-to-peer distributed data store and distributed file system. ([Source Code](https://github.com/tahoe-lafs/tahoe-lafs)) -- [XtreemFS](https://www.xtreemfs.org/) - Distributed, replicated and fault-tolerant file system for federated IT infrastructures.. ([Source Code](https://github.com/xtreemfs/xtreemfs)) +- [MooseFS](https://moosefs.com/) - Fault tolerant, network distributed file system. ([Source Code](https://github.com/moosefs/moosefs)) `GPL-2.0` `C` +- [OpenAFS](https://www.openafs.org/) - Distributed network file system with read-only replicas and multi-OS support. ([Source Code](https://git.openafs.org/?p=openafs.git;a=summary)) `IPL-1.0` `C` +- [Perkeep](https://perkeep.org/) - A set of open source formats, protocols, and software for modeling, storing, searching, sharing and synchronizing data (previously Camlistore). ([Source Code](https://github.com/perkeep/perkeep)) `Apache-2.0` `C` +- [Openstack Swift](https://docs.openstack.org/developer/swift/) - A highly available, distributed, eventually consistent object/blob store. ([Source Code](https://opendev.org/openstack/swift)) `Apache-2.0` `Python` +- [TahoeLAFS](https://tahoe-lafs.org/trac/tahoe-lafs) - Secure, decentralized, fault-tolerant, peer-to-peer distributed data store and distributed file system. ([Source Code](https://github.com/tahoe-lafs/tahoe-lafs)) `GPL-2.0` `Python` +- [XtreemFS](https://www.xtreemfs.org/) - Distributed, replicated and fault-tolerant file system for federated IT infrastructures.. ([Source Code](https://github.com/xtreemfs/xtreemfs)) `BSD-3-Clause` `Java` ### DNS - Servers From bc7b091e5f2e85f410434b4f97dd06e707f05e3c Mon Sep 17 00:00:00 2001 From: nodiscc Date: Wed, 14 Jun 2023 15:06:03 +0200 Subject: [PATCH 09/10] distributed fs: mark section as related to awesome-selfhosted/File Transfer - Object Storage & File Servers --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index e580bb5..9f03659 100644 --- a/README.md +++ b/README.md @@ -314,6 +314,8 @@ _See also: [awesome-selfhosted/Database Management](https://github.com/awesome-s *Network distributed filesystems.* +_See also: [awesome-selfhosted/File Transfer - Object Storage & File Servers](https://github.com/awesome-selfhosted/awesome-selfhosted#file-transfer---object-storage--file-servers)_ + - [Ceph](https://ceph.com/) - Distributed object, block, and file storage platform. ([Source Code](https://github.com/ceph/ceph)) `LGPL-3.0` `C++` - [DRBD](https://linbit.com/drbd/) - Distributed replicated storage system, implemented as a Linux kernel driver. ([Source Code](https://github.com/LINBIT/drbd)) `GPL-2.0` `C` - [GlusterFS](https://www.gluster.org/) - Software-defined distributed storage that can scale to several petabytes, with interfaces for object, block and file storage. ([Source Code](https://github.com/gluster/glusterfs)) `GPL-2.0/LGPL-3.0` `C` From d249073795d2284186e5ca800f1000e98beb48ba Mon Sep 17 00:00:00 2001 From: nodiscc Date: Wed, 14 Jun 2023 15:08:12 +0200 Subject: [PATCH 10/10] distributed fs: sort entries alphabetically --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 9f03659..b14388a 100644 --- a/README.md +++ b/README.md @@ -319,16 +319,16 @@ _See also: [awesome-selfhosted/File Transfer - Object Storage & File Servers](ht - [Ceph](https://ceph.com/) - Distributed object, block, and file storage platform. ([Source Code](https://github.com/ceph/ceph)) `LGPL-3.0` `C++` - [DRBD](https://linbit.com/drbd/) - Distributed replicated storage system, implemented as a Linux kernel driver. ([Source Code](https://github.com/LINBIT/drbd)) `GPL-2.0` `C` - [GlusterFS](https://www.gluster.org/) - Software-defined distributed storage that can scale to several petabytes, with interfaces for object, block and file storage. ([Source Code](https://github.com/gluster/glusterfs)) `GPL-2.0/LGPL-3.0` `C` -- [Kubo](https://github.com/ipfs/kubo) - Implementation of IPFS, a global, versioned, peer-to-peer filesystem that seeks to connect all computing devices with the same system of files. `Apache-2.0/MIT` `Go` - [Hadoop Distributed Filesystem (HDFS)](https://hadoop.apache.org/) - Distributed file system that provides high-throughput access to application data. ([Source Code](https://github.com/apache/hadoop)) `Apache-2.0` `Java` - [JuiceFS](https://juicefs.com/) - Distributed POSIX file system built on top of Redis and S3. ([Source Code](https://github.com/juicedata/juicefs)) `Apache-2.0` `Go` +- [Kubo](https://github.com/ipfs/kubo) - Implementation of IPFS, a global, versioned, peer-to-peer filesystem that seeks to connect all computing devices with the same system of files. `Apache-2.0/MIT` `Go` - [LeoFS](https://leo-project.net) - Highly available, distributed, replicated eventually consistent object/blob store. ([Source Code](https://github.com/leo-project/leofs)) `Apache-2.0` `Erlang` - [Lustre](https://www.lustre.org/) - Parallel distributed file system, generally used for large-scale cluster computing. ([Source Code](https://git.whamcloud.com/?p=fs/lustre-release.git;a=summary)) `GPL-2.0` `C` - [Minio](https://min.io/) - High-performance, S3 compatible object store built for large scale AI/ML, data lake and database workloads. ([Source Code](https://github.com/minio/minio)) `AGPL-3.0` `Go` - [MooseFS](https://moosefs.com/) - Fault tolerant, network distributed file system. ([Source Code](https://github.com/moosefs/moosefs)) `GPL-2.0` `C` - [OpenAFS](https://www.openafs.org/) - Distributed network file system with read-only replicas and multi-OS support. ([Source Code](https://git.openafs.org/?p=openafs.git;a=summary)) `IPL-1.0` `C` -- [Perkeep](https://perkeep.org/) - A set of open source formats, protocols, and software for modeling, storing, searching, sharing and synchronizing data (previously Camlistore). ([Source Code](https://github.com/perkeep/perkeep)) `Apache-2.0` `C` - [Openstack Swift](https://docs.openstack.org/developer/swift/) - A highly available, distributed, eventually consistent object/blob store. ([Source Code](https://opendev.org/openstack/swift)) `Apache-2.0` `Python` +- [Perkeep](https://perkeep.org/) - A set of open source formats, protocols, and software for modeling, storing, searching, sharing and synchronizing data (previously Camlistore). ([Source Code](https://github.com/perkeep/perkeep)) `Apache-2.0` `C` - [TahoeLAFS](https://tahoe-lafs.org/trac/tahoe-lafs) - Secure, decentralized, fault-tolerant, peer-to-peer distributed data store and distributed file system. ([Source Code](https://github.com/tahoe-lafs/tahoe-lafs)) `GPL-2.0` `Python` - [XtreemFS](https://www.xtreemfs.org/) - Distributed, replicated and fault-tolerant file system for federated IT infrastructures.. ([Source Code](https://github.com/xtreemfs/xtreemfs)) `BSD-3-Clause` `Java`