Rock64 Cluster.
#11
One thing to consider to is your storage, for example I too am planning on a 5 node cluster. I'll be giving each one an SSD so if its a 5W SSD at 5V that is 1A so thats 5A just for the storage.
  Reply
#12
Any of you guys going to cluster storage also?

Been interested in https://lizardfs.com/, http://ceph.com/ & http://www.xtreemfs.org/
  Reply
#13
I would say ceph may well be viable, I already have some 100Mb USB to eth adaptors so I would probably use the onboard gig for the ceph. I cetainly run small proxmox clusters for small solutions with a single gig interface for the ceph.
  Reply
#14
clustering HDDs or SSDs..
depends on the use case, and what kind of existing storage infrastructure needs to be integrated/migrated:

on my storage side: 2 x 8TB hdd, one 4tb hdd, and a 128er samsung evo ssd.
the ssd for smaller files, databases, system, aiming to network boot via SPI nor flash.
the main storage mechanism should be able to cache between the three elements optimizing read/write io, evaluating OMV and various setups and add ons.
in a cluster setup i'd rather have one dedicated storage node, one dedicated master/gateway node, keeping 3 (or more) nodes for distributed computing, kubernetes, docker swarm etc..

of course it's great to have ssds (especially for local database applications), but the sweet spot might be rather giving each node a smaller 1tb external 2.5" hdd, selecting one with low idle power. the gigabit connection would cap the possible added throughput when using ssds, while when clustering hdds it will be harder to saturate the network bandwith.

interesting distributed storage solutions:
https://tahoe-lafs.org/trac/tahoe-lafs
https://ipfs.io/
  Reply
#15
(09-23-2017, 11:45 AM)pitsch Wrote: clustering HDDs or SSDs..
depends on the use case, and what kind of existing storage infrastructure needs to be integrated/migrated:

on my storage side: 2 x 8TB hdd, one 4tb hdd, and a 128er samsung evo ssd.
the ssd for smaller files, databases, system, aiming to network boot via SPI nor flash.
the main storage mechanism should be able to cache between the three elements optimizing read/write io, evaluating OMV and various setups and add ons.
in a cluster setup i'd rather have one dedicated storage node, one dedicated master/gateway node, keeping 3 (or more) nodes for distributed computing, kubernetes, docker swarm etc..

of course it's great to have ssds (especially for local database applications), but the sweet spot might be rather giving each node a  smaller 1tb external 2.5" hdd, selecting one with low idle power. the gigabit connection would cap the possible added throughput when using ssds, while when clustering hdds it will be harder to saturate the network bandwith.

interesting distributed storage solutions:
https://tahoe-lafs.org/trac/tahoe-lafs
https://ipfs.io/

If have been doing a lot of research on this and was in the ceph IRC group and they actually suggested LizardFS rather than Ceph.
Its in most mainline distro's already and its easier to set up and admin.

Have a look https://lizardfs.com/
  Reply


Possibly Related Threads...
Thread Author Replies Views Last Post
  Rock64 v3 with Real Time Clock (RTC), how to verify? Enig123 1 41 05-31-2020, 07:31 PM
Last Post: Rocklobster
  Rock64 v2 network issues alephnull 2 601 05-29-2020, 06:00 AM
Last Post: maccarry
  Rock64 random freezes BTB 5 657 04-07-2020, 03:19 AM
Last Post: tomarm
Photo ROCK64 v3 4GB DDR board memory chip number Johannes 2 194 04-05-2020, 04:29 AM
Last Post: Johannes
Big Grin Rock64 as a retro-gaming console: early impressions Luke 52 28,316 03-22-2020, 03:02 PM
Last Post: Labo
  Disable Auto Power On Rock64 willowen100 4 200 03-11-2020, 08:24 AM
Last Post: Rocklobster
  Rock64 running OMV, how to setup RTL8812AU WiFi? electrosam 3 503 02-21-2020, 01:49 AM
Last Post: bigtreeman
  rock64 only works with 546 MB bionic-minimal-rock64-0.6.40-226-arm64 danjperron 2 242 02-17-2020, 01:37 PM
Last Post: danjperron
  Rock64 v3 and SD-Cards Humberg 12 4,693 02-01-2020, 09:16 PM
Last Post: Leapo
  Rock64 v2 Locking Up when Accessing External Storage theGAXman 2 216 01-14-2020, 05:44 AM
Last Post: tomarm

Forum Jump:


Users browsing this thread: 1 Guest(s)