Technical blog
"We must view with profound respect the infinite capacity of the human mind to resist the introduction of useful knowledge." - Thomas R. Lounsbury
| github | goodreads | linkedin | twitter |
ansible 2 / elasticsearch 2 / kernel 1 / learning 31 / linux 2 / mnemonics 1 / nginx 1 / paper 31 / personal 5 / research 30 / review 31 / rust 2 / scientific 31 / tools 2 /WC 209 / RT 1min
TweetTypical algorithms for decentralized data distribution work best in a system that is fully built before it first used; adding or removing components results in either extensive reorganization of data or load imbalance in the system.
RUSH variants also support weighting, allowing disks of different vintages to be added to a system.
RUSH variants is optimal or near-optimal reorganization. When new disks are added to the system, or old disks are retired, RUSH variants minimize the number of objects that need to be moved in order to bring the system back into balance.
RUSH variants can perform reorganization online without locking the filesystem for a long time to relocate data.
Subcluster in a system managed by RUSH t must have at least as many disks as an object has replicas.
RUSH t is the best algorithms for distributing data over very large clusters of disks.
RUSH r may be the best option for systems which need to remove disks one at a time from the system.
RUSH p may be the best option for smaller systems where storage space is at a premium.
RUSH t - RUSH tree
RUSH r - RUSH support for removal
PUSH p - RUSH placement using prime numbers