In the vim/emacs style war between between erasure code and replication, for our best @dirvine wisely(as always) choose replication. Now we have SAFE with is replication infrastructure but what if this is not a war erasure code OR replication? Can we have collaboration between erasure code AND replication?
What happens if we put just one more step in the self encryption of the SAFE network?
Let say we Mojette tranform a file. We will have a bigger file.
Bigger file -> More chunks -> More nodes need to store but at the same time more node to serve.
Where is the gain? You would say!
Well the chunks of the Mojette transform have an interesting property, they are correlated and you only need n out m chunks of the Mojette Tranform file the reconstruct the original file.
The size of the pool of node for the Mojette Transform file is bigger than for the original file.
The bigger the pool the faster you will receive the file.
Extra Chunks Racing
Let the m chunks of the Mojette Transform race against each other and as soon as we have n chunks we are done and we can reconstruct the original file. It will always be the fastest n chunks out of m that will come to you.
- it may speed-up the SAFE Network
if the overhead of Mojette transform encoding and decoding + extra traffic congestion is less than the potential gain of the extra chunk racing
- make the SAFE Network even more resilient
On SAFE an attacker “just need” to control one chunk now it must control m-n+1 chunks do have the same effect!
more space is need and generate more traffic.
There’s lot more to takes into account but it will take a bigger napkin
Also farmer may want to look at Rozofs (Mojette transform solution) http://rozosystems.com/ for Scale out NAS architecture.