Heapnet2 summary of observations

I skimmed through the Heapnet2 -thread and tried to collect the main observations, for folks not willing to go through all that. Feel free to add your own, I’m sure I have missed many things:

  1. Problems with faucet were user errors. Using arrow up in terminal may give you wrong faucet address.
  2. Nodes may stay empty for a long time and then start to get chunks.
  3. Problems in downloading were likely mostly because of bugs in client, not loss of data. Mostly fixed now.
  4. Uploads are quite slow and CPU intensive.
  5. Downloads are extremely fast.
  6. Nodes are very resilient to disturbances in connections.
  7. Clients are very sensitive to disturbances in connections. Up/downloads break and don’t restart.
  8. Wallet corruption was a typical reason for problems in uploading.
  9. Node’s memory consumption is creeping up very slowly, but RAM can also decrease after it has increased. More information:
    HeapNet2 [Testnet 12/10/23] [Offline] - #153 by Josh
    HeapNet2 [Testnet 12/10/23] [Offline] - #170 by storage_guy
    HeapNet2 [Testnet 12/10/23] [Offline] - #239 by storage_guy
  10. Nodes can be run behind NAT with manual port forwarding.
  11. Nodes don’t die that easily anymore.

Everything in general is working quite well already! :tada:
And improvements are coming steadily! :tada:
Big thanks to the team! :clap:

Some future prospects:

Ease of use:

Upload resilience:

Lowering non-essential network traffic:


Did anyone report nodes dying?

Nice summary :clap:


I didn’t see any reports. But because the net still goes on, it’s a bit premature to say if the slow memory increase will lead to that. (If it ever was the reason.)


Toivo thanks for your great resume :ok_hand:t2::+1:t2:

I say every year that we will get our Beta on 23 December, lets hope this year we will !! :white_check_mark:

Will we have the Safe Network, before, on or after December 23rd?

  • Before
  • On
  • After
0 voters

Thanks! And thanks to @happybeing too!

I’m planning to make this a habit, to make some kind of summary after every testnet has run for a while. I just hate how all the nuggets get lost in the main thread. (Where would this World be without all the hate?)


Great work guys! @Toivo, @happybeing, @Josh, @storage_guy and everyone else I didn’t mention.
Is the API ready yet to be used for development? The testnets itself sound utterly promising and telling me to get started with building apps.

I’m now working with Dask for Machine Learning / AI and one of the benefits is that can handle huge datasets spread over different files. Now that the download speeds are looking good and consistent it would be cool to see if I can already port the distributed dataset chunks and feed them towards Dask to perform Machine Learning on it. What I imagine is public register of open-source large datasets, they can either be downloaded to client or some sort of streaming to decentralized clusters. I really think these kind of use-cases are what makes Safe appealing, storage cost can be cheaper and data should be redundant if everything works out.

How could would it be if things like Event Horizon Telescope can publish their data on here and big data projects, AI, machine learning can all benefit from this.

How we learned to love Dask and achieved a 40x speedup | by Targomo | Medium


I would say honestly, no. However, making them so is simple code wise, but we will need to press the community again to help us help them create a simple-to-use API, and it’s on us to iterate towards providing that as quickly as possible. We all now know we can be very quick, and we will be.


Nodes are starting to die:

1 Like