InstallNet [2023-06-19 Testnet] [Offline]

Yeah, sorry, this whole thing is the main disadvantage of not using sudo.

I really wish distros would start putting ~/.local/bin on the PATH by default. It would definitely be useful to have some non-root writable location on there by default.

1 Like

Is there a way to test responsivity of a specific node? Something like ping but to test against specific node process?
I am running some nodes connected to this testnet, same connection/router, but different machines, multiple nodes on one machine, nodes running on different drives etc. I would like to test differences between different setups, but am not sure what to measure to get relevant data.

Btw I am really excited right now, I am running 100+ nodes from my home network and everything seems to work fine.

3 Likes

Maybe not ideal but you can monitor multiple nodes (ie node logfiles) using vdash. Cycling through the monitored logfiles will show log activity and some other things for the corresponding node.

3 Likes

I am getting a mix of success and failures - mostly failure

Storing file "timeout.cpython-310.pyc" of 9806 bytes..
Did not store file "timeout.cpython-310.pyc" to all nodes in the close group! Network Error Outbound Error.
Storing file "ssltransport.py" of 9045 bytes..
Did not store file "ssltransport.py" to all nodes in the close group! Network Error Outbound Error.
Storing file "util.py" of 1146 bytes..
Did not store file "util.py" to all nodes in the close group! Network Error Outbound Error.
Storing file "proxy.py" of 1148 bytes..
Successfully stored file "proxy.py" to 517c164bd48945a7b5f3aa062cfd3985b224419de6164920717510922c4d62aa
Storing file "timeout.py" of 10529 bytes..
Did not store file "timeout.py" to all nodes in the close group! Network Error Outbound Error.
Storing file "ssl_match_hostname.py" of 5812 bytes..
Did not store file "ssl_match_hostname.py" to all nodes in the close group! Network Error Outbound Error.
Storing file "url.py" of 15213 bytes..
Did not store file "url.py" to all nodes in the close group! Network Error Outbound Error.
Storing file "request.py" of 8111 bytes..
Did not store file "request.py" to all nodes in the close group! Network Error Outbound Error.
Storing file "__init__.py" of 1051 bytes..
Did not store file "__init__.py" to all nodes in the close group! Network Error Outbound Error.
ubuntu@ip-172-31-45-225:~$ safe --version
sn_cli 0.77.47

EDIT : When I try again using an earlier safe version, so far it all looks good

Storing file "etag.cpython-310.pyc" of 3908 bytes..
Successfully stored file "etag.cpython-310.pyc" to 17dbfbc0955dc664a0753793c8b871831a54a73bd3c62201caa5e7ebbc220aac
Storing file "auth.cpython-310.pyc" of 15694 bytes..
Successfully stored file "auth.cpython-310.pyc" to 403e960973d04026d54ddf18733cdbf3656f9d823d0a59d50914b13c125f6ec5
Storing file "mixins.cpython-310.pyc" of 9044 bytes..
Successfully stored file "mixins.cpython-310.pyc" to 952ec8dad4430fcbd518486c25356ba987f522a890cb806fcea6f4bed3f33d45
Storing file "accept.cpython-310.pyc" of 10641 bytes..
Successfully stored file "accept.cpython-310.pyc" to 1015dfad1efc1e5d5af28a4e9ca1da776d921c0a8781067cea7526a4adbbf34a
Storing file "headers.pyi" of 4237 bytes..
Successfully stored file "headers.pyi" to c966fbf27fc2beeaf019ca8bfb1a3254e8088689330b427fc6c29321ef37daf1
Storing file "structures.py" of 31761 bytes..
Successfully stored file "structures.py" to 1100fa7302c180769965be62efbeae6efb30f152c0a3f5cda0018c9d055ca324
Storing file "range.pyi" of 1792 bytes..
Successfully stored file "range.pyi" to 061132aa980cc4b43ad9551841e27905c5ea81b9c8b09e5d95dc04b24bccbf3a
Storing file "file_storage.py" of 6184 bytes..
Successfully stored file "file_storage.py" to 189b5ccd5ce7c2f683f985cbc84948d66b38f8d51238ca76eee3ff099abfb145
Storing file "mixins.py" of 5337 bytes..
Successfully stored file "mixins.py" to 3d4de0aa5707fa65d2400dc4b12af6924c26fe83b48fd9c5352a04c320a95e6b
Storing file "structures.pyi" of 8148 bytes..
Successfully stored file "structures.pyi" to 3fddfadf0ba6752a2c176c08807e822afb3fa31307e7c98fbaa873af18443f6a
Storing file "mixins.pyi" of 4191 bytes..
Successfully stored file "mixins.pyi" to 5614c9b3d5478756f14083a60a8565c0736e8111e31497e8121b2f776df22219
Storing file "cache_control.py" of 6043 bytes..
ubuntu@ip-172-31-45-225:~$ safe --version
sn_cli 0.77.37

:white_check_mark:

2 Likes

Yes, it was a silly mistake not thinking on my part.
It should be prominently noted in the main post as late comers are going to read the instructions and incorrect versions cause frustration.

I was thinking the network had issues, not a great user experience for anyone (newcomers) not necessarily willing to power through and see why they are not successfully able to use the network.

4 Likes

The current safe version prepends a RecordHeader to each piece of data. This allows us to distinguish between a chunk/dbc/register, since Kademlia stores everything as a Record in the network. The older nodes cannot handle these headers, as this is a breaking change. This might explain the above failures.

We have a LogMarker PR in the queue that should provide a stable way to denote important events.

Thanks for that :slight_smile:
We really need to get the OP sorted then. This seems like a stable network with low barriers to participation – IF we can get folks to use the correct binaries

If been hammering at and so far don’t think iv seen a single error. Apart from when I ran out of hard drive space for downloading to

8 Likes

safe --version ???

Yeah, for future testnets, I think we need to tie to versions. Our releases are too frequent for anything else.

It was just that for this particular net, we actually want to be able to test that the install process can get the latest version.

13 Likes

Aye, I’m not really sure what’s going on here either…

Locally, I’m testing out the log markers as laid out here: feat(node): expose log markers in public api by joshuef · Pull Request #428 · maidsafe/safe_network · GitHub and this seems to be lining up again, so hopefully this will be straightened out for the next version.

(And if there are more log msgs you’d like to rely upon, please let me know here/dm/on github and we can get more markers in! Same to you @happybeing (or indeed anyone wanting to poke about logs; what msgs are you finding most interesting???)

5 Likes

Is anyone able to download anything? Uploads seems to work but all download attempts fail.

1 Like

im still doing fine just downloaded beg blag

give this a go @digipl

safe files download begblag.mp3 3eb0873bd425e5599d72c2873ca6e691d5de5c75bbc89f2e088fa95e3390927a

edit

just started a mass download of mp3’s again and first 50 downloaded fine and network still going fast
on an oracle node

2 Likes

I try several times and always error.

Downloading file “begblag.mp3” with address 3eb0873bd425e5599d72c2873ca6e691d5de5c75bbc89f2e088fa95e3390927a
Did not get file “begblag.mp3” from the network! Chunks error Not all chunks were retrieved, expected 31, retrieved 18, missing [97df1a(10010111)…, 23f2ab(00100011)…, df2753(11011111)…, 51ef73(01010001)…, 060314(00000110)…, 20913a(00100000)…, e72d1f(11100111)…, 844fdf(10000100)…, d2a2c1(11010010)…, 3a545a(00111010)…, 72358e(01110010)…, 89883c(10001001)…, 606f78(01100000)…]…

2 Likes

just downloaded right now

ubuntu@safe:~/.safe/client/downloaded_files$ rm *
ubuntu@safe:~/.safe/client/downloaded_files$ export SAFE_PEERS=/ip4/68.183.44.129/tcp/38921/p2p/12D3KooWN3P9exk23WW7naW7Kb1rdzZeLpZRHXtF5ntyQtJrsiF7
ubuntu@safe:~/.safe/client/downloaded_files$ time safe files download begblag.mp3 3eb0873bd425e5599d72c2873ca6e691d5de5c75bbc89f2e088fa95e3390927a
Removed old logs from directory: "/tmp/safe-client"
Logging to directory: "/tmp/safe-client"
Built with git version: 74528f5 / main / 74528f5
Instantiating a SAFE client...
🔗 Connected to the Network                                                                                                                                                        Downloading file "begblag.mp3" with address 3eb0873bd425e5599d72c2873ca6e691d5de5c75bbc89f2e088fa95e3390927a
Successfully got file begblag.mp3!
Writing 15766382 bytes to "/home/ubuntu/.safe/client/begblag.mp3"

real	1m59.708s
user	0m6.517s
sys	0m2.577s

can you check your version should be 0.77.37 ?

ubuntu@safe-byres:~$ safe -V
sn_cli 0.77.37

if version is good you can try increasing the time out to 60 seconds instead of the default 30

time safe files download begblag.mp3 3eb0873bd425e5599d72c2873ca6e691d5de5c75bbc89f2e088fa95e3390927a --timeout 60
1 Like

In case someone is interested, I’ve found how to obtain non-uniform (Gamma) distribution from two uniform distributions (thanks 1 and 2):

Why logarithm appears there is a mystery for me however.

8 Likes

The version is correct and small files are the only ones that, sometimes, download without errors.

In all other files 20% to 40%, sometimes more, of the chunks fail with a rather erratic behaviour.

Same…

iMac-de-Imac27:Desktop imac27$ time safe files download begblag.mp3 3eb0873bd425e5599d72c2873ca6e691d5de5c75bbc89f2e088fa95e3390927a --timeout 60
Removed old logs from directory: “/var/folders/vw/vq5vxlj95vnfjgncs5tfh1q40000gn/T/safe-client”
Logging to directory: “/var/folders/vw/vq5vxlj95vnfjgncs5tfh1q40000gn/T/safe-client”
Built with git version: 74528f5 / main / 74528f5
Instantiating a SAFE client…
:link: Connected to the Network Downloading file “begblag.mp3” with address 3eb0873bd425e5599d72c2873ca6e691d5de5c75bbc89f2e088fa95e3390927a
Did not get file “begblag.mp3” from the network! Chunks error Not all chunks were retrieved, expected 31, retrieved 12, missing [274f09(00100111)…, 97df1a(10010111)…, 5f2d1a(01011111)…, a212fe(10100010)…, 2bf54c(00101011)…, fcdd80(11111100)…, 29131a(00101001)…, aac236(10101010)…, 8d83ee(10001101)…, 6a625f(01101010)…, f36ccd(11110011)…, 20913a(00100000)…, e72d1f(11100111)…, 844fdf(10000100)…, 894078(10001001)…, a5f133(10100101)…, 72358e(01110010)…, 89883c(10001001)…, 606f78(01100000)…]…

real 0m22.476s
user 0m1.593s
sys 0m0.543s

4 Likes

I’m out of ideas I can down load it on 3 separate Ubuntu boxes.

Maybe post the log so one of the team can have a look?

Also I started a download of 10k Mp3’s again and it’s downloading fine and fast abut 1 or 2 seconds for a mp3

3 Likes

Can I just ask btw, why are you on such an old version of macOS? I believe High Sierra 10.13.6 dates back to 2018. Not that it shouldn’t work, but it will be hard for us to reproduce issues on such an old OS.

I think I’m correct in saying that other people who have been using more recent versions of macOS haven’t experienced this problem.

5 Likes

So… I’ve put together a proxmox server (cheap lenovo tiny desktop) to replace digital ocean and run all my work and play home machines. I can power them up and shutdown using a pi zero as a wol-server. Needed an always on low power wol-server to ssh in to home because I found out you cant broadcast wake on lan over an openvpn connection. Some hints and tips there for anyone wanting to do the same. Proxmox also runs my win10 VM (SPICE client is amazing) for when I need to do excel work, am fully linux mint on my laptop now.

I’ve installed an ubuntu VM to connect to this test network.
Running all the commands in suggested order and using the tip from happybeing, I get this
“Protocol error”

Running the download command from a new terminal window is successful.

It downloaded fast and plays. Amazing. I’ve not played with testnets for a while and this feels like great progress.

I also tried to start a node…

Yea… I am behind a nat.

upload works too!!!

I guess to download my file the command is,

safe files download coolcat.jpg a103ab8bbb7b07d7eb186ca5adf7c047049eb5b8ecd640e6fc0b2dd6aca95156

Downloading my own file works immediatly… I can also change its download name.

This testnet feels polished.

:partying_face: :partying_face: :partying_face: :partying_face:
Congratulations.

Also… forgot to say I really love the chain emoji that appears in terminal.

17 Likes