Preparing Testnet 5

I have a Pi 2b laying around that I hardly ever used. What OS image do you recommend for SN and how do I put it on there? Total linux noob here who just took his first steps on Ubuntu mind you.

4 Likes

Raspbian or Ubuntu should be fine, and there are folks here will have set this up recently who can help you.

2 Likes

I wasn’t happy about the idea of flooding the testnet with “garbage” but well…if this is the only way to allow new node to connect to, I’m ready :slight_smile:

while true; do myfile=file-$(date +%s); dd if=/dev/urandom of=$myfile bs=10M count=1; safe files put ./$myfile; sleep 3; done

I’m not that happy either, but I think the priority will be to upload as much as possible, “garbage” or not to generate chunks for new nodes to store. I’m sure if this changes, the devs will let us know soon enough.

1 Like

IMO better to upload real files (images, mp3, whatever) that can be checked for intergrity after dowload.

3 Likes

Can someone tell me what would be the best setup for a dedicated note? I’m happy to purchase some hardware, just don’t have the knowledge :stuck_out_tongue:

2 Likes

According to the (old) architecture the most rewarded node will be the node closest to the median specification of all the nodes on the network. I’m not sure if there is any data about this yet.

Loving this ‘battle stations’ pep-talk @Southside. Getting the armory in gear ready for the next release! Brilliant, practical and bravo!

2 Likes

Nah, I just don’t to be as disorganised as I was last week :slight_smile: So I decided to guilt-trip the rest of youse into refining my thoughts for me…

1 Like

I’m thinking that perhaps “uploading garbage” could be improved by keeping the list of all the xorurls obtained when uploaded, so later (after hours/days) can be tested/confirmed if the data is still there or not, perhaps just storing them in a text file which can then be fed into a second script to check if they are still on the network with safe cat.

5 Likes

Im working on a script that will scrape the xorurls on successful upload and then report them to a dedicated topic on here. So we can check each others homework…

Well its a concept rather than being “in work” right now…
How do I automate a post onto this forum? is only one of the questions I have right now

Also a script that would upload a set of std test files as mentioned above by @Michael_Hills and record when and to which xorurl it was stored. Then we can see how many times these std files were uploaded and hopefully gain some info on how well deduplication is working -also upload performance

5 Likes

Not sure if that could be that good assuming you’ll be generating many URLs…but if you keep them locally and hours later can be tested against the network that’ll be really good I think

2 Likes

Thanks to the help from you guys I was able to connect to 4.2 and receive some chunks. For T5 I’m going to try and upload some files.

Basic question incoming. - safe file put(some files) in the some files bit do I just put the path to where the file is?

Does the system give me an address when the file is uploaded?

4 Likes

There are some examples here: https://github.com/maidsafe/sn_api/blob/master/sn_cli/README.md#files-put

1 Like

Yes and yes. And if you want to upload a directory add --recursive.

After upload the command will output the URL of the container which holds the file and a direct URL to the file.

3 Likes

probably already asked somewhere else but, is there any complete test shell scripts we can run and adapt to cover most cases (would be a great short tutorial too)?
tx

1 Like

I have made a start at GitHub - safenetwork-community/dedup-tester: Bash script which uploads a set of standard files to SAFE Network for performance profiling and investigation of deduplication behaviour

Feel free to dive in and help to develop this. The idea is to allow many users to upload a set of standard files which they can use to measure upload performance. Because we are attempting to store many copies of the same data the network should recognise this and deduplicate the files. As time goes on, the download speed for these files should decrease. Very crude first attempts, all help welcome…

For now it runs but is incredibly slow to write to a local baby-fleming network.

willie@leonov:~/projects/maidsafe/T5scripts$ ./std-files-upload-test.sh 
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 5120k  100 5120k    0     0  4671k      0  0:00:01  0:00:01 --:--:-- 4671k
-rw-rw-r-- 1 willie willie 5242880 Apr 27 01:28 5MB.zip
FilesContainer created at: "safe://hyryyryhr7ue71hwpxugc4h17w63ifj7ou1jdn8woiz7qw9mwpwrgx3uf5cnra"
+  5MB.zip  safe://hyfenryk19m98xnu116cyzrpouw6spk4bzui9zmb8b59gsthffux6mfs1mr 
FilesContainer created at: "safe://hyryyry3cjtp5shpnsgtxbfmm1f3kwypumpaww9dejszw5ec4yrz5frp97anra"
+  md5-5MB.txt  safe://hy8oycyqefc6jwd3kgyxdp1hiut51defj48ftk9pcb85frazdb9bqwig7by 
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 10.0M  100 10.0M    0     0  7345k      0  0:00:01  0:00:01 --:--:-- 7340k
-rw-rw-r-- 1 willie willie 10485760 Apr 27 01:29 10MB.zip
FilesContainer created at: "safe://hyryyryao53j7k8rqqnbpb81qe4c33tfaegmqtqd8rufd96xp9xhcbnfk1rnra"
+  10MB.zip  safe://hyfenryk3c587oaoy767jkcofptcph4ep7xac374u3fhkm1c6bbpboyz9be 
FilesContainer created at: "safe://hyryyry44grmhtfwguegid1ke6kz4aox5yew6xj9k1h31z8medpyhf499nenra"
+  md5-10MB.txt  safe://hy8oycyqmhjxdgx4togmkebugoy7sy9kqf37qqgrruhm9u4jsbfhas8budh 
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 20.0M  100 20.0M    0     0  7798k      0  0:00:02  0:00:02 --:--:-- 7798k
-rw-rw-r-- 1 willie willie 20971520 Apr 27 01:30 20MB.zip
FilesContainer created at: "safe://hyryyryac3bbik8m8p4h6jsayubda5g6kciwxyxao9tfe1bmq7iw75hphghnra"
+  20MB.zip  safe://hyfenrypdkneayzzjmc6y6arfbmpo4hfyhjb4qw6hsyaj4d4ckbhajmcara 
FilesContainer created at: "safe://hyryyrya3s7e1zrgraiz87mxej74se95g7aiy6bcuatad55xoonk1fcc4bynra"
+  md5-20MB.txt  safe://hy8oycyekpn1h3d7yig9g5j4fr5hxq35e3kjkm9qs48p3zbwhhm4m6na8ye 
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 50.0M  100 50.0M    0     0  8338k      0  0:00:06  0:00:06 --:--:-- 8485k
-rw-rw-r-- 1 willie willie 52428800 Apr 27 01:33 50MB.zip
FilesContainer created at: "safe://hyryyryakzffepz91adezar6tw9q9gxchu5gcjdyzkjk8z1j6488w8548ocnra"
+  50MB.zip  safe://hyfenrye4e66wc39eg8mexhwqdkunakkr1yx3dt5ntiiuhnaexcseo6cixw 
FilesContainer created at: "safe://hyryyry6wp895yg5oab8kgoq1g8cohj1zabwbeakh6f7o1b8z5jijzn5wgrnra"
+  md5-50MB.txt  safe://hy8oycye9gnrf8xiy1id9eiykbrwfjo5yh7i4my6dn6mzawhu567sstkhzy 
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  100M  100  100M    0     0  5835k      0  0:00:17  0:00:17 --:--:-- 8480k
-rw-rw-r-- 1 willie willie 104857600 Apr 27 01:43 100MB.zip
FilesContainer created at: "safe://hyryyryam4oaxpbdgfjo8wop333habrpjoqfsd9s5sj795jzw5s1npgsghanra"
+  100MB.zip  safe://hyfenrycwti1p5gwgjeaub4ym81o9ucd9c6pc4p6ajhejaxnn3rkcxtso5a 
FilesContainer created at: "safe://hyryyry4tjf1nrp7qtjcce473h7db66qj4aitwf6yyeia8gz56wrhfeawwonra"
+  md5-100MB.txt  safe://hy8oycyq4s1tqzen58p9acefctzqt1k4xqgz9tepyr1dkxzr9q6d9geccoc 
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  200M  100  200M    0     0  8114k      0  0:00:25  0:00:25 --:--:-- 8461k
-rw-rw-r-- 1 willie willie 209715200 Apr 27 02:16 200MB.zip
4 Likes

For those that are technically savvy (particularly in Linux), I would suggest considering renting a VPS for super cheap and having it available for tests. They make it a lot easier to have high quality, fast connections and are easier to leave running 24x7.

You can go on the “Low End Talk” site where suppliers post deals, and can get some decent specs for ~$30 USD/year a lot of times.

3 Likes

I tried to upload some files, but never success. Could someone please write again command working in Windows Git Bash and where he store that file ?
Thanks

I recommend this thread for dev environments :