[Offline] Another day another testnet

Up to 846 files so far

safe files ls safe://hyryyryip96f9ojodzifniqn1zcu3wbqnhsiordj7o51jh5do86c596yhqhnra
5 Likes

Hmm… I make it 854

#GamesYouCanPlayAllNight

3 Likes

This new testnet is a great way to start the weekend.

:sascha:

3 Likes

Only halfway through A. Three days to ZZ Top. :bearded_person: :bearded_person: :person_curly_hair:

2 Likes

A bit self-referential but there you go…


willie@gagarin:~/projects/maidsafe/safe_network$ time safe files put -r sn_node/
FilesContainer created at: "safe://hyryyrywzjbotkr5f8m3fmg8jogp8jxyubt64yy79ppgb19hkqprxkphhbynra?v=huaqamyf6bxord6ujsjwfjpkt4p5uy1bjwjauqfu1dni49tcc6ojo"
---+--------------------------------------------------------+--------------------------------------------------------------------|
| + | sn_node/src/storage/registers.rs                       | safe://hyryyyyjwcksyxo6gk5sthanuj89x6t9urieofmd7a6jzb5wcztwya5qwqr |
|---+--------------------------------------------------------+--------------------------------------------------------------------|
| + | sn_node/src/storage/used_space.rs                      | safe://hyryyyyepxm6eku5yibqi56nw3mmhma9t5qm7mpj6n8kmqcw34zj87a816w |
+---+--------------------------------------------------------+--------------------------------------------------------------------+

real	0m40.765s
user	0m0.934s
sys	0m0.438s
4 Likes

Wow this one seems to be going great. Well done again @maidsafe !

Rockers (split) is up in container:

safe://hyryyryudr7984zkjbjeryf4wbin4w7jdbt8cjtoyg7ajm7uu8scby4ruqrnra?v=hjnz935tgtdamw5gujakjuoxzf9ne5cttsdp8tikhfze31ifeneao
7 Likes

ok, the corruption of files is happening again using cat in powershell, windows 11.
This is one of the OP links:

safe cat safe://hygoygycc11b4pmrcb97ro6ro3wxh3cfrgi7ctbiwyya8mkktq1j35ysmzh > 6.jpg

It retrieves a file that doesn’t open, and looking at it in hex it has the same characteristics as the previous corrupted files, i.e additional 00 characters:

image

Same command, in a VM running ubuntu, on the same machine, retrieves a valid jpg.
HEX of the valid files looks like this:

let me know if there’s any additional tests I can run or logs I can check

11 Likes

I think you have indeed found a bug. Nice one

7 Likes

Ok, now, this is interesting.
Same command in Command Prompt instead of PowerShell retrieves a correct file!

So the problem is with cat (safe files get with the container of the same file works fine) in PowerShell (and windows 11? should be easy to replicate)

PS found a similar issue here (same header and blank characters, so yes, looks like an encoding issue)

Also this seems to be related:

Last bit of info, and then I leave this to the pros: files downloaded with cat in PowerShell seems to be encoded with:
image
Correct files are encoded as:
image

11 Likes

Aww yeah!

safe files put boot.png
FilesContainer created at: “safe://hyryyrytirxr1fkfjft6zsnbs8dkf4qtfbo8ewgdxqrgyj9n1sebooaxy5hnra?v=hwqwdtm8juz7skhntaer1fgjx4pxe7gcxxgio3yx9qky8s8zz5aao”
±–±---------±-------------------------------------------------------------------+
| + | boot.png | safe://hygoyeypezst8ia9cxk5bfo14bkuc9b15qo9xgnm79oso6qny15uc6fcnrc |
±–±---------±-------------------------------------------------------------------+

3 Likes

Is it expected to have new local sockets be created on every retry (30 seconds apart) while waiting to join the network, or should these local udp sockets be attempted to be re-used or earlier sockets be closed?

netstat -tulpn

udp        0      0 0.0.0.0:48854           0.0.0.0:*                           37638/sn_node
udp        0      0 0.0.0.0:33354           0.0.0.0:*                           37638/sn_node
udp        0      0 0.0.0.0:51744           0.0.0.0:*                           37638/sn_node
udp        0      0 0.0.0.0:35641           0.0.0.0:*                           37638/sn_node
udp        0      0 0.0.0.0:52451           0.0.0.0:*                           37638/sn_node
The network is not accepting nodes right now. Retrying after 30 seconds.
The network is not accepting nodes right now. Retrying after 30 seconds.
The network is not accepting nodes right now. Retrying after 30 seconds.
The network is not accepting nodes right now. Retrying after 30 seconds.
The network is not accepting nodes right now. Retrying after 30 seconds.

The number of local udp ports opened matches exactly the number of waits and retries that are taking place, and both keeps rising every 30 seconds.

Side note: I still have not been able to successfully join to the network via home.

Have others outside of happybeing been able to connect as node operator via home or via cloud resources to the base 20 nodes setup by Maidsafe?

6 Likes

I can upload and download - But node keep timing out.

Encountered a timeout while trying to join the network. Retrying after 30 seconds.

repeats message. Nothing in log.

Edit: after checking on download of my upload (a jpg) and the default coast.jpg download. Neither are displaying for gimp - says they aren’t jpg’s. The coast jpg is 4.5mb, so seems like it did download something. my jpg is smaller than what it should be. So some sort of data corruption happening somewhere.

gimp error: “Not a JPEG file: starts with 0x50 0x72”

Nope. I guess it’s not full enough yet.

I uploaded about 5.5GB of files in two folders (1.6GB + 3.9GB) yesterday and they up- and downloaded very well. I’m checking now if they still download OK. Results for the smaller folder are very good for my connection:

Today:

real	8m4,693s
user	2m9,202s
sys	    1m0,203s

Yesterday, about 10 hours ago:

real	8m29,209s
user	1m14,838s
sys	    0m34,898s

So today it was a bit faster.

2 Likes

It is not only about sockets.
sn_node used all my RAM over night, crashed lots of my services… even without connection to the network! (The network is not accepting nodes right now. Retrying after 30 seconds)
I never saw program which leaks memory so massively even before starting to make actual work.

2 Likes

I’m noticing this too. As it runs just eats more and more ram.

2 Likes

Some PUTs:

FilesContainer created at: "safe://hyryyrytbuu99pgazhs6fopd9ge6bz71drzb94o9kouzs1jg7hi88wistoonra?v=hzcen3hsxn3xzdnhhjgng4tb8wtxbc5ex5a74gznrgnsdmxwqo3uo"
+---+-------------+--------------------------------------------------------------------+
| + | stocks2.jpg | safe://hygoygykwr1mz1wm4c3aohexo7osg33tx45de4uou9rchsgbka9h47enp5c |
+---+-------------+--------------------------------------------------------------------+

real	0m4.810s
user	0m0.103s
sys	0m0.048s

FilesContainer created at: "safe://hyryyryzyuog5exef67tyijau3nwi14rb4pkeqopta1neeh77t6n4w8tjkrnra?v=h444666rok4iqxsphmsynthrsbfr8iox8ik8g7xn3u7qg7tgjnq7o"
+---+--------------------+--------------------------------------------------------------------+
| + | fintech-stocks.jpg | safe://hygoygyj3byppw7p1skix3n3egahswyutwbsupxb8smdokz5mu8c5ohp8zw |
+---+--------------------+--------------------------------------------------------------------+

real	0m6.344s
user	0m0.074s
sys	0m0.046s

FilesContainer created at: "safe://hyryyryzuapagjtjk6fhtu6kibckt48779boije9dbtc914nd6cdkmz36qenra?v=hpcpx3rthukzq6kypxhexfp8pr9teb9aiehyr3mzk9d4ebw1xe17y"
+---+--------------------+--------------------------------------------------------------------+
| + | julien-tromeur.jpg | safe://hygoygyqpndak7fyr7etn4h6nnsnhr4bbxoy97cz58m4j8kdomq5suwtuoo |
+---+--------------------+--------------------------------------------------------------------+

real	0m6.732s
user	0m0.099s
sys	0m0.025s

FilesContainer created at: "safe://hyryyryibp51hrqt481sprib16rfmspqbq3pxa9ascgtpno3i8g1x97c3krnra?v=h67jpz1bifec8yzi9qns81m4w3hboo6kukzws4rd9x51h8j8xj7jy"
+---+---------------------+--------------------------------------------------------------------+
| + | alexander-popov.jpg | safe://hygoygyju16yxa6wpyxg6d4twourcpnyaoz3ebmdg56zkw87fs1kqzz4z1a |
+---+---------------------+--------------------------------------------------------------------+

real	0m4.063s
user	0m0.084s
sys	0m0.058s

FilesContainer created at: "safe://hyryyrywi1dhe3tznd3y7xuoq4gdztd3w9smxmarui54f5zomamz3ptbf9ynra?v=hg9w8tif8cuad1k9tsqsdig6h57wczwuzzuxbu5jmgqp74yk7iajy"
+---+---------------------------+--------------------------------------------------------------------+
| + | cryptocurrency-stocks.jpg | safe://hygoygyqjsqoyib4gf5mum5p83zf8y8t5169dwr4wpt9int9jaiww4jy1iy |
+---+---------------------------+--------------------------------------------------------------------+

real	0m5.228s
user	0m0.064s
sys	0m0.102s

FilesContainer created at: "safe://hyryyryzbtc5zz5nthgmymh9wzhwibe71ambmw3piqkm5di69gip1f5hk8rnra?v=hjkragj9z86kixzbmgsxk86bufprwxi7uah5938utiepxrrfte9my"
+---+------------------------+--------------------------------------------------------------------+
| + | filesharing-crypto.jpg | safe://hygoygyqbsatznkkumgipnjr3tyrnytcf7k9bdxpk458hur9jprbpexy1ha |
+---+------------------------+--------------------------------------------------------------------+

real	0m4.743s
user	0m0.094s
sys	0m0.042s
2 Likes

I downloaded the stocks2.jpg - filessize 97.6kb, but get the same error when trying to open it as I get for others:

2 Likes

Are you on Windows?
Would you be able to show the beginning of the file in HEX?

1 Like

I am using debian.

output of first few lines using hexdump of stocks2.jpg:

0000000 7250 786f 4379 6168 6e69 2d73 2e33 2031
0000010 6828 7474 3a70 2f2f 7270 786f 6379 6168
0000020 6e69 2e73 6673 6e2e 7465 0a29 d8ff e0ff
0000030 1000 464a 4649 0100 0001 0100 0100 0000
0000040 dbff 8400 0900 0909 0a09 0a09 0c0c 0f0a
0000050 0e10 0f10 1415 1212 1514 1720 1719 1719
0000060 3120 241f 1f1f 1f24 2c31 2b35 2b28 2c35
0000070 3d4e 3737 4e3d 4c5a 4c48 6e5a 6262 8a6e
0000080 8a83 b4b4 01f2 0909 0909 090a 0c0a 0a0c

EDIT: my bad - worked it out, I was pushing through a proxy and that was messing it up somehow. Can now download correct data when going direct:

Although weird that going through a proxy would do this. Specifically I was using proxychains and pushing through Tor. File sizes for download was correct I think, but somehow file was corrupted.

6 Likes

Same here. I just tried with having only node joining and activity monitor, no other programs open on my Ubuntu. I have 8.3GB memory, and every 30s cycle increased the consumption by about 0.1%.

I also had my computer trying to join overnight. I didn’t check how it was using resources, but trying to open one small jpg jammed the whole system. Had to close the machine from power button.

EDIT: @Vort @southside or someone else, is there an easy way to somehow record the output of UbuntuSystem Monitor? I would like have a graph of several hours about the resources used by the node joining process.

1 Like