Up to 846 files so far
safe files ls safe://hyryyryip96f9ojodzifniqn1zcu3wbqnhsiordj7o51jh5do86c596yhqhnra
Up to 846 files so far
safe files ls safe://hyryyryip96f9ojodzifniqn1zcu3wbqnhsiordj7o51jh5do86c596yhqhnra
Hmm… I make it 854
#GamesYouCanPlayAllNight
This new testnet is a great way to start the weekend.
Only halfway through A. Three days to ZZ Top.
A bit self-referential but there you go…
willie@gagarin:~/projects/maidsafe/safe_network$ time safe files put -r sn_node/
FilesContainer created at: "safe://hyryyrywzjbotkr5f8m3fmg8jogp8jxyubt64yy79ppgb19hkqprxkphhbynra?v=huaqamyf6bxord6ujsjwfjpkt4p5uy1bjwjauqfu1dni49tcc6ojo"
---+--------------------------------------------------------+--------------------------------------------------------------------|
| + | sn_node/src/storage/registers.rs | safe://hyryyyyjwcksyxo6gk5sthanuj89x6t9urieofmd7a6jzb5wcztwya5qwqr |
|---+--------------------------------------------------------+--------------------------------------------------------------------|
| + | sn_node/src/storage/used_space.rs | safe://hyryyyyepxm6eku5yibqi56nw3mmhma9t5qm7mpj6n8kmqcw34zj87a816w |
+---+--------------------------------------------------------+--------------------------------------------------------------------+
real 0m40.765s
user 0m0.934s
sys 0m0.438s
Wow this one seems to be going great. Well done again @maidsafe !
Rockers (split) is up in container:
safe://hyryyryudr7984zkjbjeryf4wbin4w7jdbt8cjtoyg7ajm7uu8scby4ruqrnra?v=hjnz935tgtdamw5gujakjuoxzf9ne5cttsdp8tikhfze31ifeneao
ok, the corruption of files is happening again using cat
in powershell, windows 11.
This is one of the OP links:
safe cat safe://hygoygycc11b4pmrcb97ro6ro3wxh3cfrgi7ctbiwyya8mkktq1j35ysmzh > 6.jpg
It retrieves a file that doesn’t open, and looking at it in hex it has the same characteristics as the previous corrupted files, i.e additional 00 characters:
Same command, in a VM running ubuntu, on the same machine, retrieves a valid jpg.
HEX of the valid files looks like this:
let me know if there’s any additional tests I can run or logs I can check
I think you have indeed found a bug. Nice one
Ok, now, this is interesting.
Same command in Command Prompt instead of PowerShell retrieves a correct file!
So the problem is with cat
(safe files get
with the container of the same file works fine) in PowerShell (and windows 11? should be easy to replicate)
PS found a similar issue here (same header and blank characters, so yes, looks like an encoding issue)
Also this seems to be related:
Last bit of info, and then I leave this to the pros: files downloaded with cat
in PowerShell seems to be encoded with:
Correct files are encoded as:
Aww yeah!
safe files put boot.png
FilesContainer created at: “safe://hyryyrytirxr1fkfjft6zsnbs8dkf4qtfbo8ewgdxqrgyj9n1sebooaxy5hnra?v=hwqwdtm8juz7skhntaer1fgjx4pxe7gcxxgio3yx9qky8s8zz5aao”
±–±---------±-------------------------------------------------------------------+
| + | boot.png | safe://hygoyeypezst8ia9cxk5bfo14bkuc9b15qo9xgnm79oso6qny15uc6fcnrc |
±–±---------±-------------------------------------------------------------------+
Is it expected to have new local sockets be created on every retry (30 seconds apart) while waiting to join the network, or should these local udp sockets be attempted to be re-used or earlier sockets be closed?
netstat -tulpn
udp 0 0 0.0.0.0:48854 0.0.0.0:* 37638/sn_node
udp 0 0 0.0.0.0:33354 0.0.0.0:* 37638/sn_node
udp 0 0 0.0.0.0:51744 0.0.0.0:* 37638/sn_node
udp 0 0 0.0.0.0:35641 0.0.0.0:* 37638/sn_node
udp 0 0 0.0.0.0:52451 0.0.0.0:* 37638/sn_node
The network is not accepting nodes right now. Retrying after 30 seconds.
The network is not accepting nodes right now. Retrying after 30 seconds.
The network is not accepting nodes right now. Retrying after 30 seconds.
The network is not accepting nodes right now. Retrying after 30 seconds.
The network is not accepting nodes right now. Retrying after 30 seconds.
The number of local udp ports opened matches exactly the number of waits and retries that are taking place, and both keeps rising every 30 seconds.
Side note: I still have not been able to successfully join to the network via home.
Have others outside of happybeing been able to connect as node operator via home or via cloud resources to the base 20 nodes setup by Maidsafe?
I can upload and download - But node keep timing out.
Encountered a timeout while trying to join the network. Retrying after 30 seconds.
repeats message. Nothing in log.
Edit: after checking on download of my upload (a jpg) and the default coast.jpg download. Neither are displaying for gimp - says they aren’t jpg’s. The coast jpg is 4.5mb, so seems like it did download something. my jpg is smaller than what it should be. So some sort of data corruption happening somewhere.
gimp error: “Not a JPEG file: starts with 0x50 0x72”
Nope. I guess it’s not full enough yet.
I uploaded about 5.5GB of files in two folders (1.6GB + 3.9GB) yesterday and they up- and downloaded very well. I’m checking now if they still download OK. Results for the smaller folder are very good for my connection:
Today:
real 8m4,693s
user 2m9,202s
sys 1m0,203s
Yesterday, about 10 hours ago:
real 8m29,209s
user 1m14,838s
sys 0m34,898s
So today it was a bit faster.
It is not only about sockets.
sn_node
used all my RAM over night, crashed lots of my services… even without connection to the network! (The network is not accepting nodes right now. Retrying after 30 seconds)
I never saw program which leaks memory so massively even before starting to make actual work.
I’m noticing this too. As it runs just eats more and more ram.
Some PUTs:
FilesContainer created at: "safe://hyryyrytbuu99pgazhs6fopd9ge6bz71drzb94o9kouzs1jg7hi88wistoonra?v=hzcen3hsxn3xzdnhhjgng4tb8wtxbc5ex5a74gznrgnsdmxwqo3uo"
+---+-------------+--------------------------------------------------------------------+
| + | stocks2.jpg | safe://hygoygykwr1mz1wm4c3aohexo7osg33tx45de4uou9rchsgbka9h47enp5c |
+---+-------------+--------------------------------------------------------------------+
real 0m4.810s
user 0m0.103s
sys 0m0.048s
FilesContainer created at: "safe://hyryyryzyuog5exef67tyijau3nwi14rb4pkeqopta1neeh77t6n4w8tjkrnra?v=h444666rok4iqxsphmsynthrsbfr8iox8ik8g7xn3u7qg7tgjnq7o"
+---+--------------------+--------------------------------------------------------------------+
| + | fintech-stocks.jpg | safe://hygoygyj3byppw7p1skix3n3egahswyutwbsupxb8smdokz5mu8c5ohp8zw |
+---+--------------------+--------------------------------------------------------------------+
real 0m6.344s
user 0m0.074s
sys 0m0.046s
FilesContainer created at: "safe://hyryyryzuapagjtjk6fhtu6kibckt48779boije9dbtc914nd6cdkmz36qenra?v=hpcpx3rthukzq6kypxhexfp8pr9teb9aiehyr3mzk9d4ebw1xe17y"
+---+--------------------+--------------------------------------------------------------------+
| + | julien-tromeur.jpg | safe://hygoygyqpndak7fyr7etn4h6nnsnhr4bbxoy97cz58m4j8kdomq5suwtuoo |
+---+--------------------+--------------------------------------------------------------------+
real 0m6.732s
user 0m0.099s
sys 0m0.025s
FilesContainer created at: "safe://hyryyryibp51hrqt481sprib16rfmspqbq3pxa9ascgtpno3i8g1x97c3krnra?v=h67jpz1bifec8yzi9qns81m4w3hboo6kukzws4rd9x51h8j8xj7jy"
+---+---------------------+--------------------------------------------------------------------+
| + | alexander-popov.jpg | safe://hygoygyju16yxa6wpyxg6d4twourcpnyaoz3ebmdg56zkw87fs1kqzz4z1a |
+---+---------------------+--------------------------------------------------------------------+
real 0m4.063s
user 0m0.084s
sys 0m0.058s
FilesContainer created at: "safe://hyryyrywi1dhe3tznd3y7xuoq4gdztd3w9smxmarui54f5zomamz3ptbf9ynra?v=hg9w8tif8cuad1k9tsqsdig6h57wczwuzzuxbu5jmgqp74yk7iajy"
+---+---------------------------+--------------------------------------------------------------------+
| + | cryptocurrency-stocks.jpg | safe://hygoygyqjsqoyib4gf5mum5p83zf8y8t5169dwr4wpt9int9jaiww4jy1iy |
+---+---------------------------+--------------------------------------------------------------------+
real 0m5.228s
user 0m0.064s
sys 0m0.102s
FilesContainer created at: "safe://hyryyryzbtc5zz5nthgmymh9wzhwibe71ambmw3piqkm5di69gip1f5hk8rnra?v=hjkragj9z86kixzbmgsxk86bufprwxi7uah5938utiepxrrfte9my"
+---+------------------------+--------------------------------------------------------------------+
| + | filesharing-crypto.jpg | safe://hygoygyqbsatznkkumgipnjr3tyrnytcf7k9bdxpk458hur9jprbpexy1ha |
+---+------------------------+--------------------------------------------------------------------+
real 0m4.743s
user 0m0.094s
sys 0m0.042s
I downloaded the stocks2.jpg - filessize 97.6kb, but get the same error when trying to open it as I get for others:
Are you on Windows?
Would you be able to show the beginning of the file in HEX?
I am using debian.
output of first few lines using hexdump of stocks2.jpg:
0000000 7250 786f 4379 6168 6e69 2d73 2e33 2031
0000010 6828 7474 3a70 2f2f 7270 786f 6379 6168
0000020 6e69 2e73 6673 6e2e 7465 0a29 d8ff e0ff
0000030 1000 464a 4649 0100 0001 0100 0100 0000
0000040 dbff 8400 0900 0909 0a09 0a09 0c0c 0f0a
0000050 0e10 0f10 1415 1212 1514 1720 1719 1719
0000060 3120 241f 1f1f 1f24 2c31 2b35 2b28 2c35
0000070 3d4e 3737 4e3d 4c5a 4c48 6e5a 6262 8a6e
0000080 8a83 b4b4 01f2 0909 0909 090a 0c0a 0a0c
EDIT: my bad - worked it out, I was pushing through a proxy and that was messing it up somehow. Can now download correct data when going direct:
Although weird that going through a proxy would do this. Specifically I was using proxychains and pushing through Tor. File sizes for download was correct I think, but somehow file was corrupted.
Same here. I just tried with having only node joining and activity monitor, no other programs open on my Ubuntu. I have 8.3GB memory, and every 30s cycle increased the consumption by about 0.1%.
I also had my computer trying to join overnight. I didn’t check how it was using resources, but trying to open one small jpg jammed the whole system. Had to close the machine from power button.
EDIT: @Vort @southside or someone else, is there an easy way to somehow record the output of UbuntuSystem Monitor? I would like have a graph of several hours about the resources used by the node joining process.