Pre-Dev-Update Thread! Yay! :D

stout77 · December 17, 2022, 11:23pm

Take a snapshot and upload to the next testnet!

Southside · December 18, 2022, 12:41am

It may be that most of us will need to use cloud servers for the next wee while. The Hetzner CX11 is 4 euro/month and is adequate for put/get as it is. Add a 50Gb volume for when it is in use as a node. Delete the server(s) as soon as the testnet is done and restore as required from a snapshot and you can make 20 euro credit with Hetzer last a long time.

stout77 · December 18, 2022, 2:47am

Or free with 4 cores and 50gb on Oracle, just give in!

cryptoidiot · December 18, 2022, 9:47am

understood I correctly that problem is in public ip adress/routers? It can be solved without buy new router or public ip…?

Josh · December 20, 2022, 12:01pm

… turn around in events.

dirvine · December 20, 2022, 12:24pm

It was a bug we needed to fix in that commit. It will be back

joshuef · December 20, 2022, 12:25pm

Aye, was sadly blocking a testnet. But since this testnet you cannot join with nodes anyway, we’ve reverted for now until we can get it stable.

happybeing · January 10, 2023, 8:48pm

New safe dog CLI command coming. Let’s you check if replicas of a chunk exist:

github.com/maidsafe/safe_network

feat(client): expose a public API to query chunks to specific data replicas

maidsafe:main ← bochaco:feat-cli-cmd-to-query-data-replicas

opened 07:01PM - 05 Jan 23 UTC

bochaco

+414 -106

- Exposing also an `sn_api` public API to fetch a file from a specified set of d…ata replicas indexes and a `SafeUrl`. - Adding `--replicas` arg to CLI `dog` command which allows the user to perform a check on several data replicas for the content being targeted by specifying their indexes. - It currently supports querying data replicas only for `Files`, either with a `File`'s `XorUrl` or with any `SafeUrl` which resolves to a File. - Non-pretty printing is also supported for the data replicas report, i.e. when passing `--output <format>` arg. Example output from CLI querying `my-file.txt` linked from a FilesContainer to replicas with indexes 0, 2, 3, and 10 (index out of range of actual replicas), when some chunks were not found in any replica: ``` $ safe dog safe://hyryyrytx4imnzxfrwydbuy7fmtru56q5mjhnw1ig4ro6o1ea7u43adwh6wnra/my-file.txt -r0 -r2 -r3 -r10 == URL resolution step 1 == Resolved from: safe://hyryyrytx4imnzxfrwydbuy7fmtru56q5mjhnw1ig4ro6o1ea7u43adwh6wnra = FilesContainer = XOR-URL: safe://hyryyrytx4imnzxfrwydbuy7fmtru56q5mjhnw1ig4ro6o1ea7u43adwh6wnra Version: hxhtb38edw54getr4onmjrrndmp1ry6ohne5m9f71iofe474h91hy Type tag: 1100 XOR name: 0x2fd5562bbca4a0061983a55c493df9db5a782a4aa6d121e84918ecf59c0e9cf5 Native data type: Register Native data XOR-URL: safe://hyryyyytx4imnzxfrwydbuy7fmtru56q5mjhnw1ig4ro6o1ea7u43adwh6wnra == URL resolution step 2 == Resolved from: safe://hyryyyyxwih81u5xiwhtk9hfo47qyrnjpusryucx1barp7nkrfn7uqdkkfr = File = XOR-URL: safe://hyryyyyxwih81u5xiwhtk9hfo47qyrnjpusryucx1barp7nkrfn7uqdkkfr XOR name: 0xf4af0f29edf5a722aff0b0d75c02092d9d8809b1f20e08de894428bb370d4a29 Native data type: PublicFile Media type: Unknown == Checking data replicas of resolved content == XOR-URL: safe://hyryyyyxwih81u5xiwhtk9hfo47qyrnjpusryucx1barp7nkrfn7uqdkkfr Replicas indexes queried: [0, 2, 3, 10] Content composed of 4 chunk/s: = Chunk at XOR name 0xf4af0f29edf5a722aff0b0d75c02092d9d8809b1f20e08de894428bb370d4a29 = Replica #0: Ok! Replica #2: Ok! Replica #3: Ok! Replica #10: Error received from the network: InsufficientNodeCount { prefix: Prefix(), expected: 11, found: 4 } = Chunk at XOR name 0x7086f5f1570884db5d062cb4a0d1334d88db83a5dda8263aa74cc2bc81bbc4d9 = Replica #0: Ok! Replica #2: Error received from the network: DataNotFound(Bytes(ChunkAddress(7086f5(01110000)..))) Replica #3: Ok! Replica #10: Error received from the network: InsufficientNodeCount { prefix: Prefix(), expected: 11, found: 4 } = Chunk at XOR name 0xb1551a74e9a3404f0afa086c511f11e0d797eaa80143c5206dcce0875b2af52b = Replica #0: Ok! Replica #2: Ok! Replica #3: Ok! Replica #10: Error received from the network: InsufficientNodeCount { prefix: Prefix(), expected: 11, found: 4 } = Chunk at XOR name 0x53127c013fdd0fa1d2b385d55d30843e8b0fbd0752fe43db4a93d41dd7af9aeb = Replica #0: Error received from the network: DataNotFound(Bytes(ChunkAddress(53127c(01010011)..))) Replica #2: Ok! Replica #3: Ok! Replica #10: Error received from the network: InsufficientNodeCount { prefix: Prefix(), expected: 11, found: 4 } ```

Southside · January 10, 2023, 8:57pm

I feel a wee test on a baby-fleming coming on

from safe dog --help

-r, --replicas <REPLICAS>
        Query all the data replicas matching the given indexes to check they hold a copy of the
        content. E.g. -r0 -r2 will query replicas at index 0 and 2. The network sorts nodes
        (data replicas) in a section by comparing the data's name with nodes' names, it's a
        measure of "closeness to the data" in XOR-namespace. The index of a node in such list is
        what it's referred as a data replica index. At least the first 'data_copy_count' nodes
        should hold this data, more may well hold it too

I may need to read this several times…

Southside · January 10, 2023, 10:16pm

So got the following when playing with this new -r flag. Shows replicas 0, 1, 2 and 3 exist OK and that testing for replica 4 gives the expected error.

willie@gagarin:~$ safe files put ~/yarn.lock 
FilesContainer created at: "safe://hyryyryib1cioghtwgcpafsrrgjo9azx4cncp47jp5e38jmcpt81ipyo5tynra?v=h4y7fnmix3sdpg1jppydd9pxjam59sritadnwrbd3rp3baw6fwejo"
+---+------------------------+--------------------------------------------------------------------+
| + | /home/willie/yarn.lock | safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w |
+---+------------------------+--------------------------------------------------------------------+
willie@gagarin:~$ safe dog safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w

== URL resolution step 1 ==
Resolved from: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
= File =
XOR-URL: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
XOR name: 0x328f9cacf4ae66955dc68736db284db96e9176221839cec18759a539dda04ded
Native data type: PublicFile
Media type: Unknown

willie@gagarin:~$ safe dog -r 0 safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w

== URL resolution step 1 ==
Resolved from: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
= File =
XOR-URL: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
XOR name: 0x328f9cacf4ae66955dc68736db284db96e9176221839cec18759a539dda04ded
Native data type: PublicFile
Media type: Unknown

== Checking data replicas of resolved content ==
XOR-URL: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
Replicas indexes queried: [0]
Content composed of 1 chunk/s:
= Chunk at XOR name 0x328f9cacf4ae66955dc68736db284db96e9176221839cec18759a539dda04ded =
Replica #0: Ok!


willie@gagarin:~$ safe dog -r 1 safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w

== URL resolution step 1 ==
Resolved from: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
= File =
XOR-URL: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
XOR name: 0x328f9cacf4ae66955dc68736db284db96e9176221839cec18759a539dda04ded
Native data type: PublicFile
Media type: Unknown

== Checking data replicas of resolved content ==
XOR-URL: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
Replicas indexes queried: [1]
Content composed of 1 chunk/s:
= Chunk at XOR name 0x328f9cacf4ae66955dc68736db284db96e9176221839cec18759a539dda04ded =
Replica #1: Ok!


willie@gagarin:~$ safe dog -r 2 safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w

== URL resolution step 1 ==
Resolved from: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
= File =
XOR-URL: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
XOR name: 0x328f9cacf4ae66955dc68736db284db96e9176221839cec18759a539dda04ded
Native data type: PublicFile
Media type: Unknown

== Checking data replicas of resolved content ==
XOR-URL: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
Replicas indexes queried: [2]
Content composed of 1 chunk/s:
= Chunk at XOR name 0x328f9cacf4ae66955dc68736db284db96e9176221839cec18759a539dda04ded =
Replica #2: Ok!


willie@gagarin:~$ safe dog -r 3 safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w

== URL resolution step 1 ==
Resolved from: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
= File =
XOR-URL: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
XOR name: 0x328f9cacf4ae66955dc68736db284db96e9176221839cec18759a539dda04ded
Native data type: PublicFile
Media type: Unknown

== Checking data replicas of resolved content ==
XOR-URL: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
Replicas indexes queried: [3]
Content composed of 1 chunk/s:
= Chunk at XOR name 0x328f9cacf4ae66955dc68736db284db96e9176221839cec18759a539dda04ded =
Replica #3: Ok!


willie@gagarin:~$ safe dog -r 4 safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w

== URL resolution step 1 ==
Resolved from: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
= File =
XOR-URL: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
XOR name: 0x328f9cacf4ae66955dc68736db284db96e9176221839cec18759a539dda04ded
Native data type: PublicFile
Media type: Unknown

== Checking data replicas of resolved content ==
XOR-URL: safe://hyryyyyj1t6qk37fqc4ki5tw8g5p1oup3p4ezceoa888cdb43wwh75enp7w
Replicas indexes queried: [4]
Content composed of 1 chunk/s:
= Chunk at XOR name 0x328f9cacf4ae66955dc68736db284db96e9176221839cec18759a539dda04ded =
Replica #4: Error received from the network: InsufficientNodeCount { prefix: Prefix(), expected: 5, found: 4 }

Is InsufficientNodeCount really the correct phrase to use in this error message?

EDIT: yes it is - silly me.

joshuef · January 13, 2023, 6:09am

It might not be. That’s more about there not being enough nodes to store data. I would have thought youd get a 'DataNotFound` error here. cc @bochaco can you cast an

Southside · January 13, 2023, 6:25am

Technically its correct - there was an InsufficientNodeCount to provide the replica (#4) that I requested safe dog -r 4 but Im sure we could come up with a more helpful error msg.

I had to read the --help a few times to convince myself it was factually correct

Toivo · January 24, 2023, 4:40pm

Can’t wait to hear more about this:

github.com/maidsafe/sn_consensus

implementing MVBA protocol

maidsafe:main ← b00f:mvba_impl

opened 08:17AM - 13 Dec 22 UTC

b00f

+1718 -1003

This PR includes: 1- introducing Outgoing type. An outgoing type can be a direc…t message to a specific node, or a gossip message. 2. Updating error messages for MVBA 3. Implementation of MVBA based on Figure-3 of the spec (secure and Efficient Asynchronous Broadcast Protocols by Cachin) 4. Integrating the consensus protocols: (MVBA, ABBA and VCBC) 5. `c-request` and `c-answer` messages for requesting a valid and signed proposal 6. Fixing the consensus failure in MVBA for the 3rd round case 7. Random tests for the consensus protocol

JPL · January 24, 2023, 4:48pm

That’s this one: Update 24 November, 2022

Toivo · January 24, 2023, 5:48pm

Also, congratulations to @Anselme for the “PR number matches the current year” event

Anselme · January 25, 2023, 2:32am

Whooohooo!

Southside · January 25, 2023, 11:21pm

Yeeha !!!

now where did I put the agogometer?

DeusNexus · January 26, 2023, 1:04am

More testing to come

Southside · January 26, 2023, 3:44pm

Dragged the agogometer round to my mates garage and hooked it to the 3-phase for his hoists cos 240V is just not going to be enough.

A dull thrum is heard from here all the way to the city centre,

neik · January 26, 2023, 4:45pm

That’s your thruming reached the west end now. I can tell by all the car alarms going off down the street.