SAFE Network Dev Update - September 5, 2019

Summary

Here are some of the main things to highlight this week:

Marketing

When did it become September?! Weā€™ve been so busy delivering on the goods that the new month has just sneaked up upon us. Well, we can be sure September will be another epic month with even more updates for you all, as we move ever closer to Fleming.

First, weā€™re delighted to welcome @oetyng to the team! Youā€™ll most likely recognise his name, as heā€™s been a prominent member of the community for a number of years now. Heā€™ll be initially working with @ravinderjangra on safe_app_csharp to restructure the project for future changes, looking into different solutions to provide support for the new APIs and data types, before moving across teams to provide support where needed. Weā€™re very pleased to have someone so passionate about the project working directly on the Network, and no doubt weā€™ll see his efforts soon enough (no pressure :laughing:).

While weā€™re on the subject of the community, itā€™s worth reminding you of the GitHub sponsorship programme we mentioned a wee while ago. Remember, it doesnā€™t have to be about contributing code, you can support on documentation etc too. Please sign up, or give us a shout if there is anyone youā€™d like to nominate and we can put their name forward.

This week, @dirvine spoke at the 2nd International Conference on Blockchain, Identity and Cryptography at Napier University. @Josh kindly shared the link here but the sound quality isnā€™t great, so weā€™ll make sure we update you all with a new version if the team re-release the edited footage.

Andā€¦some new content! We have the regular monthly summary for you over on Medium, giving you a helicopter view of the highlights of all we accomplished August. You know, just a few things :sweat_smile:!

Weā€™ve also taken the time to pull apart last weekā€™s Phase 1 Vaults release, taking a bit of a step back and exploring what this really means, and how it fits into the bigger path to Fleming (Medium and Forum). You guys know what to do - clap, share, comment and spread the word! This piece has been developed for a slightly less technical audience - so ideal to share with your friends and family.

And one final thing: it looks as if hardware wallet support for MaidSafeCoin may now be here via Trezor (for more details, check out this post) :tada: Warning: this is hot off the press today (h/t @sascha :bowing_man: ) so please be aware: we havenā€™t yet had a chance to investigate this so tread carefully and, as always, we advise you to carry out your own investigations before moving any coins!

SAFE CLI

Project plan

As many of you already know, as part of last weekā€™s ā€œVault Phase 1 (real vault)ā€ release, we released the first packaged version of CLI, i.e. we moved from simply sharing the source code and build instructions to a proper release procedure for the CLIs artifacts.

Last weekā€™s release triggered a nice thread of discussion about SAFE CLIs commands, existing and potential new features, found issues, UX/UI, etc. Thank you to all those who participated in these discussions - it gave us, not only a great deal of satisfaction in watching you try these things out, but also a massive amount of useful feedback and new ideas to move forward with these applications. For those who didnā€™t participate in it, itā€™s never too late! Thereā€™s a lot of nice information in the thread - come and join us.

Moreover, last weekā€™s release and discussions kept us quite busy fixing some of the issues reported and adding some additional features which were suggested in there. This is why today we are making available a new release of both the safe_auth and safe_cli CLIs.

If you have previous versions downloaded already, you can update using the --update flag for safe-authenticator-cli or update argument for safe-cli (yep, weā€™ve taken a note to make this consistent between the two). You can also download the new binaries from their release pages:

One of the main additions in this new release was a fantastic contribution from @draw, who implemented the auto-completion functionality for the SAFE CLI which is shared as one of the assets in the release itself. Some additional information of how to use this feature can be also obtained from @drawā€™s original post from here.

Another feature added was the introduction of a new safe keys transfer command to the CLI (and its API) which allows users to transfer coins from a SafeKey, while the safe wallet transfer command still allows users to transfer coins from Wallets. We also made these commandsā€™ arguments to be optional but explicit (--from and --to) moving away from the original format of being positional arguments. This allows us to support more use cases while keeping it intuitive and simple to use. The SAFE CLI User Guide was updated accordingly, if youā€™d like to get some additional details.

Some minor additions were also included, like introducing an optional --tx-id argument to both the keys transfer and wallet transfer commands so the TX ID can be chosen by the user rather than being randomly generated by the CLI. We also added support to the cat for SafeKey URLs, which only shows information about its XOR name, if it was resolved from NRS map, etc. This can be useful particularly when a SafeKey is linked from an NRS URL, thus using cat with the --info argument/s can help us understand the NRS name resolution and location (XOR-URL) of the SafeKey.

We fixed a version number issue identified on Linux and acted on community suggestions to add a strip into the build process and include .zip and .tar.gz packages in our cli releases.

Now that this new release is ready and made available, we resumed our efforts on bringing more NodeJS bindings for the High Level APIs we are exposing from the safe_cli crate. As we saw in last weekā€™s release, we already had a first PoC of the fetch NodeJs binding, which we demonstrated to be working with the PoC Browser fetching websites published on the Vault. We now started with trying to get the bindings for FilesContainers, Published ImmutableData and NRS APIs first, so we can eventually start exposing them on the SAFE Browser for webapps to consume.

Vaults

Following last weekā€™s successful release of Phase 1 Vault there were some minor tweaks based on user feedback - primarily to add a -v, --verbose flag to get a better view of what a running Vault is doing. The flag can be repeated for even more verbose output. We also resolved a minor UX issue where network connectivity was required even just to display the --help menu and we updated the release process to include both .zip and tar.gz packages.

If you have already downloaded a local Vault then the next time you start/restart it, it will update to the latest version if you have a network connection. If you havenā€™t already downloaded a Vault to run locally then get downloading from here and be sure to read the release post from last week here.

Other than that weā€™ve been mostly focused on planning the next phase, and how to get there as swiftly as possible. Now that we have clients able to connect to a running Vault instance and interacting with it, as if itā€™s the whole network, the next natural step is to connect multiple Vaults in a single Section and have them coordinate their actions using PARSEC (at least for actions where maintaining a shared state is important). For some operations, like getting data, we want to do so without involving ordered consensus to make things as responsive as possible.

SAFE Network App

Project plan

This week continues to involve a lot of QA for version 1, both for functionality and design aspects, as we get closer to our first release. So as well as fixing the issues raised weā€™ve started on the next phase of the SNAPP roadmap. Initially we were focusing solely on MacOS, so for the next phase weā€™re aiming to resolve the installation issues on Windows too. This should then get us to the point where we can release across all three of our target desktop platforms.

Not only is the first version of the SAFE Network App getting ready to roll out, but design is already well underway for version 2.

The last design sprint for v2 was concerned with how users create an account in a permissionless way, especially on mobile devices where there will be no option to run a vault (not initially anyway).

Weā€™ve conducted several rounds of user testing to better understand how users react to the various approaches to Account on-boarding. As is always the case with UX testing, itā€™s very illuminating, and a couple of rounds have enabled us to hone in on specific solution to form the basis of a neatly-packaged feature set: the ability for existing Account holders to gift invites to friends, giving them all they need to get and up and running with their own SAFE Account.

Weā€™re now on to the business of invite generation and management.

How do existing users create, pay for, transmit, monitor andā€”if they have the needā€”take back invites? And how do we make sure they both provide enough Safecoin to meet the requirements of creating a usable Account, yet not see the benefactor overpaying, if there are currency fluctuations before an invite is redeemed? Lots of fun wee problems we are rattling through.

So this work takes in the UX design of account creation, but also the basis of how people will begin to interact with Safecoin, and pay their way on the live network, and on multiple platforms.

These are all the potted feature sets that youā€™ll start seeing coming together on the Safe Network app, as we build out the core experience to the ecosystem.

You can expect a few screencasts on this and other elements to the user experience - after we blow the doors off the v1ā€¦

SAFE Desktop Browser

After last weekā€™s proof of concept on the new Vaults, and the issues around packaging, weā€™ve released a new updated POC on mac and linux which now packages fine (this involved a lot of digging around both node module resolution and webpack to find the actual cause, which was in the module loading of the .node files). With this fixed, weā€™ve been working on getting the POC branch ā€˜up to snuffā€™, with the aim of making this our new development base. This has involved fixing lint errors and tests across the board after we removed 30% of the codebase when removing the authentication site and libs. Weā€™ll hopefully be merging a branch of this soon enough.

Beyond that, weā€™re digging into electron lib loading issues on Windows. The good news is that itā€™s a known issue in Electron. The bad news is no single fix has made it into Neon yet, so weā€™re looking into what we can do here to sort out Windows packaging, so we can move onto more fun API integrationsā€¦for which, weā€™ve started a new repo which is forming a light wrapper around our rust APIs built for the CLI. This will be forming the basis of a new safe-nodejs repo, which weā€™re currently using for fetch in the browser.

And just a note about the documentation for the work on the Perpetual Web features of the browser: weā€™ve decided to retire the Github repo for the time being.

Updating and managing the content of this repo during the design phase has proven to be overly cumbersome, especially alongside our design workflow in tools like Figma, and thus not terribly informative for the community.

We intend to replace this with more videos and screencasts, which seem more suited to articulating the nuances of the design decisions as things progess.

SAFE Mobile Browser

Project plan

We are excited to announce the release of the SAFE Mobile Browser v0.2 :tada:. It comes with the much awaited dark mode and many other exciting features including downloading images from the SAFE site to the device, iOS navigation gestures, new progress bar based on the amount of content fetched, and some bug fixes including browsing sites with numeric addresses.

Check out the release post on the forum to download and try it on your devices (If you already have it on your device, we recommended to uninstall before downloading the latest version).

SAFE Authenticator Mobile

In addition to the new version of the mobile browser, we are also releasing a new version of the Authenticator app :smile:. The changes in this release are based on the community feedback. The main change is to utilize the full display on iPads. We also made some UI/UX improvements for the bigger screen Android and iOS devices.

Check out the release post on the Forum to download and try it on your devices (If you already have it on your device, we recommended to uninstall before downloading the latest version).

SAFE App C#

This week we released the safe_app_csharp NuGet package v0.2.3. In this package we have updated the safe_app and safe_authenticator native libs to the v0.9.1. This will be the last NuGet package released to support the Alpha-2 network.

We are now tackling the refactor and simplification of the safe_app_csharp project structure before we start working on the new API and data types support. This will simplify the development and build process. A massive PR was raised for the same and itā€™s currently under review.

SAFE Client Libs

We are now on a lookout for bugs and issues reported post-launch of Phase 1, and starting to do the necessary preparation work to be ready for Phase 2. While itā€™s unlikely to impact SAFE Client Libs in a lot of ways, weā€™ll still need to tweak the Vault connectivity part of SAFE Core to be able to talk to multiple Vaults at once (and, as you might remember, the Phase 2 is all about having multiple Vaults!).

Because we do not use Routing to connect to the network (directly connecting to the Vaults instead), we need to have some of its functions right there in Client Libs. One of them is the handling of probable disparity between the answers that different Vaults give: some of them might be still in the process of reaching a consensus and might have a different worldview. We need to handle these cases on the client-side now, and we will be deciding what is the best possible way forward.

In parallel, options are being exercised to see which area of development will provide the most value to the roadmap. FFI is a potential area where we could be working on in the upcoming days. Weā€™ve researched how we can proceed with interfacing SCL and NodeJS/JavaScript. One of the options is to use Neon bindings which would work similar to the Java/JNI FFI pattern.

Another area to work on would be to continue development in RDF, which was paused before Phase 1. Quicker to implement and efficient alternatives to the Redland C Libraries which provided ways to use RDF in Rust are also being looked into as many new libraries have sprung up during the paused time.

@marcin raised a PR fixing the safe_app_jni and safe_authenticator_jni sub modules in SCL which were broken during the Phase 1 changes.

Secure Message Delivery

Project plan

We switched our full focus to planning the second phase of Vaults development, and planning the remaining work for the paused BLS integration project.

As a result there is only a little progress in Secure Message Delivery this week. Recently we started adding some more tests to ensure that messages are being properly secured and that invalid messages are being detected and rejected.

Useful Links


Feel free to send us your translation of the Update above!

91 Likes

Sometimes itā€™s the small things. Seeing safe_vault autoupdate made my day :slight_smile:

EDIT: first! wohoo!

36 Likes

second ā€¦ missed out on first by seconds.

28 Likes

You know what they sayā€¦third is the one with the treasure chest :smile:

Now, to readā€¦

Really exciting news yet again! Every line speaks to super impactful developments. Stoked to see the latest version of the mobile browser. So much web traffic takes place on mobile devices, so itā€™s great to see MaidSafe is ahead of the curve here compared to many other DLT projects.

Congrats to @oetyng for joining the MaidSafe team as well! Heā€™s always full of thought provoking ideas, so Iā€™m sure thereā€™s tons of great things to come!

Also, definitely enjoyed the Medium post too. Plus the Trezor news is a great step! :smile:

40 Likes

About time @oetyng
Great news :partying_face:

42 Likes

Arrived here first time fifth! :relaxed:

27 Likes

Looks like Iā€™m 6th! A first for me I think :joy:

I better read more although busy with boat chores, so may take a while. Reading complete, but still much to take in. An exceptional updateā€¦AGAIN! Iā€™m breathless :smile: Amazing work team, thank you all, and great news that @oetyng is now joining to help. Good luck fella and congratulations on becoming part of the core team at Maidsafe! :clap:

And now a little announcement from meā€¦

New dWeb Blog Post

Please check out @JayBirdā€™s new blog post on dWeb Blog, details below. Many thanks to @JayBird for this excellent post, heā€™s a natural IMO:

36 Likes

Killing it!! :sweat_smile:

So much progress on so many fronts. Just the shot in the arm needed to crank up the excitement levels! :sunglasses:

Seconded! A great addition to the team!

33 Likes

Thatā€™s a cool feature during testing, but it probably shouldnā€™t be default when released. Giving people the choice/switch to get latest is better, as it could make the network vulnerable to attack otherwise. Iā€™m sure you are all over this though! :slight_smile:

23 Likes

Wh00000000t @oetyng - nice one! Awesome move and I canā€™t wait for the next steps on our path to the common goal :hugs: :face_with_monocle:

29 Likes

The SAFENetwork isā€¦

17 Likes

Congratulation @oetyng to be part of the MaidSafe team.

Nice update.

20 Likes

welcome @oetyng. nice that the familiy is growing again :slight_smile:

Iā€™m trying not to get used to it, but this is another great update!
While most other projects are burning through their ICO funds with
hardly anything to showā€¦ here comes @maidsafe. Another week another
release. Getting the job done!

22 Likes

Shoutout to @chriso for adding the autoupdate. And all the other incredible work done for the phase 1 release :smiley:

29 Likes

@oetyng Good to join the greatest team !

17 Likes

@Traktion Just to let you know, myself and @StephenC actually had quite a bit of discussion about the user experience for self update with respect to Vault.

We would both agree itā€™s something the user should be in control of (as it is with safe and safe_auth), but we decided to go with the simplest possible implementation of it for now. Eventually we envisioned Vault running as some kind of background service, and that makes updating a little more complicated. Given that, we decided to postpone any more elaborate decisions for later, perhaps when weā€™re a little closer to that.

27 Likes

Good stuff! I figured you guys would have planned it already! :slight_smile:

13 Likes

Congrats @oetyng and thanks for your many contributions to help get the network live. And kudos to the entire Maidsafe team for the sustained effort and progress.

24 Likes

Thank you, team, and congratulations, @oetyng!

21 Likes

Great news about @oetyng. I remember when he joined the forum the first thing he did was release a PoC design for an event sourcing database to run on SAFE, something heā€™s revisited since. Fantastic to have someone so proactive and talented on board. I hope that project sees the light of day at some point.

28 Likes