Feasibility of datacenter farming (and the risk of farmer centralization)

“The cloud” is out, but I never suggested to use that anyway.

For file transfers, throughput beats latency. Even if you’re only transmitting 1MB at a time, a 100mbit/s uplink with 100ms of latency wins a 1mbit/s uplink with 1ms latency. That said, I haven’t studied MaidSafe’s network quality rating algorithm either.

The way I understand it, the pro will get a higher chance to receive PUT requests. And of course, when the pro’s drives are all filled up, further PUTs will have to go to other people (unless the pro expands).

One thing that’s for certain is that the algorithm will reward fast, stable vaults. As I explained above, this means more traffic for people with more bandwidth in core locations. Whether that’s enough to make a profit over bandwidth costs depends on the ratio of Safecoins you get for a GET vs. Safecoins you have to pay for a PUT and how that relates to fiat. We’ll just have to see.

I agree, I’m a bit concerned about old junk data filling up vaults. However, I would also argue that if you start farming early, you have a high chance of getting bootstrap data that applications on the network use all the time (resource lists, start pages, configuration data…).

1 Like

Well I didn’t study it, but I read the forums and I recall that it was repeatedly mentioned that responsiveness (and no, I don’t know if that means for the entire chunk, if which case it’d be a mix of responsiveness and throughput) will be rewarded but also that low-spec h/w will be okay. Quote of a quote:

The basis that I’m using to conclude these will work is from having consumed almost everything @dirvine has said on interviews, etc. He’s said that the client should run in background on most any computer without much notice. He’s said the client will run on systems with “terribly low” resources. Therefore, I have to assume that it will run well on a dedicated computer with a competent 64 bit processor with a lean OS.

Also another by Fergish

I’ve said before, and David Irvine has agreed, that rigs such as yours will not hurt the network, and if they work economically for you then there’s no downside.

URLs: Best farming hardware and Will there be farming pools on SAFE network?

One thing that’s for certain is that the algorithm will reward fast, stable vaults.

I agree, but you need to realize that MaidSafe, er, the community, will decide what fast & stable means.
For example, it was stated by Project members that reboots and even hours of downtime won’t be punished and you can also see (admittedly, I’m quoting indirectly via @fergish) that crawling-slow home vaults won’t be put out of business either.

Values determine policies, policies determine the algos, the algos decide who gets how much.
In my environment responsiveness and stability standards are different, but that’s because things don’t work the same way as here (i.e. no need to drive decentralization, for-profit enterprise, etc.).

If the aim is to achieve a reasonable degree of decentralization, crappy farmers need to be allowed to survive (and comparatively speaking, you and other from the Monsanto family won’t be rewarded for your superior harvests, so you may as well get some non-GMO inputs for your next harvest) :smiley:

Gee, there’s a lot of sneaky bastards on this forum! See this:

I’m sure we are not the only ones. (By the way, that’s why I earlier said I’d decide whether to farm later. Make sure you check that whole page, by the way).

Because there’s so many variables I think it’s going to be very difficult to create a good plan prior to beta.

Over the last summer I spent dozens of comments fighting for a laissez-faire approach to everything, but as I said above if the goal is to fight centralization, things will have to be micro-managed and that will make investment in dedicated professional facilities risky. For example, consider this: do you think that MaidSafe will lock their algo during the beta or tune it every few months (like Google tunes its index)?
Of course they’ll tune it as long as they have to and they’ll have to all the time (once a quarter or once every 6 months?, in the beginning maybe on a weekly or monthly basis).

I’m concerned about that so I’ll start very small but be ready to expand. I think farming at home up to 24-48 TB of capacity should.be doable considering my environment (including network bandwidth and latency).

People,

This question is important to me and it is all a bit confusing. I am moving house now - out of the middle of Sydney to a small country town, Cowra, 5 hours West of Sydney but paradoxically the house there has a faster Net connection (still ADSL2+ but closer to the Telstra exchange) than where I am now. I am also hoping that at some stage in the future that I will have access to the new NBN fibre network. I am in Cowra for some time probably and I have been thinking seriously about buying a lot of hardware to do farming for MaidSafe as part of the package of projects I will be working on. I am also thinking of making use of a lot of Photovoltaics to help power everything (LOTS of sun in Cowra) so I am interested in the possibility of “server farming” (not necessarily SafeCoin farming) in my own premises anyway.

Of course SafeCoin farming only becomes viable if there is some good reason to do it eg I make enough SafeCoin to spend on things that are available and useful to me in the MaidSafe network. I think MaidSafe, SafeCoin and maybe other cryptocurrencies are going to be a big, important part of the things that I am interested in and am going to be working on for the foreseeable future - if the more I am involved (hardware for farming, apps for deployment etc), the more I can be a “self-employed” citizen of this new economy, the better I will like it.

So, if I can start to see actual measurements of usefulness of various configurations of hardware, it will make it much easier for my current planning processes so I can start budgeting etc. As a generalisation, I would prefer to be a “full-time” citizen / participant of this new economy, not just a hobbyist farmer - but obviously it would be dumb at the moment to commit to start setting up tens / hundreds of TBs of hardware processing if it is actually going to lose me a lot of money (Australian $) for little return in SafeCoin.

I realise it is still early days and how these algorithms are going to work is still being decided and maybe they will even need constant tweaking once the system has gone live but I would appreciate some clarity about what configurations of hardware would be sensible. At the moment, it looks like the safe route for me is to just upgrade my Linux server to the latest, fastest machine with a spare 4TB drive to allocate to MaidSafe?

Thanks for any clarifications possible at this stage.

Regards,
Phil.

The safe way is always to just use capacity that would otherwise sit idle. Got a few hundred gigs free on your home server? Farm on those. I suppose adding a 4TB drive wouldn’t be too much of a risk either, could always resell it or use it for something else if farming turns out not to be your thing.
And if you make enough money with that, you can always decide to go bigger.

At this point, the MaidSafe network is not ready for farming yet; we cannot try out what works - so this is the best advice I can give you.

Very well, as I’m sure you’re aware, pretty much every other cryptocurrency is generated through proof-of-work computations. All you need for them is hardware, cheap/free power and a place to store and cool those machines. Bandwidth-wise you could do it on dial-up.

Great discussion here.

Loving it

1 Like

@phillip_rhoades at one of the links I referenced (Best farming hardware) you can see that small ARM-based farms “should” be fine (assuming the algo sends them some requests despite their slower response time and throughput compared to x86-based competitors). I have one such small system that I will try out during the beta.

In case of most altcoins, Proof-of-Work @ home seems difficult because those coins are unstable and the investment is usually dedicated (i.e. unlike with MaidSafe where you can use the HDDs to store your own data, compute-specific hardware can’t be readily repurposed for something other than Proof of Work mining).

In that Testnet to Mainnet Transition Plan post you can see that you’ll be able to try your setup during the beta so that will be a time to give it a try with a small (maybe 1 HDD?) setup and see whether it could be economical for you, and if so add more equipment prior to the mainnet launch.

@janitor,

That all makes sense - thanks for that. As well as lots of old hardware that I have that could be used (I do a lot of BOINC stuff already) I will be buying new hardware too - but like you say, I can see how it goes early and add new (or old) stuff as appropriate. I guess what I had in the back of my mind was that if did actually become worthwhile to buy a rack of stuff (as opposed to desktop stuff) then it would be good to know that earlier rather than later but it doesn’t make too much difference really . .

P.

The ideal from a global perspective will I believe be if the entire network ran at least cost, maximum efficiency, which would mean entirely on existing spare capacity. We might expect that this is what MaidSafe are aiming for, though no one can predict how close to the ideal it will be.

This means that in an ideal situation, dedicated farmers will be squeezed, and will need to be very efficient to compete with casual farmers who have little or no marginal costs.

Obviously there may be speculative profits from Safecoin price rises and volatility, but if we ignore those, I suggest that investing in hardware to farm is a high risk venture.

Being a part of SAFE and helping it succeed, or earning by adding value to the platform through contributing to the code, apps, or content are probably sounder options IMO.

Get working on those apps, or forming teams! :slight_smile:

1 Like

Glad to hear that an experienced forum member feels that way. @niklas, are you reading this? :wink:

I think I’ll stick with my plan to start small scale, casual home farming until it becomes clear whether our expectations (in terms of the algo’s “personality”) have been met, then decide the next steps.

The beta period will be fun (even testnet3 could be) as farmers start figuring out the algo…

1 Like

Yes, and I would beg to differ. A 24/7 farmer increases overall network speed and data availability. They can also quickly add lots of capacity. I’d say the best outcome is a healthy mix :stuck_out_tongue:

I suspect the bulk of the people who will jump on big time Safecoin farming, Bitcoin miners, won’t be too concerned about that. They’ve shown a tendency to take risks.

I have plans for that already, just waiting on a proper API :slight_smile:

2 Likes

I expect they won’t be ignored. The early farmers are the early farmers because they see great potential in MaidSafe and most likely expect SafeCoin value to increase significantly in the future.

Personally, I’m going to start farming with just my current systems. If I like the results I can easily expand in a very short time frame.

2 Likes

smoothing the transition from subletting artificial scarcity bandwidth to mesh

Think of an entity with nearly unlimited computational resources like the NSA-- if the main network gets attacked and corrupted at any time by data centers with billions of VMs pretending to be individual nodes with average network specs-- remaining online for a year or two, gaining reputation, then shutting them off, could a large amount of the data be disappeared? I think that adding in a channel feature in the MaidSafe network might be a good idea, but it will start fresh – say a 32-byte identifier with the default being all 0s for the original MaidSafe network-- and ABCDEFGHIJKLMNOPQRSTUVWXYZ01245 could be a different MaidSafe network with it’s own currency, etc-- allowing people to f’ork’ their own by setting identifiers if the main one gets corrupted.

wouldn’t there be huge safecoin incentives to keep the data up and running though?

it would be shooting yourself in the foot in a huge way to shut off your own money making nodes like that

Some people-- the people in many places of high authority and power are not concerned with money. They have more than enough, and consider any means of free publication a threat to their nesting of power. And it’s easier to collect the coins, then dump them for cash and then attack the network.

You’re right, it’d be a completely pointless attack.
Millions of compute hours would have to be invested.
Absolutely nothing of value would be gained in return.

1 Like

The idea that a government doesn’t like something, and their response is to subsidize it massively for 2 or 3 years so that they have the opportunity to sabotage at a later date it seems pretty far fetched to me.

Particularly since the subsidy makes it cheaper to use - and would result in wider adoption and their share diminishing, and their likelyhood of damaging the network diminishing as well… They would need to throw exponentially more and more resources…

If you water the weeds you will get more weeds…

2 Likes

Ever heard of Stellar Wind? Supposedly it can record all of the Internet traffic across all the in/out points in the US for over a year and only costs ‘billions of dollars’ They do it already. What makes you sure that they don’t throw black ops budgets at anything that they consider to be a threat, like freedom of speech? They do it already.

From:

The US Government spends $435,841,200 (~$435 million) per hour (both portions)

          - Of the total money shown above, the US Government 

borrows $187,785,388 (187 million) each hour-- shown on the right
portion.
No problem filling up a UPS/Fedex truck each hour, full of
cash. The mail-man will never be out of a job processing all those
payments…

US Budget in 1 Day: $10,460,188,800

        For the year 2011:
        

          - The US Government spends $10,460,188,800 (~$10 billion, 460 million) per day (both portions)

          - Of the total money shown above, the US Government borrows $4,506,849,315 
          (4 billion, 506 million) each day.

US Budget in 1 Week: $73,221,917,808

        For the year 2011:

          

          - The US Government spends $73,221,917,808 (~$73 billion, 221 million) per week (both portions)

          - Of the total money shown above, the US Government 

borrows $31,547,945,205 (31 billion, 547 million) each week-- shown on
the right portion.

US Budget in 2011: $3,818,000,000,000

        For the year 2011:

          

          - The US Government's projected budget for year 2011 is $3,818,000,000,000.

          - Of the total money shown above, the pile to the right in the amount of $1,645,000,000,000 
          is borrowed money. 

          No one in the world has as big of a salary as US 

Government, but it still borrows roughly 40% of the money it spends.

          Source: CBO, GAO & USGovernmentSpending.com

          You can say Booyakashaa when this is your weekly allowance. 

Get the picture?

1 Like

Yes, I do get the picture. I’ve read about the spying stuff and I follow economic news on a daily basis.

  • The current system is unsustainable
  • Every single dollar that’s spent goes to someone who “needs” it (maybe they need to recoup their investment in their favorite Congressman, or maybe they need to get paid for voting the way they did).

So the huge figures don’t tell us there’s an unlimited number of dollars waiting to be spent on the pursuit of pointless goals. There has to be a purpose, or marginal utility aka bang for the buck, that is higher than they derive from whatever crap they’re pulling now.

Destroying random MaidSafe data by way of a Sybil attack would be a silly and expensive approach to achieve nothing.

I won’t even attempt to analyze why it wouldn’t pay to subvert MaidSafe that way (clearly, a much, much better ROI could be obtained by spending 1/100th of the amount needed for a Sybil attack on inventing a MaidSafe-targeting malware that would enable stealth access to data, rather than stupidly destroy potentially lucrative source of info, but there are other reasons too).

2 Likes

The government has a history of accomplishing nothing with massive quantities of money. A lot of their tech is not publicly visible – likely in underground bases-- they have plenty of free hard drive space and lots of time on their hands. Unsustainability never prevented them from doing extremely stupid things with their $$. I can find countless examples of blank check spending.