0-1 EiB after 87 days
1-2 EiB after 58 days
2-3 EiB after 45 days
3-4 EiB after 35 days
4-5 EiB after 26 days
5-6 EiB after 29 days
6-7 EiB after 28 days
7-8 EiB after 21 days

21.4 PiB being used to store data.

Chia growth has slowed over the past couple of weeks, but is still massive at 31.5 EiB, about 4x more farmer storage than filecoin. Chia is seeing about 100K-200K transactions per day (source).

Filecoin at 9 EiB today, 19 days to add the latest 1 EiB of farming resources. That’s an average rate of about 650 GiB added every second, 38 TiB per minute. Someone is plugging in a new 4 TiB drive every 6 seconds.

0-1 EiB after 87 days
1-2 EiB after 58 days
2-3 EiB after 45 days
3-4 EiB after 35 days
4-5 EiB after 26 days
5-6 EiB after 29 days
6-7 EiB after 28 days
7-8 EiB after 21 days
8-9 EiB after 19 days

Interestingly the site I usually use to check the size filecoin.io shows -7 EiB so can’t handle big numbers very well. I looked into the network transfers to see if it was the client or server getting the number wrong, oh man it’s ugly. SQL in the request, yikes:

https://stats.filecoin.io/api/datasources/proxy/1/query?db=chainstats-ntwk-mainnet&q=SELECT mean(\"value\") FROM \"chain.miner_power\" WHERE time >= now() - 30m GROUP BY time(5m), \"miner\" fill(null)&epoch=ms

The site uses a popular dashboard software grafana so I suspect this is not a big problem and was well considered, but still, feels weird seeing it.

I’m using filfox which reports the size correctly.

0-1 EiB after 87 days
1-2 EiB after 58 days
2-3 EiB after 45 days
3-4 EiB after 35 days
4-5 EiB after 26 days
5-6 EiB after 29 days
6-7 EiB after 28 days
7-8 EiB after 21 days
8-9 EiB after 19 days
9-10 EiB after 19 days

Storage is extremely cheap at $0.0000639 per GB per year, which is $0.0639 per TB per year

Despite the low price only 25 PiB of data being stored. 25 PiB is a lot of data in isolation but compared to the farming capacity it’s a drop in the bucket.

Chia still on the slow grind after their initial explosion, up to about 36 EB farming.

If we have an average size of 100 GB per node on the network, 10 EiB requires about 10M nodes. If we have 40 nodes per section that’s about 270K sections and about 18 section splits. Filecoin has taken 367 days to reach 10 EiB so that would be on average one split every 20 days.

Still only about 27.5 PiB stored on the network (source). That’s about 2.5 PiB added in 17 days, which makes for an average total network upload rate of about 15.3 Gbps. There’s 774 providers, so that’s an average of 19.8 Mbps upload bandwidth per provider.

0-1 EiB after 87 days
1-2 EiB after 58 days
2-3 EiB after 45 days
3-4 EiB after 35 days
4-5 EiB after 26 days
5-6 EiB after 29 days
6-7 EiB after 28 days
7-8 EiB after 21 days
8-9 EiB after 19 days
9-10 EiB after 19 days
10-11 EiB after 17 days

Just a random early morning thought but not knowing the costs and mechanics of Filecoin, I’m curious if it’s profitable to upload junk to be a provider? Or something like that.

I guess I don’t understand how it’s profitable to provide such a glut of unused space and have that continually outpace actual storage. So it just makes me wonder if most of what is being uploaded is at least useful.

In comparison with SN where you get paid for data being retrieved not for providing unused space.

IPFS uses Filecoin AFAIK and most NFT platforms use IPFS so I know at least a highly sizable chunk of the NFT world should being stored there.

Yeah as @drehb says they are two different networks.

Filecoin uses the same concepts / protocols as as ipfs but there’s no crossover of data at all between the two. And the reason (as far as I can tell) is because filecoin charges for GET, so if they stored on ipfs there would be no way to do that. Seems backwards to me.

The idea of filecoin was to add an incentive layer to ipfs so data would be stored in a reliable way (ipfs data can go away any time, it depends on enough peers deciding to seed the data, so I think filecoin identified a good opportunity). But for filecoin to achieve this data durability they also had to charge for downloads as well as uploads. I think the reasoning was if people can download for free it would mean farmer bandwidth is being consumed but not paid for, and that meant filecoin farmers couldn’t operate in a predictable economical way (or to rephrase, the incentives weren’t aligned). I can see the logic there. But if less than 1% utilization of storage is the result of ‘aligned incentives’… I’m not sure it’s really such a good system.

The world’s technological capacity to store information grew from 2.6 (optimally compressed) exabytes (EB) in 1986 to 15.8 EB in 1993; over 54.5 EB in 2000; and to 295 (optimally compressed) EB in 2007.[9][10] This is the informational equivalent to less than one 730-megabyte (MB) CD-ROM per person in 1986 (539 MB per person); roughly four CD-ROM per person in 1993; twelve CD-ROM per person in the year 2000; and almost sixty-one CD-ROM per person in 2007.[11] It is estimated that the world’s capacity to store information has reached 5 zettabytes in 2014,[12] the informational equivalent of 4,500 stacks of printed books from the earth to the sun.
The amount of digital data stored appears to be growing approximately exponentially, reminiscent of Moore’s law. As such, Kryder’s law prescribes that the amount of storage space available appears to be growing approximately exponentially.[13][14][15][8]

17 days for filecoin to go from 11 EiB to 12 EiB. The growth is incredibly consistent.

Currently priced at $71.20 for a market cap of nearly $8B and ranked #25 by market cap. 24h trade volume is just shy of $1B.

As a $8B network with 12 EiB that naively puts the value of 1 GiB at $0.62, a decent premium considering these figures:

Filecoin storage cost: $0.0000512 per GB per year source

S3 storage cost: $0.276 per GB per year ($0.023 per GB per month)

Backblaze storage cost: $0.06 per GB per year ($0.005 per GB per month)

New HDD: $0.33 per GB ($135 for 4 TB)

0-1 EiB after 87 days
1-2 EiB after 58 days
2-3 EiB after 45 days
3-4 EiB after 35 days
4-5 EiB after 26 days
5-6 EiB after 29 days
6-7 EiB after 28 days
7-8 EiB after 21 days
8-9 EiB after 19 days
9-10 EiB after 19 days
10-11 EiB after 17 days
11-12 EiB after 17 days

Yes, the Sia Foundation. It took them 5 years to conclude that the mass, the mass of people on the planet are not ready to move to decentralized data storage and create a foundation to support the process.

0-1 EiB after 87 days
1-2 EiB after 58 days
2-3 EiB after 45 days
3-4 EiB after 35 days
4-5 EiB after 26 days
5-6 EiB after 29 days
6-7 EiB after 28 days
7-8 EiB after 21 days
8-9 EiB after 19 days
9-10 EiB after 19 days
10-11 EiB after 17 days
11-12 EiB after 17 days
12-13 EiB after 25 days

Chia network still around 36 EiB, been almost 3 months at about that size.

I wonder what is the total size of the worlds de-duplicated data sets.

I also wonder what data means?

Papers

emails / comms

photos

music

But what about log files, all video and temporary data etc. ? Video is huge as we know, but with cameras al over the planet continually recording I wonder if it’s even possible to store that. Perhaps looking at the max possible data that can be created (something like max b/w per compute device * num devices?)

Looks like the growth in both filecoin and chia farming are slowing down considerably (not shrinking, just not growing as quickly).

0-1 EiB after 87 days
1-2 EiB after 58 days
2-3 EiB after 45 days
3-4 EiB after 35 days
4-5 EiB after 26 days
5-6 EiB after 29 days
6-7 EiB after 28 days
7-8 EiB after 21 days
8-9 EiB after 19 days
9-10 EiB after 19 days
10-11 EiB after 17 days
11-12 EiB after 17 days
12-13 EiB after 25 days
13-14 EiB after 38 days