create account

RE: An Open Letter to Steemit Gods, Dan in Particular Are You Trying to Build the Buzzfeed of the Blockchain? by complexring

View this thread on: hive.blogpeakd.comecency.com

Viewing a response to: @markrmorrisjr/re-complexring-re-markrmorrisjr-an-open-letter-to-steemit-gods-dan-in-particular-are-you-trying-to-build-the-buzzfeed-of-the-blockchain-20160818t035314027z

· @complexring ·
The storage argument fails because it assumes that there is no difference between storing certain database information in RAM vs. the hard drive.
properties (22)
authorcomplexring
permlinkre-markrmorrisjr-re-complexring-re-markrmorrisjr-an-open-letter-to-steemit-gods-dan-in-particular-are-you-trying-to-build-the-buzzfeed-of-the-blockchain-20160818t135533071z
categorysteemit
json_metadata{"tags":["steemit"]}
created2016-08-18 13:55:33
last_update2016-08-18 13:55:33
depth3
children2
last_payout2016-09-18 19:33:06
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length145
author_reputation62,649,292,215,598
root_title"An Open Letter to Steemit Gods, Dan in Particular Are You Trying to Build the Buzzfeed of the Blockchain?"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id870,922
net_rshares0
@complexring ·
What would need to be done is to re-design the database so that not all of it needs to be stored by everyone.  Say 3-4 pieces that are redundant, different overlaps between witnesses, etc.  But this is challenging, coding-wise, not to mention an issue once scaled beyond that.

I don't disagree that this is a problem, and I think that there may be a solution.  But we need to figure out how to approach it.

Requiring everyone to have 32 TB of RAM (TB not GB) is far from a solution.

What could be done is a type of 'rolling database' on what is to be paid out that day, but it would require some additional tweaks to the protocol.

Say that you do monthly payouts for all posts.  After the first payout, you fix the 'payout time'.  Then, all you have to do is a pre-fetch of the info stored on the harddrive to RAM so that it can be properly processed at the right time.  Say, you do a pre-fetch 5 minutes before.  After the monthly payout happens, the current queue slowly drains and refills itself, as it drains, it rewrites the fixed monthly payout queue and adds any new posts into this setup.

In this scenario, you wouldn't be storing everything in memory all at once, and you'd probably have negligible amount of posts that are in the same 5 minute window, given that it is a 5 minute window for one month.

You may hit peaks, depending on user activity, but I think the amount in memory would still be low.
👍  ,
properties (23)
authorcomplexring
permlinkre-complexring-re-markrmorrisjr-re-complexring-re-markrmorrisjr-an-open-letter-to-steemit-gods-dan-in-particular-are-you-trying-to-build-the-buzzfeed-of-the-blockchain-20160818t143516978z
categorysteemit
json_metadata{"tags":["steemit"]}
created2016-08-18 14:35:15
last_update2016-08-18 14:35:15
depth4
children1
last_payout2016-09-18 19:33:06
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length1,417
author_reputation62,649,292,215,598
root_title"An Open Letter to Steemit Gods, Dan in Particular Are You Trying to Build the Buzzfeed of the Blockchain?"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id871,508
net_rshares7,738,727,955
author_curate_reward""
vote details (2)
@melek ·
I can't imagine what happens if steemit becomes the 1/10th the size of Facebook.
👍  , ,
properties (23)
authormelek
permlinkre-complexring-re-complexring-re-markrmorrisjr-re-complexring-re-markrmorrisjr-an-open-letter-to-steemit-gods-dan-in-particular-are-you-trying-to-build-the-buzzfeed-of-the-blockchain-20160819t014411172z
categorysteemit
json_metadata{"tags":["steemit"]}
created2016-08-19 01:44:12
last_update2016-08-19 01:44:12
depth5
children0
last_payout2016-09-18 19:33:06
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length80
author_reputation3,825,345,106,211
root_title"An Open Letter to Steemit Gods, Dan in Particular Are You Trying to Build the Buzzfeed of the Blockchain?"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id881,579
net_rshares1,126,379,542
author_curate_reward""
vote details (3)