create account

We have a problem - 6 October 2020 - 14:00 UTC by steemauto

View this thread on: hive.blogpeakd.comecency.com
· @steemauto · (edited)
$33.30
We have a problem - 6 October 2020 - 14:00 UTC
<center>![hivevote-problem.jpg](https://images.hive.blog/DQmYB7omHDppNbGLBVGmZKHiD5xGeHyqzmFvhTLKYCEyCg5/hivevote-problem.jpg)</center>

### The Problem
New hard fork 24 is a bit breaking for https://hive.vote. We use hive RPC nodes for hive.vote to get the accounts, votes, and posts with the minimum latency. In v1.24.2 (new version of hived) all the votes and posts moved to the hivemind. Since we need the votes and posts, the only available option is to set up our private hivemind. But hivemind is a big database of ~600GB data which takes a few days to fully sync on a fast storage machine.

### Available Options
We can set up our hivemind instance and get the data we need. But we at https://hive.vote, don't need all of that data from hivemind. Actually, we only need the posts and votes from the past 7 days. So, the only option I can think of is, building our own database structure which is optimized for fast writes and reads and takes way less time to fully sync (I'd guess less than 30 minutes).

### The Best Option
So, I will start building this new database structure and will share it with the community. I believe there are already a few projects like this but I'm sure those will require modifications and that requires reviewing all the code which takes time. And we are short on the time.

So let's build our own structure which will open up the opportunity to add more features to the website.

Of course, if you think you have the solution to our problem or can help us in any way, please comment below.

### Maintenance
As I said, hf24 will break https://hive.vote. So we have to turn off all the services on 6 October until the new back-end product is ready.

I'm not sure how long it will take, but I will do my best to bring it back as soon as possible.

It seems an easy job but "don't judge a book by its cover". I'm sure it will beat me up.

<b>On a side note</b>: The time for hf24 may change again (unlikely but possible), so the maintenance time may change based on that.

***
### Donations
Any amount of donations are much appreciated. https://hive.vote is free because of your kind supports.

Don't hesitate to leave your suggestions/feedback in the comments.

Thanks for your kindness ❀,
@mahdiyari
πŸ‘  , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , and 936 others
properties (23)
authorsteemauto
permlinkwe-have-a-problem-6-october-2020-14-00-utc
categoryhivevote
json_metadata{"app":"peakd/2020.09.5","format":"markdown","image":["https://images.hive.blog/DQmYB7omHDppNbGLBVGmZKHiD5xGeHyqzmFvhTLKYCEyCg5/hivevote-problem.jpg"],"links":["https://hive.vote","https://hive.vote","https://hive.vote","https://hive.vote","/@mahdiyari"],"tags":["hivevote","hive","dev","hf24","hive-vote"],"users":["mahdiyari"]}
created2020-10-03 20:39:54
last_update2020-10-03 20:42:48
depth0
children35
last_payout2020-10-10 20:39:54
cashout_time1969-12-31 23:59:59
total_payout_value18.054 HBD
curator_payout_value15.241 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length2,237
author_reputation237,404,508,620,279
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,947,110
net_rshares135,665,227,958,323
author_curate_reward""
vote details (1000)
@akhyar23 ·
Good luck brother
properties (22)
authorakhyar23
permlinkre-steemauto-2020104t101234643z
categoryhivevote
json_metadata{"tags":["hivevote","hive","dev","hf24","hive-vote"],"app":"ecency/3.0.4-mobile","format":"markdown+html"}
created2020-10-04 03:12:36
last_update2020-10-04 03:12:36
depth1
children0
last_payout2020-10-11 03:12:36
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length17
author_reputation45,371,814,017,827
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,952,387
net_rshares0
@donnerstein ·
Hello,

Trying to create a downvote trail u fails with the message, "Bad Request"

What can I have done wrong, there is only input for the description


![image.png](https://images.hive.blog/DQmZpVtA8zGjkduitz69PrWDa7WheY6WZ3qwUiMjqRF9Jw3/image.png)
πŸ‘  ,
properties (23)
authordonnerstein
permlinkqit5zo
categoryhivevote
json_metadata{"image":["https://images.hive.blog/DQmZpVtA8zGjkduitz69PrWDa7WheY6WZ3qwUiMjqRF9Jw3/image.png"],"app":"hiveblog/0.1"}
created2020-10-26 12:14:00
last_update2020-10-26 12:14:00
depth1
children4
last_payout2020-11-02 12:14:00
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length249
author_reputation313,120,958,301
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id100,259,844
net_rshares72,769,794,750
author_curate_reward""
vote details (2)
@mahdiyari ·
That error message should be improved. For creating a downvote trail you need at least 1k HP in your account.
πŸ‘  , ,
properties (23)
authormahdiyari
permlinkqiuvsx
categoryhivevote
json_metadata{"app":"hiveblog/0.1"}
created2020-10-27 10:29:21
last_update2020-10-27 10:29:21
depth2
children3
last_payout2020-11-03 10:29:21
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length109
author_reputation168,453,265,420,231
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id100,273,346
net_rshares85,722,485,350
author_curate_reward""
vote details (3)
@donnerstein ·
Oh, it must be your own HP. Or a delegation is enough.

And what happens if HP falls again afterwards. We then switched off the tail
πŸ‘  ,
properties (23)
authordonnerstein
permlinkqiuww0
categoryhivevote
json_metadata{"app":"hiveblog/0.1"}
created2020-10-27 10:52:36
last_update2020-10-27 10:52:36
depth3
children2
last_payout2020-11-03 10:52:36
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length132
author_reputation313,120,958,301
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id100,273,607
net_rshares71,313,488,809
author_curate_reward""
vote details (2)
@droida ·
> In v1.24.2 (new version of hived) all the votes and posts moved to the hivemind.

What is the hivemind? Will the hive RPC nodes stop accepting broadcasts?
properties (22)
authordroida
permlinkre-steemauto-qhnbvu
categoryhivevote
json_metadata{"tags":["hivevote"],"app":"peakd/2020.09.5"}
created2020-10-03 22:02:18
last_update2020-10-03 22:02:18
depth1
children18
last_payout2020-10-10 22:02:18
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length156
author_reputation9,575,233,920,522
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,948,892
net_rshares0
@mahdiyari ·
$0.02
hivemind is a database for the social aspect of the hive. It basically keeps post content, vote data, etc. It is a database that is easier to maintain and work with data.
RPC nodes accept the broadcast and will accept it after hf24 too. Now you can't get post content with API call from the hived node. Public RPC nodes like anyx.io run hived+hivemind behind jussi to redirect all the api calls to the correct place.

e.g. condenser_api.get_content requires hivemind.
πŸ‘  
properties (23)
authormahdiyari
permlinkre-droida-qhne1d
categoryhivevote
json_metadata{"tags":["hivevote"],"app":"peakd/2020.09.5"}
created2020-10-03 22:48:48
last_update2020-10-03 22:48:48
depth2
children17
last_payout2020-10-10 22:48:48
cashout_time1969-12-31 23:59:59
total_payout_value0.010 HBD
curator_payout_value0.011 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length467
author_reputation168,453,265,420,231
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,949,419
net_rshares162,945,100,898
author_curate_reward""
vote details (1)
@akumagai ·
you lost me at hivemind LOL

[![tenor.gif](https://images.hive.blog/DQmXiZuD6Gh4wZ4N8m9VGiULgpUMkZb6AbvRZRqu1cwvz5B/tenor.gif)](https://tenor.com/view/mind-blown-steve-brule-gif-7620514)
πŸ‘  
properties (23)
authorakumagai
permlinkqhneuq
categoryhivevote
json_metadata{"image":["https://images.hive.blog/DQmXiZuD6Gh4wZ4N8m9VGiULgpUMkZb6AbvRZRqu1cwvz5B/tenor.gif"],"links":["https://tenor.com/view/mind-blown-steve-brule-gif-7620514"],"app":"hiveblog/0.1"}
created2020-10-03 23:06:27
last_update2020-10-03 23:06:27
depth3
children0
last_payout2020-10-10 23:06:27
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length186
author_reputation70,539,476,902,517
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,949,631
net_rshares9,814,352,379
author_curate_reward""
vote details (1)
@droida ·
Thank you very much for the explanation.
properties (22)
authordroida
permlinkre-mahdiyari-qhnet4
categoryhivevote
json_metadata{"tags":["hivevote"],"app":"peakd/2020.09.5"}
created2020-10-03 23:05:27
last_update2020-10-03 23:05:27
depth3
children0
last_payout2020-10-10 23:05:27
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length40
author_reputation9,575,233,920,522
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,949,623
net_rshares0
@marki99 · (edited)
Just to understand how it all works, couldn't you run hive.vote on the anyx node without having your own?
properties (22)
authormarki99
permlinkre-mahdiyari-qhnw7g
categoryhivevote
json_metadata{"tags":["hivevote"],"app":"peakd/2020.09.5"}
created2020-10-04 05:23:54
last_update2020-10-04 05:28:03
depth3
children0
last_payout2020-10-11 05:23:54
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length105
author_reputation11,400,723,818,181
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,953,203
net_rshares0
@marki99 ·
Just to understand how it all works, couldn't you run hive.vote on the anyx node without having your own?
properties (22)
authormarki99
permlinkre-mahdiyari-qhnwo0
categoryhivevote
json_metadata{"tags":["hivevote"],"app":"peakd/2020.09.5"}
created2020-10-04 05:38:00
last_update2020-10-04 05:38:00
depth3
children13
last_payout2020-10-11 05:38:00
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length105
author_reputation11,400,723,818,181
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,953,284
net_rshares0
@hivebuzz ·
Congratulations @steemauto! You have completed the following achievement on the Hive blockchain and have been rewarded with new badge(s) :

<table><tr><td><img src="https://images.hive.blog/60x60/http://hivebuzz.me/badges/topupvotedday.png"></td><td>Your post has been really appreciated and was the most upvoted of the day</td></tr>
</table>

<sub>_You can view your badges on [your board](https://hivebuzz.me/@steemauto) and compare yourself to others in the [Ranking](https://hivebuzz.me/ranking)_</sub>
<sub>_If you no longer want to receive notifications, reply to this comment with the word_ `STOP`</sub>



**Do not miss the last post from @hivebuzz:**
<table><tr><td><a href="/hivebuzz/@hivebuzz/feedback-from-the-october-1st-hive-power-up-day"><img src="https://images.hive.blog/64x128/https://i.imgur.com/lZQYVmN.png"></a></td><td><a href="/hivebuzz/@hivebuzz/feedback-from-the-october-1st-hive-power-up-day">Feedback from the October 1st Hive Power Up Day</a></td></tr><tr><td><a href="/hivebuzz/@hivebuzz/pud-helper"><img src="https://images.hive.blog/64x128/https://i.imgur.com/Fg3dhfw.png"></a></td><td><a href="/hivebuzz/@hivebuzz/pud-helper">Hive Power Up Day - Introducing the Power Up Helper!</a></td></tr></table>
properties (22)
authorhivebuzz
permlinkhivebuzz-notify-steemauto-20201004t002953000z
categoryhivevote
json_metadata{"image":["http://hivebuzz.me/notify.t6.png"]}
created2020-10-04 00:29:51
last_update2020-10-04 00:29:51
depth1
children0
last_payout2020-10-11 00:29:51
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length1,232
author_reputation367,875,542,916,368
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,950,818
net_rshares0
@isabelpena ·
We trust that you will find the best way to resolve the issue and fix Hive soon.
properties (22)
authorisabelpena
permlinkre-steemauto-qhqw5x
categoryhivevote
json_metadata{"tags":["hivevote"],"app":"peakd/2020.09.5"}
created2020-10-05 20:13:12
last_update2020-10-05 20:13:12
depth1
children0
last_payout2020-10-12 20:13:12
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length80
author_reputation92,978,965,692,507
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,980,679
net_rshares0
@juanvegetarian ·
Good luck on the decision to build hive.vote's own database structure. I'm sure it will do good things for you going forward. 
properties (22)
authorjuanvegetarian
permlinkre-steemauto-qhneme
categoryhivevote
json_metadata{"tags":["hivevote"],"app":"peakd/2020.09.5"}
created2020-10-03 23:01:27
last_update2020-10-03 23:01:27
depth1
children0
last_payout2020-10-10 23:01:27
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length126
author_reputation50,824,349,811,114
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,949,575
net_rshares0
@lucky-elephant ·
$0.02
It’s too bad that the hardfork will break hive.vote. You seem to have a good plan to fix it so that is a good thing.
πŸ‘  ,
properties (23)
authorlucky-elephant
permlinkqhnldd
categoryhivevote
json_metadata{"app":"hiveblog/0.1"}
created2020-10-04 01:27:12
last_update2020-10-04 01:27:12
depth1
children0
last_payout2020-10-11 01:27:12
cashout_time1969-12-31 23:59:59
total_payout_value0.012 HBD
curator_payout_value0.012 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length116
author_reputation10,274,619,088,456
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,951,407
net_rshares184,830,017,919
author_curate_reward""
vote details (2)
@poshbot ·
https://twitter.com/Bhattg18/status/1312611703146700801
properties (22)
authorposhbot
permlinkre-we-have-a-problem-6-october-2020-14-00-utc-20201004t043318z
categoryhivevote
json_metadata"{"app": "beem/0.24.8"}"
created2020-10-04 04:33:18
last_update2020-10-04 04:33:18
depth1
children0
last_payout2020-10-11 04:33:18
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length55
author_reputation5,554,335,374,496
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,952,878
net_rshares0
@poshbot ·
https://twitter.com/VictoriaBSB/status/1312781655178964993
properties (22)
authorposhbot
permlinkre-we-have-a-problem-6-october-2020-14-00-utc-20201004t154838z
categoryhivevote
json_metadata"{"app": "beem/0.24.8"}"
created2020-10-04 15:48:39
last_update2020-10-04 15:48:39
depth1
children0
last_payout2020-10-11 15:48:39
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length58
author_reputation5,554,335,374,496
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,959,842
net_rshares0
@poshbot ·
https://twitter.com/HiveLift/status/1312951669672480769
properties (22)
authorposhbot
permlinkre-we-have-a-problem-6-october-2020-14-00-utc-20201005t030412z
categoryhivevote
json_metadata"{"app": "beem/0.24.8"}"
created2020-10-05 03:04:12
last_update2020-10-05 03:04:12
depth1
children0
last_payout2020-10-12 03:04:12
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length55
author_reputation5,554,335,374,496
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,968,669
net_rshares0
@wanderingmoon ·
This data base structure sounds a little like a server is needed. Using a server sounds like defeating the purpose of blockchain. Please correct me if I'm wrong and explain to me so I better understand.
properties (22)
authorwanderingmoon
permlinkre-steemauto-qholf6
categoryhivevote
json_metadata{"tags":["hivevote"],"app":"peakd/2020.09.5"}
created2020-10-04 14:26:00
last_update2020-10-04 14:26:00
depth1
children1
last_payout2020-10-11 14:26:00
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length202
author_reputation16,039,046,515,702
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,958,772
net_rshares0
@mahdiyari ·
A server that can be built by anyone. There is no centralization.
properties (22)
authormahdiyari
permlinkre-wanderingmoon-qhomzu
categoryhivevote
json_metadata{"tags":["hivevote"],"app":"peakd/2020.09.5"}
created2020-10-04 14:59:54
last_update2020-10-04 14:59:54
depth2
children0
last_payout2020-10-11 14:59:54
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length65
author_reputation168,453,265,420,231
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,959,212
net_rshares0
@wesphilbin ·
Well,

I looked this up...

> <h4>RPC
Stands for "Remote Procedure Call." Most computer programs run procedures, or sets of instructions, using the computer's CPU. In other words, the instructions are processed locally on the same computer that the software is running from. Remote procedure calls, however, run procedures on other machines or devices connected to a network</h4>
<center><sub>[Source](https://techterms.com/definition/rpc)</sub></center>
____

But then I'd have to keep looking more definitions up, and probably get confused and have to start all over. 

OR I can trust your opinion and ability; looking at what you've done so far... transparency of the Blockchain etc... Appreciate your time taken to explain things my friend.  
properties (22)
authorwesphilbin
permlinkre-steemauto-qhottd
categoryhivevote
json_metadata{"tags":["hivevote"],"app":"peakd/2020.09.5"}
created2020-10-04 17:27:15
last_update2020-10-04 17:27:15
depth1
children0
last_payout2020-10-11 17:27:15
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length746
author_reputation43,936,174,956,729
root_title"We have a problem - 6 October 2020 - 14:00 UTC"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id99,961,274
net_rshares0