create account

Upcoming: Hive DB by furion

View this thread on: hive.blog |  peakd.com |  ecency.com
steem · @furion · (edited)
$154.27
Upcoming: Hive DB
### What is Hive?
Hive (short for Hivemind) is an extension of *sbds*. While *sbds* is concerned about storing raw blockchain operations, *hive* focuses on caching the state.

**Immediately useful to us is:**
 - account state
 - post state
 - followers/following data
 - reblogs, blogs and feeds

*Hive will also contain data needed for the upcoming communities, but we need not concern ourselves with it at this time*.

Source: https://github.com/steemit/hivemind

### SteemData hosted Hive DB
[SteemData](https://steemdata.com) is providing *sbds* and *hive* services for free on a completely open basis (no signup required).

You can access the Hive MySQL database at:
```
mysql://steemit:steemit@mysql.steemdata.com:3306/hive
```

### Why is some of the data missing?
I've decided to make MySQL a first-class citizen between services offered by SteemData, and as such I've re-deployed *sbds* and *hive* on a much more powerful i7/64gb/1tb-ssd server.

*Syncing with remote steemd is a bit slow, and it will take a while to have all data.*


### SteemData Redesign
As the number of SteemData apps and services grew, the website started getting a bit messy. I've re-organized it into logical sections.

![](https://i.imgur.com/zlAUjXU.png)

<center> <h4> https://steemdata.com </h4> </center>
πŸ‘  , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , and 185 others
properties (23)
authorfurion
permlinkupcoming-hive-db
categorysteem
json_metadata{"tags":["steem","steemdev","sbds","hive"],"image":["https://i.imgur.com/zlAUjXU.png"],"links":["https://github.com/steemit/hivemind","https://steemdata.com"],"app":"steemit/0.1","format":"markdown"}
created2017-09-18 12:15:06
last_update2017-09-18 12:20:09
depth0
children22
last_payout2017-09-25 12:15:06
cashout_time1969-12-31 23:59:59
total_payout_value130.249 HBD
curator_payout_value24.023 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length1,294
author_reputation116,503,940,714,958
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,221,327
net_rshares60,156,949,031,196
author_curate_reward""
vote details (249)
@abdulrahman24 · 
Hi .. I'm new Here, I need a push , thank you for up vote this post
πŸ‘  
properties (23)
authorabdulrahman24
permlinkre-furion-upcoming-hive-db-20170919t231145948z
categorysteem
json_metadata{"tags":["steem"],"app":"steemit/0.1"}
created2017-09-19 23:11:42
last_update2017-09-19 23:11:42
depth1
children0
last_payout2017-09-26 23:11:42
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length67
author_reputation10,096,923,576
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,370,607
net_rshares924,277,935
author_curate_reward""
vote details (1)
@aftabkhan10 · 
Dnt know much about programmng but I appreciate your services dude.
properties (22)
authoraftabkhan10
permlinkre-furion-upcoming-hive-db-20170923t135413725z
categorysteem
json_metadata{"tags":["steem"],"app":"steemit/0.1"}
created2017-09-23 13:48:57
last_update2017-09-23 13:48:57
depth1
children0
last_payout2017-09-30 13:48:57
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length67
author_reputation67,607,529,862,002
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,709,170
net_rshares0
@andrewramdas · 
Very interesting @furion ...upvoted... blessings from me in Jamaica
properties (22)
authorandrewramdas
permlinkre-furion-upcoming-hive-db-20170918t151859917z
categorysteem
json_metadata{"tags":["steem"],"users":["furion"],"app":"steemit/0.1"}
created2017-09-18 15:17:24
last_update2017-09-18 15:17:24
depth1
children0
last_payout2017-09-25 15:17:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length67
author_reputation2,441,258,120,617
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,236,667
net_rshares0
@bitgeek ·
comment
Congratulations @furion, this post is the forth most rewarded post (based on pending payouts) in the last 12 hours written by a Hero account holder (accounts that hold between 10 and 100 Mega Vests). The total number of posts by Hero account holders during this period was 239 and the total pending payments to posts in this category was $4469.29. To see the full list of highest paid posts across all accounts categories, [click here](www.steemit.com/steemit/@bitgeek/payout-stats-report-for-18th-september-2017--part-i). 

If you do not wish to receive these messages in future, please reply stop to this comment.
properties (22)
authorbitgeek
permlinkre-upcoming-hive-db-20170918t185201
categorysteem
json_metadata""
created2017-09-18 18:52:03
last_update2017-09-18 18:52:03
depth1
children1
last_payout2017-09-25 18:52:03
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length616
author_reputation13,049,044,453,787
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,255,034
net_rshares0
@valued-customer · 
Fourth.  It was the fourth most rewarded post.  ;)
properties (22)
authorvalued-customer
permlinkre-bitgeek-re-upcoming-hive-db-20170918t185201-20170919t035805023z
categorysteem
json_metadata{"tags":["steem"],"app":"steemit/0.1"}
created2017-09-19 03:58:12
last_update2017-09-19 03:58:12
depth2
children0
last_payout2017-09-26 03:58:12
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length50
author_reputation359,021,754,860,185
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,289,298
net_rshares0
@dehenne ·
$0.02
thanks for the post! i have some questions :-)

will it cost in the future?
how long are the delay? i mean how long does it need from steemd into the mysql db? how often is the db updated?

Can i use this for our notifications in steempi? that would be awesome. Are there any limits? query limits, time limits etc?

at the moment i made a bad hack to get reblogs for our giveaway :D so hive would help, too!!
πŸ‘  
properties (23)
authordehenne
permlinkre-furion-upcoming-hive-db-20170920t085335135z
categorysteem
json_metadata{"tags":["steem"],"app":"steemit/0.1"}
created2017-09-20 08:53:33
last_update2017-09-20 08:53:33
depth1
children0
last_payout2017-09-27 08:53:33
cashout_time1969-12-31 23:59:59
total_payout_value0.017 HBD
curator_payout_value0.004 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length408
author_reputation8,032,043,781,732
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,403,978
net_rshares8,829,780,220
author_curate_reward""
vote details (1)
@donchate · 
We are loving the MongoDB steemdata service. Very much appreciated. Hope it stays around for a while.
properties (22)
authordonchate
permlinkre-furion-upcoming-hive-db-20170922t012314147z
categorysteem
json_metadata{"tags":["steem"],"app":"steemit/0.1"}
created2017-09-22 01:23:21
last_update2017-09-22 01:23:21
depth1
children0
last_payout2017-09-29 01:23:21
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length101
author_reputation956,784,034,700
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,572,255
net_rshares0
@fabien ·
$1.93
Wow this is awesome! The future is now with you @furion :)
πŸ‘  ,
properties (23)
authorfabien
permlinkre-furion-upcoming-hive-db-20170918t141156087z
categorysteem
json_metadata{"tags":["steem"],"community":"busy","app":"busy/2.0.0"}
created2017-09-18 14:11:57
last_update2017-09-18 14:11:57
depth1
children0
last_payout2017-09-25 14:11:57
cashout_time1969-12-31 23:59:59
total_payout_value1.450 HBD
curator_payout_value0.481 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length58
author_reputation16,649,367,183,999
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,230,867
net_rshares758,423,949,599
author_curate_reward""
vote details (2)
@kenhudoy · 
@furion
just saw this post and am happy for steemians like you ho dedicate time creatin options for us to teem better and have an excellent experience... thanks for all your efforts...really appreciate
properties (22)
authorkenhudoy
permlinkre-furion-upcoming-hive-db-2017926t104946249z
categorysteem
json_metadata{"app":"chainbb/0.3","format":"markdown+html","tags":[]}
created2017-09-26 09:49:18
last_update2017-09-26 09:49:18
depth1
children0
last_payout2017-10-03 09:49:18
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length203
author_reputation10,766,809,992,992
root_title"Upcoming: Hive DB"
beneficiaries
0.
accountchainbb
weight1,500
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,967,161
net_rshares0
@mian290 · 
Great work very informative post like it and upvoted!!
keep it up!!
properties (22)
authormian290
permlinkre-furion-upcoming-hive-db-20170918t124409777z
categorysteem
json_metadata{"tags":["steem"],"app":"steemit/0.1"}
created2017-09-18 12:44:12
last_update2017-09-18 12:44:12
depth1
children0
last_payout2017-09-25 12:44:12
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length67
author_reputation160,829,086,681
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,223,427
net_rshares0
@muhammadbadawi · 
hello 
This is awesome !
Please check my last post and share your opinion
@muhammadbadawi
properties (22)
authormuhammadbadawi
permlinkre-furion-upcoming-hive-db-20170918t190136252z
categorysteem
json_metadata{"tags":["steem"],"users":["muhammadbadawi"],"app":"steemit/0.1"}
created2017-09-18 19:01:36
last_update2017-09-18 19:01:36
depth1
children0
last_payout2017-09-25 19:01:36
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length89
author_reputation-11,258,167,147
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,255,812
net_rshares0
@neander-squirrel ·
$2.12
It seems i'll have to learn mySQL after all:)

When you said "post state" do you mean hiveDB will tell me if a post was edited or not? That would be useful because sometimes `get_content` doesn't show this info, even the post was edited.

How much delay hiveDB has compared to the head block?
πŸ‘  ,
properties (23)
authorneander-squirrel
permlinkre-furion-upcoming-hive-db-20170918t122830472z
categorysteem
json_metadata{"tags":["steem"],"app":"steemit/0.1"}
created2017-09-18 12:28:33
last_update2017-09-18 12:28:33
depth1
children1
last_payout2017-09-25 12:28:33
cashout_time1969-12-31 23:59:59
total_payout_value2.077 HBD
curator_payout_value0.042 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length292
author_reputation416,506,081,655
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,222,292
net_rshares828,802,263,622
author_curate_reward""
vote details (2)
@furion · 
No, for the post history you would still have to query sbds or SteemData Mongo, and compare the diffs between posts with the matching author/permlink.
properties (22)
authorfurion
permlinkre-neander-squirrel-re-furion-upcoming-hive-db-20170918t123042098z
categorysteem
json_metadata{"tags":["steem"],"app":"steemit/0.1"}
created2017-09-18 12:30:42
last_update2017-09-18 12:30:42
depth2
children0
last_payout2017-09-25 12:30:42
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length150
author_reputation116,503,940,714,958
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,222,441
net_rshares0
@nutritionhealth · 
Great work veryπŸ‘ŒπŸ‘ŒπŸ‘ŒπŸ‘Œ informative post like πŸ‘πŸ‘πŸ‘πŸ‘it and upvotedπŸ’πŸ’πŸ’πŸ’
properties (22)
authornutritionhealth
permlinkre-furion-upcoming-hive-db-20170918t125411364z
categorysteem
json_metadata{"tags":["steem"],"app":"steemit/0.1"}
created2017-09-18 12:54:33
last_update2017-09-18 12:54:33
depth1
children0
last_payout2017-09-25 12:54:33
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length64
author_reputation-36,787,585,889
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,224,326
net_rshares0
@optimisticguy · 
https://www.youtube.com/watch?v=kZoz_ssC8i8

The Hive Mind in the Real World (Because Science w/ Kyle Hill)
πŸ‘  
πŸ‘Ž  
properties (23)
authoroptimisticguy
permlinkre-furion-upcoming-hive-db-20170918t193102721z
categorysteem
json_metadata{"tags":["steem"],"image":["https://img.youtube.com/vi/kZoz_ssC8i8/0.jpg"],"links":["https://www.youtube.com/watch?v=kZoz_ssC8i8"],"app":"steemit/0.1"}
created2017-09-18 19:31:03
last_update2017-09-18 19:31:03
depth1
children0
last_payout2017-09-25 19:31:03
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length107
author_reputation-898,410,536,557
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,258,254
net_rshares3,911,321,147
author_curate_reward""
vote details (2)
@stakuza · 
i`ve follow and upvoted u :) waiting for u :)
πŸ‘Ž  
properties (23)
authorstakuza
permlinkre-furion-upcoming-hive-db-20170918t121615653z
categorysteem
json_metadata{"tags":["steem"],"app":"steemit/0.1"}
created2017-09-18 12:16:18
last_update2017-09-18 12:16:18
depth1
children0
last_payout2017-09-25 12:16:18
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length45
author_reputation22,826,072,371
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,221,426
net_rshares-3,273,122,518
author_curate_reward""
vote details (1)
@steemreports · (edited)
$1.99
This looks great! Is part of the idea to take some of the load off the RPC nodes?
πŸ‘  ,
properties (23)
authorsteemreports
permlinkre-furion-upcoming-hive-db-20170918t124648155z
categorysteem
json_metadata{"tags":["steem"],"app":"steemit/0.1"}
created2017-09-18 12:46:48
last_update2017-09-18 13:02:54
depth1
children3
last_payout2017-09-25 12:46:48
cashout_time1969-12-31 23:59:59
total_payout_value1.490 HBD
curator_payout_value0.495 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length81
author_reputation26,974,091,964,123
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,223,666
net_rshares777,175,203,598
author_curate_reward""
vote details (2)
@furion · (edited)
$0.04
Yeah, it certainly will, and it already does. Several apps already use SteemData rather than steemd directly, which is much faster for many use cases and allows for powerful queries.
πŸ‘  
properties (23)
authorfurion
permlinkre-steemreports-re-furion-upcoming-hive-db-20170918t140353412z
categorysteem
json_metadata{"tags":["steem"],"app":"steemit/0.1"}
created2017-09-18 14:03:54
last_update2017-09-18 14:04:06
depth2
children2
last_payout2017-09-25 14:03:54
cashout_time1969-12-31 23:59:59
total_payout_value0.032 HBD
curator_payout_value0.010 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length182
author_reputation116,503,940,714,958
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,230,151
net_rshares16,940,847,043
author_curate_reward""
vote details (1)
@steemreports ·
$1.90
I've just investigated the schema and installed mysqlclient for Python. I'm currently maintaining a sqlite db for our stuff, but you're already doing the consolidation so edits etc. are merged into hive_posts_cache (if I'm not mistaken?), which I'm not so sure how to do easily. I look forward to investigating further once it has synced! Thanks very much for this work.
πŸ‘  ,
properties (23)
authorsteemreports
permlinkre-furion-re-steemreports-re-furion-upcoming-hive-db-20170918t141613474z
categorysteem
json_metadata{"tags":["steem"],"app":"steemit/0.1"}
created2017-09-18 14:16:12
last_update2017-09-18 14:16:12
depth3
children0
last_payout2017-09-25 14:16:12
cashout_time1969-12-31 23:59:59
total_payout_value1.423 HBD
curator_payout_value0.472 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length370
author_reputation26,974,091,964,123
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,231,236
net_rshares744,302,662,715
author_curate_reward""
vote details (2)
@steemreports · 
From what I can see it has currently just got 56% of the blocks. Will it take more than a week to be up to date? Is this because getting old blocks over RPC is really slow, and it will speed up as the blocks get more recent? I presume hive_posts_cache starts filling only once we're in the last 7 days of blocks?
properties (22)
authorsteemreports
permlinkre-furion-re-steemreports-re-furion-upcoming-hive-db-20170921t091649070z
categorysteem
json_metadata{"tags":["steem"],"app":"steemit/0.1"}
created2017-09-21 09:16:48
last_update2017-09-21 09:16:48
depth3
children0
last_payout2017-09-28 09:16:48
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length312
author_reputation26,974,091,964,123
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,504,155
net_rshares0
@therealwolf · (edited)
$0.31
wow - that's pretty cool! Especially for development when you don't want to output everything just to get the variable name.

But I will def. check it out for the data parsing purpose. Thanks a lot!
πŸ‘  
properties (23)
authortherealwolf
permlinkre-furion-upcoming-hive-db-20170918t201222971z
categorysteem
json_metadata{"tags":["steem"],"app":"steemit/0.1"}
created2017-09-18 20:12:24
last_update2017-09-18 20:27:21
depth1
children0
last_payout2017-09-25 20:12:24
cashout_time1969-12-31 23:59:59
total_payout_value0.310 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length198
author_reputation582,208,885,469,814
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,261,420
net_rshares123,509,940,464
author_curate_reward""
vote details (1)
@wayforhappiness · 
resteemit SERVICE! We're offering resteems to over 3300 followers for only 0.25 SBD or 0.25 STEEM per resteem. Our resteems generally do better than Promoted Posts. you can simply send 0.25 SBD or 0.25 STEEM now and the link to your post to @wayforhappiness and we'll resteem it right away. Resteems get you more views, more followers, more engagement on your post, and usually more money. We've had several repeat buyers who love the service. Thanks!
πŸ‘  
πŸ‘Ž  , , ,
properties (23)
authorwayforhappiness
permlinkre-furion-upcoming-hive-db-20170918t163413423z
categorysteem
json_metadata{"tags":["steem"],"users":["wayforhappiness"],"app":"steemit/0.1"}
created2017-09-18 16:34:18
last_update2017-09-18 16:34:18
depth1
children0
last_payout2017-09-25 16:34:18
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length451
author_reputation-939,903,435,434
root_title"Upcoming: Hive DB"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id15,243,429
net_rshares-318,568,493,507
author_curate_reward""
vote details (5)
Help/Feedback