create account

steemdb 0.2.0 - rshares allocation browser, new data api's and some minor improvements by jesta

View this thread on: hive.blogpeakd.comecency.com
· @jesta ·
$392.51
steemdb 0.2.0 - rshares allocation browser, new data api's and some minor improvements
With a focus on data, the new labs section of [steemdb.com](https://steemdb.com) is now live, including 5 unique API endpoints as well as a new way to browse reward share distributions.

Since steemdb is still [a relatively new project](https://steemit.com/steemdb/@jesta/steemdb-com-open-source-blockchain-explorer-and-data-playground-alpha-release), I'm still exploring what this site really is becoming. I'd encourage you to read the [update to steemstats](https://steemit.com/steemstats/@jesta/steemstats-0-3-5-improved-post-inspector-fixes-and-prep-for-0-14-0), at the bottom I spoke a bit about the direction of steemstats + steemdb in the coming months. 

## Welcome to the Lab

![steemdb labs](http://i.imgur.com/513mqTy.png)

A new section of steemdb is now live - [the lab](https://steemdb.com/labs). The lab is for experimental views and data, to help us (the community) learn more about exactly what is happening within the steem ecosystem. Any time someone asks for a specific data view or way to analyze the data, I'll be adding a link to it here.

At it's launch, this section has one experimental view and 5 new api endpoints. Some of these endpoints are somewhat slow still, as I'm still working on optimizing the queries in the database.

### Reward Shares allocated by voter, per day

![rshares browser](http://i.imgur.com/kysCGaX.png)

I've been chatting with @clayop recently about finding ways to determine who is contributing the most day by day to the rewards of posts. This new page is a set of data to show you how many reward shares each voter has allocated per day.

https://steemdb.com/labs/rshares

You can browse day by day using the navigation, just like on the homepage. The information on this page is as follows:

- Total Reward Shares: The total sum of every reward share allocated to every post that day (UTC Time). It's a huge number, that's for sure. 
- Voters: The total unique voters that day

This data is then followed by a table of the 100 most impactful voters that day, sorted by total rshares distributed. This table includes:

- The rank/position of their contributions.
- The percentage of overall contributions they contributed for the day.
- The actual number value of these contributions.
- The total votes that account cast in that day.
- A link to view more about that account.

From this table, you can see who is dishing out the most rewards that day. I'm incredibly curious to know what the community thinks of this data, if it's useful, and what other kinds of data you'd be curious in knowing.

### Public APIs

The labs page also features a number of API endpoints for you to use for your analysis or websites. They were APIs that I needed for various purposes or that the community has asked for.

- **currency supply**: A day by day view of each of the currencies. It aggregates and creates the total values based on snapshots of every single account by day.
- **global props history**: If you've worked with steemd before, you've likely used the global dynamic properties. This is a historical feed of this data, with a snapshot being created every 6 hours.
- **percentage vesting**: The percentage of steem held as vests over time.
- **voter rshares**: This is the equivalent of the reward shares browser listed above, in API format. 
- **down voters**: A list of the 20 most prolific down voters each day. Useful for keeping tabs on those likely abusing the system.

## Follower Details

![follower details](http://i.imgur.com/jwn2Y2k.png)

By popular request, I've added some account information/details to the Followers and Following tabs of each account. Both of these tabs are sorted by VESTS/SP by default.

## Charts

![30 day charts](http://i.imgur.com/87uDyTE.png)

All charts are now 30-day charts, which lets you actually see which date it was instead of just guessing. This also helped improve load times on the site, so it was a win-win.

## Misc Fixes

- Added support for new operations in 0.14.0
- Witness Voting calculations now include proxy votes
- Created new indexes to improve database load times
- Added filtering + pagination to the accounts page late last week

## Contribute!

https://github.com/aaroncox/steemdb

This is an open source project, anyone's welcome to contribute. I realize the specific technologies aren't common within this community, but I'm more than happy to assist someone in building specific features that might help benefit the community.

Right now creating new ways to expose "big data" from the blockchain has been my goal. Having a database like this synchronized with the blockchain allows for some in-depth analysis in ways we might not otherwise have had.

Feel free to reach out in #steemdb.com in steemit.chat or here on steemit if you have ideas for features, requests for data, or are looking to chat.
👍  , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , and 297 others
properties (23)
authorjesta
permlinksteemdb-0-2-0-rshares-allocation-browser-new-data-api-s-and-some-minor-improvements
categorysteemdb
json_metadata{"tags":["steemdb","patch-notes"],"users":["clayop"],"image":["http://i.imgur.com/513mqTy.png","http://i.imgur.com/kysCGaX.png","http://i.imgur.com/jwn2Y2k.png","http://i.imgur.com/87uDyTE.png"],"links":["https://steemdb.com","https://steemit.com/steemdb/@jesta/steemdb-com-open-source-blockchain-explorer-and-data-playground-alpha-release","https://steemit.com/steemstats/@jesta/steemstats-0-3-5-improved-post-inspector-fixes-and-prep-for-0-14-0","https://steemdb.com/labs","https://steemdb.com/labs/rshares","https://github.com/aaroncox/steemdb"]}
created2016-09-09 09:43:36
last_update2016-09-09 09:43:36
depth0
children7
last_payout2016-10-10 11:15:30
cashout_time1969-12-31 23:59:59
total_payout_value378.140 HBD
curator_payout_value14.373 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length4,825
author_reputation140,605,453,893,072
root_title"steemdb 0.2.0 - rshares allocation browser, new data api's and some minor improvements"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id1,182,505
net_rshares95,753,657,100,174
author_curate_reward""
vote details (361)
@laskoff ·
#Jesta Niceeeeeee Post ;)
properties (22)
authorlaskoff
permlinkre-jesta-steemdb-0-2-0-rshares-allocation-browser-new-data-api-s-and-some-minor-improvements-20160909t094728159z
categorysteemdb
json_metadata{"tags":["Jesta","steemdb"]}
created2016-09-09 09:47:27
last_update2016-09-09 09:47:27
depth1
children0
last_payout2016-10-10 11:15:30
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length25
author_reputation-21,792,744,940
root_title"steemdb 0.2.0 - rshares allocation browser, new data api's and some minor improvements"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id1,182,527
net_rshares0
@mark-waser ·
Wow!  You weren't kidding about "the specific technologies aren't common within this community" . . . .  I wanted to volunteer to do some stuff with/for you but . . . . 

Personally, I'm making the switch from C# to Node.JS on Azure.  I'll be upgrading from AngularJS 1.5 to AngularJS2 shortly.  React is really cool in many ways but really doesn't separate presentation and code and has a *much* higher maintenance overhead.

If there is anything we could do to cooperate, I'd love to hear about it . . . . but . . . 

Keep on steemin'

  -- Mark
properties (22)
authormark-waser
permlinkre-jesta-steemdb-0-2-0-rshares-allocation-browser-new-data-api-s-and-some-minor-improvements-20160909t113554053z
categorysteemdb
json_metadata{"tags":["steemdb"]}
created2016-09-09 11:36:09
last_update2016-09-09 11:36:09
depth1
children0
last_payout2016-10-10 11:15:30
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length547
author_reputation3,513,410,950,995
root_title"steemdb 0.2.0 - rshares allocation browser, new data api's and some minor improvements"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id1,183,254
net_rshares0
@penguinpablo ·
$0.08
Wow, very nice! Thank you @jesta! Keep it up :)

I found a small bug in the calculation of the reputation number for some users: @dantheman for example has a reputation of 104 here https://steemdb.com/@dantheman while this should be 71 at the moment.
👍  ,
properties (23)
authorpenguinpablo
permlinkre-jesta-steemdb-0-2-0-rshares-allocation-browser-new-data-api-s-and-some-minor-improvements-20160909t100344381z
categorysteemdb
json_metadata{"tags":["steemdb"],"users":["jesta","dantheman"],"links":["https://steemdb.com/@dantheman"]}
created2016-09-09 10:03:45
last_update2016-09-09 10:03:45
depth1
children1
last_payout2016-10-10 11:15:30
cashout_time1969-12-31 23:59:59
total_payout_value0.059 HBD
curator_payout_value0.018 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length250
author_reputation792,312,678,950,166
root_title"steemdb 0.2.0 - rshares allocation browser, new data api's and some minor improvements"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id1,182,617
net_rshares207,485,157,256
author_curate_reward""
vote details (2)
@jesta ·
Yeah I've been asking around to figure out why that's happening, I haven't been able to figure it out myself. I copied the code pretty much directly from steemit.com's source code, and I'm not exactly sure why it's not accurate.

If anyone wants to help, [here's the lines of code](https://github.com/aaroncox/steemdb/blob/master/app/helpers/Reputation.php) that are causing the problem :)
properties (22)
authorjesta
permlinkre-penguinpablo-re-jesta-steemdb-0-2-0-rshares-allocation-browser-new-data-api-s-and-some-minor-improvements-20160909t102019697z
categorysteemdb
json_metadata{"tags":["steemdb"],"links":["https://github.com/aaroncox/steemdb/blob/master/app/helpers/Reputation.php"]}
created2016-09-09 10:20:18
last_update2016-09-09 10:20:18
depth2
children0
last_payout2016-10-10 11:15:30
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length389
author_reputation140,605,453,893,072
root_title"steemdb 0.2.0 - rshares allocation browser, new data api's and some minor improvements"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id1,182,691
net_rshares0
@testz ·
Awesome!!!
properties (22)
authortestz
permlinkre-jesta-steemdb-0-2-0-rshares-allocation-browser-new-data-api-s-and-some-minor-improvements-20160909t163914540z
categorysteemdb
json_metadata{"tags":["steemdb"]}
created2016-09-09 16:39:15
last_update2016-09-09 16:39:15
depth1
children0
last_payout2016-10-10 11:15:30
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length10
author_reputation32,317,482,835,114
root_title"steemdb 0.2.0 - rshares allocation browser, new data api's and some minor improvements"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id1,186,180
net_rshares0
@the-ego-is-you ·
What's not to like!
properties (22)
authorthe-ego-is-you
permlinkre-jesta-steemdb-0-2-0-rshares-allocation-browser-new-data-api-s-and-some-minor-improvements-20160909t095510444z
categorysteemdb
json_metadata{"tags":["steemdb"]}
created2016-09-09 09:55:12
last_update2016-09-09 09:55:12
depth1
children0
last_payout2016-10-10 11:15:30
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length19
author_reputation7,031,347,556,614
root_title"steemdb 0.2.0 - rshares allocation browser, new data api's and some minor improvements"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id1,182,567
net_rshares0
@williambanks ·
Wow, this is awesome!
properties (22)
authorwilliambanks
permlinkre-jesta-steemdb-0-2-0-rshares-allocation-browser-new-data-api-s-and-some-minor-improvements-20160909t125552562z
categorysteemdb
json_metadata{"tags":["steemdb"]}
created2016-09-09 12:55:42
last_update2016-09-09 12:55:42
depth1
children0
last_payout2016-10-10 11:15:30
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length21
author_reputation90,708,691,850,244
root_title"steemdb 0.2.0 - rshares allocation browser, new data api's and some minor improvements"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id1,183,866
net_rshares0