create account

Lessons Learned from Curation Rewards Discussion by dantheman

View this thread on: hive.blogpeakd.comecency.com
· @dantheman · (edited)
$454.02
Lessons Learned from Curation Rewards Discussion
I would like to thank everyone who has participated in the curation rewards discussion!  Many of you have provided incredibly useful insights. I would like to take an opportunity to summarize those insights for everyone who doesn't have time to read through the entire discussion as well as add new thoughts of my own.

## 1. Curation Rewards Attract Users

One thing is abundantly clear, curation rewards have had a major impact in attracting users to Steem. Removing curation rewards all together would have a negative impact on a meaningful part of our community. These rewards are one thing that sets Steem apart from the competition.

## 2. People and Bots will Play the Game

With the advent of advanced AI algorithms it is clear that computer models can provide high quality estimates of the value of a post and do so faster than any human could. This means that bots will always have an advantage in this game and they cannot be prevented. 

Assuming we have the right incentives, the participation of bots is a good thing. It rewards those who invest time and money improving how new content is discovered.  If we don't have the right incentives, then the same power will be applied to destroy us.  In other words, blockchain incentives are a powerful weapon that needs to be pointed in the right direction to avoid shooting ourselves in the foot.

## 3. Curation Rewards Discourage Voting 

People have repeatedly expressed that they withhold from voting to "save their power" for future use. What this implies is that "good content" is being ignored because people are saving for "great content".  This implies that there is less total information (links between users and content).  In some ways this is good, it means the votes that are cast have a higher quality.

## 4. Curation Rewards Impact Culture 

When people are paid to curate they start to adapt strategies. Votes are cast for personal gain rather than for the benefit of  the person they are voting for. This makes voting a selfish act rather than a generous act. The spirit of the site changes from one of rewarding content to one of "playing the game". 

## 5. Rewarding the Little Guy 

Someone with little Steem Power is just as *human* as someone with a lot of Steem Power. Their opinion carries a certain amount of weight simply because they are a person. Under Steem everything is weighted by Steem Power to prevent Sybil attacks.  This means that people with just $3 of free Steem Power are currently unable to earn curation rewards because their weight is so small compared to larger players. 

Any attempt to give advantage to smaller accounts will result in large users dividing their balance into many accounts. This in and of itself is not a reason to stop looking for more democratic solutions.

## 6. Designing a Better System

Some quality suggestions have been made on how to defeat the auto-upvote bots that have come out. One of the best ideas is discounting curation rewards for authors that have a history of earning high payouts. This means that the reward someone would receive for upvoting my posts will be less than the reward you would receive for upvoting a new user's post that is of equal quality.

The generalization of this algorithm is to implement our own on-chain AI for predicting the value of a post on a scale between 0 and 1.  A high prediction will mean low curation rewards, a low prediction will mean high curation rewards. Looking at an author's history is just a simplistic form of such an AI.  A more advanced form would consider the existing voters, the time of day, the tags, links, images, and even the content.

The goal of the curation rewards would be to discover *unexpected results*.  Those who upvote things that our algorithm wouldn't expect to get upvoted should be rewarded.  It is the unexpected results that add the most value and are the hardest to automate. 

## 7. An Arms Race 

Any algorithm we implement to estimate votes can be improved upon. The curation rewards are kind of like the [Netflix Prize](http://www.netflixprize.com/) for blogging.  Those who can write bots that are more effective than our own on-blockchain prediction will make money.  The blockchain will have to constantly evolve its algorithms to incorporate the best known 'bot algorithms' and reduce the rewards for those who use them.  Through iterative releases of the post-prediction algorithms the quality and speed of the curation on Steem will advance. User's who identify quality posts that are not recognized by Steem's algorithms or the bots will earn the most. Those who follow predictable patterns will earn the least.

## 8. Constant Tweaking may be Necessary

What I have concluded from this is that we must be prepared to tweak the curation rewards algorithm in response to advances in automated curation. Through this tweaking we can continuously re-bias the curation rewards toward human curators.  We should welcome bots that figure out how to game the system, they only make us stronger.  Perhaps there is an algorithm that can automatically "learn" and "adapt" to advancements in upvote bots.

## Proposed Solution

In an [earlier post I suggested rewarding those who who accurately predict the final payout](/steem/@steemitblog/curation-by-prediction-market-proposal). This kind of prediction market is harder for most people to use, but ultimately the hardest to abuse. I believe that if bot's were the ones to play the prediction market game, then the outcome of the prediction market could impact the weight of the existing curation rewards.  

If the prediction market were to estimate a post to earn $1000, then the voting rewards would be small for that post. If the prediction market predicts $1.00 then voting rewards could be much higher.  This creates a tension between making high predictions and rewarding the votes that make the prediction come true.  The higher the prediction, the less financial incentive there is for voters to vote and therefore, the less likely for it to become a self fulfilling prophesy.  The opposite would also be true: a low prediction would financially incentivise voters to prove it wrong.

The majority of the rewards should be allocated toward accurate predictions in order to advance research into bots that curate content. A token amount should be rewarded to those who vote.  To maximize the perceived value of voting, the rewards may have to be in the form of raffle tickets. Most voters get nothing, but all voters get a chance to win $1000! 

I believe with the right incentives we can motivate the community to produce the best curated content on the internet.
👍  , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , and 19 others
👎  ,
properties (23)
authordantheman
permlinklessons-learned-from-curation-rewards-discussion
categorysteem
json_metadata{"tags":["steem","curation"],"links":["http://www.netflixprize.com/","/steem/@steemitblog/curation-by-prediction-market-proposal"]}
created2016-06-02 14:46:12
last_update2016-06-02 16:28:45
depth0
children19
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value227.012 HBD
curator_payout_value227.006 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length6,641
author_reputation240,292,002,602,347
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id21,688
net_rshares73,416,696,382,884
author_curate_reward""
vote details (85)
@abit ·
The proposed solution in this article is not clear. The link of detailed proposal is https://steemit.com/steem/@steemitblog/curation-by-prediction-market-proposal
👍  , ,
properties (23)
authorabit
permlinkre-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t160856942z
categorysteem
json_metadata{"tags":["steem"]}
created2016-06-02 16:08:54
last_update2016-06-02 16:08:54
depth1
children1
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length162
author_reputation141,171,499,037,785
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id21,743
net_rshares58,876,081,446
author_curate_reward""
vote details (3)
@abit ·
$34.96
Better if the link is included in OP. Not too easy to find it because it's posted by another account.
👍  ,
properties (23)
authorabit
permlinkre-abit-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t161050358z
categorysteem
json_metadata{"tags":["steem"]}
created2016-06-02 16:10:48
last_update2016-06-02 16:10:48
depth2
children0
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value17.482 HBD
curator_payout_value17.481 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length101
author_reputation141,171,499,037,785
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id21,745
net_rshares19,016,652,422,100
author_curate_reward""
vote details (2)
@cyrano.witness ·
> With the advent of advanced AI algorithms it is clear that computer models can provide high quality estimates of the value of a post and do so faster than any human could. 
> Assuming we have the right incentives, the participation of bots is a good thing. 

The problem with AI bots is that you don't know what they'll learn. Remember the Microsoft chatbot that turned into a Nazi within a couple of days?
Voting bots would learn to vote for posts with high rewards, which could mean posts for which many bots vote - not necessarily posts with good content.
👍  
properties (23)
authorcyrano.witness
permlinkre-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t184137213z
categorysteem
json_metadata{"tags":["steem"]}
created2016-06-02 18:41:36
last_update2016-06-02 18:41:36
depth1
children3
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length560
author_reputation4,484,166,969,124
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id21,881
net_rshares12,229,130,044
author_curate_reward""
vote details (1)
@cryptogee ·
Ha, I just Googled 
[Microsoft Nazi AI](http://www.telegraph.co.uk/technology/2016/03/24/microsofts-teen-girl-ai-turns-into-a-hitler-loving-sex-robot-wit/); pure class :)
properties (22)
authorcryptogee
permlinkre-cyranowitness-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t222158538z
categorysteem
json_metadata{"tags":["steem"],"links":["http://www.telegraph.co.uk/technology/2016/03/24/microsofts-teen-girl-ai-turns-into-a-hitler-loving-sex-robot-wit/"]}
created2016-06-02 22:22:12
last_update2016-06-02 22:22:12
depth2
children0
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length170
author_reputation419,387,439,147,428
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id21,979
net_rshares0
@dantheman ·
This is exactly the challenge we face. When we reward voting with a share in the result, voters will start predicting voters in a circular prediction. With enough "predictable agents" in the system the outcome is everyone votes on one thing.
👍  
properties (23)
authordantheman
permlinkre-cyranowitness-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t185451584z
categorysteem
json_metadata{"tags":["steem"]}
created2016-06-02 18:54:51
last_update2016-06-02 18:54:51
depth2
children0
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length241
author_reputation240,292,002,602,347
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id21,894
net_rshares11,632,587,115
author_curate_reward""
vote details (1)
@liondani ·
NSFW content for example
properties (22)
authorliondani
permlinkre-cyranowitness-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t193544288z
categorysteem
json_metadata{"tags":["steem"]}
created2016-06-02 19:35:45
last_update2016-06-02 19:35:45
depth2
children0
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length24
author_reputation95,095,146,236,111
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id21,920
net_rshares0
@pal ·
I was thinking about different bot strategies and how they could impact steem.  There could be such variety of successful algorithms that will be hard to make blockchain AI to adapt quickly to all of them.

Here my example:
https://steemit.com/steem/@pal/sniper-whale-vote-bot-strategy
👍  ,
properties (23)
authorpal
permlinkre-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t154505475z
categorysteem
json_metadata{"tags":["steem"]}
created2016-06-02 15:45:06
last_update2016-06-02 15:45:06
depth1
children0
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length285
author_reputation12,055,554,235,183
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id21,734
net_rshares235,566,594,087
author_curate_reward""
vote details (2)
@smooth ·
I downvoted the post not because I disagree with the post or think it is not a quality post but because I do not think that the interests of Steem are served by every platform or devteam update or request for community feedback pulling thousands of dollars from the reward pools that go to ordinary users. The reward consensus algorithm also disproportionately rewards these posts since they are the only thing that 100% of Steem users have in common (aside from being human, etc.).
properties (22)
authorsmooth
permlinkre-dantheman-lessons-learned-from-curation-rewards-discussion-20160617t031147400z
categorysteem
json_metadata{"tags":["steem"]}
created2016-06-17 03:11:48
last_update2016-06-17 03:11:48
depth1
children0
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length482
author_reputation253,602,537,834,068
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id34,871
net_rshares0
@steemship ·
Good recap of the discussion and food for thought. I especially like the honesty of concluding that the voting algos will need constant revision and refinement. So true.
👍  
properties (23)
authorsteemship
permlinkre-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t212117886z
categorysteem
json_metadata{"tags":["steem"]}
created2016-06-02 21:21:18
last_update2016-06-02 21:21:18
depth1
children1
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length169
author_reputation70,083,642,919,654
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id21,957
net_rshares12,229,130,044
author_curate_reward""
vote details (1)
@liondani ·
>  everything flows and nothing stands still, everything gives way and nothing stands still 

(Heraclitus via Plato, "Cratylus" 402a)
properties (22)
authorliondani
permlinkre-steemship-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t215738068z
categorysteem
json_metadata{"tags":["steem"]}
created2016-06-02 21:57:36
last_update2016-06-02 21:57:36
depth2
children0
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length133
author_reputation95,095,146,236,111
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id21,969
net_rshares0
@treeleaves ·
Some amazing ideas.
properties (22)
authortreeleaves
permlinkre-dantheman-lessons-learned-from-curation-rewards-discussion-20160608t171133287z
categorysteem
json_metadata{"tags":["steem"]}
created2016-06-08 17:11:33
last_update2016-06-08 17:11:33
depth1
children0
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length19
author_reputation3,845,241,917,953
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id26,326
net_rshares0
@tuck-fheman ·
> 6. Designing a Better System

![](http://s20.postimg.org/3tp07aknx/steem_ripple50x50.gif)

> A token amount should be rewarded to those who vote. To maximize the perceived value of voting, the rewards may have to be in the form of raffle tickets. Most voters get nothing, but all voters get a chance to win $1000!

![](http://s20.postimg.org/3tp07aknx/steem_ripple50x50.gif)

Excellent idea! :)

https://steemit.com/games/@tuck-fheman/upvote-this-post-and-earn-an-equal-amount-of-the-rewards-from-this-post
👍  
properties (23)
authortuck-fheman
permlinkre-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t150802763z
categorysteem
json_metadata{"tags":["steem"],"image":["http://s20.postimg.org/3tp07aknx/steem_ripple50x50.gif"]}
created2016-06-02 15:08:06
last_update2016-06-02 15:08:06
depth1
children7
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length508
author_reputation345,778,813,561,569
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id21,705
net_rshares5,795,039,466
author_curate_reward""
vote details (1)
@ned ·
$1.49
>but all voters get a chance to win $1000!

Even with the randomness involved, I believe the payout would still need stake weighted .. otherwise .. sybil attack from bots that predict the payout.
👍  
properties (23)
authorned
permlinkre-tuck-fheman-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t154408181z
categorysteem
json_metadata{"tags":["steem"]}
created2016-06-02 15:44:06
last_update2016-06-02 15:44:06
depth2
children1
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.746 HBD
curator_payout_value0.746 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length195
author_reputation94,449,026,656,258
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id21,733
net_rshares2,764,472,587,734
author_curate_reward""
vote details (1)
@arhag ·
Yes, I agree. But no need to make it superlinear, please!
properties (22)
authorarhag
permlinkre-ned-re-tuck-fheman-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t155138291z
categorysteem
json_metadata{"tags":["steem"]}
created2016-06-02 15:51:36
last_update2016-06-02 15:51:36
depth3
children0
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length57
author_reputation52,490,827,205,383
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id21,737
net_rshares0
@streemian ·
This bot detected images from a legacy source and decided autonomously
to upload them to the InterPlanetary FileSystem (IPFS)! The upload was
successfull and the pictures can be found here:

```
orig: http://s20.postimg.org/3tp07aknx/steem_ripple50x50.gif
desc: 
hash: QmY8KBqKUfik8hsDRoWsYf9wevs3HcAPRY4SfSDFgBNxLL/steem_ripple50x50.gif
```

```
orig: http://s20.postimg.org/3tp07aknx/steem_ripple50x50.gif
desc: 
hash: QmPdKa6CkBQ9BEQSxHWU1yCcSVGrYdZAVyoP18rxtKdChb/steem_ripple50x50.gif
```
👎  
properties (23)
authorstreemian
permlinkre-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t150802763z-20160602t150813
categorysteem
json_metadata""
created2016-06-02 15:08:12
last_update2016-06-02 15:08:12
depth2
children4
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length495
author_reputation6,578,969,489,361
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id21,706
net_rshares-464,770,269
author_curate_reward""
vote details (1)
@dantheman ·
Your bot needs to de-duplicate.
👍  
properties (23)
authordantheman
permlinkre-streemian-re-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t150813-20160602t153409123z
categorysteem
json_metadata{"tags":["steem"]}
created2016-06-02 15:34:09
last_update2016-06-02 15:34:09
depth3
children1
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length31
author_reputation240,292,002,602,347
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id21,726
net_rshares11,334,315,650
author_curate_reward""
vote details (1)
@tuck-fheman ·
You think you've won streemian bot, but what you don't know is that I'm intentionally making you spam this place until everyone else get's annoyed with you too and the owner removes your posting ability or makes you post in your own damn topic! =b
properties (22)
authortuck-fheman
permlinkre-streemian-re-re-dantheman-lessons-learned-from-curation-rewards-discussion-20160602t150813-20160602t152350389z
categorysteem
json_metadata{"tags":["steem"]}
created2016-06-02 15:23:54
last_update2016-06-02 15:23:54
depth3
children1
last_payout2016-08-13 16:34:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length247
author_reputation345,778,813,561,569
root_title"Lessons Learned from Curation Rewards Discussion"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id21,719
net_rshares0