#### Previously, [I posted a script](https://steemit.com/radiator/@inertia/how-to-use-ai-to-find-articles-with-ruby) that claims to predict new post payouts based on trending posts. To re-cap, we're using ID3 to correlate certain fields in the post *without* considering the name of the author. #### I did this report manually. If it performs well, it might be interesting to do it automatically each day. Anyway, let's see how it did this time ...  --- Here's the output from Sunday, January 20th, 2017 at about 7:27 PM (UTC): ```bash $ ruby ai-scan.rb ``` ``` Predicting the following payouts will rise by: 16 SBD: https://steemit.com/aceh/@keuudeip/they-sold-this-handmade-in-their-traditional-market-a-vote-for-cultural-diversity 16 SBD: https://steemit.com/steemitphotochallenge/@knight-angel/steemitphotochallenge-25-entry-no2-plasticine-rock 16 SBD: https://steemit.com/openmic/@ken-and-jane/open-mic-night-week-15-come-in-from-the-cold-an-original-song-by-ken-and-jane 16 SBD: https://steemit.com/steemitphotochallenge/@dreamstream/more-of-the-blues-steemitphotochallenge-entry 17 SBD: https://steemit.com/film/@jackmanmania/banking-on-bitcoin-2016-film-review 17 SBD: https://steemit.com/photography/@dejoelblog/monument-general-strike-in-yogyakarta-1-march-1949 17 SBD: https://steemit.com/til/@transhuman/til-of-tommy-emmanuel 17 SBD: https://steemit.com/animal/@barvon/golden-frog 17 SBD: https://steemit.com/photography/@dman57/notocactus-otto-blossomed 17 SBD: https://steemit.com/cosplay/@gnumix/cosplay-wars-marvel-vs-dc 17 SBD: https://steemit.com/fiction/@johnjgeddes/tempest-and-tea-spells-and-magic-and-simple-attraction-conclusion 17 SBD: https://steemit.com/anarchy/@ericwilson/anarchy-is-everywhere-2017115t13242651z 17 SBD: https://steemit.com/nature/@tangmo/beautiful-flowers-strange-trees-and-dog-gangs-in-the-garden 17 SBD: https://steemit.com/art/@alexeymohov/butterfly 17 SBD: https://steemit.com/photography/@foreman/green-leaf-sprinkled-with-snow 20 SBD: https://steemit.com/poker/@tuck-fheman/poker-what-am-i-holding-aka-guess-my-hand ``` All of the above posts had a pending payout of less than a dollar when I ran the script. They all had at least 23 hours left for the first payout. So, what we're looking for is the resulting payout for these posts, once they get to that point. How close does my script get to those numbers? | Actual Change | URL | |-|-| | 5 SBD | https://steemit.com/aceh/@keuudeip/they-sold-this-handmade-in-their-traditional-market-a-vote-for-cultural-diversity | | 0 SBD | https://steemit.com/steemitphotochallenge/@knight-angel/steemitphotochallenge-25-entry-no2-plasticine-rock | | 14 SBD | https://steemit.com/openmic/@ken-and-jane/open-mic-night-week-15-come-in-from-the-cold-an-original-song-by-ken-and-jane | | 6 SBD | https://steemit.com/steemitphotochallenge/@dreamstream/more-of-the-blues-steemitphotochallenge-entry | | 16 SBD | https://steemit.com/film/@jackmanmania/banking-on-bitcoin-2016-film-review | | 0 SBD | https://steemit.com/photography/@dejoelblog/monument-general-strike-in-yogyakarta-1-march-1949 | | 0 SBD | https://steemit.com/til/@transhuman/til-of-tommy-emmanuel | | 0 SBD | https://steemit.com/animal/@barvon/golden-frog | | 0 SBD | https://steemit.com/photography/@dman57/notocactus-otto-blossomed | | 0 SBD | https://steemit.com/cosplay/@gnumix/cosplay-wars-marvel-vs-dc | | 6 SBD | https://steemit.com/fiction/@johnjgeddes/tempest-and-tea-spells-and-magic-and-simple-attraction-conclusion | | 0 SBD | https://steemit.com/anarchy/@ericwilson/anarchy-is-everywhere-2017115t13242651z | | 0 SBD | https://steemit.com/nature/@tangmo/beautiful-flowers-strange-trees-and-dog-gangs-in-the-garden | | 0 SBD | https://steemit.com/art/@alexeymohov/butterfly | | 0 SBD | https://steemit.com/photography/@foreman/green-leaf-sprinkled-with-snow | | 2 SBD | https://steemit.com/poker/@tuck-fheman/poker-what-am-i-holding-aka-guess-my-hand | To actually claim a prediction as accurate, the post has to make at least as much as predicted. None of them exceeded the prediction. If we cherry-pick the results, the ones that got non-zero payouts had pretty decent curation because my votes were *after* 30 minutes but *before* many high stake votes. Not quite perfect, because the almost optimized curation is also within the first 10 votes cast. --- The above test did not segment based on tag. For the next test, I narrowed to the `photography` tag: ``` Predicting the following payouts will rise by: 0 SBD: https://steemit.com/life/@gardenofeden/full-moon-community-gathering-photo-album-from-the-dhyana-yoga-center-please-join-us-at-the-next-event-on-january-28th 0 SBD: https://steemit.com/photography/@ejhaasteem/devil-horns-on-small-creatures 0 SBD: https://steemit.com/art/@marius19/decoration-origami 0 SBD: https://steemit.com/aceh/@keuudeip/they-sold-this-handmade-in-their-traditional-market-a-vote-for-cultural-diversity 0 SBD: https://steemit.com/nature/@mynameisbrian/good-morning-agouti 0 SBD: https://steemit.com/photography/@fibra59/morning-fishing-greeting 0 SBD: https://steemit.com/photography/@abdullar/flowers-at-night-photos 0 SBD: https://steemit.com/photography/@foreman/green-leaf-sprinkled-with-snow 3 SBD: https://steemit.com/steemitphotochallenge/@germanaure/steemitphotochallenge-25-entry-2-me-and-my-problems 4 SBD: https://steemit.com/steemitphotochallenge/@knight-angel/steemitphotochallenge-25-entry-no2-plasticine-rock 16 SBD: https://steemit.com/photography/@dman57/notocactus-otto-blossomed 16 SBD: https://steemit.com/photography/@xntryk1/swapmeet-finds-644 17 SBD: https://steemit.com/photography/@julia-steemit/rainbow-bright 17 SBD: https://steemit.com/steemitphotochallenge/@roma-nt/steemitphotochallenge-25-balalaika 17 SBD: https://steemit.com/photography/@apolymask/i-finally-got-to-100-subscribers-on-youtube 17 SBD: https://steemit.com/funny/@singapasee/the-grasshopper-stories-2017116t2953477z 17 SBD: https://steemit.com/food/@abudar/delights-and-benefits-of-snail-dongdong 17 SBD: https://steemit.com/photography/@dman57/icicles 19 SBD: https://steemit.com/photography/@kalemandra/purrfect-colorsplash-cat-eyes ``` The above results were a little less uniform than the tag indifferent result. They initially ranged from less than a dollar to $15. Their timeframes were also less uniform, ranging 23 hours left to only 16 hours left. This makes sense because tag indifferent results track more activity and more of a timeframe is included here. | Actual Change | URL | |-|-| | 20 SBD | https://steemit.com/life/@gardenofeden/full-moon-community-gathering-photo-album-from-the-dhyana-yoga-center-please-join-us-at-the-next-event-on-january-28th | | 24 SBD | https://steemit.com/photography/@ejhaasteem/devil-horns-on-small-creatures | | 0 SBD | https://steemit.com/art/@marius19/decoration-origami | | 5 SBD | https://steemit.com/aceh/@keuudeip/they-sold-this-handmade-in-their-traditional-market-a-vote-for-cultural-diversity | | 9 SBD | https://steemit.com/nature/@mynameisbrian/good-morning-agouti | | 0 SBD | https://steemit.com/photography/@fibra59/morning-fishing-greeting | | 0 SBD | https://steemit.com/photography/@abdullar/flowers-at-night-photos | | 0 SBD | https://steemit.com/photography/@foreman/green-leaf-sprinkled-with-snow | | 0 SBD | https://steemit.com/steemitphotochallenge/@germanaure/steemitphotochallenge-25-entry-2-me-and-my-problems | | 0 SBD | https://steemit.com/steemitphotochallenge/@knight-angel/steemitphotochallenge-25-entry-no2-plasticine-rock | | 0 SBD | https://steemit.com/photography/@dman57/notocactus-otto-blossomed | | 0 SBD | https://steemit.com/photography/@xntryk1/swapmeet-finds-644 | | 0 SBD | https://steemit.com/photography/@julia-steemit/rainbow-bright | | 0 SBD | https://steemit.com/steemitphotochallenge/@roma-nt/steemitphotochallenge-25-balalaika | | 0 SBD | https://steemit.com/photography/@apolymask/i-finally-got-to-100-subscribers-on-youtube | | 0 SBD | https://steemit.com/funny/@singapasee/the-grasshopper-stories-2017116t2953477z | | 0 SBD | https://steemit.com/food/@abudar/delights-and-benefits-of-snail-dongdong | | 0 SBD | https://steemit.com/photography/@dman57/icicles | | 0 SBD | https://steemit.com/photography/@kalemandra/purrfect-colorsplash-cat-eyes | In terms of accuracy, 8 predictions out of 19 were correct. But while the ones that had a prediction of zero increased payout and these 8 were accurate by this criteria, it was a somewhat useless kind of accuracy. However, 4 of those 8 actually had a non-zero payout, so that's a success. It seems like using a tag for this script is indicated, so further testing should probably include a tag. --- #### Conclusion * *Is it just the same as luck or can ID3 actually predict the final payout?* - On its face, I think the results might be worse than luck. * *Do we consider zero payout as "accurate" when the prediction is zero like the four we see in the second sample?* - Actually, this is where the script seems to be better than chance, so our methodology might benefit from a few tweaks to improve this. * *Should we cherry-pick the initial prediction to only consider articles with 9 votes at 30 minutes?* - I think this should be explored. If these results are an indication, it seems like this analysis is more useful when we narrow the search by tag. Based on these results, I think it's worth continued tests.
author | inertia |
---|---|
permlink | performance-of-ai-scan-rb-round-1 |
category | radiator |
json_metadata | {"tags":["radiator","ruby","steem","howto","machinelearning"],"image":["http://www.publicdomainpictures.net/pictures/200000/velka/crystal-ball-14785249855CZ.jpg"],"links":["https://steemit.com/radiator/@inertia/how-to-use-ai-to-find-articles-with-ruby","https://steemit.com/aceh/@keuudeip/they-sold-this-handmade-in-their-traditional-market-a-vote-for-cultural-diversity","https://steemit.com/steemitphotochallenge/@knight-angel/steemitphotochallenge-25-entry-no2-plasticine-rock","https://steemit.com/openmic/@ken-and-jane/open-mic-night-week-15-come-in-from-the-cold-an-original-song-by-ken-and-jane","https://steemit.com/steemitphotochallenge/@dreamstream/more-of-the-blues-steemitphotochallenge-entry","https://steemit.com/film/@jackmanmania/banking-on-bitcoin-2016-film-review","https://steemit.com/photography/@dejoelblog/monument-general-strike-in-yogyakarta-1-march-1949","https://steemit.com/til/@transhuman/til-of-tommy-emmanuel","https://steemit.com/animal/@barvon/golden-frog","https://steemit.com/photography/@dman57/notocactus-otto-blossomed","https://steemit.com/cosplay/@gnumix/cosplay-wars-marvel-vs-dc","https://steemit.com/fiction/@johnjgeddes/tempest-and-tea-spells-and-magic-and-simple-attraction-conclusion","https://steemit.com/anarchy/@ericwilson/anarchy-is-everywhere-2017115t13242651z","https://steemit.com/nature/@tangmo/beautiful-flowers-strange-trees-and-dog-gangs-in-the-garden","https://steemit.com/art/@alexeymohov/butterfly","https://steemit.com/photography/@foreman/green-leaf-sprinkled-with-snow","https://steemit.com/poker/@tuck-fheman/poker-what-am-i-holding-aka-guess-my-hand","https://steemit.com/life/@gardenofeden/full-moon-community-gathering-photo-album-from-the-dhyana-yoga-center-please-join-us-at-the-next-event-on-january-28th","https://steemit.com/photography/@ejhaasteem/devil-horns-on-small-creatures","https://steemit.com/art/@marius19/decoration-origami","https://steemit.com/nature/@mynameisbrian/good-morning-agouti","https://steemit.com/photography/@fibra59/morning-fishing-greeting","https://steemit.com/photography/@abdullar/flowers-at-night-photos","https://steemit.com/steemitphotochallenge/@germanaure/steemitphotochallenge-25-entry-2-me-and-my-problems","https://steemit.com/photography/@xntryk1/swapmeet-finds-644","https://steemit.com/photography/@julia-steemit/rainbow-bright","https://steemit.com/steemitphotochallenge/@roma-nt/steemitphotochallenge-25-balalaika","https://steemit.com/photography/@apolymask/i-finally-got-to-100-subscribers-on-youtube","https://steemit.com/funny/@singapasee/the-grasshopper-stories-2017116t2953477z","https://steemit.com/food/@abudar/delights-and-benefits-of-snail-dongdong","https://steemit.com/photography/@dman57/icicles","https://steemit.com/photography/@kalemandra/purrfect-colorsplash-cat-eyes"],"app":"steemit/0.1","format":"markdown"} |
created | 2017-01-16 20:30:48 |
last_update | 2017-01-16 20:30:48 |
depth | 0 |
children | 0 |
last_payout | 2017-02-17 03:48:42 |
cashout_time | 1969-12-31 23:59:59 |
total_payout_value | 1.002 HBD |
curator_payout_value | 0.190 HBD |
pending_payout_value | 0.000 HBD |
promoted | 0.000 HBD |
body_length | 9,488 |
author_reputation | 346,568,901,399,561 |
root_title | "Performance of: ai-scan.rb (Round 1)" |
beneficiaries | [] |
max_accepted_payout | 1,000,000.000 HBD |
percent_hbd | 0 |
post_id | 2,263,915 |
net_rshares | 11,867,390,789,228 |
author_curate_reward | "" |
voter | weight | wgt% | rshares | pct | time |
---|---|---|---|---|---|
hr1 | 0 | 1,676,425,476,271 | 100% | ||
sandra | 0 | 69,092,775,348 | 100% | ||
complexring | 0 | 4,882,835,981,884 | 100% | ||
pheonike | 0 | 12,372,043,087 | 12% | ||
proctologic | 0 | 37,062,395,549 | 50% | ||
proctologic2 | 0 | 596,079,103 | 50% | ||
proctologic3 | 0 | 415,989,982 | 50% | ||
teamsteem | 0 | 442,222,836,272 | 100% | ||
murh | 0 | 1,270,349,010 | 13% | ||
dragonslayer109 | 0 | 235,779,923,502 | 100% | ||
thecryptofiend | 0 | 384,333,765,687 | 100% | ||
applecrisp | 0 | 997,131,075 | 20% | ||
juanmiguelsalas | 0 | 51,139,511,581 | 100% | ||
grandpere | 0 | 40,193,539,014 | 80% | ||
crok | 0 | 5,471,470,566 | 100% | ||
fyrstikken | 0 | 54,670,074,308 | 2% | ||
michaellamden68 | 0 | 2,032,738,279 | 100% | ||
thebatchman | 0 | 1,117,483,617 | 3% | ||
asmolokalo | 0 | 136,365,080,843 | 100% | ||
vi1son | 0 | 35,851,191,537 | 100% | ||
jesta | 0 | 1,675,871,501,253 | 100% | ||
thegoodguy | 0 | 5,215,693,911 | 100% | ||
speda | 0 | 243,867,849,880 | 100% | ||
gregm | 0 | 98,149,173,991 | 100% | ||
thebatchman1 | 0 | 69,191,084 | 3% | ||
inertia | 0 | 167,636,040,674 | 100% | ||
the-future | 0 | 25,200,675,806 | 100% | ||
celsius100 | 0 | 42,112,205,461 | 100% | ||
seb | 0 | 1,128,714,185 | 100% | ||
webdeals | 0 | 19,329,426,946 | 100% | ||
beanz | 0 | 49,415,101,438 | 100% | ||
alexpmorris | 0 | 7,558,079,398 | 100% | ||
jamesbrown | 0 | 205,782,177,539 | 100% | ||
sykochica | 0 | 41,052,446,215 | 100% | ||
felixxx | 0 | 64,598,407,030 | 100% | ||
transhuman | 0 | 1,910,583,384 | 44% | ||
thewhitewolf | 0 | 2,738,716,283 | 100% | ||
ioc | 0 | 661,855,274,872 | 100% | ||
virtualgrowth | 0 | 8,917,519,495 | 30% | ||
lamech-m | 0 | 4,502,517,573 | 100% | ||
jsantana | 0 | 14,133,358,191 | 50% | ||
sethlinson | 0 | 4,009,143,854 | 20% | ||
hilarski | 0 | 38,422,994,573 | 20% | ||
runridefly | 0 | 19,483,361,962 | 76% | ||
stephenkendal | 0 | 10,664,077,416 | 100% | ||
ivet | 0 | 12,580,806,513 | 50% | ||
titusfrost | 0 | 20,253,505,332 | 100% | ||
maarnio | 0 | 7,097,001,664 | 100% | ||
analyzethis | 0 | 50,970,277 | 100% | ||
roadhog | 0 | 50,751,176 | 100% | ||
doggnostic | 0 | 50,665,476 | 100% | ||
jsg | 0 | 51,268,453,596 | 100% | ||
jenny-talls | 0 | 50,403,638 | 100% | ||
post-successful | 0 | 50,210,467 | 100% | ||
bitcoinparadise | 0 | 11,105,555,046 | 100% | ||
pickoum | 0 | 21,980,543,855 | 100% | ||
thegame | 0 | 518,584,215 | 10% | ||
steembets | 0 | 526,437,615 | 10% | ||
dodders007 | 0 | 26,117,373,883 | 100% | ||
so-guitarist | 0 | 1,102,199,507 | 100% | ||
tomino | 0 | 137,147,863,462 | 100% | ||
steem-meme | 0 | 1,916,028,622 | 20% | ||
sunscape | 0 | 8,692,284,021 | 20% | ||
meanpeoplesuck | 0 | 139,723,141 | 100% | ||
steemspeak | 0 | 222,739,712 | 2% | ||
fyrst-witness | 0 | 329,459,660 | 2% | ||
lovethepeople | 0 | 67,882,339 | 50% | ||
vladtheimpaler | 0 | 3,129,724,264 | 100% | ||
steemland.com | 0 | 525,593,039 | 10% | ||
porco-bastardo | 0 | 65,962,544 | 50% | ||
angel76 | 0 | 13,715,431,736 | 100% | ||
crowdfundedwhale | 0 | 20,828,155,180 | 50% | ||
trans-juanmi | 0 | 5,792,615,236 | 60% | ||
jfesrom | 0 | 1,450,530,294 | 33% | ||
doodleman | 0 | 13,401,124,262 | 100% | ||
steemprentice | 0 | 16,931,880,676 | 30% | ||
reisman | 0 | 721,171,375 | 20% | ||
juliosalas | 0 | 798,569,761 | 60% | ||
timothyb | 0 | 2,581,641,200 | 100% | ||
tamersameeh | 0 | 394,392,131 | 100% | ||
inom | 0 | 1,614,133,813 | 100% | ||
ejemai | 0 | 250,351,571 | 100% | ||
thehulk | 0 | 0 | 100% |