create account

RE: AI learns to play Flappy Bird - the impact of machine learning on Steem Blockchain by a-non-e-moose

View this thread on: hive.blogpeakd.comecency.com

Viewing a response to: @neavvy/re-a-non-e-moose-re-neavvy-ai-learns-to-play-flappy-bird-the-impact-of-machine-learning-on-steem-blockchain-20190318t220512078z

· @a-non-e-moose ·
$0.06
You needn't start with the very basics of neural network with me, but I couldn't expect you to guess what I'm already familiar with.

I've actually written a C++ class to implement feed forward artificial neural networks with arbitrarily many input nodes, hidden layers, and output nodes. I understand in general the meaning and purpose of the network's inputs and it's operation.

My questions in a more technically refined articulation are as follows.

what type of function is f(x,y)? I presuppose it's a multiplication, but I see no bias in your perceptron. Is it a sigmoid function, a heaviside step function or something else entirely? Is the output a boolean? I don't imagine you use back-propagation to train this simple of a network, so how was the activation function modified? Perhaps it was reinforcement training, but the concurrent multiple trials suggest to me that it may be an evolutionary algorithm.

No need to respond here, especially if your upcoming article will address all these questions. I can wait for that. I just thought a more detailed set of questions may lend itself more easily to being concisely answered.

If you feel so inclined to answer, of course.
👍  ,
properties (23)
authora-non-e-moose
permlinkre-neavvy-re-a-non-e-moose-re-neavvy-ai-learns-to-play-flappy-bird-the-impact-of-machine-learning-on-steem-blockchain-20190320t174456541z
categorysteemstem
json_metadata{"tags":["steemstem"],"app":"steemit/0.1"}
created2019-03-20 17:44:57
last_update2019-03-20 17:44:57
depth3
children5
last_payout2019-03-27 17:44:57
cashout_time1969-12-31 23:59:59
total_payout_value0.046 HBD
curator_payout_value0.014 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length1,186
author_reputation2,521,005,983,051
root_title"AI learns to play Flappy Bird - the impact of machine learning on Steem Blockchain"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id81,632,777
net_rshares93,902,172,996
author_curate_reward""
vote details (2)
@crypto.piotr ·
Dear @a-non-e-moose

I just "spoke" to @neavvy (as we already got to know each other in real life and I really adore this boy) and he pointed out that your knowledge is mindblowing. And he surely had a point :)

Amazing comment!

ps.
I noticed you don't have much SP. Would you like me to support you with small 40sp delegation? It would allow you to stay a bit more active without reaching resource credit limits.

Cheers
Piotr
👍  
properties (23)
authorcrypto.piotr
permlinkre-a-non-e-moose-re-neavvy-re-a-non-e-moose-re-neavvy-ai-learns-to-play-flappy-bird-the-impact-of-machine-learning-on-steem-blockchain-20190320t220918793z
categorysteemstem
json_metadata{"tags":["steemstem"],"users":["a-non-e-moose","neavvy"],"app":"steemit/0.1"}
created2019-03-20 22:09:15
last_update2019-03-20 22:09:15
depth4
children3
last_payout2019-03-27 22:09:15
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length428
author_reputation27,396,789,428,606
root_title"AI learns to play Flappy Bird - the impact of machine learning on Steem Blockchain"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd0
post_id81,642,267
net_rshares2,289,941,516
author_curate_reward""
vote details (1)
@a-non-e-moose ·
$0.02
I'm going to have to decline this. It'll be my second denial and if I accepted it would be my second delegation from you :)

Seems like you haven't got around to reading most of the comment's I've recently left you.
👍  
properties (23)
authora-non-e-moose
permlinkre-cryptopiotr-re-a-non-e-moose-re-neavvy-re-a-non-e-moose-re-neavvy-ai-learns-to-play-flappy-bird-the-impact-of-machine-learning-on-steem-blockchain-20190320t223527112z
categorysteemstem
json_metadata{"tags":["steemstem"],"app":"steemit/0.1"}
created2019-03-20 22:35:27
last_update2019-03-20 22:35:27
depth5
children2
last_payout2019-03-27 22:35:27
cashout_time1969-12-31 23:59:59
total_payout_value0.014 HBD
curator_payout_value0.004 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length215
author_reputation2,521,005,983,051
root_title"AI learns to play Flappy Bird - the impact of machine learning on Steem Blockchain"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id81,643,170
net_rshares30,885,340,680
author_curate_reward""
vote details (1)
@crypto.piotr · (edited)
Dear @a-non-e-moose

> Seems like you haven't got around to reading most of the comment's I've recently left you.

I'm doing my best but past few days has been just crazy and I'm only catching up with Steemit now.

> I'm going to have to decline this

Why are you declining my little support? Bububu

Don't be surprised if I will offer delegation again some time in the future :)

Yours
Piotr
👍  ,
properties (23)
authorcrypto.piotr
permlinkre-a-non-e-moose-re-cryptopiotr-re-a-non-e-moose-re-neavvy-re-a-non-e-moose-re-neavvy-ai-learns-to-play-flappy-bird-the-impact-of-machine-learning-on-steem-blockchain-20190322t144740964z
categorysteemstem
json_metadata{"tags":["steemstem"],"users":["a-non-e-moose"],"app":"steemit/0.1"}
created2019-03-22 14:47:36
last_update2019-03-22 14:48:03
depth6
children1
last_payout2019-03-29 14:47:36
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length392
author_reputation27,396,789,428,606
root_title"AI learns to play Flappy Bird - the impact of machine learning on Steem Blockchain"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd0
post_id81,738,969
net_rshares5,905,666,708
author_curate_reward""
vote details (2)
@neavvy ·
Thank you for your reply @a-non-e-moose. Appreciate that.

> what type of function is f(x,y)? I presuppose it's a multiplication, but I see no bias in your perceptron.

I decided not to include bias on my simple scheme, as it would most probably confuse many readers of this article. In fact you guessed, the third input of my function is bias.

> Is it a sigmoid function, a heaviside step function or something else entirely? Is the output a boolean? I don't imagine you use back-propagation to train this simple of a network, so how was the activation function modified?

Well, using all of those sophisticated methods would be indeed clueless for such non complicated model. So I decided to use simple multiplication algorithm. Output is boolean (true makes the bird jump, false makes the bird continue falling) and the activation function is pretty simple: if the sum of inputs multiplied by their weights is positive output is true, otherwise it is false.

> Perhaps it was reinforcement training, but the concurrent multiple trials suggest to me that it may be an evolutionary algorithm.

The training was reinforcement. I decided to use a bigger number of birds in order to increase the probability of training a perfect player faster. But all of those birds were completely independent.

> No need to respond here, especially if your upcoming article will address all these questions. I can wait for that. I just thought a more detailed set of questions may lend itself more easily to being concisely answered.

I am always happy to respond :) Especially as you seem to share very similar passions with me.
👍  
properties (23)
authorneavvy
permlinkre-a-non-e-moose-re-neavvy-re-a-non-e-moose-re-neavvy-ai-learns-to-play-flappy-bird-the-impact-of-machine-learning-on-steem-blockchain-20190322t204209914z
categorysteemstem
json_metadata{"tags":["steemstem"],"users":["a-non-e-moose"],"app":"steemit/0.1"}
created2019-03-22 20:42:09
last_update2019-03-22 20:42:09
depth4
children0
last_payout2019-03-29 20:42:09
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length1,615
author_reputation7,152,069,083,132
root_title"AI learns to play Flappy Bird - the impact of machine learning on Steem Blockchain"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id81,756,673
net_rshares1,856,469,352
author_curate_reward""
vote details (1)