create account

Cut Algorithm for Bayesian Analysis (cn新人干货)贝叶斯分析中的修剪算法 by epi5tat

View this thread on: hive.blogpeakd.comecency.com
· @epi5tat ·
$2.39
Cut Algorithm for Bayesian Analysis (cn新人干货)贝叶斯分析中的修剪算法
I will briefly introduce the main idea of the cut algorithm for Bayesian analysis. It is part of my PhD notes, hope you enjoy!
这篇短文将简短的介绍贝叶斯分析中的修剪算法,是我PhD研究中的一些简要笔记,望点赞支持~

We know that Bayesian analysis is popular in modern statistical analysis because (1). it allows simultaneous incorporation of all relevant data. (2). it simultaneously deals with all uncertainties in a single big model. Bayesian model can be divided into some smaller sub-models and we call it modules. However, there is always case that we can not guaranty our assumption on each module is correct. The reliability of the whole model may be affected given some modules are not correctly specified. This motivates us to modularize the whole model and the cut algorithm is proposed to prevent good modules being contaminated by suspect modules. 
贝叶斯分析是统计学中一种非常流行的方法,因为它可以同步分析多个数据源,并且可以用一个大模型来同步考虑所有的不确定性。贝叶斯模型可以分解成许多个子模型。然而我们很难保证每一个子模型的统计假设都是正确的,模型整体的可靠性会因为部分子模型的错误假设而降低,修剪算法的目的就在于将这种错误假设导致的不良影响尽可能的局部化,以降低这些不良影响对整体模型的影响。

Consider this simplified example, we assume data Z depends on the parameter φ and data Y depends on both φ and θ, the joint distribution is:
考虑如下的例子,我们假设Z基于参数φ并且Y基于参数φ和θ,联合分布如下:
![](https://cdn.steemitimages.com/DQmTT5f8zETBvTboQ4v1mMSWWg95SmDsjdTPuzdAYazC4Mb/image.png)
![](https://cdn.steemitimages.com/DQmVQGV3eHYNQJGW68mHute5REUapNLmpmR1GkKHGzCoYjr/image.png)

We can write its posterior and we can see that the estimation of φ depends on both Z and Y. Imaging we are confident about the specification of Z but not Y.
我们可以写出它的后验分布并且我们可以看到对于参数φ的估计是基于数据Z和Y的。假设我们充分信任数据Z的统计假设但是不信任Y。
![](https://cdn.steemitimages.com/DQmTuZpq82ogLs6oAhBvSy33ujfuugtxy3Eqfbh6UK6h7RL/image.png)

The misspecification on Y may affect the estimation of φ, we modify the posterior to the cut distribution to cut this possible bad effect. So the only difference here is the estimation of φ no longer depends on Y.
对于数据Y的错误统计假设可能影响φ的估计,我们将原来的后验分布修改成新的修剪分布,这样可以将不良影响消除。修改后的修剪分布同原来的后验分布的唯一区别在于参数 φ的估计不再依赖于数据Y。
![](https://cdn.steemitimages.com/DQmc3K6zFmkKEB4TqMqRY1FG88xdqibfy1K2b4uZyof38Dc/image.png)

However, we have a problem if we use the naive cut algorithm to draw samples from the cut distribution. This algorithm uses two transition kernels to draw φ and θ separately.
然而,利用修剪算法来从修剪分布生成样本是有问题的。这个算法利用两个转移核函数来分别生成参数φ和θ的样本。
![](https://cdn.steemitimages.com/DQmdFT1aLBdy1jVfi243RypVFX7gB3Augd2TZqpJHmqGgBK/image.png)
![](https://cdn.steemitimages.com/DQmcJ5WFPobn7n2PNMb7K7AP97KAzBEDvZpeg3vGgoCmanU/image.png)

The previous study has pointed out that the Markov chain does not have the cut distribution as its stationary distribution. Instead, there is a weight function.
以前的研究指出这种生成样本的方法会导致生成的马氏链的稳态分布不是作为目标的修剪分布。相反,会产生一个额外的权函数。
![](https://cdn.steemitimages.com/DQmZP5jfVKQA243JB9ASpQVT7kdpEpjUwPaD9vuHRdZ9GwG/image.png)
![](https://cdn.steemitimages.com/DQmcNLJUVfPrhUh3HdKd3zH17G2wLERbWARUJqqmrt3kBTx/image.png)

I will introduce how to make this weight function be 1 in next post.
下一篇文章会介绍如何使这个多余的权函数变为1。

Reference:
参考文献:
Plummer, M. (2015). Cuts in Bayesian graphical models. Statistics and Computing, 25(1):37{43.

注:图片自制

---

#####  <sub> **Sponsored ( Powered by [dclick](https://www.dclick.io) )** </sub>
##### [[DCLICK HTML Ad] - Earn Steem from your blog or website!](https://api.dclick.io/v1/c?x=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJjIjoiZXBpNXRhdCIsInMiOiJjdXRhbGdvcml0aG0tZm9yLWJheWVzaWFuLWFuYWx5c2lzLWNuLTE1NTA4NzkyNjU4NjUiLCJhIjpbInQtMTQ4OCJdLCJ1cmwiOiJodHRwczovL3N0ZWVtaXQuY29tL0BkY2xpY2svZGNsaWNrLWh0bWwtYWQtZWFybi1zdGVlbS1mcm9tLXlvdXItYmxvZy1vci13ZWJzaXRlLTE1NTA2MTYyODM2MjEiLCJpYXQiOjE1NTA4NzkyNjUsImV4cCI6MTg2NjIzOTI2NX0.MFvvJqjo3fubTwFy2kFdL1-7E7rmrSwPsyz3W-NwuSk)
<sup>Hi Steemians. Today, I'd like to introduce you to th...</sup>
<br><center>![logo](https://steemitimages.com/200x100/https://cdn.steemitimages.com/DQmbjkrc5UT4GgZXygAnS3mLrboAy7Y8gr7R7guB8HG3f5n/logopad500.png)<br><br>This posting was written via <br>[dclick](https://www.dclick.io) the Ads platform based on Steem Blockchain.</center>
👍  , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , and 365 others
properties (23)
authorepi5tat
permlinkcutalgorithm-for-bayesian-analysis-cn-1550879265865
categorycn
json_metadata{"tags":["cn","cnstm","cn-curation","cn-stem","steemstem"],"app":"dclick.app","format":"markdown"}
created2019-02-22 23:47:48
last_update2019-02-22 23:47:48
depth0
children3
last_payout2019-03-01 23:47:48
cashout_time1969-12-31 23:59:59
total_payout_value1.827 HBD
curator_payout_value0.560 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length4,010
author_reputation197,660,352,685
root_title"Cut Algorithm for Bayesian Analysis (cn新人干货)贝叶斯分析中的修剪算法"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id80,262,170
net_rshares4,372,802,752,693
author_curate_reward""
vote details (429)
@arcange ·
Congratulations @epi5tat!
Your post was mentioned in the [Steem Hit Parade for newcomers](https://steemit.com/hit-parade/@arcange/daily-hit-parade-for-newcomers-20190222) in the following category:

* Upvotes - Ranked 8 with 409 upvotes

I also upvoted your post to increase its reward
If you like my work to promote newcomers and give them more visibility on the Steem blockchain, consider to [vote for my witness](https://steemit.com/~witnesses)!
properties (22)
authorarcange
permlinkre-cutalgorithm-for-bayesian-analysis-cn-1550879265865-20190222t170832000z
categorycn
json_metadata""
created2019-02-23 16:11:00
last_update2019-02-23 16:11:00
depth1
children0
last_payout2019-03-02 16:11:00
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length448
author_reputation1,146,611,356,767,317
root_title"Cut Algorithm for Bayesian Analysis (cn新人干货)贝叶斯分析中的修剪算法"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id80,290,204
net_rshares0
@steemitboard ·
Congratulations @epi5tat! You have completed the following achievement on the Steem blockchain and have been rewarded with new badge(s) :

<table><tr><td>https://steemitimages.com/60x70/http://steemitboard.com/@epi5tat/voted.png?201902230742</td><td>You received more than 500 upvotes. Your next target is to reach 1000 upvotes.</td></tr>
</table>

<sub>_[Click here to view your Board](https://steemitboard.com/@epi5tat)_</sub>
<sub>_If you no longer want to receive notifications, reply to this comment with the word_ `STOP`</sub>



> Support [SteemitBoard's project](https://steemit.com/@steemitboard)! **[Vote for its witness](https://v2.steemconnect.com/sign/account-witness-vote?witness=steemitboard&approve=1)** and **get one more award**!
properties (22)
authorsteemitboard
permlinksteemitboard-notify-epi5tat-20190223t082835000z
categorycn
json_metadata{"image":["https://steemitboard.com/img/notify.png"]}
created2019-02-23 08:28:33
last_update2019-02-23 08:28:33
depth1
children0
last_payout2019-03-02 08:28:33
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length747
author_reputation38,975,615,169,260
root_title"Cut Algorithm for Bayesian Analysis (cn新人干货)贝叶斯分析中的修剪算法"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id80,275,624
net_rshares0
@steemstem ·
$0.45
re-epi5tat-cutalgorithm-for-bayesian-analysis-cn-1550879265865-20190223t054059967z
<div class='text-justify'> <div class='pull-left'> <br /> <center> <img width='125' src='https://i.postimg.cc/9FwhnG3w/steemstem_curie.png'> </center>  <br/> </div> <br /> <br /> 

 This post has been voted on by the **SteemSTEM** curation team and voting trail in collaboration with **@curie**. <br /> 
 If you appreciate the work we are doing then consider [voting](https://www.steemit.com/~witnesses) both projects for witness by selecting [**stem.witness**](https://steemconnect.com/sign/account_witness_vote?approve=1&witness=stem.witness) and [**curie**](https://steemconnect.com/sign/account_witness_vote?approve=1&witness=curie)! <br /> 
For additional information please join us on the [**SteemSTEM discord**]( https://discord.gg/BPARaqn) and to get to know the rest of the community! </div>
👍  , , , , ,
properties (23)
authorsteemstem
permlinkre-epi5tat-cutalgorithm-for-bayesian-analysis-cn-1550879265865-20190223t054059967z
categorycn
json_metadata{"app":"bloguable-bot"}
created2019-02-23 05:41:03
last_update2019-02-23 05:41:03
depth1
children0
last_payout2019-03-02 05:41:03
cashout_time1969-12-31 23:59:59
total_payout_value0.336 HBD
curator_payout_value0.110 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length800
author_reputation262,017,435,115,313
root_title"Cut Algorithm for Bayesian Analysis (cn新人干货)贝叶斯分析中的修剪算法"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id80,271,435
net_rshares755,916,630,618
author_curate_reward""
vote details (6)