RE: Duplicate account history entries on STEEM: How to detect and fix them by themarkymark

View this thread on: hive.blog | peakd.com | ecency.com

Viewing a response to: @holger80/duplicate-account-history-entries-on-steem-how-to-detect-and-fix-them

bug · @themarkymark · Jul 30 '20

$0.07

I spoke to you and roadscape about this a long time ago, it was a change in how RocksDB handles things and there can be duplicate entries and you have to check if the IDs are the same.  I am surprised it does not happen on Hive as I didn't hear of a fix.

I had missing Json entries issue as well.

👍 holger80, sultan-indo
👎 r351574nc3, salty-mcgriddles, dein-problem

`author`	themarkymark
`permlink`	re-holger80-qe9eez
`category`	bug
`json_metadata`	{"tags":["bug"],"app":"peakd/2020.07.2"}
`created`	2020-07-30 01:49:48
`last_update`	2020-07-30 01:49:48
`depth`	1
`children`	3
`last_payout`	2020-08-06 01:49:48
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.036 HBD
`curator_payout_value`	0.036 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	297
`author_reputation`	1,786,247,900,680,379
`root_title`	"Duplicate account history entries on STEEM: How to detect and fix them"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	98,791,623
`net_rshares`	334,527,284,112
`author_curate_reward`	""

properties (23)vote details (5)

voter	rshares	pct
r351574nc3	-94,564,767,693	-100%
holger80	440,038,752,380	10%
salty-mcgriddles	-14,303,941,488	-100%
dein-problem	0	-0.1%
sultan-indo	3,357,240,913	100%

@holger80 · Jul 30 '20 (edited)

$0.02

I run the script on your account and found 3 duplicate entries:
```

{'producer': 'themarkymark', 'vesting_shares': {'amount': '487047858', 'precision': 6, 'nai': '@@000000037'}, 'trx_id': '0000000000000000000000000000000000000000', 'block': 42304342, 'trx_in_block': 4294967295, 'op_in_trx': 0, 'virtual_op': 1, 'timestamp': '2020-04-06T13:01:27', 'account': 'themarkymark', 'type': 'producer_reward', '_id': '5efd96c86758e62daab6251b4fd40e286ab6f3c2', 'index': 2411563}
{'producer': 'themarkymark', 'vesting_shares': {'amount': '487047842', 'precision': 6, 'nai': '@@000000037'}, 'trx_id': '0000000000000000000000000000000000000000', 'block': 42304354, 'trx_in_block': 4294967295, 'op_in_trx': 0, 'virtual_op': 1, 'timestamp': '2020-04-06T13:02:03', 'account': 'themarkymark', 'type': 'producer_reward', '_id': 'fa4ff605eaec77ec4949b475fba30f5372c70d69', 'index': 2411564}
{'producer': 'themarkymark', 'vesting_shares': {'amount': '487047858', 'precision': 6, 'nai': '@@000000037'}, 'trx_id': '0000000000000000000000000000000000000000', 'block': 42304342, 'trx_in_block': 4294967295, 'op_in_trx': 0, 'virtual_op': 1, 'timestamp': '2020-04-06T13:01:27', 'account': 'themarkymark', 'type': 'producer_reward', '_id': '5efd96c86758e62daab6251b4fd40e286ab6f3c2', 'index': 2411565}
{'producer': 'themarkymark', 'vesting_shares': {'amount': '487047842', 'precision': 6, 'nai': '@@000000037'}, 'trx_id': '0000000000000000000000000000000000000000', 'block': 42304354, 'trx_in_block': 4294967295, 'op_in_trx': 0, 'virtual_op': 1, 'timestamp': '2020-04-06T13:02:03', 'account': 'themarkymark', 'type': 'producer_reward', '_id': 'fa4ff605eaec77ec4949b475fba30f5372c70d69', 'index': 2411566}
{'producer': 'themarkymark', 'vesting_shares': {'amount': '476907066', 'precision': 6, 'nai': '@@000000037'}, 'trx_id': '0000000000000000000000000000000000000000', 'block': 45322425, 'trx_in_block': 4294967295, 'op_in_trx': 0, 'virtual_op': 1, 'timestamp': '2020-07-20T15:27:15', 'account': 'themarkymark', 'type': 'producer_reward', '_id': 'a4409a3b8798fef22a0b3831e0be451433976298', 'index': 2637227}
{'producer': 'themarkymark', 'vesting_shares': {'amount': '476907066', 'precision': 6, 'nai': '@@000000037'}, 'trx_id': '0000000000000000000000000000000000000000', 'block': 45322425, 'trx_in_block': 4294967295, 'op_in_trx': 0, 'virtual_op': 1, 'timestamp': '2020-07-20T15:27:15', 'account': 'themarkymark', 'type': 'producer_reward', '_id': 'a4409a3b8798fef22a0b3831e0be451433976298', 'index': 2637228}
```
There are not in order. As only one producer_reward is possible per block, these 6 entries are only 3 valid ones.
The duplicate entries can also check directly on the API:
```
curl -s --data '{"jsonrpc":"2.0", "method":"account_history_api.get_account_history", "params":{"account":"themarkymark", "start":2411566, "limit":3}, "id":1}' https://api.hive.blog
```

👍 dustsweeper, anli, andrepol, holycow2019, re2pair

`author`	holger80
`permlink`	re-themarkymark-qe9trc
`category`	bug
`json_metadata`	{"tags":["bug"],"app":"peakd/2020.07.2"}
`created`	2020-07-30 07:21:15
`last_update`	2020-07-30 07:30:06
`depth`	2
`children`	0
`last_payout`	2020-08-06 07:21:15
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.012 HBD
`curator_payout_value`	0.012 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	2,852
`author_reputation`	358,857,509,568,825
`root_title`	"Duplicate account history entries on STEEM: How to detect and fix them"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	98,795,084
`net_rshares`	119,359,292,687
`author_curate_reward`	""

properties (23)vote details (5)

voter	rshares	pct
anli	6,413,695,490	99%
andrepol	5,381,350,145	99%
dustsweeper	107,045,650,302	10.53%
holycow2019	277,293,153	100%
re2pair	241,303,597	100%

@mintrawa · Jul 30 '20

Does using or not using MIRA change anything about this problem?

<hr>
<sub>

[Witness FR - Gen X - Geek 🤓 Gamer 🎮 Traveler ⛩️](/@mintrawa/introducing-a-gen-x-geek-gamer-traveler-witness)

</sub>

properties (22)

`author`	mintrawa
`permlink`	re-themarkymark-qe9g9n
`category`	bug
`json_metadata`	{"tags":["bug"],"app":"peakd/2020.07.2"}
`created`	2020-07-30 02:29:48
`last_update`	2020-07-30 02:29:48
`depth`	2
`children`	1
`last_payout`	2020-08-06 02:29:48
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	195
`author_reputation`	18,694,802,429,423
`root_title`	"Duplicate account history entries on STEEM: How to detect and fix them"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	98,792,077
`net_rshares`	0

@luext · Jul 30 '20

Hi @mintrawa. Please be aware the you have commented on a post (or comment) from themarkymark.The user have been kicked off other social media platforms and is harassing other users by continually downvoting them. The user also control and use the buildawhale account (An old voting bot) for this and are controlling several self controlled and doubtable blacklists.
<center>We strongly recommend not to upvote and comment this user</center><center>Doing so will post you on our blacklist</center>

properties (22)

`author`	luext
`permlink`	20200730t022956630z
`category`	bug
`json_metadata`	{"tags":["comment"],"app":"peakd/2020.07.1"}
`created`	2020-07-30 02:29:57
`last_update`	2020-07-30 02:29:57
`depth`	3
`children`	0
`last_payout`	2020-08-06 02:29:57
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	498
`author_reputation`	-776,273,771,260
`root_title`	"Duplicate account history entries on STEEM: How to detect and fix them"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	98,792,081
`net_rshares`	0