Viewing a response to: @liberosist/app-feature-request-filter-the-new-feed
Here is a GitHub issue for it. Problem is that it isn't as easy as it sounds. We offered a $300 SBD bounty just to do a part of it, and it went unclaimed. I think Steemit is planning to do it, but it is something that won't be done until communities and a few other things are done first. https://github.com/steemit/condenser/issues/125
author | timcliff |
---|---|
permlink | re-liberosist-app-feature-request-filter-the-new-feed-20170421t045727138z |
category | steemdev |
json_metadata | {"tags":["steemdev"],"links":["https://github.com/steemit/condenser/issues/125"],"app":"steemit/0.1"} |
created | 2017-04-21 04:57:27 |
last_update | 2017-04-21 04:57:27 |
depth | 1 |
children | 12 |
last_payout | 2017-04-28 04:57:27 |
cashout_time | 1969-12-31 23:59:59 |
total_payout_value | 0.084 HBD |
curator_payout_value | 0.019 HBD |
pending_payout_value | 0.000 HBD |
promoted | 0.000 HBD |
body_length | 337 |
author_reputation | 272,954,445,077,789 |
root_title | "App/feature Request: Filter the New feed" |
beneficiaries | [] |
max_accepted_payout | 1,000,000.000 HBD |
percent_hbd | 10,000 |
post_id | 3,068,954 |
net_rshares | 547,694,094,201 |
author_curate_reward | "" |
voter | weight | wgt% | rshares | pct | time |
---|---|---|---|---|---|
pharesim | 0 | 178,700,164,993 | 1% | ||
lovejoy | 0 | 33,971,460,929 | 100% | ||
hipster | 0 | 42,593,386,327 | 5% | ||
acidyo | 0 | 5,124,206,120 | 5% | ||
samether | 0 | 379,588,102 | 5% | ||
christoph3 | 0 | 2,767,900,848 | 100% | ||
trees | 0 | 103,249,611 | 5% | ||
strawhat | 0 | 397,287,928 | 5% | ||
cryptochannel | 0 | 168,974,241 | 5% | ||
mrgreen | 0 | 110,450,739 | 5% | ||
ausbitbank | 0 | 98,112,641,152 | 100% | ||
krystle | 0 | 26,023,990,061 | 100% | ||
liberosist | 0 | 16,448,437,416 | 100% | ||
dirty.hera | 0 | 281,554,726 | 100% | ||
timcliff | 0 | 73,575,330,480 | 32% | ||
projectnewbie | 0 | 871,183,800 | 5% | ||
leongkhan | 0 | 60,514,741,688 | 100% | ||
tamersameeh | 0 | 92,359,586 | 5% | ||
rahul.stan | 0 | 89,345,272 | 5% | ||
fisteganos | 0 | 402,703,660 | 2.5% | ||
dunia | 0 | 6,633,024,993 | 100% | ||
evildeathcore | 0 | 332,111,529 | 5% |
From helicopter view it is more or less to create a frontend such as customer care people use for messaging/chatting type of services based on using SQL type of queries. I have no idea how this works in the blockchain as DB, since any SQL type of query can have performance impact. I only know that with 20 years experience in high end IT and telecommunications industry and solutions, I was selling a product that just did that! The same product had also instance reporting through pre-aggregation of parameters, and we had a whole bunch of those parameters in a multi dimensional DB to allow all sort of cross views/reporting. The pre-aggregation was there to create the instant response on a report request. OLAP technology was used. The difficult part of the product was the data loader, ie the data stream from the core engines (te messaging engines, such as SMS, MMS, RCS) towards this customer care and reporting product, since it needed to support 10.000 - 50.000 tx/sec (and under race track conditions (ie no hardware failures) up to 100.000 tx/sec), and we succeeded in creating this. We had this tool separate from the core messaging engines for the obvious reason that the processing required for data loading, data aggregation and the SQL queries for customer care shall not have impact on the performance of the core messaging service. Relating this back to blockchains (just a DB again in my helicopter view again), you want to create a copy of the blockchain and perform these type of tasks offline from the core blockchain that needs to totally focus on speed of transactions. If somehow the blockchain is sooooo superfast it can handle everything on the same blockchain, go for it, but I would say: try to find another solution since transaction speed is super super important for scale. **NOTE: I'm not a software architect, I'm also not a software designer so my suggestions above shall be taken with precautions; However the information I provided can be taken as real and correct.** **Note: 300 SBD bounty? Seriously? If you want a good working system being able to handle proper performance, this will cost factor of 100s more! If you just want to have the functionality but no performance at all, maybe 300 SBD or lets say factor of 10 (ie 3.000 SBD) could be sufficient**
author | edje |
---|---|
permlink | re-timcliff-re-liberosist-app-feature-request-filter-the-new-feed-20170421t074400347z |
category | steemdev |
json_metadata | {"tags":["steemdev"],"app":"steemit/0.1"} |
created | 2017-04-21 07:44:00 |
last_update | 2017-04-21 07:47:48 |
depth | 2 |
children | 8 |
last_payout | 2017-04-28 07:44:00 |
cashout_time | 1969-12-31 23:59:59 |
total_payout_value | 0.118 HBD |
curator_payout_value | 0.036 HBD |
pending_payout_value | 0.000 HBD |
promoted | 0.000 HBD |
body_length | 2,301 |
author_reputation | 182,981,833,957,909 |
root_title | "App/feature Request: Filter the New feed" |
beneficiaries | [] |
max_accepted_payout | 1,000,000.000 HBD |
percent_hbd | 10,000 |
post_id | 3,069,706 |
net_rshares | 765,544,957,677 |
author_curate_reward | "" |
voter | weight | wgt% | rshares | pct | time |
---|---|---|---|---|---|
wackou | 0 | 610,177,548,943 | 9.6% | ||
anyx | 0 | 55,030,426,106 | 24% | ||
arcange | 0 | 10,006,649,873 | 24% | ||
dirty.hera | 0 | 112,621,890 | 24% | ||
timcliff | 0 | 73,678,397,326 | 32% | ||
ebargains | 0 | 7,806,898,956 | 24% | ||
sjennon | 0 | 3,013,778,494 | 24% | ||
steemvest17 | 0 | 3,803,475,101 | 24% | ||
reisman | 0 | 732,843,452 | 24% | ||
vermute | 0 | 243,244,478 | 12% | ||
kuvo | 0 | 120,105,732 | 12% | ||
evildeathcore | 0 | 675,745,116 | 24% | ||
mhaimo | 0 | 143,222,210 | 12% |
Yes, that is a good explanation. Basically what they need to do is have a daemon that processes the blockchain transactions and puts them into something that can be easily and efficiently queried (like a SQL database). I agree that it would be expensive to get someone to develop - which goes along with what I was saying as far as it not being something that can be quickly and easily done. It is a very useful feature, and it is something that can be done, but it is going to take time/resources to complete.
author | timcliff |
---|---|
permlink | re-edje-re-timcliff-re-liberosist-app-feature-request-filter-the-new-feed-20170421t173828280z |
category | steemdev |
json_metadata | {"tags":["steemdev"],"app":"steemit/0.1"} |
created | 2017-04-21 17:38:27 |
last_update | 2017-04-21 17:38:27 |
depth | 3 |
children | 7 |
last_payout | 2017-04-28 17:38:27 |
cashout_time | 1969-12-31 23:59:59 |
total_payout_value | 0.000 HBD |
curator_payout_value | 0.000 HBD |
pending_payout_value | 0.000 HBD |
promoted | 0.000 HBD |
body_length | 510 |
author_reputation | 272,954,445,077,789 |
root_title | "App/feature Request: Filter the New feed" |
beneficiaries | [] |
max_accepted_payout | 1,000,000.000 HBD |
percent_hbd | 10,000 |
post_id | 3,074,290 |
net_rshares | 22,715,410,472 |
author_curate_reward | "" |
voter | weight | wgt% | rshares | pct | time |
---|---|---|---|---|---|
edje | 0 | 22,715,410,472 | 100% |
I'm in the business of mission critical software with super performance, and about 5% of all software engineering effort is writing the code lines. Rest is making sure the system is stable and FAST! any software engineer can make marketing software, ie functionality only, but when it comes to performance and stability, then software architecting and engineering is a whole different beast. EDIT: btw, No SQL DB seems to become more popular. Also DB technologies from Facebook and Google are super super fast, Cassandra. But even LDAP is very fast, at least in reading, not so much in writing. For proper tools, already DB selection is super important. DB expert is required. Than an software architect (usually not the same person, or you have one of those superman software architects).
author | edje |
---|---|
permlink | re-timcliff-re-edje-re-timcliff-re-liberosist-app-feature-request-filter-the-new-feed-20170421t174350571z |
category | steemdev |
json_metadata | {"tags":["steemdev"],"app":"steemit/0.1"} |
created | 2017-04-21 17:43:51 |
last_update | 2017-04-21 17:47:00 |
depth | 4 |
children | 6 |
last_payout | 2017-04-28 17:43:51 |
cashout_time | 1969-12-31 23:59:59 |
total_payout_value | 0.000 HBD |
curator_payout_value | 0.000 HBD |
pending_payout_value | 0.000 HBD |
promoted | 0.000 HBD |
body_length | 790 |
author_reputation | 182,981,833,957,909 |
root_title | "App/feature Request: Filter the New feed" |
beneficiaries | [] |
max_accepted_payout | 1,000,000.000 HBD |
percent_hbd | 10,000 |
post_id | 3,074,341 |
net_rshares | 73,678,397,326 |
author_curate_reward | "" |
voter | weight | wgt% | rshares | pct | time |
---|---|---|---|---|---|
timcliff | 0 | 73,678,397,326 | 32% |
Ah, thanks for that. I know nothing about development, but I see it already there in AutoSteem. Just needs a more manual curation approach. Of course, I can understand a Search feature will be difficult, but this is just filtering new posts coming in.
author | liberosist | ||||||
---|---|---|---|---|---|---|---|
permlink | re-timcliff-re-liberosist-app-feature-request-filter-the-new-feed-20170421t045727138z-2017421t105854328z | ||||||
category | steemdev | ||||||
json_metadata | {"tags":"steemdev","app":"esteem/1.4.2","format":"markdown+html"} | ||||||
created | 2017-04-21 05:28:57 | ||||||
last_update | 2017-04-21 05:28:57 | ||||||
depth | 2 | ||||||
children | 2 | ||||||
last_payout | 2017-04-28 05:28:57 | ||||||
cashout_time | 1969-12-31 23:59:59 | ||||||
total_payout_value | 0.000 HBD | ||||||
curator_payout_value | 0.000 HBD | ||||||
pending_payout_value | 0.000 HBD | ||||||
promoted | 0.000 HBD | ||||||
body_length | 252 | ||||||
author_reputation | 177,167,275,265,899 | ||||||
root_title | "App/feature Request: Filter the New feed" | ||||||
beneficiaries |
| ||||||
max_accepted_payout | 1,000,000.000 HBD | ||||||
percent_hbd | 10,000 | ||||||
post_id | 3,069,097 | ||||||
net_rshares | 73,675,274,130 | ||||||
author_curate_reward | "" |
voter | weight | wgt% | rshares | pct | time |
---|---|---|---|---|---|
timcliff | 0 | 73,675,274,130 | 32% |
In GitHub it is "waiting for microservice" which basically means that they first need to implement something that allows them to filter and query for data, rather than just providing a stream of what the blockchain returns. It can be done, but my understanding is that there are some higher priorities to get done first.
author | timcliff |
---|---|
permlink | re-liberosist-re-timcliff-re-liberosist-app-feature-request-filter-the-new-feed-2017421t105854328z-20170421t173029315z |
category | steemdev |
json_metadata | {"tags":["steemdev"],"app":"steemit/0.1"} |
created | 2017-04-21 17:30:30 |
last_update | 2017-04-21 17:30:30 |
depth | 3 |
children | 1 |
last_payout | 2017-04-28 17:30:30 |
cashout_time | 1969-12-31 23:59:59 |
total_payout_value | 0.000 HBD |
curator_payout_value | 0.000 HBD |
pending_payout_value | 0.000 HBD |
promoted | 0.000 HBD |
body_length | 320 |
author_reputation | 272,954,445,077,789 |
root_title | "App/feature Request: Filter the New feed" |
beneficiaries | [] |
max_accepted_payout | 1,000,000.000 HBD |
percent_hbd | 10,000 |
post_id | 3,074,223 |
net_rshares | 10,706,924,052 |
author_curate_reward | "" |
voter | weight | wgt% | rshares | pct | time |
---|---|---|---|---|---|
dez1337 | 0 | 10,706,924,052 | 100% |
I think the two main reasons for the microservice flag are scaling (Create a "search" service which can be scaled separatly instead of scaling the whole application) and avoiding implementations that have to be refactored later when implementing the microservices. Those reasons are pretty valid from my point of view so #NoOffence. Beside that I do not see any other valid reasons why this has not been implemented yet, because I guess that the implementation itself should be quite easy. - Do you know some? Actually I've already scanned the whole blockchain some weeks ago using my Java-API to collect usernames and their IDs - It was done in about 2 days consuming about 2GB of RAM so the resources should not be a problem at all. We also would only need to save the metrics (like number of votes, number of characters, ...) for each post and not the whole content of it - This saves a lot of disk space. Also projects like SteemDB have shown that it is not that hard to scan the blockchain and store the data.
author | dez1337 |
---|---|
permlink | re-timcliff-re-liberosist-re-timcliff-re-liberosist-app-feature-request-filter-the-new-feed-2017421t105854328z-20170421t221933042z |
category | steemdev |
json_metadata | {"tags":["nooffence","steemdev"],"app":"steemit/0.1"} |
created | 2017-04-21 22:19:33 |
last_update | 2017-04-21 22:19:33 |
depth | 4 |
children | 0 |
last_payout | 2017-04-28 22:19:33 |
cashout_time | 1969-12-31 23:59:59 |
total_payout_value | 0.032 HBD |
curator_payout_value | 0.010 HBD |
pending_payout_value | 0.000 HBD |
promoted | 0.000 HBD |
body_length | 1,016 |
author_reputation | 20,544,257,521,749 |
root_title | "App/feature Request: Filter the New feed" |
beneficiaries | [] |
max_accepted_payout | 1,000,000.000 HBD |
percent_hbd | 10,000 |
post_id | 3,076,388 |
net_rshares | 236,481,036,242 |
author_curate_reward | "" |
voter | weight | wgt% | rshares | pct | time |
---|---|---|---|---|---|
dez1337 | 0 | 10,707,038,259 | 100% | ||
timcliff | 0 | 225,773,997,983 | 100% |