![](https://steemitimages.com/DQmSZqRt9VmFKG2aFeTRG7iXwwpKXjyNfSxWj77BgMbRq81/image.png)

This analysis aims to give an overview of the average review time of each of the Utopian categories. 

This also aims to inform Utopian moderators of the average review time of each of the categories to act as basis for them should they choose to set Key Performance Indicators (KPIs) for their teams or to the project owner to set a KPI for the whole Utopian moderation team.

Due to the amount of data that need to be analyzed and the time required to come up with these reports, this author decided to split this into multiple reports. With this report providing an overview.

This report analyzed all categories as a whole - the number of contributions, the % rejection, and the average review time.

### Outline
1. Contributions Overview
    1. Monthly Contributions 
    1. Accepted vs Rejected
1. Rejection Rate
    1. Per Category
    1. Per Moderator
1. Monthly Average Review Time
1. Conclusion


### Scope of Analysis
The data extracted was from January 19, 2018 to March 12, 2018.

### 1. Contributions Overview

| <center>Monthly Contributions</center> | <center>Accepted vs Rejected</center> |
| -- | -- |
| ![](https://steemitimages.com/DQmYfB4BgVjJ2nX5VFtsz8gpDfa3ih8cDSdZ4s2X7M5Fvom/image.png) | ![](https://steemitimages.com/DQmXkeacjnJXCv2P8qxogm2GMCD3z18KwCsnQErAuhx15em/image.png) |

Based on the left chart, from Jan. 19 to Mar 12, 2018, there were **more than 24000 contributions** reviewed by **121 moderators**. 

Around **40% (9679)** of these were rejected while the remaining **60% (14602)** were accepted.

### 2. Rejection Rate

#### 2.1. Per Category

![](https://steemitimages.com/DQmTfYVMxDUyxGWSgktsto92dCEjJpHM9DqHt9C1EAg3LLG/image.png)

The table on the left shows the reject rate per category sorted by number of contributions.

* **translations**, the top-most contributed category, before it was [temporarily paused](https://steemit.com/utopian-io/@utopian-io/translation-contribution-submissions-paused-until-further-notice), was at **23%** rejection
* **ideas** (or suggestions), the second most contributed, was at **57%**
* While **graphics**, the third most contributed, was at **53%**

<div class="pull-right">
    
![](https://steemitimages.com/350x350/https://steemitimages.com/DQmTkDTCwZ95gt93tnt8Nw28AAGHDAxmKWXrqja9EKdEPdE/image.png)

</div>

Referring to the data on the previous section, the rejection rate of **23%** for translations was below the overall average rejection rate of **40%**.

> This can either mean that translation contributions were high-quality that 80% were accepted or a possible leniency in moderation

#### 2.2. Per Moderator

![image.png](https://res.cloudinary.com/hpiynhbhq/image/upload/v1520936670/quwy9xc9hmrmurhjwi65.png)

Based on the left table, @onos, @tykee, and @andrejcibik led all moderators with 1708, 1435, and 1031 contributions reviewed, respectively. Their rejection rate were 50%, 66%, and 54%, respectively.

<div class="pull-left">

![image.png](https://steemitimages.com/200x200/https://res.cloudinary.com/hpiynhbhq/image/upload/v1520936807/weqag6apkxm1sv6gas8a.png)

</div>

The contributions they reviewed mainly came from the **ideas** and **graphics** categories.

<hr/>

### 3. Monthly Average Review Time

<center>![](https://steemitimages.com/DQmU3sjcsQEkubFgK6F2kN4X3NerFUSufMJRr8itpLJj3yr/image.png)</center>

Based on the chart above, the average review time across all categories was **33 hours**. For **January it was 33 hours**, for **February 34 hours**, and for **March 27 hours**.

The fastest review time was **26 seconds** for [this contribution](https://utopian.io/utopian-io/@ms10398/utopian-js-final-release-with-all-features-added) while the longest review time was **545 hours** for [this contribution](https://utopian.io/utopian-io/@juecoree/behavior-analysis-cebu-for-cebu-community-january-2018) . 

**545 hours (23 days)** was a bogus review time which prompted me to look into these contributions that took this long to review. Here were examples:

| Contribution | Category | Review Time (Hours) | Last Moderator | Status |
| -- | -- | -- | -- | -- |
| [Behavior Analysis: #cebu for Cebu community(January 2018)](https://utopian.io/utopian-io/@juecoree/behavior-analysis-cebu-for-cebu-community-january-2018) | Analysis | 545 (23 days) | @knowledges | Rejected |
|  [How To Build AJAX Based Navigation list in ASP.NET](https://utopian.io/utopian-io/@aminda/how-to-build-ajax-based-navigation-list-in-asp-net) | Tutorial | 507 (21 days) | @espoem | Rejected |
| [NIGERIANS EARN FROM MUSIC THROUGH DSOUND](https://utopian.io/utopian-io/@arewa/nigerians-earn-from-music-through-dsound) | Visibility | 488 (20 days) | @knowledges | Rejected |

There were **83 contributions** like these which I think were related with cleaning up the Utopian feed.

This prompted me to add the filter:
> Remove all contributions whose review times exceeded 6 days or 144 hours

Here were the stats side-by-side for comparison:

| <center>WITHOUT filter</center> | <center>WITH Filter</center> |
| -- | -- |
| ![image.png](https://res.cloudinary.com/hpiynhbhq/image/upload/v1520935943/j94irfzt5j8k95qedn8q.png) | ![image.png](https://res.cloudinary.com/hpiynhbhq/image/upload/v1520935962/kyalu1f7pfdiuy0uzc9i.png) |
| ![image.png](https://res.cloudinary.com/hpiynhbhq/image/upload/v1520935979/ttnuspgxgoqome0mkh41.png) | ![image.png](https://res.cloudinary.com/hpiynhbhq/image/upload/v1520935999/o7e5a8cbakckn2twbzxl.png) |

It didn't make much difference. Here were the categories that had these *cleanup activities* which affected the review times.

![image.png](https://res.cloudinary.com/hpiynhbhq/image/upload/v1520934769/jtego3owyhlgzxfjiumn.png)

The average review time across all categories is still **32 hours** or **1.3 days**.

### 4. Conclusion

Based on this analysis, we saw that there were **more than 24000 contributions** reviewed by **121 moderators** with an average of **32 hours** review time from January 19 to March 12, 2018. 

These contributions had a **60% acceptance rate** (and consequently a 40% rejection rate) with the **translation** category's higher at **77%**.

We also looked at the rejection rate of the top 3 moderators with each moderator rejecting more than **50%** of the contributions they reviewed with the rejected ones mostly coming from the **ideas** and **graphics** categories. This indicated poor quality submissions in these categories.

Afterwards, we also looked into the detail of the moderation review time and saw that the quickest review time was **26 seconds** and the longest reaching **545 hours (23 days)**. We learned that the latter with review time exceeding 144 hours (6 days) were related with Utopian feed cleanup by supervisors.

#### Tools

* Power BI for charts
* Utopian.io local DB (MongoDB) for the data
* Studio 3T MongoDB for exporting data from local DB
```
db.posts.find({created: { $gte: '2018-01-19' }}, { 'json_metadata': 1, created: 1, author: 1 } )
db.posts.aggregate([
	{ $match: { created: { $gte: '2018-01-19' } } },
	{"$group": { _id: "$json_metadata.type", 
	  			count:{$sum: 1} } },
	{ $sort : { 'count' : -1}}
])
```

***

<sup>I am part of a Blockchain Business Intelligence community. We all post under the tag #BlockchainBI. If you have an analysis you would like carried out on Steemit or Blockchain data, please do contact me or any of the #BlockchainBI team and we will do our best to help you...</sup>

<sup>You can find #blockchainbi on discord https://discordapp.com/invite/JN7Yv7j</sup>

<br /><hr/><em>Posted on <a href="https://utopian.io/utopian-io/@eastmael/utopian-stats-analyzing-utopian-moderation-time-blockchain-business-intelligence">Utopian.io -  Rewarding Open Source Contributors</a></em><hr/>