create account

Big data - What is it really about - In laymen’s terms by jacor

View this thread on: hive.blogpeakd.comecency.com
· @jacor · (edited)
$321.28
Big data - What is it really about - In laymen’s terms
I hope everybody on the platform noticed the **massive shift in the trending pages**, not only do we have much more diversity of content at the top of the trending pages, we also have a much wider spread of posts receiving rewards.  I have just checked the pages and the top 10 pages all have at least *$100* pay-out amounts.  If you did the same thing last week, there was a definite drop in reward payments from page 3.  There were massive payments, and then a drop to next to nothing.   

This is massive as this means that either the whales are spreading their weight more efficiently, or there are more dolphins and orca's which is created n an ongoing basis, and thereor the voting power is starting to be spread.  This will ultimately be the best thing that can happen on Steemit.  More evenly voting power.

https://s26.postimg.org/68hwg8luh/bigdata_2.jpg
[Image Credit](http://03e24ad.netsolhost.com/wp-content/uploads/2015/01/bigdata.jpg)

# Big data
I am not a specialist on the subject, but I have been in IT for many years, and I am blessed to understand a fairly diverse technology set. I have also been told that I have the ability to translate Information Technology into "English". What I hope to do with this post, is to open up the understanding of the the Big data world to the non-technology minds within the community.  I will also use an example to explain this in laymen's terms.

## What is Big Data?
It is exactly what it says, a large set of data.  But most people don’t really get what **Big** mean.  Even some of the more junior developers in the industry gets this wrong.  I am speaking about ***BIG***, no ... **large**, no wait **massive amounts of data**, no I think what we must call it is **enormous amounts of data**. I do not think there are specific words which actually show the size of the data we are talking about here. The data sets are so large, that it is even too big to store in a database.  Sure some Big Data projects is based on data that is stored, but let me show you an example what I am talking about.  There are many new ways which technologists is adapting to this technology and creating new ways to interrogate this type of data, but it will be too technical.

## Big Data Example
So you are driving on your way to the office and you get a call from you energy service provider.  The lady from the call centre says: @jacor,*Did you not perhaps forgot to turn off your stove before you left home for work today*.  Now how on earth will she know this.  **It is all about analysis and trends**.  We are already have a very integrated **"network of things"**, but the matter of the fact is that when energy service providers start monitoring the use of electricity in each households, business, factory or manufacturing plant, they will start seeing these type of trends.  

How will they know that you forgot your stove on?  They have been building a trend of your usage over a long period of time.  They have a dashboard, which highlights specific things, when something is out of the ordinary. This spike is out of the ordinary in this case, as for the past *101 days*, you have only used a specific amount of energy when it comes to the use of your stove. Today you are using the stove much longer than usually, so something might be wrong.  If we go further into IOT, they will know you are leaving for the office at a specific time, again a feature of connectivity on the IOT.  Your vehicle is connected to the grid and they can see that you are not at home, your wife just dropped of the kids at school, because they have just logged into the international school database.  Aha 'Big brother is waching us' .

At the end of the day, the energy provider, cannot store all the information about every household's energy forever, but they can store the trends and 'spikes' and monitor the live feed of energy flow and report on that.  For me that is big data!

 (I am planning to write a about IOT - Internet of Things- in a follow-up post, depending if this post is accepted well in our community) 

## What will big data be used for?
There are a multitude of applications for this new technology, and will be too technical to start explaining ***Hadoop*** and the likes to the specific audience I am targeting with this post.  

What I can show you in graph form, is what direction the utlisation of big data is being used for by business today as we speak.

https://s26.postimg.org/54xs4a17d/Big_Data.gif

### Why this post?

I am thinking of writing a series of posts to explain some terms, which a lot of people just take for granted and beleive it is clear that everobody just know what it is. These terms are used in the industry on an ongoing basis. If there are people in the community that will be interested in understanding more of this.  Please leave comment. If there are specific things you want to learn more about, please leave a comment. 

### I would love to hear some comments of what each of you think will be a good apllication for this technology set.  
# Happy Steeming!

___
***Please follow me on my blog @jacor if you enjoy my topics and content.***

@jacor **features authors to promote a diversity of content and new authors. All STEEM Dollars for these posts go to the featured author.**

**If you are looking to be featured as an author, please contact me via email - featureonsteemit@gmail.com**
_____
👍  , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , and 90 others
properties (23)
authorjacor
permlinkbig-data-what-is-it-really-about-in-laymen-s-terms
categorytechnology
json_metadata{"tags":["technology","life"],"users":["jacor"],"image":["https://s26.postimg.org/68hwg8luh/bigdata_2.jpg"]}
created2016-08-11 09:32:15
last_update2016-08-11 20:07:42
depth0
children15
last_payout2016-09-10 22:39:27
cashout_time1969-12-31 23:59:59
total_payout_value278.914 HBD
curator_payout_value42.368 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length5,391
author_reputation126,754,951,433,035
root_title"Big data - What is it really about - In laymen’s terms"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id742,470
net_rshares41,239,059,319,028
author_curate_reward""
vote details (154)
@akareyon ·
The future will depend on how well humans manage to tame the beast. 

The data will be scoured by bots, their filters pre-programmed and genetically adaptive, responsive to personalized reward system defined by the user, now confronted with the tasty creem. 

The question is which service the community will reward more: the freedom of rough speech or the predigested narrative so well known from all other media. The right interface would filter these attempts at attemption-grabbing out and make them invisible, and visualize automated analytics to highlight conflicts of financial interest.
properties (22)
authorakareyon
permlinkre-jacor-big-data-what-is-it-really-about-in-laymen-s-terms-20160811t150424764z
categorytechnology
json_metadata{"tags":["technology"]}
created2016-08-11 15:04:24
last_update2016-08-11 15:04:24
depth1
children0
last_payout2016-09-10 22:39:27
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length594
author_reputation6,770,831,834,202
root_title"Big data - What is it really about - In laymen’s terms"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id746,637
net_rshares0
@cire81 ·
$0.04
I think big data mining can be a  scary matter. From the perspective of the consumer I am monitored for my activities and spending pattern. This is an intrusion of my privacy. Especially with the convenience of technology in assisting with data collection, it makes this whole setup even more frightening. Not sure about others or technology set used but I am really concern with privacy as that is my basic human rights.
👍  , ,
properties (23)
authorcire81
permlinkre-jacor-big-data-what-is-it-really-about-in-laymen-s-terms-20160811t102800553z
categorytechnology
json_metadata{"tags":["technology"]}
created2016-08-11 10:27:54
last_update2016-08-11 10:27:54
depth1
children4
last_payout2016-09-10 22:39:27
cashout_time1969-12-31 23:59:59
total_payout_value0.036 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length421
author_reputation99,228,490,804
root_title"Big data - What is it really about - In laymen’s terms"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id742,995
net_rshares54,375,956,369
author_curate_reward""
vote details (3)
@jacor ·
$0.04
Agreed, but I am afraid there is not much we can do about it.  Agree with you on the basic human rights.  However, even if you look at something like the blockchain, where all the data is public, it is just a matter of time before somebody will use some sort of scraping tool to get data about each of us to use in marketing going forward.  One of thse things I guess!
👍  ,
properties (23)
authorjacor
permlinkre-cire81-re-jacor-big-data-what-is-it-really-about-in-laymen-s-terms-20160811t103116902z
categorytechnology
json_metadata{"tags":["technology"]}
created2016-08-11 10:31:18
last_update2016-08-11 10:31:18
depth2
children3
last_payout2016-09-10 22:39:27
cashout_time1969-12-31 23:59:59
total_payout_value0.036 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length368
author_reputation126,754,951,433,035
root_title"Big data - What is it really about - In laymen’s terms"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id743,031
net_rshares53,277,806,342
author_curate_reward""
vote details (2)
@robertm ·
$0.03
I suppose it is all about the underlying motive. In fields like education, farming and health care, as well as science, being able to get access to, mine and interpret big data, people's lives are being vastly improved every day. But yes, there are always those that wish to exploit something for themselves. It is a balance, but we can not afford to stop moving forward.  We just need to be cautious. I am often reminded of those that used to say the car will never catch on as it is to slow, noisy, and dangerous .... they will never get one. See where we are today
👍  ,
properties (23)
authorrobertm
permlinkre-jacor-re-cire81-re-jacor-big-data-what-is-it-really-about-in-laymen-s-terms-20160811t105854427z
categorytechnology
json_metadata{"tags":["technology"]}
created2016-08-11 10:58:54
last_update2016-08-11 10:58:54
depth3
children2
last_payout2016-09-10 22:39:27
cashout_time1969-12-31 23:59:59
total_payout_value0.034 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length567
author_reputation1,157,833,456,786
root_title"Big data - What is it really about - In laymen’s terms"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id743,290
net_rshares52,144,209,838
author_curate_reward""
vote details (2)
@domino ·
$0.16
We can use the siacoin for that. It is a good way
👍  
properties (23)
authordomino
permlinkre-jacor-big-data-what-is-it-really-about-in-laymen-s-terms-20160811t104456251z
categorytechnology
json_metadata{"tags":["technology"]}
created2016-08-11 10:44:57
last_update2016-08-11 10:44:57
depth1
children0
last_payout2016-09-10 22:39:27
cashout_time1969-12-31 23:59:59
total_payout_value0.119 HBD
curator_payout_value0.038 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length49
author_reputation88,821,926,233,387
root_title"Big data - What is it really about - In laymen’s terms"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id743,159
net_rshares220,308,519,772
author_curate_reward""
vote details (1)
@michaellamden68 ·
$0.04
Very interesting post, I'm still amazed at the extraordinary nature of steem; the future will be inspired by innovation.
👍  ,
properties (23)
authormichaellamden68
permlinkre-jacor-big-data-what-is-it-really-about-in-laymen-s-terms-20160811t133500317z
categorytechnology
json_metadata{"tags":["technology"]}
created2016-08-11 13:35:00
last_update2016-08-11 13:35:00
depth1
children0
last_payout2016-09-10 22:39:27
cashout_time1969-12-31 23:59:59
total_payout_value0.030 HBD
curator_payout_value0.006 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length120
author_reputation98,902,028,363,203
root_title"Big data - What is it really about - In laymen’s terms"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id745,292
net_rshares54,434,497,879
author_curate_reward""
vote details (2)
@pinkyh60 ·
$0.04
Thanks for the perspective @jacor. So much data that it can't be stored - yikes!
👍  
properties (23)
authorpinkyh60
permlinkre-jacor-big-data-what-is-it-really-about-in-laymen-s-terms-20160811t144409897z
categorytechnology
json_metadata{"tags":["technology"],"users":["jacor"]}
created2016-08-11 14:44:15
last_update2016-08-11 14:44:15
depth1
children0
last_payout2016-09-10 22:39:27
cashout_time1969-12-31 23:59:59
total_payout_value0.028 HBD
curator_payout_value0.008 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length80
author_reputation31,165,485,683
root_title"Big data - What is it really about - In laymen’s terms"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id746,359
net_rshares53,221,326,148
author_curate_reward""
vote details (1)
@ramta ·
$0.16
[http://i.imgur.com/OlX4SwZ.png] _**Hello @jacor**_
Thank you. I am one that need Information Technology into "English".
_**My question:**_  I hear the terms Whales, Dolphins etc. How many categories are there? What are the numbers or % in each? What are the trends here?

Regards
The Viking from Norway
👍  ,
properties (23)
authorramta
permlinkre-jacor-big-data-what-is-it-really-about-in-laymen-s-terms-20160811t103144357z
categorytechnology
json_metadata{"tags":["technology"],"users":["jacor"],"image":["http://i.imgur.com/OlX4SwZ.png"]}
created2016-08-11 10:31:42
last_update2016-08-11 10:31:42
depth1
children2
last_payout2016-09-10 22:39:27
cashout_time1969-12-31 23:59:59
total_payout_value0.156 HBD
curator_payout_value0.004 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length303
author_reputation48,535,140,400,879
root_title"Big data - What is it really about - In laymen’s terms"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id743,032
net_rshares222,420,136,986
author_curate_reward""
vote details (2)
@jacor ·
$0.16
Hi @ramta, great to hear from you.  Good question ... You can see the distribution and categories by selecting [clicking here](https://steemd.com/distribution )  On this page they are not called Whales or Dolphins, etc.  This is the name that the community decided on when it started.  There are many ways to interpret, but in my view: 
- Whales - Legends are the whales and there are not many 46 in total on the platform . (0,08% of the community)
- Orca's are the Super hero's (.31% of the community)
- Dolphin's have 2 categories (Hero's (Large Dolphin (1.01%)) and superuser (Small Dophin(3.84%))
- Then the newbies (Largest portion of the community Close to 84% of the community).

I hope this helps...

I might be wring but that is how I classify them for myself.
👍  ,
properties (23)
authorjacor
permlinkre-ramta-re-jacor-big-data-what-is-it-really-about-in-laymen-s-terms-20160811t104525976z
categorytechnology
json_metadata{"tags":["technology"],"users":["ramta"],"links":["https://steemd.com/distribution"]}
created2016-08-11 10:45:27
last_update2016-08-11 10:45:27
depth2
children1
last_payout2016-09-10 22:39:27
cashout_time1969-12-31 23:59:59
total_payout_value0.140 HBD
curator_payout_value0.020 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length769
author_reputation126,754,951,433,035
root_title"Big data - What is it really about - In laymen’s terms"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id743,165
net_rshares222,420,136,986
author_curate_reward""
vote details (2)
@ramta ·
$0.16
[http://i.imgur.com/OlX4SwZ.png] _**Thank you @jacor**_ 
It became perfectly clear to me.

[https://s20.postimg.org/5uv71nw65/thank_you.jpg]
Regards
The Viking from Norway (Large Dolphin)
👍  ,
properties (23)
authorramta
permlinkre-jacor-re-ramta-re-jacor-big-data-what-is-it-really-about-in-laymen-s-terms-20160811t112213102z
categorytechnology
json_metadata{"tags":["technology"],"users":["jacor"],"image":["http://i.imgur.com/OlX4SwZ.png"]}
created2016-08-11 11:22:09
last_update2016-08-11 11:22:09
depth3
children0
last_payout2016-09-10 22:39:27
cashout_time1969-12-31 23:59:59
total_payout_value0.152 HBD
curator_payout_value0.008 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length187
author_reputation48,535,140,400,879
root_title"Big data - What is it really about - In laymen’s terms"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id743,490
net_rshares221,287,837,774
author_curate_reward""
vote details (2)
@robertm ·
$0.04
Brilliant stuff @jacor. I enjoyed this.  I think we to often presume people know what these buzz words mean, so glad someone takes the time to write about this in simple terms
👍  
properties (23)
authorrobertm
permlinkre-jacor-big-data-what-is-it-really-about-in-laymen-s-terms-20160811t105434158z
categorytechnology
json_metadata{"tags":["technology"],"users":["jacor"]}
created2016-08-11 10:54:33
last_update2016-08-11 10:54:33
depth1
children2
last_payout2016-09-10 22:39:27
cashout_time1969-12-31 23:59:59
total_payout_value0.036 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length175
author_reputation1,157,833,456,786
root_title"Big data - What is it really about - In laymen’s terms"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id743,251
net_rshares53,221,256,719
author_curate_reward""
vote details (1)
@jacor ·
$0.03
Thank you @robertm .  Great to hear from you! I hope to build a community of followers from a non-technology background as well.  Always good to add value to the community.
👍  
properties (23)
authorjacor
permlinkre-robertm-re-jacor-big-data-what-is-it-really-about-in-laymen-s-terms-20160811t105731468z
categorytechnology
json_metadata{"tags":["technology"],"users":["robertm"]}
created2016-08-11 10:57:30
last_update2016-08-11 10:57:30
depth2
children1
last_payout2016-09-10 22:39:27
cashout_time1969-12-31 23:59:59
total_payout_value0.034 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length172
author_reputation126,754,951,433,035
root_title"Big data - What is it really about - In laymen’s terms"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id743,281
net_rshares52,088,889,555
author_curate_reward""
vote details (1)
@robertm ·
$0.04
I think that is where the world is moving, where most of us are tech users, but only a few of us the ones under the hood .... so to speak. Good luck with that.
👍  
properties (23)
authorrobertm
permlinkre-jacor-re-robertm-re-jacor-big-data-what-is-it-really-about-in-laymen-s-terms-20160811t120007913z
categorytechnology
json_metadata{"tags":["technology"]}
created2016-08-11 12:00:06
last_update2016-08-11 12:00:06
depth3
children0
last_payout2016-09-10 22:39:27
cashout_time1969-12-31 23:59:59
total_payout_value0.028 HBD
curator_payout_value0.008 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length159
author_reputation1,157,833,456,786
root_title"Big data - What is it really about - In laymen’s terms"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id743,898
net_rshares54,353,694,789
author_curate_reward""
vote details (1)