create account

The science of data by steevc

View this thread on: hive.blogpeakd.comecency.com
· @steevc ·
$5.04
The science of data
I am currently between work assignments and, like many people, I have been furloughed until something comes up. I am using the time to educate myself a little more. I am a developer who works with various technologies, but the requirements of any goven job can be quite narrow and may use older technology. I have been working quite a bit with Python recently and wanted to look into the area of [data science](https://en.wikipedia.org/wiki/Data_science). This is about extracting knowledge from data. Fortunately Python has some good functionality for this in the [Pandas](https://pandas.pydata.org/) data analysis library.

![Data science](http://static.openlawlab.com/uploads/2017/05/legal-design-sketches-9.jpg)
Image from [Open Law Lab](http://www.openlawlab.com/2017/05/15/data-science-in-your-legal-services/) with CC licence.

I like some structure to my learning and so looked for some suitable courses. I have used [Coursera](https://www.coursera.org/) in the past for various courses on programming as well as music. They have some good teachers who do video lessons. They had a [data science course](https://www.coursera.org/learn/python-data-analysis) from the University of Michigan.

Previously I was able to do Coursera course without paying. You just did not get an official certificate at the end. Now it seems you need to pay, but at around £1 per day it is not too bad considering you could do a lot of courses over a year. I am doing another on [networks](https://www.coursera.org/learn/computer-networking) concurrently.

My friend @stav is in a similar situation and he is also [doing some learning](https://peakd.com/technology/@stav/so-this-will-be-today-s-focus).

Some courses use other students to do the grading, but this one makes use of [Jupyter notebooks](https://jupyter.org/) where you run code on a web page and the results are automatically verified.

I have just completed for the third week of six and I have to say I am finding it challenging. I have done plenty of database programming and this has some similarities with that, but the way things are done is different enough to stretch my brain. Last week I got 100% right, but I got a couple wrong this week. That was still enough to pass. They rely on you doing some research of your own to find appropriate functions to achieve the goals. That can be hard when you are not sure what to search for. This week I had to import some Excel data and massage it into the appropriate form. I expect this is routine for data sciences, but you need experience to know which tools to reach for, much as a mechanic needs to know which tools are needed to strip an engine down.

I am finding this course interesting despite some frustration with the difficulty. I may need to do more reading of other material.

I have hopes that I can apply the knowledge I gain to some projects around Hive. There is plenty of data here to analyse. I may start with some personal projects to look at my own data. There is lots of fun to be had generating charts from it.

Although I may be in the second half of my working life I am still keen to keep learning. I have worked with computers for decades and they are endlessly fascinating. The technology is much more diverse than when I started and nobody can be an expert in everything these days.

Stay curious.
👍  , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , and 93 others
👎  , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , and 31 others
properties (23)
authorsteevc
permlinkthe-science-of-data
categorystem
json_metadata{"links":["https://en.wikipedia.org/wiki/Data_science","https://pandas.pydata.org/","http://www.openlawlab.com/2017/05/15/data-science-in-your-legal-services/","https://www.coursera.org/","https://www.coursera.org/learn/python-data-analysis","https://www.coursera.org/learn/computer-networking","https://peakd.com/technology/@stav/so-this-will-be-today-s-focus","https://jupyter.org/"],"image":["http://static.openlawlab.com/uploads/2017/05/legal-design-sketches-9.jpg"],"users":["stav"],"tags":["stem","programming","python","datascience","coursera","hive-196387"],"app":"esteem/2.2.6-surfer","format":"markdown+html","community":"esteem.app"}
created2020-06-10 19:31:00
last_update2020-06-10 19:31:00
depth0
children18
last_payout2020-06-17 19:31:00
cashout_time1969-12-31 23:59:59
total_payout_value2.696 HBD
curator_payout_value2.344 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length3,329
author_reputation1,371,953,394,127,322
root_title"The science of data"
beneficiaries
0.
accountesteemapp
weight300
max_accepted_payout1,000,000.000 HBD
percent_hbd0
post_id97,888,042
net_rshares12,949,428,217,489
author_curate_reward""
vote details (252)
@bashadow ·
$0.01
> Stay curious.

More people need to take an attitude like that. Curiosity may have killed the cat but at least it did not die of boredom.
👍  , ,
properties (23)
authorbashadow
permlinkre-steevc-qbq7kk
categorystem
json_metadata{"tags":["stem"],"app":"peakd/2020.05.5"}
created2020-06-10 20:00:15
last_update2020-06-10 20:00:15
depth1
children0
last_payout2020-06-17 20:00:15
cashout_time1969-12-31 23:59:59
total_payout_value0.010 HBD
curator_payout_value0.001 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length138
author_reputation100,388,692,638,882
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,888,492
net_rshares84,310,627,857
author_curate_reward""
vote details (3)
@bhoa ·
$0.03
Good luck on your learning quest.. learning never ends!!
👍  , ,
properties (23)
authorbhoa
permlinkqbqar1
categorystem
json_metadata{"app":"hiveblog/0.1"}
created2020-06-10 21:09:06
last_update2020-06-10 21:09:06
depth1
children0
last_payout2020-06-17 21:09:06
cashout_time1969-12-31 23:59:59
total_payout_value0.012 HBD
curator_payout_value0.013 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length56
author_reputation60,701,104,434,307
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,889,563
net_rshares100,131,929,228
author_curate_reward""
vote details (3)
@bozz ·
$0.02
Very interesting!  Personal professional development is one area that I always lag behind in.  I am usually so busy fixing everyone else's issues that I don't have time to focus on myself and my own learning.  That being said, I do have a project I am looking forward to learning and trying out this Summer.  Posts will definitely be forthcoming!
👍  
properties (23)
authorbozz
permlinkre-steevc-qbrhfq
categorystem
json_metadata{"tags":["stem"],"app":"peakd/2020.05.5"}
created2020-06-11 12:31:51
last_update2020-06-11 12:31:51
depth1
children1
last_payout2020-06-18 12:31:51
cashout_time1969-12-31 23:59:59
total_payout_value0.012 HBD
curator_payout_value0.012 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length346
author_reputation2,233,470,735,904,856
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,900,001
net_rshares91,176,089,597
author_curate_reward""
vote details (1)
@steevc ·
For it can be hard to know what to study as I am not sure what I will work on next, but it may help to have some experience of this field.

Enjoy your learning.
properties (22)
authorsteevc
permlinkre-bozz-qbrhv9
categorystem
json_metadata{"tags":["stem"],"app":"peakd/2020.05.5"}
created2020-06-11 12:40:21
last_update2020-06-11 12:40:21
depth2
children0
last_payout2020-06-18 12:40:21
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length160
author_reputation1,371,953,394,127,322
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,900,135
net_rshares0
@chitty ·
$0.02
I have picked your post for my daily hive voting initiative, Keep it up and Hive On!!
👍  
properties (23)
authorchitty
permlinkre-the-science-of-data-20200612t000231
categorystem
json_metadata""
created2020-06-12 00:02:33
last_update2020-06-12 00:02:33
depth1
children0
last_payout2020-06-19 00:02:33
cashout_time1969-12-31 23:59:59
total_payout_value0.012 HBD
curator_payout_value0.012 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length86
author_reputation86,901,300,608,582
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,911,202
net_rshares92,459,211,050
author_curate_reward""
vote details (1)
@gtown ·
$0.02
I visit this site daily looking for bargains. This popped up today if you're interested. It's JetBrains Academy. Free till next year with Java and Python. Usually $50 USD a month.

https://www.ozbargain.com.au/node/543860

Not trying to sell anything, just thought it might be useful if you're looking at on-line learning in this space. 🙂
👍  
properties (23)
authorgtown
permlinkre-steevc-qbr6wk
categorystem
json_metadata{"tags":["stem"],"app":"peakd/2020.05.5"}
created2020-06-11 08:43:33
last_update2020-06-11 08:43:33
depth1
children1
last_payout2020-06-18 08:43:33
cashout_time1969-12-31 23:59:59
total_payout_value0.012 HBD
curator_payout_value0.012 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length339
author_reputation23,149,371,614,755
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,897,277
net_rshares91,867,356,241
author_curate_reward""
vote details (1)
@steevc ·
Thanks for the tip. I will have a look.
properties (22)
authorsteevc
permlinkre-gtown-qbreng
categorystem
json_metadata{"tags":["stem"],"app":"peakd/2020.05.5"}
created2020-06-11 11:30:51
last_update2020-06-11 11:30:51
depth2
children0
last_payout2020-06-18 11:30:51
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length39
author_reputation1,371,953,394,127,322
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,899,142
net_rshares0
@jeffandhisguitar ·
$0.02
cheers steevc :)
👍  
properties (23)
authorjeffandhisguitar
permlinkqbqxtt
categorystem
json_metadata{"app":"hiveblog/0.1"}
created2020-06-11 05:27:33
last_update2020-06-11 05:27:33
depth1
children0
last_payout2020-06-18 05:27:33
cashout_time1969-12-31 23:59:59
total_payout_value0.012 HBD
curator_payout_value0.012 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length16
author_reputation54,218,915,617,587
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,895,152
net_rshares91,727,908,258
author_curate_reward""
vote details (1)
@rafaelaquino ·
$0.02
Thank you for sharing your experience. In my case since last week I'm investigating everything related to data analysis with python. I've learned a lot from some youtube videos. I also downloaded two books on data analysis. I went deep into it with "jupyter notebook" and this week I went to the web [kaggle](https://www.kaggle.com) there is a lot of material to see, learn and do. Thanks for your publication @steevc you encourage me to keep learning

Translated with www.DeepL.com/Translator (free version)
👍  
properties (23)
authorrafaelaquino
permlinkqbrkpi
categorystem
json_metadata{"users":["steevc"],"links":["https://www.kaggle.com"],"app":"hiveblog/0.1"}
created2020-06-11 13:41:45
last_update2020-06-11 13:41:45
depth1
children1
last_payout2020-06-18 13:41:45
cashout_time1969-12-31 23:59:59
total_payout_value0.012 HBD
curator_payout_value0.012 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length508
author_reputation109,066,575,680,880
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,901,131
net_rshares94,135,493,435
author_curate_reward""
vote details (1)
@steevc ·
I need to have a look at Kaggle some time. I will spend some more time on watching some videos.
properties (22)
authorsteevc
permlinkre-rafaelaquino-qbrook
categorystem
json_metadata{"tags":["stem"],"app":"peakd/2020.05.5"}
created2020-06-11 15:07:33
last_update2020-06-11 15:07:33
depth2
children0
last_payout2020-06-18 15:07:33
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length95
author_reputation1,371,953,394,127,322
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,902,604
net_rshares0
@recording-box ·
$0.02
I managed to do "Hello World" in Javascript.   I'm going to pick it back up after reading this  :)
Have you used EdX?  I have and have learned a few bits & bobs with the free stuff.
👍  
properties (23)
authorrecording-box
permlinkre-steevc-qbqpqt
categorystem
json_metadata{"tags":["stem"],"app":"peakd/2020.05.5"}
created2020-06-11 02:33:09
last_update2020-06-11 02:33:09
depth1
children1
last_payout2020-06-18 02:33:09
cashout_time1969-12-31 23:59:59
total_payout_value0.012 HBD
curator_payout_value0.012 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length181
author_reputation37,843,974,248,128
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,893,286
net_rshares91,121,360,351
author_curate_reward""
vote details (1)
@steevc ·
I may have used EdX. There are so many tutorials out there, but sometimes it is worth paying. I may be able to claim the cost anyway. Programming is fun, so keep it up.
properties (22)
authorsteevc
permlinkre-recording-box-qbrf3c
categorystem
json_metadata{"tags":["stem"],"app":"peakd/2020.05.5"}
created2020-06-11 11:40:24
last_update2020-06-11 11:40:24
depth2
children0
last_payout2020-06-18 11:40:24
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length168
author_reputation1,371,953,394,127,322
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,899,255
net_rshares0
@santigs · (edited)
$0.02
Have you checked the free python tutorials from [Corey Schafer](https://www.youtube.com/channel/UCCezIgC97PvUuR4_gbFUs5g)?
I have followed some of them and are really impressive. 
I was able to create my price evolution videos following his tutorials
👍  , ,
properties (23)
authorsantigs
permlinkre-steevc-qbqcnw
categorystem
json_metadata{"tags":["stem"],"app":"peakd/2020.05.5"}
created2020-06-10 21:50:24
last_update2020-06-10 21:51:45
depth1
children3
last_payout2020-06-17 21:50:24
cashout_time1969-12-31 23:59:59
total_payout_value0.012 HBD
curator_payout_value0.011 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length250
author_reputation140,188,596,902,353
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,890,202
net_rshares91,853,381,660
author_curate_reward""
vote details (3)
@steevc ·
Thanks, I'll have a look. If only we could get people like him posting on Hive :)
properties (22)
authorsteevc
permlinkre-santigs-qbrepn
categorystem
json_metadata{"tags":["stem"],"app":"peakd/2020.05.5"}
created2020-06-11 11:32:12
last_update2020-06-11 11:32:12
depth2
children2
last_payout2020-06-18 11:32:12
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length81
author_reputation1,371,953,394,127,322
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,899,164
net_rshares0
@santigs ·
We can suggest it. It will not hurt him to post in both places. He is kind enough to keep his content for free even if you do not contribute to his Patreon page. We could even suggest creating a python tutorial to show how to use Hive libraries.
properties (22)
authorsantigs
permlinkre-steevc-qbrin0
categorystem
json_metadata{"tags":["stem"],"app":"peakd/2020.05.5"}
created2020-06-11 12:57:12
last_update2020-06-11 12:57:12
depth3
children1
last_payout2020-06-18 12:57:12
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length245
author_reputation140,188,596,902,353
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,900,399
net_rshares0
@stav ·
$0.04
I feel fried this evening!  The book I've been working through to backup my online studies has thankfully been very useful so far. 
👍  , ,
properties (23)
authorstav
permlinkre-steevc-qbq6yz
categorystem
json_metadata{"tags":["stem"],"app":"peakd/2020.05.5"}
created2020-06-10 19:47:24
last_update2020-06-10 19:47:24
depth1
children1
last_payout2020-06-17 19:47:24
cashout_time1969-12-31 23:59:59
total_payout_value0.028 HBD
curator_payout_value0.015 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length131
author_reputation52,141,742,331,876
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,888,287
net_rshares209,780,875,714
author_curate_reward""
vote details (3)
@steevc ·
Things move so quickly that books can soon be out of date. I will see if I can get by with online resources for now. I have enough old computing books.
👍  ,
properties (23)
authorsteevc
permlinkre-stav-qbq74t
categorystem
json_metadata{"tags":["stem"],"app":"peakd/2020.05.5"}
created2020-06-10 19:50:54
last_update2020-06-10 19:50:54
depth2
children0
last_payout2020-06-17 19:50:54
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length151
author_reputation1,371,953,394,127,322
root_title"The science of data"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id97,888,362
net_rshares267,524,051
author_curate_reward""
vote details (2)