[kr-dev]하고 싶은것~( feat crawling ) by capcoms

View this thread on: hive.blog | peakd.com | ecency.com

kr · @capcoms · Mar 10 '18 (edited)

$6.50

[kr-dev]하고 싶은것~( feat crawling )

안녕하세요~ 솔로라 @capcoms 입니다~.
스팀을 본격적으로 시작한지 2주 가량이 지난것 같습니다~.

그 동안 다양한 포스팅을 접하였습니다~  소소한 일상~ 먹스팀 , 여행 ,  육아 , 책추천 , 아트 , 코인 , 운동, 개발 등~ 
당연 이중 젤 인기가 있는 글은 먹스팀 , 여행 , 육아 인것 같았습니다~  저도 이런 주제의 글을 잘 읽게 되구요.

하지만 스팀을 하면서 무언가 하고 싶다는 것이 생겼습니다~ 바로 개발&통계 포스팅 입니다~ 

개발은 @clayop  님의 스티마노 @jungs님의  주사위 & steemus 를 보며 너무 대단 하다는 생각에 멋있어 보였습니다. 비록 지금 무언가를 하기에 늦은 나이라 생각하지만 그래도 시작은 해보고 싶은 생각이 들었습니다.  

일단 간단 한거 부터 무작정 따라하고 포스팅 하자!
라는 마인드로 시작해보려 합니다~

# 첫 걸음을 시작하기 위한 준비 

![20180309_082019.jpg](https://res.cloudinary.com/hpiynhbhq/image/upload/v1520551277/s2wzr700wuw27yrjl7ll.jpg)
전 통계를 전공하고 있기 때문에 데이터만 있으면 무언가 할수 있겠다 생각을 하여 크롤링 관련 책을 구입 하였습니다.

![20180309_084422.jpg](https://res.cloudinary.com/hpiynhbhq/image/upload/v1520552712/gbnv7uadab4javojnljm.jpg)
대상독자 
세가지 사항중 2,3번은 해당 되군요 호호
(코딩은 무뇌한 인데 큰일이군요~)

![20180309_083204.jpg](https://res.cloudinary.com/hpiynhbhq/image/upload/v1520551981/xdogbdjcc5f9iu7iyyti.jpg)
첫페이지 소개글에 정리되어 있는 부분입니다~ 
4가지 단계로 진행하라고 나와 있네요~
\*.*/ 너무너무 간단해 보이네요~



# 첫번째 미션 [데이터를 획득]하자!!

스팀을 하다보면 lee2님께서 태그를 활용하여 주소 데이터를 수집 하고 찾아와 감사의 댓글을 달아주고 가는걸 경험 했었 습니다.  저도 스팀 사이트에서 어떤 정보든 크롤링 해보고 싶다는 생각에 첫번째 미션으로 정하였습니다~

첫번째 미션이 성공하면 후기 & 다음 포스팅 하겠습니다~

제에게 응원은 힘이 됩니다~  스팀 가즈아~

👍 ilovemylife, cheongpyeongyull, ksc, centering, eunyx, hjk96, virus707, dkim86, yourhoney, daldalmango, capcoms, coinmaker, joons, ballantines30, agee00, konaldo88, arbitragedy, younbokum, lovehm1223, supergiant, mrjang, sisicoco, zoretko, tiny657

`author`	capcoms
`permlink`	kr-dev-feat-crawling
`category`	kr
`json_metadata`	{"community":"busy","app":"busy/2.4.0","format":"markdown","tags":["kr","kr-newbie","busy","jjangjjangman","kr-dev"],"users":["capcoms","clayop","jungs"],"links":["/@capcoms","/@clayop","/@jungs"],"image":["https://steemitimages.com/0x0/https://res.cloudinary.com/hpiynhbhq/image/upload/v1520551277/s2wzr700wuw27yrjl7ll.jpg","https://steemitimages.com/0x0/https://res.cloudinary.com/hpiynhbhq/image/upload/v1520552712/gbnv7uadab4javojnljm.jpg","https://steemitimages.com/0x0/https://res.cloudinary.com/hpiynhbhq/image/upload/v1520551981/xdogbdjcc5f9iu7iyyti.jpg"]}
`created`	2018-03-08 23:53:12
`last_update`	2018-03-10 01:08:24
`depth`	0
`children`	18
`last_payout`	2018-03-15 23:53:12
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	5.194 HBD
`curator_payout_value`	1.306 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	1,191
`author_reputation`	1,547,476,609,082
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,212,820
`net_rshares`	1,713,607,705,264
`author_curate_reward`	""

properties (23)vote details (24)

voter	rshares	pct
ksc	172,475,628,430	20%
coinmaker	47,236,739,206	100%
centering	145,506,435,431	9%
cheongpyeongyull	197,110,221,722	11%
hjk96	100,272,020,480	30%
virus707	81,690,863,193	1%
capcoms	54,529,517,227	100%
lovehm1223	15,186,220,911	9%
ilovemylife	435,821,892,243	100%
daldalmango	57,191,657,087	40%
arbitragedy	19,198,931,583	100%
younbokum	18,508,418,644	29%
mrjang	4,772,144,857	20%
supergiant	11,242,042,818	5%
zoretko	557,234,382	100%
dkim86	71,965,988,119	100%
yourhoney	65,791,529,003	7%
joons	31,225,070,464	100%
konaldo88	20,462,147,417	100%
agee00	22,531,507,965	100%
eunyx	109,383,682,599	48%
ballantines30	27,429,750,967	68%
tiny657	523,951,186	100%
sisicoco	2,994,109,330	100%

@daldalmango · Mar 9 '18

응원해요~! 저도 그런거 만들어보고 싶어요!

properties (22)

`author`	daldalmango
`permlink`	re-capcoms-kr-dev-feat-crawling-20180309t050428849z
`category`	kr
`json_metadata`	{"tags":["kr"],"app":"steemit/0.1"}
`created`	2018-03-09 05:04:30
`last_update`	2018-03-09 05:04:30
`depth`	1
`children`	1
`last_payout`	2018-03-16 05:04:30
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	24
`author_reputation`	5,489,753,712,056
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,252,495
`net_rshares`	0

@capcoms · Mar 9 '18

함께해요~~^^

properties (22)

`author`	capcoms
`permlink`	re-daldalmango-re-capcoms-kr-dev-feat-crawling-20180309t063500344z
`category`	kr
`json_metadata`	{"tags":["kr"],"app":"steemit/0.1"}
`created`	2018-03-09 06:35:12
`last_update`	2018-03-09 06:35:12
`depth`	2
`children`	0
`last_payout`	2018-03-16 06:35:12
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	8
`author_reputation`	1,547,476,609,082
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,264,252
`net_rshares`	0

@eunyx · Mar 9 '18

**[히치의 기본소득 보팅 Event #9]**에 당첨되셨습니다. 축하드립니다^^

크롤링 성공 포스팅을 기대하겠습니다.

properties (22)

`author`	eunyx
`permlink`	re-capcoms-kr-dev-feat-crawling-20180309t134852936z
`category`	kr
`json_metadata`	{"tags":["kr"],"community":"busy","app":"busy/2.4.0"}
`created`	2018-03-09 13:49:03
`last_update`	2018-03-09 13:49:03
`depth`	1
`children`	1
`last_payout`	2018-03-16 13:49:03
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	67
`author_reputation`	5,327,071,188,566
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,329,464
`net_rshares`	0

@capcoms · Mar 10 '18

당첨 감사합니다~

properties (22)

`author`	capcoms
`permlink`	re-eunyx-re-capcoms-kr-dev-feat-crawling-20180310t010337652z
`category`	kr
`json_metadata`	{"tags":["kr"],"app":"steemit/0.1"}
`created`	2018-03-10 01:03:39
`last_update`	2018-03-10 01:03:39
`depth`	2
`children`	0
`last_payout`	2018-03-17 01:03:39
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	9
`author_reputation`	1,547,476,609,082
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,424,925
`net_rshares`	0

@hjk96 · Mar 9 '18

화이팅입니다

properties (22)

`author`	hjk96
`permlink`	re-capcoms-kr-dev-feat-crawling-20180309t054150304z
`category`	kr
`json_metadata`	{"tags":["kr"],"app":"steemit/0.1"}
`created`	2018-03-09 05:42:03
`last_update`	2018-03-09 05:42:03
`depth`	1
`children`	1
`last_payout`	2018-03-16 05:42:03
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	6
`author_reputation`	215,294,071,096,398
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,257,588
`net_rshares`	0

@capcoms · Mar 9 '18

반님 응원 감사합니다. ~

properties (22)

`author`	capcoms
`permlink`	re-hjk96-re-capcoms-kr-dev-feat-crawling-20180309t063352312z
`category`	kr
`json_metadata`	{"tags":["kr"],"app":"steemit/0.1"}
`created`	2018-03-09 06:33:54
`last_update`	2018-03-09 06:33:54
`depth`	2
`children`	0
`last_payout`	2018-03-16 06:33:54
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	14
`author_reputation`	1,547,476,609,082
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,264,090
`net_rshares`	0

@hongyeol · Mar 9 '18

와우...통계를 전공으로 하고 계시다니!
저두 딥러닝과 머신러닝에 관심은 많은데...네 관심만 많습니다...
포스팅보며 앞으로 조금씩 배워가면 되나요?ㅎㅎ

properties (22)

`author`	hongyeol
`permlink`	re-capcoms-kr-dev-feat-crawling-20180309t065832017z
`category`	kr
`json_metadata`	{"tags":["kr"],"app":"steemit/0.1"}
`created`	2018-03-09 06:58:33
`last_update`	2018-03-09 06:58:33
`depth`	1
`children`	0
`last_payout`	2018-03-16 06:58:33
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	86
`author_reputation`	2,669,821,076,765
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,267,415
`net_rshares`	0

@lovehm1223 · Mar 9 '18

오.. 응원합니다. !! 어떤 통계가 나올지 궁금하네요 ^.^

properties (22)

`author`	lovehm1223
`permlink`	re-capcoms-kr-dev-feat-crawling-20180309t055019992z
`category`	kr
`json_metadata`	{"tags":["kr"],"app":"steemit/0.1"}
`created`	2018-03-09 05:50:24
`last_update`	2018-03-09 05:50:24
`depth`	1
`children`	1
`last_payout`	2018-03-16 05:50:24
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	34
`author_reputation`	22,285,431,158,774
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,258,621
`net_rshares`	0

@capcoms · Mar 9 '18

아직 어떤 통계를 산출 할지는 고민입니다. ~^^
우선 첫번째 미션을 ^^~ 통과 해보겠습니다.

properties (22)

`author`	capcoms
`permlink`	re-lovehm1223-re-capcoms-kr-dev-feat-crawling-20180309t063434022z
`category`	kr
`json_metadata`	{"tags":["kr"],"app":"steemit/0.1"}
`created`	2018-03-09 06:34:36
`last_update`	2018-03-09 06:34:36
`depth`	2
`children`	0
`last_payout`	2018-03-16 06:34:36
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	53
`author_reputation`	1,547,476,609,082
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,264,181
`net_rshares`	0

@sirin418 · Mar 8 '18

응원합니다. 저도 코딩 공부 중인데, 같이 열심히 하시죠. 스팀 가즈아.

properties (22)

`author`	sirin418
`permlink`	re-capcoms-kr-dev-feat-crawling-20180308t235722720z
`category`	kr
`json_metadata`	{"tags":["kr"],"app":"steemit/0.1"}
`created`	2018-03-08 23:57:54
`last_update`	2018-03-08 23:57:54
`depth`	1
`children`	1
`last_payout`	2018-03-15 23:57:54
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	40
`author_reputation`	6,063,109,716,569
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,213,341
`net_rshares`	0

@capcoms · Mar 9 '18

같이 화이팅 입니다.

properties (22)

`author`	capcoms
`permlink`	re-sirin418-re-capcoms-kr-dev-feat-crawling-20180309t063318730z
`category`	kr
`json_metadata`	{"tags":["kr"],"app":"steemit/0.1"}
`created`	2018-03-09 06:33:30
`last_update`	2018-03-09 06:33:30
`depth`	2
`children`	0
`last_payout`	2018-03-16 06:33:30
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	11
`author_reputation`	1,547,476,609,082
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,264,041
`net_rshares`	0

@tiny657 · Mar 9 '18

저도 공부해 보고 싶네요.  화이팅!!

properties (22)

`author`	tiny657
`permlink`	re-capcoms-kr-dev-feat-crawling-20180309t091152667z
`category`	kr
`json_metadata`	{"tags":["kr"],"app":"steemit/0.1"}
`created`	2018-03-09 09:11:54
`last_update`	2018-03-09 09:11:54
`depth`	1
`children`	0
`last_payout`	2018-03-16 09:11:54
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	21
`author_reputation`	40,536,083,354
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,287,896
`net_rshares`	0

@virus707 · Mar 9 '18

스팀마노는 @clayop님의 프로젝트입니다^^  저랑은 무관~

properties (22)

`author`	virus707
`permlink`	re-capcoms-kr-dev-feat-crawling-20180309t151048256z
`category`	kr
`json_metadata`	{"tags":["kr"],"users":["clayop"],"app":"steemit/0.1"}
`created`	2018-03-09 15:10:42
`last_update`	2018-03-09 15:10:42
`depth`	1
`children`	1
`last_payout`	2018-03-16 15:10:42
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	34
`author_reputation`	557,563,606,581,756
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,343,988
`net_rshares`	0

@capcoms · Mar 10 '18

앗 홍보를 해주셔서 잘 몰라 뵙습니다^^;

properties (22)

`author`	capcoms
`permlink`	re-virus707-re-capcoms-kr-dev-feat-crawling-20180310t010314978z
`category`	kr
`json_metadata`	{"tags":["kr"],"app":"steemit/0.1"}
`created`	2018-03-10 01:03:18
`last_update`	2018-03-10 01:03:18
`depth`	2
`children`	0
`last_payout`	2018-03-17 01:03:18
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	23
`author_reputation`	1,547,476,609,082
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,424,883
`net_rshares`	0

@virus707 · Mar 9 '18

짱짱맨 태그 사용에 감사드립니다^^
존버앤캘리 이번편은 왠지 찡함..^^ 
https://steemit.com/kr/@mmcartoon-kr/20180307
[골든티켓x짱짱맨x워니프레임] 10차 옴팡이 이모티콘 증정
https://steemkr.com/kr/@goldenticket/x-x-10-100

properties (22)

`author`	virus707
`permlink`	re-kr-dev-feat-crawling-1520628125769uid
`category`	kr
`json_metadata`	{"tags":["support"],"users":["mmcartoon-kr","goldenticket"],"links":["https://steemit.com/kr/@mmcartoon-kr/20180307","https://steemkr.com/kr/@goldenticket/x-x-10-100"],"app":"SteemJ-Core/0.4.3","format":"markdown"}
`created`	2018-03-09 20:42:06
`last_update`	2018-03-09 20:42:06
`depth`	1
`children`	0
`last_payout`	2018-03-16 20:42:06
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	168
`author_reputation`	557,563,606,581,756
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,394,946
`net_rshares`	0

@younbokum · Mar 9 '18

정말 이런 포스팅을 보면 서 배워야지 배워야지 하는데 
정말 게으른 1인이네요 전 여행이나 먹스팀위주로 스팀을 하는데 
새로운 통계포스팅 기대할께요

properties (22)

`author`	younbokum
`permlink`	re-capcoms-kr-dev-feat-crawling-20180309t131311809z
`category`	kr
`json_metadata`	{"tags":["kr"],"app":"steemkr/0.1"}
`created`	2018-03-09 13:13:12
`last_update`	2018-03-09 13:13:12
`depth`	1
`children`	1
`last_payout`	2018-03-16 13:13:12
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	82
`author_reputation`	3,594,075,005,579
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,323,426
`net_rshares`	0

@capcoms · Mar 10 '18

응원감사합니다~  여행 포스팅도  쭉 기대하겠습니다~

properties (22)

`author`	capcoms
`permlink`	re-younbokum-re-capcoms-kr-dev-feat-crawling-20180310t010436665z
`category`	kr
`json_metadata`	{"tags":["kr"],"app":"steemit/0.1"}
`created`	2018-03-10 01:04:39
`last_update`	2018-03-10 01:04:39
`depth`	2
`children`	0
`last_payout`	2018-03-17 01:04:39
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	29
`author_reputation`	1,547,476,609,082
`root_title`	"[kr-dev]하고 싶은것~( feat crawling )"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	43,425,047
`net_rshares`	0

@yourhoney · Mar 9 '18

(오늘보팅 78)

와 이런걸 개발하시는 분들도 대단하지만
개발하려고 마음먹으신 cpacoms님도 대단쓰..!! 응원합니당

properties (22)