• 검색 결과가 없습니다.

Design and Implementation of Automated Twitter Data Collecting System : Focus on Environmental Data

N/A
N/A
Protected

Academic year: 2021

Share "Design and Implementation of Automated Twitter Data Collecting System : Focus on Environmental Data"

Copied!
4
0
0

로드 중.... (전체 텍스트 보기)

전체 글

(1)

㧦☯䢪♲

䔎㥚䎆 ◆㧊䎆 㑮㰧 㔲㓺䎲 ㍺Ἒ ⹥ ῂ䡚 :

䢮ἓ

◆㧊䎆⯒

㭧㕂㦒⪲

ₖ☚䡫*, ῂ㧦䢮**, ₖ㦧⳾*** *㎇‶ὖ╖䞯ᾦ ㏢䝚䔎㤾㠊╖䞯 ** ㎇‶ὖ╖䞯ᾦ ㌂䣢ὒ䞯╖䞯 *** ㎇‶ὖ╖䞯ᾦ ㌂䣢ὒ䞯╖䞯 ㏢゚㧦Ṗ㫇䞯ὒ / ㏢䝚䔎㤾㠊╖䞯 [email protected], [email protected], [email protected]

G

Design and Implementation of Automated Twitter Data

Collecting System : Focus on Environmental Data

Do-Hyung Kim* Jahwan Koo**, Ung-Mo Kim*** *College of Software, Sungkyunkwan University ** College of Social Sciences, Sungkyunkwan University

*** Dept. of Consumer and Family Sciences, College of Social Sciences / College of Software, Sungkyunkwan University 殚檃 ㏢㎲ ⍺䔎㤢䋂 ㍲゚㓺㦮 ㌂㣿㧦Ṗ ⓮㠊⋮Ⳋ㍲, ㏢㎲ ⍺䔎㤢䋂 ㍲゚㓺㌗㠦㍲ ⹲㌳䞮⓪ ゛◆㧊䎆 ⯒ 䢲㣿䞲 ㍲゚㓺Ṗ ⓮㠊⋮ἶ 㧞┺. ㏢㎲ ⍺䔎㤢䋂 ㍲゚㓺 ◆㧊䎆⓪ 㔺㔲Ṛ㦒⪲ ㌳㎇♮Ⳇ, ➆⧒㍲ ◆㧊䎆 㑮㰧 㔲㓺䎲 㡃㔲 㧦☯䢪䞮㡂 㭖 㔺㔲Ṛ㦒⪲ ◆㧊䎆⯒ 㑮㰧䞶 䞚㣪Ṗ 㧞┺. ⽎ ⏒ⶎ㠦㍲⓪ ╖䚲㩗㧎 ㏢㎲ ⍺䔎㤢䋂 ㍲゚㓺㧎 䔎㥚䎆㦮 ◆㧊䎆⯒ 㰖㏣㩗㦒⪲ 㑮㰧䞮₆ 㥚䞲 㧦☯ 㑮㰧 㔲㓺䎲 㦚 㩲㞞䞲┺. 㑮㰧 㔲㓺䎲㦖 Twitter API ⯒ 䢲㣿䞮⓪ Python ⧒㧊ぢ⩂Ⰲ⯒ 䐋䟊 ⌊㣿 ⹥ Ⲫ䌖◆㧊䎆 ⯒ 㑮㰧䞮Ⳇ, 㑮㰧♲ ◆㧊䎆⯒ 㨂 Ỗ㯳䞲 ⛺ 㩖㧻䞲┺. ⡦䞲 ῂ䡚♲ 㔲㓺䎲㠦 䢮ἓ ◆㧊䎆⯒ 㭒㩲⪲ 䞮⓪ 䉒Ⰲ⯒ 㧛⩻䞮㡂 㔺㩲 䔎㥚䎆 ◆㧊䎆⯒ 㑮㰧䞮Ⳇ ῂ䡚♲ 㔲㓺䎲㦚 Ỗ㯳䟊⽊㞮┺. 1. 昢嵦 㾲⁒ 䔎㥚䎆, 䗮㧊㓺⿗ὒ ṯ㦖 SNS(Social Network Service) ㌂㣿㧦Ṗ ⓮㠊⋮Ⳋ㍲, SNS 㠦㍲ ⹲㌳䞮⓪ ╖ ⨟㦮 ◆㧊䎆⯒ 㩫䂮, ἓ㩲, ⶎ䢪 ❇ ┺㟧䞲 ⿚㟒㠦 䢲 㣿䞮⩺⓪ ⏎⩻㧊 Ἒ㏣♮ἶ 㧞┺. 㧊⩂䞲 SNS 㠦㍲ ㌳ ㎇♮⓪ ◆㧊䎆⓪ ゛◆㧊䎆㦮 㩫㦮㠦 㩫䢫䧞 ⿖䞿䞲┺. 㯟, 㩫䡫䢪♮㰖 㞠ἶ, ╖㣿⨟㧊Ⳇ, 㔺㔲Ṛ㦒⪲ ㌳㎇♲ ┺[1]. ➆⧒㍲ 㧊⩂䞲 SNS ゛◆㧊䎆⯒ 䔏㎇㠦 ⰴỢ 䢲㣿䞮₆ 㥚䟊㍲⓪ 㞞㩫㩗㧊ἶ 㰖㏣㩗㦒⪲ ◆㧊䎆⯒ 㑮㰧䞶 㑮 㧞⓪ 㔲㓺䎲㧊 㣪ῂ♲┺. Ⱔ㦖 㡆ῂ㧦✺㧊 ┾₆㩗㧎 ◆㧊䎆 ⿚㍳㦚 㥚䟊 䔎 㥚䎆 ◆㧊䎆 㑮㰧 㔲㓺䎲㦚 ㍺Ἒ, ῂ䡚䟊㢪┺. 䔎㥚䎆 ⓪ 䔎㥚䎆 ◆㧊䎆㠦 㩧⁒䞮₆ 㥚䞲 API ⯒ ὋṲ䞮ἶ 㧞㦒Ⳇ, 㥏䗮㧊㰖⯒ 䐋䞲 Ỗ㌟☚ Ṗ⓻䞮┺. ⡦䞲 䔎㥚 䎆 ◆㧊䎆⯒ 㑮㰧䞮⓪ ┺㟧䞲 Third party API ⹥ ⧒㧊 ぢ⩂Ⰲ☚ Ⱒ✺㠊㪎 㧞┺. 㤆Ⰲ 㡆ῂ㠦㍲⓪ 㩫䟊㰚 䉒Ⰲ㠦 ➆⧒ 䔎㥚䎆 ◆㧊 䎆⯒ 㑮㰧䞮Ⳇ, ⿞䞚㣪䞲 ◆㧊䎆㢖 㭧⽋ ◆㧊䎆⯒ 㩲 Ệ䞲 䤚 ⋶㰲 ⼚⪲ ⋮⑚㠊 㩖㧻䞮⓪ ὒ㩫㦚 㰖㏣㩗㦒 ⪲ 㑮䟟䞮⓪ 㔲㓺䎲㦚 㩲㞞䞲┺. 㧊⯒ 䐋䟊 㭖 㔺㔲Ṛ㦒⪲, 㰖㏣㩗㦒⪲ 䔎㥚䎆 ◆㧊 䎆⯒ 㑮㰧䞶 ➢ ⹲㌳䞶 㑮 㧞⓪ ◆㧊䎆 㭧⽋ ⹥ ṗ㫛 㡞㣎 ㌗䢿㠦 ╖䞲 ὖⰂ⯒ ㌂㣿㧦㦮 㫆㧧 㠜㧊☚ 㔲㓺 䎲 㧦㼊㩗㦒⪲ 㰖㤦䞶 㑮 㧞┺. ⽎ ⏒ⶎ㦮 ῂ㫆⓪ ┺㦢ὒ ṯ┺. 2 㧻㠦㍲⓪ 䔎㥚䎆 ◆㧊䎆⯒ 㑮㰧 㔲㓺䎲㦚 ㍺Ἒ ⹥ ῂ䡚䞮㡖▮ ┺㟧䞲 ㍶䟟 㡆ῂ⯒ ㏢Ṳ䞮ἶ, 䔎㥚䎆 ◆㧊䎆⯒ 㑮㰧䞮⓪ ┺ 㟧䞲 ⹿⻫㦚 ㍲㑶䞲┺. 3 㧻㠦㍲⓪ ⽎ 㡆ῂ㠦㍲ 㩲㞞 䞮⓪ 㧦☯䢪♲ 䔎㥚䎆 ◆㧊䎆 㑮㰧 㔲㓺䎲㦮 㣪ῂ㫆 Ịὒ ῂ㫆⯒ 㩲㞞䞲┺. 㧊㠊 4 㧻㠦㍲ 䢮ἓ㦚 㭒㩲⪲ 㔺㩲 䔎㥚䎆 ◆㧊䎆⯒ 㑮㰧䞮㡂 ἆὒ⯒ 䢫㧎䞲 䤚, 5 㧻㠦㍲ ἆ⪶ὒ 䟻䤚 Ἒ䣣㠦 ╖䟊 ⹳䧢┺. 2. 分崮 櫶割 2.1. SNS 塶決瘶 朞滗 昦窏櫶割

Byun, Kim, et al(2012)㦖 Twitter API 㢖 Java ⯒ 㧊㣿 䞮㡂 㧦☯䢪♲ 䔎㥚䎆 ◆㧊䎆 㑮㰧 㔲㓺䎲㦚 㩲㞞䞮 㡖┺. 㩲㞞♲ 㔲㓺䎲㦖 䔎㥚䎆 Ἒ㩫Ṛ 䕪⪲㤆 ὖἚ⯒

361

(2)

䐋䟊 ◆㧊䎆⯒ 㑮㰧䞲 䤚, 㑮㰧♲ ◆㧊䎆 ⌊㠦㍲ 䋺 㤢✲ Ỗ㌟㦚 䐋䟊 㤦䞮⓪ ◆㧊䎆⯒ ◆㧊䎆⻶㧊㓺㠦 㩖㧻䞲┺.[2] 㾲⹒㍳(2015)㦖 Twitter API ⯒ 㧊㣿䞮㡂 㥶㩖Ṗ 㧛⩻ 䞲 ὖ㕂 䋺㤢✲㠦 ╖䞲 䔎㥚䎆 ◆㧊䎆⯒ 㑮㰧䞲 䤚, ⿚㍳ ⹥ 㔲ṗ䢪䞮⓪ 㔲㓺䎲㦚 㩲㞞䞮㡖┺. 㩲㞞♲ 㔲 㓺䎲㦖 䔎㥭 ◆㧊䎆⯒ 䞮⬾ ⿚⨟Ⱒ MySQL DB 㠦 㩖 㧻䞮Ⳇ, ⁎ 㣎㠦⓪ ⿚㍳ 㢚⬢♲ ◆㧊䎆Ⱒ 㩖㧻䞲┺. ⡦䞲 ὖ㕂 䋺㤢✲㠦 ╖䞲  ỿ䞲 䔎㥭 㯳Ṗ⯒ Ṧ㰖䞮 㡂 㥶㩖Ṗ 㧊⯒ 䕢㞛䞶 㑮 㧞☚⪳ 䞮㡖┺.[3] 䞮㔏☚ ❇(2016)㦖 䔎㥚䎆⪲⿖䎆 ╖䢪䡫 Ⱖ⶟䂮 ◆ 㧊䎆⯒ 㑮㰧䞮₆ 㥚䞮㡂 㥏 䋂⪺Ⱇ ⹿㔳㦚 㩲㞞䞮㡖 㦒Ⳇ, ₆㫊㦮 䔎㥚䎆 API ₆⹮㦮 ◆㧊䎆 㑮㰧₆㢖 ゚ ᾦ䞮㡂 ṯ㦖 㔲Ṛ☯㞞 ▪ Ⱔἶ 㢚㩚䞲 Ⱖ⶟䂮 ◆㧊䎆 ⯒ 㠑㦚 㑮 㧞㠞┺.[4] 2.2. 瞾瞾氊瘶 塶決瘶汞 朞滗 愯憛 䔎㥚䎆⓪ Tweet ◆㧊䎆㠦 㩧⁒䞮₆ 㥚䞲 API[5]⯒ ὋṲ䞮ἶ㧞┺. 䔎㥚䎆 Ἒ㩫㦚 䐋䟊 API key ⯒ 㰖 ⹱ 㞚 ㌂㣿䞶 㑮 㧞㦒Ⳇ, ⶊ⬢ ⧒㧊㎒㓺㦮 ἓ㤆 㾲⁒ 7 㧒 㧊⌊㦮 ◆㧊䎆㠦 ╖䞲 Ỗ㌟㧊 Ṗ⓻䞮┺. 䔎㥚䎆 㥏 䗮㧊㰖㦮 ἶ  Ỗ㌟ ₆⓻㦚 䢲㣿䞮㡂 㥏 䋂⪺Ⱇ ⹿⻫㦒⪲ 䔎㥚䎆 ◆㧊䎆⯒ 㑮㰧䞶 㑮☚ 㧞┺. https://twitter.com/search?q=<keyword>&src=typed_query& f=live 㭒㏢㦮 <keyword>㠦 Ỗ㌟ 䉒Ⰲ⯒ 㧛⩻䞮㡂 URL 㦚 ㌳㎇䞶 㑮 㧞㦒Ⳇ, 䞲 ⻞㠦 ⳾✶ 㩫⽊⯒ 䚲㔲 䞮㰖 㞠₆ ⟚ⶎ㠦 ṯ㦖 㥏 䗮㧊㰖㠦 ╖䟊 㓺䋂⪺ 㩫 ⽊⯒ 㰖㏣㩗㦒⪲ ẇ㔶䞮Ⳇ 㣪㼃䟊㟒 㢚㩚䞲 㩫⽊⯒ 㠑㦚 㑮 㧞┺. Python3 ⧒㧊ぢ⩂Ⰲ㧎 GetOldTweets3[6]㦖 䔎㥚䎆㦮 㥏 API ⯒ ㌂㣿䞮㡂 䔎㥚䎆 ◆㧊䎆⯒ 㑮㰧䞲┺. 䔎㥚 䎆Ṗ 㩲Ὃ䞮⓪ 䝚⪲⁎⧮⹣ 㠎㠊 㑮㭖㦮 API Ṗ Ṗ㰚 ┾㩦㧎 ⋶㰲 㩲䞲㧊 㠜ἶ, 㥏 䋂⪺Ⱇ ⹿㔳ὒ Ⱎ㺂Ṗ 㰖⪲ 䉒Ⰲ⯒ 㧧㎇䞮㡂 ◆㧊䎆⯒ 㑮㰧䞶 㑮 㧞┺. ➆ ⧒㍲ ⽎ 㡆ῂ㠦㍲⓪ 䟊╏ ⧒㧊ぢ⩂Ⰲ⯒ 䐋䟊 䔎㥚䎆 㦮 ◆㧊䎆⯒ 㑮㰧䞲┺. 3. 瞾氊瘶 畲嵪峲 柢枪癢 把昣 愕 割昷 3.1. 殚割浶兺 ⽎ 㡆ῂ㠦㍲ ㍺Ἒ䞲 Tweet ◆㧊䎆 㑮㰧 㔲㓺䎲㦖 ┺㦢ὒ ṯ㦖 㣪ῂ㫆Ị㦚 㿿㫇㔲䅲㟒 䞲┺. 㔲㓺䎲㦚 ῂ㿫䞲 䤚㠦⓪ 㿪Ṗ㩗㧎 㥶㩖㦮 㫆㧧 㠜 㧊 㧦☯㩗㧊ἶ 㰖㏣㩗㦒⪲ 㾲㔶 ◆㧊䎆⯒ 㑮㰧䞮㡂 ₆㫊 ◆㧊䎆㠦 㿪Ṗ䟊㟒 䞲┺. 㑮㰧䞶 Tweet ◆㧊䎆⓪ 㡂⩂ 㫛⮮㧊Ⳇ, ṗṗ ㌂㩚 㠦 㧧㎇♲ Ỗ㌟㔳ὒ 㩲㣎㔳㧊 㫊㨂䞲┺. Tweet 㦮 ⌊㣿 㧊 Ỗ㌟㔳㠦 䙂䞾♮Ⳋ㍲ 㩲㣎㔳㠦⓪ 䙂䞾♮㰖 㞠⓪ ◆㧊䎆⯒ 㑮㰧, 㩖㧻䟊㟒 䞲┺. 3.2. 柢枪癢 橊疪癓燖 GetOldTweets3 ⧒㧊ぢ⩂Ⰲ⓪ Python 䢮ἓ㠦㍲ ㌂㣿 Ṗ⓻䞮┺. GetOldTweets3.manager.TweetCriteria 䞾㑮⯒ ㌂㣿䞮㡂 Ỗ㌟ 䉒Ⰲ ⹥ Ỗ㌟ ₆Ṛ ❇㦚 ㍺㩫䞲 䤚, GetOldTweets3.manager.TweetManager.getTweets 䞾㑮⯒ ㌂㣿䞮Ⳋ Twitter API ⯒ 䢲㣿䞮㡂 ◆㧊䎆⯒ 㑮㰧䞲 䤚, 㑮㰧 ἆὒ⯒ ♮☢⩺㭖┺. Twitter API ⓪ Ỗ㌟ 䉒Ⰲ⯒ 䐋䟊 ◆㧊䎆⯒ 㣪㼃 㔲 䉒Ⰲ㦮 Ỗ㌟㠊⯒ Tweet 㦮 ⌊㣿㈦ 㞚┞⧒ 㧧㎇㧦ⳛ₢ 㰖 䙂䞾䞮㡂 Ỗ㌟䞮⓪ 䔏㰫㧊 㧞┺. Twitter API ⯒ ㌂ 㣿䞮⓪ GetOldTweets3 ⧒㧊ぢ⩂Ⰲ⯒ 䐋䟊 㑮㰧䞲 ◆ 㧊䎆 㡃㔲 ṯ㦖 䔏㎇㦚 Ṗ㰚┺. 㧊⩝Ợ 㑮㰧♲ ◆㧊䎆⓪ ⽎ 㔲㓺䎲㧊 㤦䞮⓪ ◆㧊 䎆Ṗ 㞚┞⸖⪲, 㿪Ṗ㩗㧎 ◆㧊䎆 Ỗ㯳 㧧㠛㦚 䐋䟊 ⌊㣿㠦 Ỗ㌟㠊Ṗ 䙂䞾♮㰖 㞠⓪ ◆㧊䎆⯒ 㩲Ệ䞮⓪ 㧧㠛㧊 䞚㣪䞮┺. 㩲㣎㠊 㡃㔲 Twitter API 㠦 䙂䞾䞮㡂 㣪㼃䞶 ἓ㤆, 㑮㰧♮㠊㟒 䞶 ◆㧊䎆Ṗ 㩲㣎㔳㧊 䙂䞾♲ 㧧㎇㧦ⳛ㦒 ⪲ 㧎䟊 㑮㰧♮㰖 㞠㦚 㑮 㧞┺. ➆⧒㍲ Ỗ㌟㠊Ⱒ㦒 ⪲ 㧊⬾㠊㰚 䉒Ⰲ⯒ 㧧㎇䞮㡂 ◆㧊䎆⯒ 㑮㰧䞮ἶ, 㧊 䤚 㩲㣎㠊Ṗ 䙂䞾♲ ◆㧊䎆⯒ 㩲Ệ䞮⓪ 㧧㠛㧊 䞚㣪 䞮┺.

(⁎Ⱂ 1) Tweet 㑮㰧 㔲㓺䎲㦮 activity diagram 1. Task Scheduler Ṗ 䋂⪺⩂ 䝚⪲⁎⧾㦚 㔺䟟㔲䋾┺. 2. 㧊㩚㠦 㧧㎇♲ ⪲⁎ 䕢㧒㦚 䐋䟊 Ỗ㌟ 㔲㧧㔲㩦 㦚 䕢㞛䞲┺. 3,4. 䉒Ⰲ 䕢㧒㦚 䟊㍳䞮㡂 Ỗ㌟㠊㢖 㩲㣎㠊 䋺㤢✲ ⶟䂮⯒ Ⱒ✶┺. 5. GetOldTweets3 ⧒㧊ぢ⩂Ⰲ㠦 Ỗ㌟㠊⪲ 㧊⬾㠊㰚 䉒Ⰲ㢖 Ỗ㌟ ₆Ṛ㦚 㰖㩫䞮㡂 ◆㧊䎆⯒ 㑮㰧 㣪㼃䞲 ┺.

6,7. GetOldTweets3 ⧒㧊ぢ⩂Ⰲ⓪ Twitter API 㠦 䟊╏ 䉒Ⰲ⯒ 㩚㏷䞮㡂 ◆㧊䎆⯒ 㑮㰧䞲┺. 8. 㑮㰧♲ ◆㧊䎆⯒ Controller 㠦 ♮☢⩺㭖┺. 9,10. ◆㧊䎆 Ỗ㯳 㧧㠛㦚 䐋䟊 ⌊㣿㠦 Ỗ㌟㠊Ṗ 䙂 䞾♮㰖 㞠Ệ⋮, 㩲㣎㠊Ṗ 䙂䞾♲ ◆㧊䎆⯒ 㩲Ệ䞲┺. 11. 㾲㫛㩗㦒⪲ 㠑㦖 ◆㧊䎆⯒ 㩖㧻䞲┺.

362

-2020 온라인 춘계학술발표대회 논문집 제27권 제1호 (-2020. 5)

(3)

(⁎Ⱂ 2) Tweet 㑮㰧 㔲㓺䎲㦮 sequence diagram

(⁎Ⱂ 2)㠦 ⳛ㔲♲ Crawler 㦮 ⌊⿖ ῂ㫆⓪ (⁎Ⱂ 1) 㦮 activity diagram 㠦㍲ 䚲䡚♲ ⌊㣿ὒ ṯ┺.

㥶㩖Ṗ OS 㦮 Task Scheduler ⯒ ㍺㩫䞮Ⳋ, Crawler ⓪ 㡺㰗 Task Scheduler 㠦 㦮䟊㍲Ⱒ 㔺䟟♮Ⳇ, 㢚㎇♲ ◆ 㧊䎆⓪ User 㠦Ợ 䕢㧒⪲㖾 㩲Ὃ♲┺. 㧊 ὒ㩫㠦㍲ Twitter API Ṗ 㦧╋䞮㰖 㞠㦚 ἓ㤆㠦 ╖䟊 㾲╖ ⚦ ⻞ ₢㰖 㑮㰧㦚 㔲☚䞲┺. 4. 割割笊 愯憛 㤆Ⰲ⓪ ⽎ 㔲㓺䎲㦚 䢲㣿䞮㡂 Twitter 㠦㍲ 䢮ἓ ὖ ⩾ 㠎 㧊 䙂䞾♲ Tweet 㦚 㑮㰧䞮㡖┺. 㑮㰧䞶 䢮ἓ ◆㧊䎆⓪ (⁎Ⱂ 3)ὒ ṯ㧊 3 㫛⮮㦮 ╖ ⿚⮮⪲ ⋮③ 㑮 㧞㦒Ⳇ, 3 㫛㦮 ◆㧊䎆⓪ ┺㔲 15 㫛㦮 ㏢⿚⮮⪲ ⋮⒲┺. (⁎Ⱂ 3) 䢮ἓ◆㧊䎆 ⿚⮮ ṗ ㏢⿚⮮ ◆㧊䎆 㑮㰧㦚 㥚䞲 Ỗ㌟㠊 ⹥ 㩲㣎㠊⓪ 㞚⧮ <䚲 1>ὒ ṯ┺. 㑮㰧䞲 ◆㧊䎆⓪ ╖䞲⹒ῃ 䚲㭖㔲㠦 ➆⧒ Tweet 㧊 㧧㎇♲ ⋶㰲 ⼚⪲ ⋮⒮㠊 csv 䕢㧒 䡫䌲⪲ 㩖㧻♲┺. 4.1. 嵢勾 砒沂 㔲㓺䎲 㨂⿖䕛 ⹥ 䝚⪲⁎⧾ 㔺䟟 㔺䕾 ❇㦮 ㌗䢿㠦 ㍲☚ 㧊㩚 㑮㰧 㔲㩦㠦 㧊㠊㍲ 㑮㰧䞶 㑮 㧞☚⪳, ◆ 㧊䎆 㑮㰧 ㎇Ὃ 㔲 ⪲⁎ 䕢㧒㠦 ◆㧊䎆 㑮㰧 㔲㩦ὒ 㑮㰧 ◆㧊䎆 㫛⮮, 㑮㰧 ₆Ṛ 㩫⽊⯒ ⋾₊┺. 䋂⪺Ⱇ 㔲㓺䎲㦖 䝚⪲⁎⧾ 㔺䟟 㔲㩦Ⱎ┺ ⪲⁎ 䕢㧒㦚 䐋䟊 㧊㩚 㑮㰧 㔲㩦㦒⪲⿖䎆 㧊㠊㍲ ◆㧊䎆⯒ 㑮㰧䞲┺. (⁎Ⱂ 4) ◆㧊䎆 㑮㰧㭧㧎 㔲㓺䎲㦮 UI (⁎Ⱂ 5) 㑮㰧♲ ◆㧊䎆(ⶒ㨂⋲) 5. 冶嵦 ⽎ ⏒ⶎ㠦㍲⓪ Ṗ㧻 ╖䚲㩗㧎 ㏢㎲ ⍺䔎㤢䋂 ㍲゚ 㓺㧎 䔎㥚䎆㦮 ◆㧊䎆⯒ 㧦☯䢪♮㠊 㰖㏣㩗㦒⪲ 㑮㰧 䞮₆ 㥚䞲 㔲㓺䎲㦚 ㍺Ἒ䞮㡖┺. ⁎ 䤚, 䢮ἓ ◆㧊䎆 ⯒ 㑮㰧䞮⓪ Case study ⯒ 䐋䟊 䔎㥚䎆 ◆㧊䎆Ṗ 㩫㌗ 㩗㦒⪲ 㑮㰧♾㦚 䢫㧎䞮㡖┺. 㿪䤚㠦 ◆㧊䎆 㑮㰧 ㏣☚⯒ 䟻㌗㔲䋺₆ 㥚䞲 ⼧⪂ 㑮㰧 㔲㓺䎲ὒ ṯ㦖 ⹿⻫㠦 ╖䞲 㡆ῂ㢖, 㑮㰧♲ ◆ 㧊䎆⯒ Hadoop ὒ ṯ㦖 ╖㣿⨟ ◆㧊䎆 ⿚㍳ 㔲㓺䎲㠦 㩖㧻䞮㡂 ◆㧊䎆 ὖⰂ, ⿚㍳, 㔲ṗ䢪㠦 㓓Ợ 䢲㣿䞶 㑮 㧞☚⪳ 㿪Ṗ 㡆ῂṖ 㑮䟟♲┺Ⳋ 㔲㓺䎲㦮 㢚㎇☚ Ṗ ⏨㞚㰞 ộ㦒⪲ ₆╖♲┺.

363

-2020 온라인 춘계학술발표대회 논문집 제27권 제1호 (-2020. 5)

(4)

<䚲 1> 15 㫛 䢮ἓ ◆㧊䎆 㑮㰧㦚 㥚䞲 Ỗ㌟㠊㢖 㩲㣎㠊 䋺 䋺㤢✲ ỖỖ㌟㠊 㩲㩲㣎㠊 䞮 䞮㻲 䞮㻲㑮㰞 OR 㑮㰞㡺㡒 OR 㥶㡃㡺㡒 OR ⶒ㡺㡒 OR 䞮㻲㥶⨟ OR 䞮㻲㩫゚ OR 䞮㻲 OR Ṳ㻲 OR ☚⧧ OR Ṳ㤎 OR 䞲ṫ OR 㡗㌆ṫ OR ⋯☯ṫ OR ⁞ṫ OR4 ╖ṫ OR 㧊䙂⽊ OR 㡂㭒⽊ OR ṫ㻲⽊ OR 䞾㞞㺓 ⎫⽊OR 㺓⎫䞿㻲⽊ OR ╂㎇⽊ OR ṫ㩫ἶ⪏⽊ OR 䂶ἷ⽊ OR 㿿㭒╦ OR 䣷㎇╦ OR 㞞☯╦ OR 㧚 䞮╦ OR 䞿㻲╦ OR ⋾ṫ╦ OR ⹖㟧╦ OR ῆ㥚╦ OR ⿖䟃╦ OR ╖㼃╦ OR 㣿╊╦ OR ㎂㰚ṫ ╦ OR 㭒㞪╦ OR ⿖㞞╦ OR ⽊⪏╦ OR 㧻䦻╦ OR 㡗㭒╦ OR 㼃䘟╦ OR 䢪㻲╦ OR ᾊ㌆╦ OR 㿮㻲╦ OR 㦮㞪╦ OR 䕪╏╦ OR ☚㞪╦ OR ⽊㎇ṫ╦ OR 㔏㽢⽊ OR ㏢㟧ṫ╦ OR 䞮㻲䢮 ἓ OR 䞮㻲ὖⰂ OR ῂ⹎⽊ OR ⋯┾⽊ OR ㌗㭒⽊ OR ⺇㩲⽊ OR Ὃ㭒⽊ OR ㎎㫛⽊ OR 㭓㌆⽊ ⰺⰺ OR 䒂㠊 OR 㡂䟟 OR ὖὧ OR ✲⧒㧊ぢ OR ⰱ㰧 OR 䗲㎮ OR 㩚㤦㭒䌳 OR 㠛㼊 OR Ṗ⽒Ⱒ䞲Ὁ 䢎 䢎㏢ 䢎㑮 OR ─ OR 㩖㑮㰖 OR ㏢䌳 OR 㔋㤦 OR ╊㑮䢎 OR ⹒ⶒ䢎㑮 OR ╊䢎 ⰺⰺ OR 䒂㠊 OR 㡂䟟 OR ὖὧ OR ✲⧒㧊ぢ OR ⰱ㰧 OR 䗲㎮ OR 㩚㤦㭒䌳 OR 㠛㼊 OR Ṗ⽒Ⱒ䞲Ὁ ㌗ ㌗㑮☚ ㌗㑮☚ OR 㑮☭ⶒ OR ㌗㑮ὖ OR ㌗䞮㑮☚ 㩲䛞 OR 䞚䎆 OR ⹎ῃ OR ⰺⰺ OR 䒂㠊 OR 㡂䟟 OR ὖὧ OR ✲⧒㧊ぢ OR ⰱ㰧 OR 䗲㎮ 䞮 䞮㑮☚ 䞮㑮☚ OR 䞮㑮㻮Ⰲ OR 䞮㑮ὖ OR ㌗䞮㑮☚ ⰺⰺ OR 䒂㠊 OR 㡂䟟 OR ὖὧ OR ✲⧒㧊ぢ OR ⰱ㰧 OR 䗲㎮ OR 㩚㤦㭒䌳 OR 㠛㼊 OR ἶṳ 㰖 㰖䞮㑮 㰖䞮㑮 OR 㞪⹮㑮 ㌳㑮 OR 㻲㡆 OR ⰺⰺ OR 䒂㠊 OR 㡂䟟 OR ὖὧ OR ✲⧒㧊ぢ OR ⰱ㰧 OR 䗲㎮ OR 㩚㤦㭒䌳 ⶒ ⶒ㨂⋲ 䢣㑮 OR 䙃㤆 OR 㰧㭧䢎㤆 OR 䞮㻲⻪⧢ ⰺⰺ OR 䒂㠊 OR 㡂䟟 OR ὖὧ OR ✲⧒㧊ぢ OR ⰱ㰧 OR 䗲㎮ OR 㩚㤦㭒䌳 OR 㠛㼊 OR Ṗ⽒Ⱒ䞲Ὁ ╖ ╖₆ ╖₆䢮ἓ OR ⹎㎎Ⲓ㰖 OR ⹎Ⲓ OR 䢿㌂ OR ╖₆㡺㡒 OR ╖₆ ⺆㿲 OR ☚⪲ 㨂゚㌆ Ⲓ㰖 OR 㧦☯㹾 ⺆㿲Ṗ㓺 OR 㔺⌊Ὃ₆㰞 OR Ὃ₆㡺㡒 OR ⰺ㡆 OR 㓺⳾⁎ OR 㡺㫊 OR ⿖㥶Ⲓ㰖 OR 㽞 ⹎㎎Ⲓ㰖 OR 䢿㌆䢪ⶒ OR 㰞㏢㌆䢪ⶒ ⰺⰺ OR 䒂㠊 OR 㡂䟟 OR ὖὧ OR ✲⧒㧊ぢ OR ⰱ㰧 OR 䗲㎮ OR 㩚㤦㭒䌳 OR 㠛㼊 OR Ṗ⽒Ⱒ䞲Ὁ 䘦 䘦₆ⶒ 䘦₆ⶒ (㦢㔳ⶒ OR ⿚␾ OR ㌂㠛㧻 OR ㌳䢲 OR Ị㍺ OR 㧦☯㹾 OR 㰖㩫 OR 㩚₆ OR 㩚㧦 OR ⰺⰓ OR ㏢ṗ OR 㨂䢲㣿 OR 䟊㡃⺆㿲 OR Ṗ㡆㎇ OR ⿞㡆㎇ OR ゚Ṗ㡆㎇ OR 䝢⧒㓺䕇 OR ㌳䢲 OR 㻮Ⰲ) OR 㨂䢲㣿㝆⩞₆ OR 㦢㔳ⶒ㝆⩞₆ ⰺⰺ OR 䒂㠊 OR 㡂䟟 OR ὖὧ OR ✲⧒㧊ぢ OR ⰱ㰧 OR 䗲㎮ OR 㩚㤦㭒䌳 OR 㠛㼊 OR Ṗ⽒Ⱒ䞲Ὁ 䢪 䢪䞯ⶒ㰞 䢪䞯ⶒ㰞 OR 䢮ἓ䢎⯊ⴂ OR 䢪䞯㌂ἶ OR 㥶䟊䢪䞯ⶒ㰞 OR 㧪⮮㎇㥶₆㡺㡒ⶒ㰞 OR 䢪䞯㩲䛞㎇ ⿚ OR 㥶☛ⶒ㰞 OR 㥶䟊ⶒ㰞 ⰺⰺ OR 䒂㠊 OR 㡂䟟 OR ὖὧ OR ✲⧒㧊ぢ OR ⰱ㰧 OR 䗲㎮ OR 㩚㤦㭒䌳 OR 㠛㼊 OR Ṗ⽒Ⱒ䞲Ὁ ₆ ₆㌗⼖䢪 㧒㌂⨟ OR 㧒㫆⨟ OR ṫ㤆⨟ OR 㔋☚ OR 㤊⨟ OR ₆㞫 OR 䛣䟻 OR 䛣㏣ OR ₆㌗⼖䢪 OR ṫ㑮⨟ ⰺⰺ OR 䒂㠊 OR 㡂䟟 OR ὖὧ OR ✲⧒㧊ぢ OR ⰱ㰧 OR 䗲㎮ OR 㩚㤦㭒䌳 OR 㠛㼊 OR Ṗ⽒Ⱒ䞲Ὁ ₆ ₆䤚⼖䢪 䞲䕢 OR 䙃㡒 OR Ṗ⶚ OR 㰧㭧䢎㤆 OR 㰖ῂ㡾☚ OR 䟊㑮Ⳋ OR 㡾⋲䢪 OR ╖₆䢒䌗☚ OR 㡺 㫊䂋 OR 㠮┞␾ OR ⧒┞⌦ OR 䛣䤚 OR ₆㡾⼖䢪 OR ṫ㑮⨟⼖䢪 OR ₆䤚⼖䢪 OR 䙃㍺ OR 㡾 㔺Ṗ㓺 OR 㡾㔺䣾ὒ ⰺⰺ OR 䒂㠊 OR 㡂䟟 OR ὖὧ OR ✲⧒㧊ぢ OR ⰱ㰧 OR 䗲㎮ OR 㩚㤦㭒䌳 OR 㠛㼊 OR Ṗ⽒Ⱒ䞲Ὁ 㰖 㰖㰞 㰖㰞 OR 㰖䂋 OR 㰖㰞㨂䟊 OR 㰖㰞䞯 OR ὧⶒ㧦㤦 OR 䟊㩖㰖㰞 OR 䟊㩖ὧⶒ OR ㍳㥶㧦㤦 OR ㌆㌂䌲 OR 㰖㡊 OR 㰖㰞㧦㤦 OR 㰖㰞☚ OR 㰖㰚 OR ῃ䏶㰖㰞 OR ㍳㥶䟊㩖 OR 㰖⹮ ⰺⰺ OR 䒂㠊 OR 㡂䟟 OR ὖὧ OR ✲⧒㧊ぢ OR ⰱ㰧 OR 䗲㎮ OR 㩚㤦㭒䌳 OR 㠛㼊 OR Ṗ⽒Ⱒ䞲Ὁ 㰖 㰖䡫  ἓ㌂㰖 OR 㰖䚲Ⳋ OR 㰖䡫Ὴἷ OR 㰖䡫ἓ㌂☚ OR 㰖䡫䚲ἶ OR 㰖䡫 OR 㞓䋂䢖 OR 㰖䡫☚ ⰺⰺ OR 䒂㠊 OR 㡂䟟 OR ὖὧ OR ✲⧒㧊ぢ OR ⰱ㰧 OR 䗲㎮ OR 㩚㤦㭒䌳 OR 㠛㼊 OR Ṗ⽒Ⱒ䞲Ὁ 䏶 䏶㟧 䏶㟧 OR 䏶㟧㡺㡒 OR 䏶㟧䢮ἓ OR ㎇㑯䏶 ⰺⰺ OR 䒂㠊 OR 㡂䟟 OR ὖὧ OR ✲⧒㧊ぢ OR ⰱ㰧 OR 䗲㎮ OR 㩚㤦㭒䌳 OR 㠛㼊 OR Ṗ⽒Ⱒ䞲Ὁ ㌳ ㌳䌲Ἒ ㌳䌲䢮ἓ OR ㌳䌲ὖὧ OR 㧦㡆⽋㤦 OR ㌳䌲㍲゚㓺 OR ㌳䌲Ἒ䕢ᾊ OR ῃⰓ㔋㰖 OR 䢮ἓ㡗䟻䘟 Ṗ OR ㌳ⶒἚ ⰺⰺ OR 䒂㠊 OR 㡂䟟 OR ὖὧ OR ✲⧒㧊ぢ OR ⰱ㰧 OR 䗲㎮ OR 㩚㤦㭒䌳 OR 㠛㼊 OR Ṗ⽒Ⱒ䞲Ὁ ٻ ٻ 焾処怾竒

[1] A. Bhardwaj, R. Singh, V. Deep and P. Sharma, BDT3V — A Technique for Big Data Testing considering 3V’s, 2018 Second International Conference on Green Computing and Internet of Things (ICGCIoT), Bangalore, India, 2018, pp. 222-225.

[2] Byun, C., Kim, Y., Lee, H., & Kim, K. K. Automated Twitter data collecting tool and case study with rule-based analysis. In Proceedings of the 14th International Conference on Information Integration and Web-based Applications & Services, Bali Indonesia, December 2012, pp. 196-204. [3] 㾲⹒㍳. 䣾㥾㩗㧎 䔎㥭 ⿚㍳ 㔲㓺䎲 ㍺Ἒ ⹥ ῂ䡚

⹿⻫. Journal of Digital Convergence, 13(2), pp. 43-50, 2015

[4] 䞮㔏☚, ㍶☯㎇, 㧊䟊㭖, 㧊㌗ῂ. ╖䢪 Ⱖ⶟䂮 ῂ㿫 㦚 㥚䞲 㥏 䋂⪺⩂ ₆⹮ ╖䢪 㑮㰧₆. 䞲ῃ㩫⽊ὒ 䞯䣢 䞯㑶⹲䚲⏒ⶎ㰧, pp. 334-336, 2016

[5] Twitter, Inc. “Overview — Twitter Developers”, 2020, https://developer.twitter.com/en/docs/tweets/search/overv iew

[6] PyPI, “GetOldTweets3 · PyPI”. 2020, https://pypi.org/project/GetOldTweets3/

364

참조

관련 문서

Azure Data Factory (ADF) is a cloud-based data integration service that allows you to orchestrate and automate data movement and data transformation. Ingesting data can

Zhu, &#34;Defending False Data Injection Attack on Smart Grid Network Using Adaptive CUSUM Test,&#34; Proceeding of the 45th Annual Conference on Information Sciences

• Program Context-Aware Data Separation Technique – Predicts update times of data based

(1973), “An Experimental Investigation on The Similitude in The Consolidation of A Soft Clay, Including The Secondary Creep Settlement“, Proceedings, 8th International

○ Furthermore along with obtaining fundamental data on power network system in Korea and related-data on demand, supply, transmission of Russia and North

41 Developing Web Intelligence System of Construction Tacit Knowledge Based on Text

Particularly, after selecting a specific cycle by collecting HWC data and primary system-related data from Gori NPP Unit 1 and comparatively analyzing

Recommendations on trajectory selection in flight planning based on weather uncertainty, Proceedings of the 2017 WMO Aeronautical Meteorology Scientific