딥인코더-디코더 기반의 인공지능 포토 스토리텔러





딥인코더-디코더 기반의 인공지능 포토 스토리텔러

민경복*, Dang L. Minh*, 이수진**, 문현준*

*세종대학교 컴퓨터 공학과, **중앙대학교 다빈치 SW 교육원 e-mail :hmoon@sejong.ac.kr

G

$,SKRWRVWRU\WHOOHUEDVHGRQGHHSHQFRGHUGHFRGHUDUFKLWHFWXUH 



.\XQJERN0LQ /0LQK'DQJ 6XMLQ/HH +\HRQMRRQ0RRQ  'HSDUWPHQWRI&RPSXWHU6FLHQFHDQG(QJLQHHULQJ6HMRQJ8QLYHUVLW\

'HSDUWPHQWRI'D9LQFKL6:(GXFDWLRQ&KXQJDQJ8QLYHUVLW\





殚       檃

5HVHDUFKXVLQJDUWLILFLDOLQWHOOLJHQFHWRJHQHUDWHFDSWLRQVIRUDQLPDJHKDVEHHQVWXGLHGH[WHQVLYHO\+RZHYHU

WKHVHV\VWHPVDUHXQDEOHWRFUHDWHFUHDWLYHVWRULHVWKDWLQFOXGHPRUHWKDQRQHVHQWHQFHEDVHGRQLPDJHFRQWHQW$

VWRU\LVDEHWWHUZD\WKDWKXPDQVXVHWRIRVWHUVRFLDOFRRSHUDWLRQDQGGHYHORSVRFLDOQRUPV7KLVSDSHUSURSRVHVD

IUDPHZRUN WKDW FDQ JHQHUDWH D UHODWLYHO\ VKRUW VWRU\ WR GHVFULEH EDVHG RQ WKH FRQWH[W RI DQ LPDJH 7KH PDLQ

FRQWULEXWLRQVRIWKLVSDSHUDUH$QXQVXSHUYLVHGIUDPHZRUNZKLFKXVHVUHFXUUHQWQHXUDOQHWZRUNVWUXFWXUHDQG

HQFRGHUGHFRGHUPRGHOWRFRQVWUXFWDVKRUWVWRU\IRUDQLPDJH$KXJH(QJOLVKQRYHOGDWDVHWLQFOXGLQJKRUURU

DQGURPDQWLFWKHPHVWKDWDUHPDQXDOO\FROOHFWHGDQGYDOLGDWHG%\LQYHVWLJDWLQJWKHVKRUWVWRULHVWKHSURSRVHGPRGHO

SURYHVWKDWLWFDQJHQHUDWHPRUHFUHDWLYHFRQWHQWVFRPSDUHGWRH[LVWLQJLQWHOOLJHQWV\VWHPVZKLFKFDQSURGXFHRQO\

RQHFRQFLVHVHQWHQFH7KHUHIRUHWKHIUDPHZRUNGHPRQVWUDWHGLQWKLVZRUNZLOOWULJJHUWKHUHVHDUFKRIDPRUHUREXVW

$,VWRU\ZULWHUDQGHQFRXUDJHVWKHDSSOLFDWLRQRIWKHSURSRVHGPRGHOLQKHOSLQJVWRU\ZULWHUILQGDQHZLGHD



,1752'8&7,21

,Q UHFHQW \HDUV EH\RQG XQGHUVWDQGLQJ DQG FDUU\LQJ RXW

VSHFLILF WDVNV $UWLILFLDO ,QWHOOLJHQFH $, KDV EHHQ

LQFUHDVLQJO\DSSOLHGLQWKHILHOGVZKLFKDUHFRQVLGHUHGKXPDQ

WHUULWRU\ WKH LGHD RI XVLQJ $, WR JHQHUDWH DUWZRUNV VXFK DV

SKRWR > @ QRYHOV DQG PRYLH VFHQDULRV KDV EHFRPH D

WUHQGLQJWRSLFLQWKHUHVHDUFKFRPPXQLW\ 

7KHVWRU\LVRQHRIWKHHDUOLHVWDQGIXQGDPHQWDOPHDQVIRU

KXPDQNLQGWRWUDQVIHUNQRZOHGJHWRWKHIROORZLQJJHQHUDWLRQV

$ VWRU\ LV KLJKO\ OLQNHG WR WKH YLVXDO GRPDLQ EHFDXVH WKH

QDUUDWLYH DQG YLVXDO FRQWH[W DUH WKH SULPDU\ VRXUFH RI

LQVSLUDWLRQIRUVWRULHV7KHWDVNRIFUHDWLQJDVKRUWVWRU\EDVHG

RQ WKH FRQWH[W RI WKH LQSXW LPDJH ZKLFK WKLV UHVHDUFK

PHQWLRQVDV³YLVXDOVWRU\ZULWHU´LVDFKDOOHQJLQJWRSLFWRWKDW

FRPELQH FRPSXWHU YLVLRQ WHFKQLTXHV DQG QDWXUDO ODQJXDJH

SURFHVVLQJ 1/3 WHFKQRORJLHV ,W GHPDQGV QRW RQO\ WKH

UHFRJQLWLRQ RI WKH FRQWH[W LQ D SKRWR ZKLFK LQYROYHV

LQWHUDFWLRQDQGUHODWLRQDPRQJREMHFWVEXWDOVRDFRPSOLFDWHG

V\VWHPWRJHQHUDWHDVKRUWVWRU\IURPWKHSURVSHFWRIODQJXDJH

FRQVLVWHQF\ )LJXUH  GHVFULEHV D W\SLFDO LPDJH FDSWLRQ

ZKLFKEULHIO\VXPPDUL]HGWKHFRQWHQWRIDQLPDJHDQGDVKRUW

ZKLFKUHOLHVRQWKHFDSWLRQRIWKHLPDJHWKDWZDVFUHDWHGE\

RXUSURSRVHGPRGHO

7KH DGYDQFHPHQWV LQ FRPSXWHU YLVLRQ DQG 1/3 KDYH

DOORZHG WKH FRPSXWHUV WR ³SHUFHLYH´ DQG JHQHUDWH DFFXUDWH

GHVFULSWLRQV IRU D JLYHQ LPDJH 7KH UHVXOWV SURYHG WKDW

UHVHDUFKHUV KDG PDGH VLJQLILFDQW LPSURYHPHQWV LQ LPDJH

FDSWLRQLQJILHOG>@WKDWVHHNVWRRXWSXWDFDSWLRQIRUDQLQSXW

LPDJH RU YLGHR VHTXHQFH GHVFULSWLRQ ZKLFK DLPV WR FUHDWH

GHVFULSWLRQVIRUDVHTXHQFHRIIUDPHV

)LJXUH  $ VKRUW FDSWLRQ JHQHUDWHG WR GHVFULEH WKH LPDJH

 FRQWHQWDORQJZLWKDVWRU\JHQHUDWHGE\WKHSURSRVHGPRGHO

7KHQH[WVWHSLVWRPDNHDQDUUDWLYHVKRUWVWRU\DERXWWKH

FRQWH[WRIDFDSWLRQHGLPDJH7KLVLQGLFDWHVWKDWWKHIRFXVLV

VKLIWHG IURP JHQHUDWLQJ D FDSWLRQ WR FUHDWLQJ D VKRUW VWRU\

([LVWLQJUHVHDUFKHVPDLQO\FRQFHQWUDWHGRQFUHDWLQJDVLPSOH

FDSWLRQIRUDVLQJOHLPDJH>@:HWDNHRQHVWHSIXUWKHUWRWU\

WRJHQHUDWHDVKRUWVWRU\EDVHGRQWKHLPDJHFRQWH[W:HUHJDUG

WKH UHVHDUFK WRSLF DV DQ XQVXSHUYLVHG VHTXHQFHWRVHTXHQFH

SUREOHP ZLWK D SKRWR DV WKH LQSXW ZKHUHDV WKH RXWSXW LV D

VHQWHQFH VHTXHQFH ,W LV DQ HQWLUHO\ GLIIHUHQW PDWWHU IURP

FRPPRQ VHTXHQFHWRVHTXHQFH LVVXHV ,PDJH FDSWLRQLQJ

UHVHDUFKLVWKHQHDUHVWUHODWHGUHVHDUFKWR³YLVXDOVWRU\ZULWHU´

,QWKRVHVWXGLHVUHFXUUHQWQHXUDOQHWZRUN511LVIUHTXHQWO\

LPSOHPHQWHGWRJHQHUDWHDVHQWHQFHDVWKHRXWSXWWRGHVFULEH

WKH LQSXW LPDJH >@ &RPSDUH WR WKH FRPPRQ VHTXHQFHWR

VHTXHQFH SUREOHP DQG WKH ³YLVXDO VWRU\ ZULWHU´ LV PRUH

FRPSOLFDWHGGXHWRWKHFKDOOHQJHRIPRGHOOLQJWKHKXJHYLVXDO

YDULDQFH DQG PDLQWDLQLQJ WKH ORQJWHUP FRQVLVWHQF\ DPRQJ

VHYHUDOVHQWHQFHV  2019년 추계학술발표대회 논문집 제26권 제2호 (2019. 11)

- 931 -





,QWKLVSDSHUZHLQWURGXFHDQXQVXSHUYLVHGVHTXHQFHWR

VHTXHQFH JDWHG UHFXUUHQW XQLW *58 IUDPHZRUN WKDW

JHQHUDWHV D VKRUW VWRU\ RI GLIIHUHQW JHQUHV XVLQJ WKH FDSWLRQ

FRQWHQW 7KH PRGHO FUHDWHV VWRULHV VHQWHQFH E\ VHQWHQFH

FRQFHUQLQJ WKH LPDJH FRQWH[W DQG WKH SUHYLRXVO\ JHQHUDWHG

VHQWHQFH 7KH SURSRVHG IUDPHZRUN FRQVLVWV RI DQ 511

GHFRGHU WKDW LV WUDLQHG RQ FROOHFWHG GDWDVHWV $IWHU WKDW

VHQWHQFHV H[WUDFWHG IURP WKH GDWDVHWV DUH PDSSHG WR D VNLS

WKRXJKW YHFWRU 7KHQ WKH 511 PRGHO LV FRQGLWLRQHG RQ WKH

VNLSWKRXJKWYHFWRUWRFUHDWHWKHHQFRGHGVHQWHQFH0RUHRYHU

ZHXVHYLVXDOVHPDQWLFHPEHGGLQJPRGHOWRPDSFRQFHSWXDO

FDSWLRQV GDWDVHW LPDJHV DQG FDSWLRQV LQWR D FRPPRQ YHFWRU

VSDFH2XUJRDOZLWKWKLVDSSURDFKZDVWRIRUFHWKHV\VWHPWR

JHQHUDWH VWRULHV WKDW FRQWDLQ PRUH QDUUDWLYH DQG FRQVLVWHQW

ODQJXDJHDQGWKDWHYHU\JHQHUDWHGVHQWHQFHLQWKHVWRU\ZLOOEH

DIIHFWHGE\SUHYLRXVO\JHQHUDWHGVHQWHQFHV



5(/$7(':25.

7KH V\VWHP SURSRVHG E\ >@ DOLJQHG FURZGVRXUFHG SORW

V\QRSVHV ZLWK VKRWV IURP WKH YLGHRV IRU VWRU\VW\OH FRQWHQW

UHWULHYDO 7KH DXWKRUV DSSOLHG D VLPLODULW\ IXQFWLRQ EHWZHHQ

VHQWHQFHVLQSORWV\QRSVHVDQGVKRWVEDVHGRQNH\ZRUGVDQG

SHUVRQDOLGHQWLWLHVLQVXEWLWOHV,Q>@WKHDXWKRUVLPSOHPHQWHG

D PXOWLSOH QHXUDO QHWZRUN VWUXFWXUH EDVHG RQ VLQJOH DQG

SDLUZLVH HOHPHQWEDVHG SUHGLFWLRQV DQG H[SORLWHG ERWK WH[W

DQG LPDJH IHDWXUHV 7KH REWDLQHG UHVXOWV SURYHG WKDW WKH

SURSRVHG PRGHO FRXOG OHDUQ H[FLWLQJ DVSHFWV RI FRPPRQ

WHPSRUDO VHQVH ,Q DQRWKHU UHVHDUFK SURSRVHG E\ >@ WKH

DXWKRUVH[SORLWHGKDVKWDJVIURPDQLQSXWLPDJHDQGDQDO\]HG

LWWRFUHDWHPHDQLQJIXODQHFGRWHVFRQQHFWLQJWRWKHHVVHQFHRI

WKH LPDJH 7KH\ XVHG WKH DWWHQWLRQEDVHG HQFRGHUGHFRGHU

IUDPHZRUN WR FUHDWH KDVKWDJV IRU DQ LPDJH $IWHU WKDW D

FKDUDFWHUOHYHO ODQJXDJH PRGHO ZDV WUDLQHG XVLQJ D PXOWL

OD\HU511DQGWKLVPRGHOLVDSSOLHGWRJHQHUDWHVWRULHVXVLQJ

RQHRI WKHJHQHUDWHG KDVKWDJV$QRWKHU PRGHOGHPRQVWUDWHG

E\$OH[DQGHULQ>@FDQSURGXFHLPDJHFDSWLRQVZKLFKZHUH

YLVXDOO\ GHVFULSWLYH DQG DSSURSULDWHO\ 7KH DXWKRUV WULHG WR

GLYLGH VHPDQWLFV DQG VW\OH 1/3 WHFKQLTXHV DQG IUDPH

VHPDQWLFVZHUHHPSOR\HGWRJHQHUDWHFRQFLVHVHPDQWLFWHUP

UHSUHVHQWDWLRQ 0RUHRYHU WKH\ LPSOHPHQWHG D XQLILHG

ODQJXDJH PRGHO WKDW GHFRGHG VHQWHQFHV ZLWK GLYHUVH ZRUG

FKRLFHVDQGV\QWD[IRUGLIIHUHQWVW\OHV 

2XUZRUNGLIIHUVIURPSUHYLRXVZRUNLQVHYHUDOLPSRUWDQW

DVSHFWV:HGHDOZLWKDPRUHFKDOOHQJLQJDUHDRIVWRU\FDSWLRQ

DOLJQPHQW 8QOLNH FDSWLRQ JHQHUDWLRQ ZKLFK RQO\ GHVFULEHV

ZKDWWKHPDLQFRQWHQWRIDQLPDJHLVWKHVWRU\LVPRUHYHUERVH

DQGPLJKWYDU\EHFDXVHLWLVRQO\EDVHGRQWKHLPDJHFRQWH[W



 0(7+2'2/2*<

'DWDVHWSUHSDUDWLRQIRUVWRU\WHOOLQJ 

7KLV VWXG\ FRQWDLQV WZR GLIIHUHQW GDWDVHWV  %RRNV

GRZQORDGIURPWKH6PDVKZRUGVZHEVLWHZKLFKLVDZHEVLWH

ZKHUHDXWKRUVVKDUHWKHLUXQSXEOLVKHGERRNVWRWKHFRPPXQLW\

:HFUDZORQO\ERRNVZKLFKFRQWDLQHGRYHUZRUGVWR

ILOWHURXWSHUKDSVQRLVLHUVKRUWHUVWRULHV7KHGDWDVHWKDVERRNV

LQ  GLIIHUHQW JHQUHV URPDQFH  ERRNV DQG KRUURU 

ERRNV  &RQFHSWXDO FDSWLRQV GDWDVHW ZKLFK LV D KXJH

FDSWLRQVGDWDVHWLQWURGXFHGE\*RRJOHLQ>@,WFRQWDLQV

RYHUPLOOLRQSDLUVRILPDJHDQGFDSWLRQZKLFKZHUHFUHDWHG

E\ DXWRPDWLFDOO\ ILOWHULQJ DQG H[WUDFWLQJ FDSWLRQ DQQRWDWLRQV

IURPWKHLQWHUQHW7KHGDWDVHWLQFOXGHVDQLQFUHDVHGPDJQLWXGH

RI FDSWLRQHG LPDJHV FRPSDUHG WR WKH KXPDQFXUDWHG 06

&2&2 GDWDVHW 0RUHRYHU WKH GDWDVHW FRQWDLQV D EURDGHU

GLYHUVLW\RILPDJHFDSWLRQSDLUVDVWKHLPDJHVDQGDQQRWDWLRQV

ZHUHGRZQORDGHGIURPELOOLRQVRIZHESDJHVHQDEOLQJEHWWHU

SHUIRUPDQFHRILPDJHFDSWLRQLQJPRGHOVDQGWKXVWKHPRGHOV

ZLOOJHQHUDWHEHWWHUFDSWLRQV

,Q RUGHU WR GRZQORDG WKH ERRNV ZH XVH DQ DXWRPDWHG

S\WKRQFUDZOHU7KHGRZQORDGHGERRNVZHUHLQ3')IRUPDW

VRZHDSSO\DS\WKRQSGIW[WOLEUDU\WRFRQYHUWWKHPLQWRSODLQ

WH[WIRUPDW)LQDOO\ZHXVHGWKHS\WKRQ1/3OLEUDU\WRJURRP

WKHGDWDE\UHPRYLQJEODQNURZVDQGILQDOO\VDYHDOOFRQWHQWV

LQWRRQHILOH

3URSRVHG$,FDSWLRQJHQHUDWLRQPRGHO 

,Q WKLV VHFWLRQ D GHWDLOHG GHVFULSWLRQ RI WKH SURSRVHG

³YLVXDO VWRU\ ZULWHU´ PRGHO LV H[SODLQHG WKRURXJKO\ 7KH

LPSOHPHQWDWLRQSURFHVVRIWKHSURSRVHGPRGHOLVGHVFULEHGLQ

)LJXUHZKLFKLQFOXGHVWKUHHPDLQFRPSRQHQWV7UDLQERWK

YLVXDOVHPDQWLFDOLJQPHQWPRGHODQGVNLSWKRXJKWHQFRGHURQ

WKHFRQFHSWXDOFDSWLRQVGDWDVHW([WUDFWVNLSWKRXJKWYHFWRUV

IURP WKH FROOHFWHG VWRULHVGDWDVHW DQG3HUIRUP GHHS VW\OH

WUDQVIHUIURPFDSWLRQVW\OHWRVWRU\VW\OHXVLQJWKHVNLSWKRXJKW

GHFRGHU 



)LJXUH2YHUDOOV\VWHPDUFKLWHFWXUHRISKRWRVWRU\WHOOHU

$ 6NLSWKRXJKWYHFWRUV

x

Encoder

*LYHQDVHQWHQFHWXSOH ሺ࢙_࢏ି૚ǡ ࢙_࢏ǡ ࢙_࢏ା૚ሻWKHPRGHOWULHVWR

HQFRGHWKHVHQWHQFH ࢙_࢏ LQWRDIL[HGYHFWRU$IWHUWKDWEDVHG

RQ WKH JHQHUDWHG YHFWRU LW DWWHPSWV WR FUHDWH WKH SUHYLRXV

VHQWHQFH ࢙_࢏ି૚ DQGWKHQH[WVHQWHQFH ࢙_࢏ା૚/HW ࢝_࢏^࢚ LQGLFDWHV

WKH ࢚WK ZRUG IRU WKH VHQWHQFH ࢙_࢏ DQG OHW ࢞_࢏^࢚ EH LWV ZRUG

HPEHGGLQJ :H GLYLGH WKH PRGHO LQWR WZR PDLQ VHFWLRQV

LQYROYLQJWKHHQFRGHUDQGGHFRGHU

6XSSRVH WKDW

ݓ

_௜^ଵ

ǡ ǥ ǡ ݓ

_௜^ே GHSLFWV DOO

ܰ

 ZRUGV

ݓ

 LQ

WKHFXUUHQWVHQWHQFH

ݏ

_௜7KHHQFRGHUWDVNLVWRFUHDWHDKLGGHQ

VWDWH

݄

_௜^௧ IRU HDFK WLPH VWHS

ݐ

 WKDW HQFRGH WKH VHTXHQFH RI

ZRUGVIURP

ݓ

_௜^ଵ WR

ݓ

_௜^௧7KHUHIRUHWKHODVWKLGGHQVWDWH

݄

_௜^ே RI WKH VHQWHQFH

ݏ

_௜



ZLOO HQFRGH WKH HQWLUH FRQWHQWV *58

2019년 추계학술발표대회 논문집 제26권 제2호 (2019. 11)

- 932 -





PRGHO RI WKH HQFRGHU JHQHUDWHV WKH FXUUHQW KLGGHQ VWDWH

݄

_௜^௧ E\ OLQHDUO\ DGGLQJ WKH SUHYLRXV KLGGHQ VWDWH

݄

_௜^௧ିଵ DQG WKH

QHZO\SURSRVHGVWDWH

݄෨

_௜^௧ 



 

t t t t t

i i i i i

h z h

^

  z h



ZKHUH ۨ LV HOHPHQWZLVH PXOWLSOLFDWLRQ DQG ݖ_௜^௧LV WKH XSGDWH

JDWH 7KH XSGDWH JDWH ݖ_௜^௧ LV DSSOLHG WR GHFLGHV KRZ PXFK

LQIRUPDWLRQIURPWKHSDVWQHHGWREHNHSWIRUWKHIXWXUH,WLV

FDOFXODWHGE\DOLQHDUVXPEHWZHHQWKHQHZO\SURSRVHGVWDWHDQG

WKHH[LVWLQJVWDWH







t t t z

i z i z i i

z V W x  U h

^

 b



ı LV WKH ORJLVWLF QRQOLQHDULW\ DQG ܹ_௭^ QîP PDWUL[ ܷ_௭^ QîQ

PDWUL[ ܾ_௭^ QîYHFWRUDUHIL[HGVL]HGSDUDPHWHUVEHORQJWR

WKHXSGDWHJDWHWZRZHLJKWVDQGELDV7KDQNVWRWKHVLJPRLG

DFWLYDWLRQIXQFWLRQWKHXSGDWHJDWHRXWSXWYDOXHLVLQWKHUDQJH

RI]HURWRRQH,ILWLVRQHWKHXSGDWHJDWHZLOOFRPSOHWHO\IRUJHW

SUHYLRXV KLGGHQ VWDWHV  ZKLFK PHDQV ݄_௜^௧ൌ ݄෨_௜^௧ 2Q WKH RWKHU

KDQGLILWLV]HURWKHQDOOKLGGHQVWDWHVIURPSUHYLRXVWLPHVWHSV

ZLOOEHFRSLHGRYHUWKDWLV ݄_௜^௧ൌ ݄_௜^௧ିଵ7KHSURSRVHGVWDWH ݄෨_௜^௧LV

FDOFXODWHGVLPLODUO\WRWKHWUDGLWLRQDOUHFXUUHQWXQLW

_i^t

WDQK

_i^t



_i^t _i^t 



_i^t

 h Wx  U r h

^

 b



LQ ZKLFK ݎ_௜^௧ LV D UHVHW JDWH 7KH UHVHW JDWH ݎ_௜^௧ LV FDOFXODWHG

VLPLODU WR WKH XSGDWH JDWH EXW EDVHG RQ D VHW RI GLIIHUHQW

SDUDPHWHU YDOXHV ܹ_௥^ QîP PDWUL[ ܷ_௥^  QîQ PDWUL[ ܾ_௥^ QîYHFWRU







t t t r

i r i r i i

r V W x  U h

^

 b



:KHQWKHVWDWXVLVRIIݎ_௜^௧HTXDOVWRWKHUHVHWJDWHIRUFHV

WKHQHZO\SURSRVHGVWDWHWREHKDYHDVLWLVZRUNLQJRQWKHILUVW

ZRUGLQDVHTXHQFHRIZRUGVHQDEOLQJLWWRHOLPLQDWHWKHVWDWH

݄_௜^௧ିଵ FRPSXWHGSUHYLRXVO\

$OWKRXJK*58SUHVHUYHVWKHPHPRU\UHPDUNDEO\EHWWHUWKDQ

511 LW MXVW DQDO\]HV WKHIRUZDUG OLQJXDO FRQWH[W 7KHUHIRUH

*58 LV XQDEOH WR H[DPLQH WKH EDFNZDUG FRQWH[W 7KXV WKH

OHDUQLQJ SURFHVV RI *58 LV FRQVLGHUHG SDUWLDOO\ FRPSOHWHG

EHFDXVHLQDVHQWHQFHWKHFRQWH[WRIDZRUGLVLQIOXHQFHGE\LWV

IRUZDUGFRQWH[WDQGLWVEDFNZDUGFRQWH[W7*58ZKLFKLVDQ

LPSURYHG YHUVLRQ RI *58 ZDV LQWURGXFHG WR FRSH ZLWK WKH

PHQWLRQHGSUREOHPLWDOORZVWKHPRGHOWRHQFRGHWKHOLQJXDO

FRQWH[W RI D ZRUG IURP ERWK VLGHV ,W FRQWDLQV WZR PDLQ

QHWZRUNVRQHQHWZRUNSURFHVVWKHIRUZDUGFRQWH[WZKHUHDV

WKHRWKHUDQDO\]HVWKHEDFNZDUGFRQWH[W7KHHTXDWLRQVIRUWKH

KLGGHQVWDWHWKHSURSRVHGKLGGHQVWDWHXSGDWHJDWHDQGUHVHW

JDWHRIWKHIRUZDUGDQGEDFNZDUG*58DUHGHVFULEHGEHORZ

)RUZDUGSDVV







t t t

z z

z V W x  U h

^

))& ))& ))& )))&



 

t t t

r r

r V W x  U h )& ))& ))& ))&



_t

WDQK

^{d t d}



^{t t }



h W x  U r h

^

)& )))& )))& )& )))&





 

t t t t t

h z h

^

  z h ))&

))& ))& )))& ))&



7KHEDFNZDUGSDVVLVWKHVWHSZHDGGHGWRRXUPRGHO



^{t t} 



t z z

z V W x  U h ')))

^

') ')) '))









t t t

r r

r V W x  U h

^

') ')) ')) ')))



_t

WDQK

^{d t d}



^{t t }



h W x  U r h

^

') '))) '))) ') ')))





 

t t t t t

h

i

z h

^

  z h ')) ')) '))) ')) '))



x

Decoder

7KHGHFRGHULVFDOFXODWHGVLPLODUWRWKHHQFRGHUH[FHSWWKDW

WKHFDOFXODWLRQLVEDVHGRQWKHHQFRGHURXWSXW ݄_௜ IURPVHQWHQFH

ݏ_௜ DQGWKHLQWURGXFWLRQRI ܥ_௭ǡ ܥ_௥ǡ ܥ WKDWLVXVHGDVDELDVIRUWKH

KLGGHQ VWDWH XSGDWH JDWH DQG UHVHW JDWH FRPSXWDWLRQ E\ WKH

HQFRGHURXWSXWYHFWRU ݄_௜

 7ZRGLIIHUHQWGHFRGHUVDUHFUHDWHGRQHLVDSSOLHGWRFUHDWH

WKHSUHYLRXVVHQWHQFH ݏ_௜ିଵDQGRQHLVXVHGWRJHQHUDWHWKHQH[W

VHQWHQFH ݏ_௜ାଵ 7KH WZR GHFRGHUV XVH GLIIHUHQW SDUDPHWHUV WR

FDOFXODWHWKHLUKLGGHQVWDWHV+RZHYHUWKH\DUHEDVHGRQRQH

YRFDEXODU\GLFWLRQDU\9WKDWXVHVDKLGGHQVWDWHWRFDOFXODWHD

GLVWULEXWLRQRYHUZRUGV$VDUHVXOWWZRGHFRGHUVDUHVLPLODUWR

DQ511ODQJXDJHPRGHOEXWUHSO\RQWKHHQFRGHURXWSXW ݄_௜ 

$VVXPHWKDW ݄ሬሬሬԦ LQGLFDWHWKHKLGGHQVWDWHRIWKHGHFRGHURI^௧ WKHQH[WVHQWHQFH ݏ_௜ାଵ DWWLPHVWHSW7KHXSGDWHJDWHUHVHWJDWH

DQGKLGGHQVWDWH  RIWKH ݏ_௜ାଵGHFRGHULVJLYHQDVIROORZV

 

 

t t t

z z z i

z V W x

^

 U h

^

 C h



 

 

t t t

r r z i

r V W x

^

 U h

^

 C h



_t

WDQK

^{d t  d}



^{t t }



_i

 h W x

^

 U r h

^

 Ch

^



 

t t t t t

h z h

^

  z h



:KHUH ݔ^௧ିଵ LVWKHZRUGHPEHGGLQJRIWKHSUHYLRXVZRUGDV

WKHGHFRGHUWU\WRJXHVVWKHFXUUHQWZRUGEDVHGRQWKHFRQWH[W

RIWKHSUHYLRXVZRUG 

 9LVXDOVHPDQWLFHPEHGGLQJSURFHVVLQJ 

7KLV WRSLF >@ LV DOVR RQH RI WKH NH\ DUHD EHFDXVH

VWRU\WHOOHUZLOOXVHFDSWLRQQRWGLUHFWO\IURPWKHLPDJH,QSXW

LPDJH DSSO\ YLVXDOVHPDQWLF HPEHGGLQJ EHWZHHQ &2&2

LPDJHVDQGFDSWLRQV,QWKLVPRGHOFDSWLRQVDQGLPDJHVDUH

PDSSHG LQWR D FRPPRQ YHFWRU VSDFH $IWHU WUDLQLQJ QHZ

LPDJHV FDQ EH HPEHGGHG DQG UHWULHYH FDSWLRQV (QFRGHU LV

XVHGE\DGHHSFRQYROXWLRQQHWZRUN&11DQG/RQJVKRUW

WHUPPHPRU\UHFXUUHQWQHWZRUN/670IRUOHDUQLQJDMRLQW

LPDJHVHQWHQFH HPEHGGLQJ 'HFRGHU LV XVHG E\ D QHXUDO

ODQJXDJH PRGHO WKDW FRPELQHVVWUXFWXUH DQG FRQWHQWYHFWRUV

IRUJHQHUDWLQJZRUGVRQHDWDWLPHLQVHTXHQFH      

&RQGLWLRQDOQHXUDOODQJXDJHPRGHOV 

*LYHQ WKHVH PRGHOV D PHWKRG WR OLQN WKH JDS EHWZHHQ

UHWULHYHGLPDJHFDSWLRQVDQGSDVVDJHVLQQRYHOVLVUHTXLUHG

7KDW LV LI ZH KDG D IXQFWLRQ

ܨ

 WKDW PDSV D FROOHFWLRQ RI

LPDJH FDSWLRQ YHFWRUV

ܺ

 WR D ERRN SDVVDJH YHFWRU

ܨሺšሻ



WKHQ ZH FRXOG IHHG

ܨሺšሻ

 WR WKH GHFRGHU WR JHW RXU VWRU\

7KHUH LV QR VXFK SDUDOOHO GDWD VR ZH QHHG WR FRQVWUXFW

ܨ

 DQRWKHUZD\

6XSSRVHWKDWZHKDYHYHFWRUVDFDSWLRQ

ݔ

DFDSWLRQ

VW\OHYHFWRU

ܿ

 DQGDVWRU\VW\OHYHFWRU

ܾ

7KHQZHGHILQH

ܨ

 DV

2019년 추계학술발표대회 논문집 제26권 제2호 (2019. 11)

- 933 -





 

F x   x c b 

ZKLFKLQWXLWLYHO\PHDQVNHHSWKHWKRXJKWRIWKHFDSWLRQ

EXWUHSODFHWKHLPDJHFDSWLRQVW\OHZLWKWKDWRIDVWRU\7KHQ

ZHIHHG

ܨሺšሻ

 WRWKHGHFRGHU

(;3(5,0(175(68/76

)LJXUH  VKRZV WZR H[DPSOHV RI WKH JHQHUDWHG VWRULHV

ZKLFK LQFOXGH ERWK URPDQFH VWRULHV DQG KRUURU VWRULHV 7KH

UHVXOWVSURYHWKDWRXUPRGHOFDQFUHDWHYLYLGVWRULHVIRULPDJHV

,Q SDUWLFXODU ILUVWO\ WKH PRGHO XVHG GHHS YLVXDOVHPDQWLF

DOLJQPHQWWRFUHDWHDVKRUWFDSWLRQIRUDQLPDJH$IWHUWKDW

WKLVFDSWLRQLVXVHGDVDTXHU\WRWUDQVIHUWKHKRUURURUURPDQFH

VWRU\VW\OHWRWKHFDSWLRQXVLQJWKHSURSRVHGVHQWHQFHHQFRGHU

GHFRGHU PRGHO 7KH UHWULHYHG VWRULHV DUH VHPDQWLFDOO\

XQGHUVWDQGDEOHDQGWKH\DOVREDVHGRQWKHJHQHUDOFRQWHQWRI

WKHLPDJH

)LJXUH*HQHUDWHGUHVXOWVLQFOXGLQJDJHQHUDOFDSWLRQUHG

 URPDQFHVWRU\EOXHDQGKRUURUVWRU\EODFN

$ VOLJKWO\ PRUH H[FLWLQJ LGHD LV VKRZQ LQ )LJXUH  ZH

DSSO\RXUPRGHORQWKHLPDJHVJHQHUDWHGE\FRPSXWHUIURP

WKHUHVHDUFKSURSRVHGE\>@7KHFUHDWHGFDSWLRQVSURYHWKDW

WKHGHHSYLVXDOVHPDQWLFDOLJQPHQWZRUNVZHOOLQGHVFULELQJ

WKHJHQHUDOFRQWHQWVIURPWKHLPDJHVHYHQLIWKHLPDJHVDUH

JHQHUDWHGE\WKHFRPSXWHU

 &21&/86,21

7KLV VWXG\ LQWURGXFHG D VWRU\WHOOLQJ V\VWHP IURP WKH

FRQWHQWV RI D SKRWR )LUVWO\ ZH FROOHFWHG D ODUJH GDWDVHW RI

QRYHOVIRUHDFKURPDQFHDQGKRUURUJHQUH$IWHUWKDWDPRGHO

ZKLFKDSSOLHG1/3DQGHQFRGHUGHFRGHUVWUXFWXUHWRJHQHUDWH

WKHVWRU\ZHUHSURSRVHG)LQDOO\ZHJHQHUDWHGVWRULHVZKLFK

ZHUHUHODWHGWRWKHSLFWXUHLQGLIIHUHQWZD\V 

7KHUHDUHVHYHUDOZD\VWRH[WHQGWKLVVWXG\ZRUNLQWKH

IXWXUH,QRXUVWXG\ZHDUHQRWXVLQJJUDPPDUGHWDLOFRQWH[W

PRGXOHLQWKHDUFKLWHFWXUH7KRVHWZRIXQFWLRQVFDQPDNHD

PRUHQDWXUDOVWRU\DQGORQJHUVWRU\WRNHHSZLWKWKHQDUUDWLYH

$QRWKHUZHDNQHVVRIWKHV\VWHPLVGHHSOHDUQLQJPRGHO:H

XVHG RQO\ EDVLF &11 PRGHO ZLWK /670 PHWKRG EXW LW LV

RULJLQDOO\GHYHORSHGIRULPDJHSURFHVVLQJ,QRUGHUWRPDNHD

PRUHDGYDQFHGVWRU\FUHDWRUZHQHHGWRILQGDVXLWDEOHGHHS

OHDUQLQJPRGHOZLWK1/3

)LJXUH  *HQHUDWHG UHVXOWV IURP WKH SURSRVHG PRGHO IRU D

 SKRWRJHQHUDWHGE\FRPSXWHU

$&.12:/('*0(17

7KLV ZRUN ZDV VXSSRUWHG E\ ,QVWLWXWH RI ,QIRUPDWLRQ  FRPPXQLFDWLRQV 7HFKQRORJ\ 3ODQQLQJ  (YDOXDWLRQ ,,73 JUDQWIXQGHGE\WKH.RUHDJRYHUQPHQW06,7

'HYHORSPHQWRI$,&RQYHUJHQFH7HFKQRORJLHVIRU6PDUW&LW\

,QGXVWU\ 3URGXFWLYLW\ ,QQRYDWLRQ DQG E\ .RUHD ,QVWLWXWH RI

3ODQQLQJDQG(YDOXDWLRQIRU7HFKQRORJ\LQ)RRG$JULFXOWXUH

)RUHVWU\ DQG )LVKHULHV ,3(7 WKURXJK $JUL%LR ,QGXVWU\

7HFKQRORJ\ 'HYHORSPHQW 3URJUDP IXQGHG E\ 0LQLVWU\ RI

$JULFXOWXUH)RRGDQG5XUDO$IIDLUV0$)5$

6%

5()(5(1&(6

>@ 'DQJ / 0LQK 6\HG ,EUDKLP +DVVDQ 6XK\HRQ ,P DQG +\HRQMRRQ 0RRQ )DFH

LPDJHPDQLSXODWLRQGHWHFWLRQEDVHGRQDFRQYROXWLRQDOQHXUDOQHWZRUN([SHUW6\VWHPV

ZLWK$SSOLFDWLRQV

>@'DQJ/6\HG+DVVDQ6XK\HRQ,P-DHFKHRO/HH6XMLQ/HHDQG+\HRQMRRQ0RRQ

'HHSOHDUQLQJEDVHGFRPSXWHUJHQHUDWHGIDFHLGHQWLILFDWLRQXVLQJFRQYROXWLRQDOQHXUDO

QHWZRUN$SSOLHG6FLHQFHVQR

>@9LQ\DOV27RVKHY$%HQJLR6 (UKDQ'6KRZDQGWHOO$QHXUDO

LPDJHFDSWLRQJHQHUDWRU,Q3URFHHGLQJVRIWKH,(((FRQIHUHQFHRQFRPSXWHUYLVLRQDQG

SDWWHUQUHFRJQLWLRQSS

>@ &KHQ ;  /DZUHQFH =LWQLFN &  0LQGV H\H $ UHFXUUHQW YLVXDO

UHSUHVHQWDWLRQIRULPDJHFDSWLRQJHQHUDWLRQ,Q3URFHHGLQJVRIWKH,(((FRQIHUHQFHRQ

FRPSXWHUYLVLRQDQGSDWWHUQUHFRJQLWLRQSS

>@'RQDKXH-$QQH+HQGULFNV/*XDGDUUDPD65RKUEDFK09HQXJRSDODQ6

6DHQNR. 'DUUHOO7/RQJWHUPUHFXUUHQWFRQYROXWLRQDOQHWZRUNVIRUYLVXDO

UHFRJQLWLRQDQGGHVFULSWLRQ,Q3URFHHGLQJVRIWKH,(((FRQIHUHQFHRQFRPSXWHUYLVLRQ

DQGSDWWHUQUHFRJQLWLRQSS

>@7DSDVZL0%lXPO0 6WLHIHOKDJHQ5$OLJQLQJSORWV\QRSVHVWRYLGHRV

IRUVWRU\EDVHGUHWULHYDO,QWHUQDWLRQDO-RXUQDORI0XOWLPHGLD,QIRUPDWLRQ5HWULHYDO



>@$JUDZDO+&KDQGUDVHNDUDQ$%DWUD'3DULNK' %DQVDO06RUW

VWRU\6RUWLQJMXPEOHGLPDJHVDQGFDSWLRQVLQWRVWRULHVDU;LYSUHSULQWDU;LY

>@*DXU6$SULO*HQHUDWLRQRID6KRUW1DUUDWLYH&DSWLRQIRUDQ,PDJH8VLQJ

WKH6XJJHVWHG+DVKWDJ,Q,(((WK,QWHUQDWLRQDO&RQIHUHQFHRQ'DWD(QJLQHHULQJ

:RUNVKRSV,&'(:SS,(((

>@0DWKHZV$;LH/ +H;6HPVW\OH/HDUQLQJWRJHQHUDWHVW\OLVHGLPDJH

FDSWLRQV XVLQJ XQDOLJQHG WH[W ,Q 3URFHHGLQJV RI WKH ,((( &RQIHUHQFH RQ &RPSXWHU

9LVLRQDQG3DWWHUQ5HFRJQLWLRQSS

>@ .LURV 5\DQ 5XVODQ 6DODNKXWGLQRY DQG 5LFKDUG 6 =HPHO 8QLI\LQJ YLVXDO

VHPDQWLF HPEHGGLQJV ZLWK PXOWLPRGDO QHXUDO ODQJXDJH PRGHOV DU;LY SUHSULQW

DU;LY

>@ *DW\V /HRQ $ $OH[DQGHU 6 (FNHU DQG 0DWWKLDV %HWKJH ,PDJH VW\OH WUDQVIHU

XVLQJ FRQYROXWLRQDO QHXUDO QHWZRUNV ,Q 3URFHHGLQJV RI WKH ,((( FRQIHUHQFH RQ

FRPSXWHUYLVLRQDQGSDWWHUQUHFRJQLWLRQSS 2019년 추계학술발표대회 논문집 제26권 제2호 (2019. 11)

- 934 -