• 검색 결과가 없습니다.

김형욱

N/A
N/A
Info
다운로드
Protected

Academic year: 2022

Share "김형욱"

Copied!
13
0
0

로드 중.... (전체 텍스트 보기)

전체 글

(1)

06. 순환신경망(RNN)

김형욱

(2)

Sequence data

• 사람들은 하나의 단어로만 말을 이해하지 않음

• 이전의 단어, 현재 단어의 조합으로 말을 이해

• 기존의 NN/CNN은 이러한 일을 할 수 없음

(3)

Recurrent Neural Network

(4)

Recurrent Neural Network

• RNN에서 사용되는 수식

모든 셀에서 같은 함수식 사용

h t = f w (h t −1 , x t )

(5)

Recurrent Neural Network

h t = f w (h t −1 , x t )

h t = tanh(W hh h t −1 +W xh x t )

y t = W hy h t

(6)

RNN-example

• Input data들은 one-hot encoding

E L L O

H E L L

(7)

RNN-example

h

t

= tanh(W

hh

h

t−1

+W

xh

x

t

) y t = W hy h t

(8)

RNN applications

• Language Modeling

• Speech Recognition

• Machine Translation

• Conversation Modeling/Question Answering

• Image/Video Captioning

• Image/Music/Dance Generation

(9)

RNN

(10)

Multi-Layer RNN

(11)

RNN in TensorFlow

Cell = tf.contrib.rnn.BasicRNNCell(num_units=hidden_size)

…

Outputs, _states = tf.nn.dynamic_rnn(cell,x_data, dtype=tf.float32)

(12)

RNN

(13)

참조

지금 다운로드하기 ( PDF - 13 페이지 - 490.39 KB )

관련 문서

화학공학의 이론과 응용 제8권 제2호 2002년

"Dynamic simulations of molten carbonate fuel-cell

Dynamic Power Supply Current Testing for Open Defects in CMOS SRAMs

Thus, if we can monitor the dynamic power supply current of a SRAM cell array, data retention faults can be detected by tran- sition write ‘0’ and transition write

DQB (Dynamic Query Band): Dynamic Query Device for Efficient Exploration of Time-series Data

핵심어: Time series data, parallel coordinates, dynamic query, interactive data exploration, Timeboxes, : Time series data, parallel coordinates, dynamic query, interactive

Modeling and Dynamic Analysis of Microturbine and Fuel Cell Using EMTP

In this paper, we designed dynamic modeling of Microturbine and Fuel cell being worthy as a small distributed energy source and analyzed dynamic

Creation and clustering of proximity data for text data analysis

Keywords: text mining, proximity data, TF-IDF, multidimensional scaling,

A New Frontier in Police Surveillance

Across the United States, federal and state law enforcement agencies are sweeping up cell phone and location data from American citizens using a device colloquially referred to as

Enhanced macrophage uptake of radiolabeled liposome triggered by ginseng extracts

Chemoattractant Signaling between Tumor Cells and Macrophages Regulates Cancer Cell Migration, Metastasis and Neovascularization.. Zhang F, Parayath NN, Ene CI, Stephan SB, Koehne

Short-term Traffic States Prediction Using k-Nearest Neighbor Algorithm: Focused on Urban Expressway in Seoul

J. Previous research has been thoroughly reviewed for understanding fundamentals of k-NN algorithm that has been widely used for short-term traffic states prediction.