Image Sensor and Its Applications

(1)

Computer Graphics, Image processing and computer Vision Division of Computer Information Engineering

Lee Byung Gook, Dongseo Univ., Busan, Korea lbg@dongseo.ac.kr

2009.12.29 NIMS Thematic Workshop@Ewha W. Univ.

Image Sensor and

Its Applications

(2)

/28

Image Sensor

• CCD(Charge Coupled Device) Sensor

• 1960 년대 후반 Bell Lab. Williards S. Boyle 과 George E.

Smith 가 새로운 형태의 컴퓨터 기억 회로를 설계

• 1970 년에 처음 선보인 이 작은 반도체 실리콘은 가시광에 반응하기 때 문에 천문 분야에서 최초의 영상 기기

• 1975 년 제트 추진 연구소 (JPL), 애리조나 대학 , 천왕성

lbg@dongseo.ac.kr

http://astro.kias.re.kr/~hshwang/ccd.htm

23年 3月 22日 2

(3)

Image Sensor

• CCD & CMOS(Complementary Metal-Oxide Semiconductor)

• CCD 감도 , 화질 좋다 . 소비전력 많고 전송도중 잡신호의 영향

• CMOS 각 화소에 신호증폭회로설치 , 전송속도가 빠르다 소비전력과 발열이 적다 . 라이브뷰 기능에 적합

• Demosaicking

The Bayer arrangement of color filters on the pixel array of an image sensor. Each two-by-two cell contains two green, one blue, and one red filter

(4)

/28

Image Sensor

• CCD, CMOS & Foveon Sensor

lbg@dongseo.ac.kr

23年 3月 22日 4

(5)

Spectrum

(6)

/28

23年 3月 22日 lbg@dongseo.ac.kr 6

Samsung unveils flat-panel X-ray detector

Imaging sensor converts invisible X-ray images into digital signals 23 Nov 2007 The flat-panel X-ray measures 45cm x 46cm and boasts a 3,072 x 3,072 (9.4- megapixel) resolution providing ultra-high definition images.

To create its flat-panel X-ray, Samsung attached photodiodes to a TFT substrate produced using its proprietary amorphous silicon technology.

The device will be available worldwide from the first quarter of 2008.

(7)

Hand Tracking

(8)

/28

Skin Color Detection

23年 3月 22日 lbg@dongseo.ac.kr 8

(9)

Background subtraction Skin Color Detection Blob Analysis Opening & Closing

Contour Tracing k Curvature Peak Points Peak & Valley Points

(10)

lbg@dongseo.ac.kr /28

23年 3月 22日 10

(11)

Shadow Garden

(12)

/28

Interactive Art

lbg@dongseo.ac.kr

23年 3月 22日 12

(13)

u-Pointer

120 154 175

(14)

lbg@dongseo.ac.kr /28

2 2

( ) ( ) cos ( ) ( ) sin

u x d x d d y d

x  c  x  c f r   y  c f r 

2 2

( ) ( ) sin ( ) ( ) cos

u y d x d d y d

y  c  x  c f r   y  c f r 

2

( )

2

( )

2

d d x d y

r  x  c  y  c center of radial distortion

2 3

2

( ) 1

1 2 3

f r   k r  k r  k r

0 1 2

6 7

1

u u

p

u u

m x m y m x m x m y

 

  

3 4 5

6 7

1

u u

p

u u

m x m y m y m x m y

 

  

23年 3月 22日 14

T

u

T

_p

( , )

d d d

I x y

Distorted Image Undistorted Image I x y

_u

( ,

_u _u

) Projected Image I

_p

( x

_p

, y

_p

)

( ,

_x _y

)

C c c

(15)

Image Sensor and Its Applications

Computer Graphics, Image processing and computer Vision Division of Computer Information Engineering

Lee Byung Gook, Dongseo Univ., Busan, Korea lbg@dongseo.ac.kr

2009.12.29 NIMS Thematic Workshop@Ewha W. Univ.

Image Sensor and

Its Applications

Image Sensor

• CCD(Charge Coupled Device) Sensor

• 1960 년대 후반 Bell Lab. Williards S. Boyle 과 George E.

Smith 가 새로운 형태의 컴퓨터 기억 회로를 설계

• 1970 년에 처음 선보인 이 작은 반도체 실리콘은 가시광에 반응하기 때 문에 천문 분야에서 최초의 영상 기기

• 1975 년 제트 추진 연구소 (JPL), 애리조나 대학 , 천왕성

Image Sensor

• CCD & CMOS(Complementary Metal-Oxide Semiconductor)

• CCD 감도 , 화질 좋다 . 소비전력 많고 전송도중 잡신호의 영향

• CMOS 각 화소에 신호증폭회로설치 , 전송속도가 빠르다 소비전력과 발열이 적다 . 라이브뷰 기능에 적합

• Demosaicking

Image Sensor

• CCD, CMOS & Foveon Sensor

Spectrum

Hand Tracking

Skin Color Detection

Background subtraction Skin Color Detection Blob Analysis Opening & Closing

Contour Tracing k Curvature Peak Points Peak & Valley Points

Shadow Garden

Interactive Art

u-Pointer

( ) ( ) cos ( ) ( ) sin

x  c  x  c f r   y  c f r 

( ) ( ) sin ( ) ( ) cos

y  c  x  c f r   y  c f r 

( )

( )

r  x  c  y  c center of radial distortion

( ) 1

f r   k r  k r  k r

1

m x m y m x m x m y

 

  

1

m x m y m y m x m y

 

  

T

T

( , )

I x y

Distorted Image Undistorted Image I x y

( ,

) Projected Image I

( x

, y

)

( ,

)

C c c

Original Image Gray Image Corner Detection Image

Pattern Image Undistorted Image Projected Image