Design of an Always-On Image Sensor Using an Analog Lightweight Convolutional Neural Network

Sensors

Sungjae Lee¹  Youngdoo Son¹  SooYoun Kim²  Jaihyuk Choi² 

[1] Department of Industrial and Systems Engineering, Dongguk University-Seoul, Seoul 04620, Korea;Department of Semiconductor Science, Dongguk University-Seoul, Seoul 04620, Korea;

关键词: always-on;    Complementary Metal Oxide Semiconductor (CMOS) image sensor;    convolutional neural networks;    image classification;   

DOI  :  10.3390/s20113101

来源: DOAJ

【 摘 要 】

This paper presents an always-on Complementary Metal Oxide Semiconductor (CMOS) image sensor (CIS) using an analog convolutional neural network for image classification in mobile applications. To reduce the power consumption as well as the overall processing time, we propose analog convolution circuits for computing convolution, max-pooling, and correlated double sampling operations without operational transconductance amplifiers. In addition, we used the voltage-mode MAX circuit for max pooling in the analog domain. After the analog convolution processing, the image data were reduced by 99.58% and were converted to digital with a 4-bit single-slope analog-to-digital converter. After the conversion, images were classified by the fully connected processor, which is traditionally performed in the digital domain. The measurement results show that we achieved an 89.33% image classification accuracy. The prototype CIS was fabricated in a 0.11 μm 1-poly 4-metal CIS process with a standard 4T-active pixel sensor. The image resolution was 160 × 120, and the total power consumption of the proposed CIS was 1.12 mW with a 3.3 V supply voltage and a maximum frame rate of 120.

【 授权许可】

Unknown